Can IRIS do parallel data querying across multiple sharded server (code to data)
Allow a question from a newbie
1. Lets assume we have a global (matrix) [X,Y,Z] that is distributed across sharded nodes
2. Matrix size doesnt matter, but lets assume it holds 500 GB for the moment
3. I want to return all rows where f(x,y,z) is true. f() is an arbitrary function, i.e. f = x + 20(y*y) > z
Questions
Q1. Can such a computation (in ObjectScript) be moved and distributed from the client to the different sharded nodes for parallel processing
Q2. Where is that documented (incl. perhaps an example and performance measurements)
Thanks a lot
Frank
make your formula f = x + 20(y*y) > z
a calculated, SQLcomputed property in your TABLE
and provide it with a bitmap index and it will run distributed and be incredible fast
docs:
https://docs.intersystems.com/iris20192/csp/docbook/DocBook.UI.Page.cls?KEY=GOBJ_proplit#GOBJ_proplit_computed
https://docs.intersystems.com/iris20192/csp/docbook/Doc.View.cls?KEY=RSQL_C145362
Thanks a lot Robert.