I have a table that is broken up into many virtual shards. So basically I have N identical tables:
Document1 Document2 . . Document36 Currently these tables all live in the same database, but in the future they may be moved to different servers to scale out if the needs arise. Is there any way to configure a DIH for these tables so that it will automatically loop through the 36 identical tables and pull data out for indexing? Something like (pseudo code): for (i = 1; i <= 36; i++) { ## retrieve data from the table Document{$i} & index the data } What's the best way to handle a situation like this? Thanks