You'll almost certainly have to shard then. First of all Lucene has a
hard limit of 2^31 docs in a single index so there's a 2B limit.
There's no such limit on the number of docs in the collection (i.e. 5
shards each can have 2B docs for 10B docs total in the collection).
But nobody that I know of
There is a very large amount of data and there will be a constant addition of
more data. There will be hundreds of millions if not billions of items.
We have to be able to be able to be constantly indexing items but also allow
for searching. Sadly there is no way to know the amount of searching th
On 10/3/2017 3:18 PM, gatanathoa wrote:
I am trying to find what setup will give us the fastest searching. But I have
not been able to find out this information with my internet searching.
I have the possibility to have up to 16 identical servers for the index,
what setup will get me the fastest
Others will comment I'm sure, but I'm suspicious the answer is that you can
only know by testing.
The kind and quantity of data in your indexes - the type of queries you
normally receive, etc, etc...
All these things will have an affect on your speed.
For sure you don't want 15 Zookeepers. That
