On Thu, 2015-01-08 at 22:55 +0100, Nishanth S wrote: > Thanks guys for your inputs I would be looking at around 100 Tb of total > index size with 5100 million documents [...]
That is a large corpus when coupled with your high indexing & QPS requirements. Are the queries complex too? Will you be doing non-trivial faceting? Your requirements are so high that any guesswork at this point is likely to be wrong by an order of magnitude. What is very certain is that you will need serious hardware. Your starting point should not be to try and estimate the number of shards. Start by building a test setup. - Toke Eskildsen
