Re: Need guidance for distributing data base on date interval in a collection

2017-07-18 Thread Charlie Hull
Hi, You should also consider how you should shard for best performance: for example, if most of your queries are for recent documents, you could end up with them all hitting only one shard. Here's an old blog we wrote on this subject (it mentions another open source engine, Xapian, but ignore that

Re: Need guidance for distributing data base on date interval in a collection

2017-07-18 Thread Modassar Ather
Hi Rehman, You may want to look into how the documents are routed on different shards. For that you can look into following documentation. https://cwiki.apache.org/confluence/display/solr/Shards+and+Indexing+Data+in+SolrCloud Basically it is the id of the document which when prefixed with certain

Re: Need guidance for distributing data base on date interval in a collection

2017-07-18 Thread Atita Arora
Hi Rehman, I am not sure about your use case, but why wouldn't you consider creating shard for a particular date range like within a week from current date, 15 days, a month and so on and so forth. I have done a similar implementation elsewhere. Can you tell more about your use case? Atita On