Re: Question on storage and index/data management in solr

2013-04-25 Thread Vinay Rai
: Shawn Heisey To: solr-user@lucene.apache.org Sent: Thursday, April 25, 2013 11:32 PM Subject: Re: Question on storage and index/data management in solr On 4/25/2013 8:39 AM, Vinay Rai wrote: > 1. Keep each of last 24 hours segments separate. > 2. Segments generated between last 48 to 24 hours

Re: Question on storage and index/data management in solr

2013-04-25 Thread Shawn Heisey
On 4/25/2013 8:39 AM, Vinay Rai wrote: > 1. Keep each of last 24 hours segments separate. > 2. Segments generated between last 48 to 24 hours to be merged into one. > Similarly, for segments created between 72 to 48 hours and so on for last 1 > week. > 3. Similarly, merge previous 4 week's data i

Question on storage and index/data management in solr

2013-04-25 Thread Vinay Rai
Hi, I am relatively new to solr and evaluating it for my project. I would have lots of data coming in at a fast rate (say 10 MB per sec) and I would need the recent data (last 24 hours, or last 100GB) to be searchable faster than the old data. I did a bit of reading on the controls provided by