Re: Seek your wisdom for implementing 12 million docs..

2011-09-26 Thread Toke Eskildsen
On Sun, 2011-09-25 at 22:00 +0200, Ikhsvaku S wrote: > Documents: We have close to ~12 million XML docs, of varying sizes average > size 20 KB. These documents have 150 fields, which should be searchable & > indexed. [...] Approximately ~6000 such documents are updated & 400-800 new > ones > are a

Re: Seek your wisdom for implementing 12 million docs..

2011-09-25 Thread Erick Erickson
Round N + 1 of "it depends" . This isn't a very big index as Solr indexes go, my first guess would be that you can easily fit this on the machines you're talking about. But, as always, how you implement things may prove me wrong. Really, about the only thing you can do is try it. Be aware that "th

Seek your wisdom for implementing 12 million docs..

2011-09-25 Thread Ikhsvaku S
Hi List, We are pretty new to Solr & Lucene and have just starting indexing few 10K documents using Solr. Before we attempt anything bigger we want to see what should be the best approach.. Documents: We have close to ~12 million XML docs, of varying sizes average size 20 KB. These documents have