Re: Index not fitting in memory (file-cache)

2016-03-24 Thread Toke Eskildsen
Robert Brown wrote: > Before I go out and throw more RAM into the system, in the above > example, what would you recommend? That you try to determine what causes the slow response times. Replay logged queries (thousands of queries, not just a few) and see if the pauses are random or tied to spe

Re: Index not fitting in memory (file-cache)

2016-03-24 Thread Robert Brown
Thanks Shawn, One of my indexes is 70G on disk but only has 25G RAM, usually it's fast as hell, less than 0.5s for a full API wrapped call, but we do occasionally see searches taking 2.5 seconds. I'm currently shuffling VMs around to increase the RAM, good to hear this may solve those random

Re: Index not fitting in memory (file-cache)

2016-03-24 Thread Shawn Heisey
On 3/24/2016 4:02 AM, Robert Brown wrote: > If my index data directory size is 70G, and I don't have 70G (plus > heap, etc) in the system, this will occasionally affect search speed > right? When Solr has to resort to reading from disk? > > Before I go out and throw more RAM into the system, in th

Index not fitting in memory (file-cache)

2016-03-24 Thread Robert Brown
Hi, If my index data directory size is 70G, and I don't have 70G (plus heap, etc) in the system, this will occasionally affect search speed right? When Solr has to resort to reading from disk? Before I go out and throw more RAM into the system, in the above example, what would you recommend