Dan, I can suggest a solution that should help. VeloBit enables you to add SSDs to your servers as a cache (SSD will cost you $200, per server should be enough). Then, assuming a 100MB/s read speed from your SAS disks, you can read 50GB data into the VeloBit HyperCache cache in about 9 mins (this happens automatically, all you need to do is add the SSD to your server and install Velobit one time, which takes 2 minutes). Solr should run much faster after that. The added benefit of the solution is that you would have also boosted the steady state performance by 4x.
Let me know if you are interested in trying it out and I'll set you up to talk with my engineers. Best regards, Peter Velikin VP Online Marketing, VeloBit, Inc. pe...@velobit.com tel. 978-263-4800 mob. 617-306-7165 VeloBit provides plug & play SSD caching software that dramatically accelerates applications at a remarkably low cost. The software installs seamlessly in less than 10 minutes and automatically tunes for fastest application speed. Visit www.velobit.com for details. -----Original Message----- From: dan sutton [mailto:danbsut...@gmail.com] Sent: Friday, January 27, 2012 9:44 AM To: solr-user Subject: Solr Warm-up performance issues Hi List, We use Solr 4.0.2011.12.01.09.59.41 and have a dataset of roughly 40 GB. Every day we produce a new dataset of 40 GB and have to switch one for the other. Once the index switch over has taken place, it takes roughly 30 min for Solr to reach maximum performance. Are there any hardware or software solutions to reduce the warm-up time ? We tried warm-up queries but it didn't change much. Our hardware specs is: * Dell Poweredge 1950 * 2 x Quad-Core Xeon E5405 (2.00GHz) * 48 GB RAM * 2 x 146 GB SAS 3 Gb/s 15K RPM disk configured in RAID mirror One thing that does seem to take a long time is un-inverting a set of multivalued fields, are there any optimizations we might be able to use here? Thanks for your help. Dan
