Hey Dipti, Basically query optimizations + setting cache sizes to a very high level. Other than that, the config is about the same as the out-of-the-box config that comes with the Solr download.
I haven't found a magic switch to get very fast query responses + facet counts with the frequency of commits I'm having using one single SOLR instance. Adding some TOP queries for a certain type of user to static warming queries just moved the time of autowarming the caches to the time it took to warm the caches with static queries. I've been staging a setup where there's a small solr instance receiving all the updates and a large instance which doesn't receive the live feed of updates. The small index will be merged with the large index periodically (once a week or once a month). The two instances are seen by the client app as one instance using the sharding features of SOLR. The instances are running on the same server inside their own JVM / jetty. In this setup the caches are very HOT for the large index and queries are extremely fast, and the small index is small enough to get extremely fast queries without having to warm up the caches too much. Basically I'm able to have a commit frequency of 10 seconds in a 40M docs index while counting TOP5 facets over 14 fields in 200ms. In reality the commit frequency of 10 seconds comes from the fact that the updates are going into a 1M - 2M documents index, and the fast facet counts from the fact that the 38M documents index has hot caches and doesn't receive any updates. Also, not running updates to the large index means that the SOLR instance reading the large index uses about half the memory it used before when running the updates to the large index. At least it does so on Win2k3. -Janne 2010/2/15 dipti khullar <dipti.khul...@gmail.com> > Hey Janne > > Can you please let me know what other optimizations are you talking about > here. Because in our application we are committing in about 5 mins but > still > the response time is very low and at times there are some connection time > outs also. > > Just wanted to confirm if you have done some major configuration changes > which have proved beneficial. > > Thanks > Dipti > >
