Hi, Have you tried playing with mergeFactor or even mergePolicy?
-- Jan Høydahl - search architect Cominvent AS - www.cominvent.com On 16. feb. 2010, at 08.26, Janne Majaranta wrote: > Hey Dipti, > > Basically query optimizations + setting cache sizes to a very high level. > Other than that, the config is about the same as the out-of-the-box config > that comes with the Solr download. > > I haven't found a magic switch to get very fast query responses + facet > counts with the frequency of commits I'm having using one single SOLR > instance. > Adding some TOP queries for a certain type of user to static warming queries > just moved the time of autowarming the caches to the time it took to warm > the caches with static queries. > I've been staging a setup where there's a small solr instance receiving all > the updates and a large instance which doesn't receive the live feed of > updates. > The small index will be merged with the large index periodically (once a > week or once a month). > The two instances are seen by the client app as one instance using the > sharding features of SOLR. > The instances are running on the same server inside their own JVM / jetty. > > In this setup the caches are very HOT for the large index and queries are > extremely fast, and the small index is small enough to get extremely fast > queries without having to warm up the caches too much. > > Basically I'm able to have a commit frequency of 10 seconds in a 40M docs > index while counting TOP5 facets over 14 fields in 200ms. > In reality the commit frequency of 10 seconds comes from the fact that the > updates are going into a 1M - 2M documents index, and the fast facet counts > from the fact that the 38M documents index has hot caches and doesn't > receive any updates. > > Also, not running updates to the large index means that the SOLR instance > reading the large index uses about half the memory it used before when > running the updates to the large index. At least it does so on Win2k3. > > -Janne > > > 2010/2/15 dipti khullar <dipti.khul...@gmail.com> > >> Hey Janne >> >> Can you please let me know what other optimizations are you talking about >> here. Because in our application we are committing in about 5 mins but >> still >> the response time is very low and at times there are some connection time >> outs also. >> >> Just wanted to confirm if you have done some major configuration changes >> which have proved beneficial. >> >> Thanks >> Dipti >> >>
