Allow me to chim in and ask a generic question about monitoring tools for people close to developers: are any of the tools mentioned in this thread actually able to show graphs of loads, e.g. cache counts or CPU load, in parallel to a console log or to an http request log??
I am working on such a tool currently but I have a bad feeling of reinventing the wheel. thanks in advance Paul Le 8 déc. 2011 à 08:53, Dmitry Kan a écrit : > Otis, Tomás: thanks for the great links! > > 2011/12/7 Tomás Fernández Löbbe <tomasflo...@gmail.com> > >> Hi Dimitry, I pointed to the wiki page to enable JMX, then you can use any >> tool that visualizes JMX stuff like Zabbix. See >> >> http://www.lucidimagination.com/blog/2011/10/02/monitoring-apache-solr-and-lucidworks-with-zabbix/ >> >> On Wed, Dec 7, 2011 at 11:49 AM, Dmitry Kan <dmitry....@gmail.com> wrote: >> >>> The culprit seems to be the merger (frontend) SOLR. Talking to one shard >>> directly takes substantially less time (1-2 sec). >>> >>> On Wed, Dec 7, 2011 at 4:10 PM, Dmitry Kan <dmitry....@gmail.com> wrote: >>> >>>> Tomás: thanks. The page you gave didn't mention cache specifically, is >>>> there more documentation on this specifically? I have used solrmeter >>> tool, >>>> it draws the cache diagrams, is there a similar tool, but which would >> use >>>> jmx directly and present the cache usage in runtime? >>>> >>>> pravesh: >>>> I have increased the size of filterCache, but the search hasn't become >>> any >>>> faster, taking almost 9 sec on avg :( >>>> >>>> name: search >>>> class: org.apache.solr.handler.component.SearchHandler >>>> version: $Revision: 1052938 $ >>>> description: Search using components: >>>> >>> >> org.apache.solr.handler.component.QueryComponent,org.apache.solr.handler.component.FacetComponent,org.apache.solr.handler.component.MoreLikeThisComponent,org.apache.solr.handler.component.HighlightComponent,org.apache.solr.handler.component.StatsComponent,org.apache.solr.handler.component.DebugComponent, >>>> >>>> stats: handlerStart : 1323255147351 >>>> requests : 100 >>>> errors : 3 >>>> timeouts : 0 >>>> totalTime : 885438 >>>> avgTimePerRequest : 8854.38 >>>> avgRequestsPerSecond : 0.008789442 >>>> >>>> the stats (copying fieldValueCache as well here, to show term >>> statistics): >>>> >>>> name: fieldValueCache >>>> class: org.apache.solr.search.FastLRUCache >>>> version: 1.0 >>>> description: Concurrent LRU Cache(maxSize=10000, initialSize=10, >>>> minSize=9000, acceptableSize=9500, cleanupThread=false) >>>> stats: lookups : 79 >>>> hits : 77 >>>> hitratio : 0.97 >>>> inserts : 1 >>>> evictions : 0 >>>> size : 1 >>>> warmupTime : 0 >>>> cumulative_lookups : 79 >>>> cumulative_hits : 77 >>>> cumulative_hitratio : 0.97 >>>> cumulative_inserts : 1 >>>> cumulative_evictions : 0 >>>> item_shingleContent_trigram : >>>> >>> >> {field=shingleContent_trigram,memSize=326924381,tindexSize=4765394,time=215426,phase1=213868,nTerms=14827061,bigTerms=35,termInstances=114359167,uses=78} >>>> name: filterCache >>>> class: org.apache.solr.search.FastLRUCache >>>> version: 1.0 >>>> description: Concurrent LRU Cache(maxSize=153600, initialSize=4096, >>>> minSize=138240, acceptableSize=145920, cleanupThread=false) >>>> stats: lookups : 1082854 >>>> hits : 940370 >>>> hitratio : 0.86 >>>> inserts : 142486 >>>> evictions : 0 >>>> size : 142486 >>>> warmupTime : 0 >>>> cumulative_lookups : 1082854 >>>> cumulative_hits : 940370 >>>> cumulative_hitratio : 0.86 >>>> cumulative_inserts : 142486 >>>> cumulative_evictions : 0 >>>> >>>> >>>> index size: 3,25 GB >>>> >>>> Does anyone have some pointers to where to look at and optimize for >> query >>>> time? >>>> >>>> >>>> 2011/12/7 Tomás Fernández Löbbe <tomasflo...@gmail.com> >>>> >>>>> Hi Dimitry, cache information is exposed via JMX, so you should be >> able >>> to >>>>> monitor that information with any JMX tool. See >>>>> http://wiki.apache.org/solr/SolrJmx >>>>> >>>>> On Wed, Dec 7, 2011 at 6:19 AM, Dmitry Kan <dmitry....@gmail.com> >>> wrote: >>>>> >>>>>> Yes, we do require that much. >>>>>> Ok, thanks, I will try increasing the maxsize. >>>>>> >>>>>> On Wed, Dec 7, 2011 at 10:56 AM, pravesh <suyalprav...@yahoo.com> >>>>> wrote: >>>>>> >>>>>>>>> facet.limit=500000 >>>>>>> your facet.limit seems too high. Do you actually require this >> much? >>>>>>> >>>>>>> Since there a lot of evictions from filtercache, so, increase the >>>>> maxsize >>>>>>> value to your acceptable limit. >>>>>>> >>>>>>> Regards >>>>>>> Pravesh >>>>>>> >>>>>>> -- >>>>>>> View this message in context: >>>>>>> >>>>>> >>>>> >>> >> http://lucene.472066.n3.nabble.com/cache-monitoring-tools-tp3566645p3566811.html >>>>>>> Sent from the Solr - User mailing list archive at Nabble.com. >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Regards, >>>>>> >>>>>> Dmitry Kan >>>>>> >>>>> >>>> >>>> >>>> >>>> -- >>>> Regards, >>>> >>>> Dmitry Kan >>>> >>> >>> >>> >>> -- >>> Regards, >>> >>> Dmitry Kan >>> >> > > > > -- > Regards, > > Dmitry Kan
