Need help with Solr Performance

2008-10-08 Thread Rajiv2
Hi, I need some recommendations w/ some issues I'm having w/ solr search performance. Here is my index/hardware config: - CentOS on 8 quad core xeon processors @ 3.16 Ghz - 32 GB RAM - Tomcat and JAVA 1.6 - Solr 1.3 ~15 million documents . - Index size on disk is about 22 GB - 8 quad core xeon p

Re: Need help with Solr Performance

2008-10-08 Thread Rajiv2
Hi, thanks for responding so quickly, >6-12 seconds seems really long and 15 million docs is nothing on a >machine like this. Are you sure the issue is in Solr? How are you >measuring the 6-12 seconds? I'm looking at the value in the Solr response. >Assuming it is Solr... >How often are

Re: Need help with Solr Performance

2008-10-08 Thread Rajiv2
>what is your actual query? >Are you doing faceting / highlighting / or anything else? I am doing faceting on 5 fields, no highlighting or anything else, debugging is also off. A basic query that I'm doing using dismax is 'cleaning services' over 15 million local business records. -- View thi

Re: Need help with Solr Performance

2008-10-08 Thread Rajiv2
>and query times without faceting are... ? >solr's built in faceting is "simple" and has its limits. 15M is >higher than i've seen good faceting performance out of, particularly >multivalued fields. > > Erik Hi, My facet fields are multi valued and w/o faceting the query time is about

Re: Need help with Solr Performance

2008-10-08 Thread Rajiv2
yes I'm using 1.3 here are the contents of debug.. I'm only pasting the first explain since the whole debug section is very long. cleaning services cleaning services - +((DisjunctionMaxQuery((about_us:cleaning^0.7 | zip:cleaning^0.7 | (insurances:cleaners insurances:cleaning insurances:clean)

Re: Need help with Solr Performance

2008-10-08 Thread Rajiv2
w/ faceting qtime is around +200ms. qtime for a standard query on the default search field is less than 100ms. Usually around 60ms. qtime for id: is around 16ms. ryantxu wrote: > >> - >> >> 6727.0 >> - >> >> 6457.0 >> >> - >> >> 0.0 >> >> - > > So I take it, this is with faceting t

Need help with Parsing user Query

2008-11-05 Thread Rajiv2
Hi, I need help with solving a particular problem I'm having. I have a one box search website where users can type "cosmetic surgery houston tx" or "cosmetic surgery 22151". I need to come up with a reliable way to parse out the geo terms/or zipcodes from the user query so that I can submit a qu

Feedback needed on sharding/distributed search

2009-02-10 Thread Rajiv2
Hello, we’re currently in the midst of re-designing our search hardware architecture and I have some questions about sharding and distributed search. 1. What is the benefit of using sharding/distributed search over keeping the index intact? 2. What is the best approach to determinin

LocalSolr distributed search

2009-02-18 Thread Rajiv2
Hello, I'm currently using LocalSolr in my project and coming across some issues with making the LocalSolrQueryComponent work w/ distributed search. I'm using version LocalSolr 2.0 and Solr 1.3. Can someone point me in the right direction on how to modify this component to work with Distribu

Re: LocalSolr distributed search

2009-02-23 Thread Rajiv2
Great this works. BTW, there seems to be a problem w/ LocalSolrQueryComponent. It doesn't seem to be respecting any filtering parameters in the solr request (fq). thanks, Rajiv pjaol wrote: > > Hi > > Most of the localsolr / locallucene doc's are a little out of date I'll > get to updating