Re: SOLR HttpCache Qtime

2011-10-12 Thread Lord Khan Han
.. thanks On Mon, Oct 10, 2011 at 1:07 PM, Tor Henning Ueland wrote: > On Sat, Oct 1, 2011 at 11:55 PM, Lord Khan Han > wrote: > > Is there anyway to get correct Qtime when we use http caching ? I think > Solr > > caching also the Qtime so giving the the same Qtime in res

Re: SOLR HttpCache Qtime

2011-10-04 Thread Lord Khan Han
to do anything here. > > Best > Erick > > On Tue, Oct 4, 2011 at 9:24 AM, Lord Khan Han > wrote: > > We are using this Qtime field and publishing in our front web. Even the > > httpCache decreasing the Qtime in reality, its still using the cached old > > Qtime valu

Re: Shingle and Query Performance

2011-10-04 Thread Lord Khan Han
, 2011 at 1:01 PM, Lord Khan Han wrote: > Thanks Erick.. If I figure out something I will let you know also.. No > body replied except you I thought there might be more people involve here.. > > Thanks > > > On Wed, Aug 31, 2011 at 3:47 AM, Erick Erickson > wrote: > >&g

Re: SOLR HttpCache Qtime

2011-10-04 Thread Lord Khan Han
t;correct" > it? > > That said, I have no clue how you'd attempt to > do this. > > Best > Erick > > On Sat, Oct 1, 2011 at 5:55 PM, Lord Khan Han > wrote: > > Hi, > > > > Is there anyway to get correct Qtime when we use http caching ? I th

SOLR HttpCache Qtime

2011-10-01 Thread Lord Khan Han
Hi, Is there anyway to get correct Qtime when we use http caching ? I think Solr caching also the Qtime so giving the the same Qtime in response what ever takes it to finish .. How I can set Qtime correcly from solr when I use http caching On. thanks

Re: SOLR Index Speed

2011-09-30 Thread Lord Khan Han
Any idea ? On Thu, Sep 29, 2011 at 1:53 PM, Lord Khan Han wrote: > Hi, > > The no-op run completed in 20 minutes. The only commented line was > "solr.addBean(doc)" We've tried SUSS as a drop in replacement for > CommonsHttpSolrServer but it's behavior was we

Re: SOLR Index Speed

2011-09-29 Thread Lord Khan Han
beyond 500-700 docs/minute? > > Otis > > Sematext :: http://sematext.com/ :: Solr - Lucene - Hadoop - HBase > Lucene ecosystem search :: http://search-lucene.com/ > > > > > > >From: Lord Khan Han > >To: solr-user@l

Re: SOLR Index Speed

2011-09-27 Thread Lord Khan Han
Nutch > Lucene ecosystem search :: http://search-lucene.com/ > > > > > >From: Lord Khan Han > >To: solr-user@lucene.apache.org > >Sent: Monday, September 26, 2011 7:09 AM > >Subject: SOLR Index Speed > > > >Hi, > >

Re: SOLR Index Speed

2011-09-27 Thread Lord Khan Han
how big are your index files? > 3) as others have recently written, make sure you don't give your JRE so > much memory that your OS is starved for memory to use for file system cache. > > JRJ > > -Original Message- > From: Lord Khan Han [mailto:khanuniver...@g

Re: SOLR Index Speed

2011-09-27 Thread Lord Khan Han
index machine resources. I gave 12 gig heap to solr and machine is not swapping. I couldnt figure out the problem if there is.. PS: We are committing at the end of the submit. On Tue, Sep 27, 2011 at 11:37 AM, Lord Khan Han wrote: > Sorry :) it is not 500 doc per sec. ( It is what i wis

Re: SOLR Index Speed

2011-09-27 Thread Lord Khan Han
; ~32. > What happens to your CPU load and indexing speed then? > > > Otis > > Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch > Lucene ecosystem search :: http://search-lucene.com/ > > > > > >From: Lord Khan Han > >

SOLR Index Speed

2011-09-26 Thread Lord Khan Han
Hi, We have 500K web document and usind solr (trunk) to index it. We have special anaylizer which little bit heavy cpu . Our machine config: 32 x cpu 32 gig ram SAS HD We are sending document with 16 reduce client (from hadoop) to the stand alone solr server. the problem is we couldnt get speedi

Re: Shingle and Query Performance

2011-08-31 Thread Lord Khan Han
n the debug component? > > Sorry I can't be more help here, but nothing really > jumps out. > Erick > > On Tue, Aug 30, 2011 at 12:45 PM, Lord Khan Han > wrote: > > Below the output of the debug. I am measuring pure solr qtime which show > in > > the Q

Re: Shingle and Query Performance

2011-08-30 Thread Lord Khan Han
e QTime of the returned response? > (which is the time actually spent searching) or the time until > the response gets back to the client, which may involve lots besides > searching... > > Best > Erick > > On Tue, Aug 30, 2011 at 7:59 AM, Lord Khan Han > wrote: > >

Re: Shingle and Query Performance

2011-08-30 Thread Lord Khan Han
d loading is enabled? > > > > > > > > Best > > Erick > > > > On Sun, Aug 28, 2011 at 5:30 AM, Lord Khan Han > wrote: > >> Another insteresting thing is : all one word or more word queries > including > >> phrase queries such as &quo

Re: Shingle and Query Performance

2011-08-28 Thread Lord Khan Han
Another insteresting thing is : all one word or more word queries including phrase queries such as "barack obama" slower in shingle configuration. What i am doing wrong ? without shingle "barack obama" Querytime 300ms with shingle 780 ms.. On Sat, Aug 27, 2011 at 7:58 PM,

Re: Shingle and Query Performance

2011-08-27 Thread Lord Khan Han
andler? > > What is the parsed query (from the debugQuery response)? > > Have you tried this with Solr 3.3 to see if there's any appreciable > difference? > >Erik > > On Aug 27, 2011, at 09:34 , Lord Khan Han wrote: > > > When grouping off the query

Re: Shingle and Query Performance

2011-08-27 Thread Lord Khan Han
, 2011 at 3:37 PM, Erik Hatcher wrote: > Please confirm is this is caused by grouping. Turn grouping off, what's > query time like? > > > On Aug 27, 2011, at 07:27 , Lord Khan Han wrote: > > > On the other hand We couldnt use the cache for below types queries. I > th

Re: Shingle and Query Performance

2011-08-27 Thread Lord Khan Han
On the other hand We couldnt use the cache for below types queries. I think its caused from grouping. Anyway we need to be sub second without cache. On Sat, Aug 27, 2011 at 2:18 PM, Lord Khan Han wrote: > Hi, > > Thanks for the reply. > > Here the solr log capture.: > > *

Re: Shingle and Query Performance

2011-08-27 Thread Lord Khan Han
query time is half of the current shingle one !. Shouldn't be shingled index better for such heavy 2 word phrases search ? I am confused. On the other hand One of the on the shelf big FAT companies search engine doing the same query same machine 0.7 / 0.8 secs without cache . I am confiden

Shingle and Query Performance

2011-08-26 Thread Lord Khan Han
Hi, We are indexing news document from the various sites. Currently we have 200K docs indexed. Total index size is 36 gig. There is also attachement to the news (pdf -docs etc) So document size could be high (ie 10mb). We are using some complex queries which includes around 30 - 40 terms per qu

Solr Highlight Component

2011-05-24 Thread Lord Khan Han
Hi , Can I limit the terms that the HighlightComponent uses. My query is generally long and I want specific ones to be highlighted and the rest is not highlighted. Is there an option like the SpellCheckComponent. it uses q unless spellcheck.q if specified. Is a hl.q parameter possible? Or any o

Re: WELCOME to solr-user@lucene.apache.org

2011-05-24 Thread Lord Khan Han
Hi , Can I limit the terms that the HighlightComponent uses. My query is generally long and I want specific ones to be highlighted and the rest is not highlighted. Is there an option like the SpellCheckComponent. it uses q unless spellcheck.q if specified. Is a hl.q parameter possible? Or an