Vote for or implement :) this issue:
https://issues.apache.org/jira/browse/SOLR-1565 StreamingUpdateSolrServer
should support RequestWriter API
--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com
> As far as I know. It is the simplest, but I found that is uses a 'lot' of
On Wed, Oct 6, 2010 at 9:57 PM, Burton-West, Tom wrote:
> Hi Mike,
>
>>.Do you use multiple threads for indexing? Large RAM buffer size is
>>>also good, but I think perf peaks out mabye around 512 MB (at least
>>>based on past tests)?
>
> We are using Solr, I'm not sure if Solr uses multiple thre
ecosystem search :: http://search-lucene.com/
- Original Message
From: "Burton-West, Tom"
To: "solr-user@lucene.apache.org"
Sent: Wed, October 6, 2010 9:57:12 PM
Subject: RE: Experience with large merge factors
Hi Mike,
.Do you use multiple threads for indexing? Large
ngUpdateSolrServer is the simplest
thing to use for this.
Otis
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/
- Original Message
> From: "Burton-West, Tom"
> To: "solr-user@lucene.apache.org"
Hi Mike,
>.Do you use multiple threads for indexing? Large RAM buffer size is
>>also good, but I think perf peaks out mabye around 512 MB (at least
>>based on past tests)?
We are using Solr, I'm not sure if Solr uses multiple threads for indexing. We
have 30 "producers" each sending documents
You could do periodic small optimizes. The optimize command now
includes 'maxSegments' which limits the target number of segments.
It is possible to write a Lucene program that collects a bunch of
segments and annoints it as an index. This gives you a way to collect
segments after you write them w
4 weeks is a depressingly long time to re-index!
Do you use multiple threads for indexing? Large RAM buffer size is
also good, but I think perf peaks out mabye around 512 MB (at least
based on past tests)?
Believe it or not, merging is typically compute bound. It's costly to
decode & re-encode
Thank you once again Betsy!
Vincent Vu Nguyen
Division of Science Quality and Translation
Office of the Associate Director for Science
Centers for Disease Control and Prevention (CDC)
404-498-6154
Century Bldg 2400
Atlanta, GA 30329
-Original Message-
From: Burton-West, Tom [mailto:tbur
