Re: Solr 4.0 indexing performance question

2013-01-23 Thread Kevin Stone
Another revelation... I can see that there is a time difference in the Solr output for adding these documents when I watch it realtime. Here are some rows from the 3.5 solr server: Jan 23, 2013 11:57:23 AM org.apache.solr.core.SolrCore execute INFO: [gxdResult] webapp=/solr path=/update/javabin pa

Re: Solr 4.0 indexing performance question

2013-01-23 Thread Kevin Stone
I'm still poking around trying to find the differences. I found a couple things that may or may not be relevant. First, when I start up my 3.5 solr, I get all sorts of warnings that my solrconfig is old and will run using 2.4 emulation. Of course I had to upgrade the solconfig for the 4.0 instance

Re: Solr 4.0 indexing performance question

2013-01-23 Thread Kevin Stone
Do you mean commenting out the ... tag? Because that I already commented out. Or do I also need to remove the entire tag? Sorry, I am not too familiar with everything in the solrconfig file. I have a tag that essentially looks like this: Everything inside is commented out. -Kevin On 1/23/13

Re: Solr 4.0 indexing performance question

2013-01-23 Thread Mark Miller
It's hard to guess, but I might start by looking at what the new UpdateLog is costing you. Take it's definition out of solrconfig.xml and try your test again. Then let's take it from there. - Mark On Jan 23, 2013, at 11:00 AM, Kevin Stone wrote: > I am having some difficulty migrating our sol

Re: Solr 4.0 indexing performance

2012-11-15 Thread Jack Krupansky
Did you start from scratch, or did you bulk index into an existing index? There is some "backcompat" logic in there, which is convenient, but not necessarily the best performance. -- Jack Krupansky -Original Message- From: Nils Weinander Sent: Thursday, November 15, 2012 1:29 AM To:

Re: Solr 4.0 indexing performance

2012-11-15 Thread Otis Gospodnetic
But slower indexing with solr 4.0 sounds suspicious to me... you compared your configs? JVM parameters? GC? IO? CPU? Otis -- Performance Monitoring - http://sematext.com/spm On Nov 15, 2012 5:26 AM, "Nils Weinander" wrote: > Ah, thanks Markus! > > That's a good thing. I tried disabling the tran

Re: Solr 4.0 indexing performance

2012-11-15 Thread Nils Weinander
Ah, thanks Markus! That's a good thing. I tried disabling the transaction log, the difference performance is marginal. So, I'll stick with the transaction logging. On Thu, Nov 15, 2012 at 11:02 AM, Markus Jelsma wrote: > Hi - you're likely seeing a drop in performance because of durability > wh

RE: Solr 4.0 indexing performance

2012-11-15 Thread Markus Jelsma
Hi - you're likely seeing a drop in performance because of durability which is enabled by default via a transaction log. When disabled 4.0 is iirc slightly faster than 3.x. -Original message- > From:Nils Weinander > Sent: Thu 15-Nov-2012 10:35 > To: solr-user@lucene.apache.org > Subj