Re: solr add document

2015-08-23 Thread CrazyDiamond
thx i just need to call solr.commit -- View this message in context: http://lucene.472066.n3.nabble.com/solr-add-document-tp4224480p4224698.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: solr add document

2015-08-21 Thread Erick Erickson
Please provide details. You might want to review: http://wiki.apache.org/solr/UsingMailingLists You haven't provided 1> the sample doc 2> the schema you're using, at least for the search field 3> the solrconfig.xml file, particularly the default search field 4> the results of adding &debug=query

Re: Solr add document over 20 times slower after upgrade from 4.0 to 4.9

2014-09-05 Thread Erick Erickson
Alexandre: It Depends (tm) of course. It all hinges on the setting in , whether is true or false. In the former case, you, well, open a new searcher. In the latter you don't. I agree, though, this is all tangential to the memory consumption issue since the RAM buffer will be flushed regardless

Re: Solr add document over 20 times slower after upgrade from 4.0 to 4.9

2014-09-05 Thread Alexandre Rafalovitch
On Fri, Sep 5, 2014 at 9:55 AM, Mikhail Khludnev wrote: >> Why do one big commit? You could do hard commits along the way but keep >> searcher open and not see the changes until the end. >> > > Alexandre, > I don't think it's can happen in solr-user list, next search pickups the > new searcher. W

Re: Solr add document over 20 times slower after upgrade from 4.0 to 4.9

2014-09-05 Thread Mikhail Khludnev
On Fri, Sep 5, 2014 at 3:22 PM, Alexandre Rafalovitch wrote: > Why do one big commit? You could do hard commits along the way but keep > searcher open and not see the changes until the end. > Alexandre, I don't think it's can happen in solr-user list, next search pickups the new searcher. Ryan,

Re: Solr add document over 20 times slower after upgrade from 4.0 to 4.9

2014-09-05 Thread Alexandre Rafalovitch
Why do one big commit? You could do hard commits along the way but keep searcher open and not see the changes until the end. Obviously a separate issue from memory consumption discussion, but thought I'll add it anyway. Regards, Alex On 05/09/2014 3:30 am, "Li, Ryan" wrote: > HI Shawn, > >

Re: Solr add document over 20 times slower after upgrade from 4.0 to 4.9

2014-09-05 Thread Li, Ryan
Hi Guys, Just some update. I've tried with Solr 4.10 (same code for Solr 4.9). And that has the same index speed as 4.0. The only problem left now is that Solr 4.10 takes more memory than 4.0 so I'm trying to figure out what is the best number for Java heap size. I think that proves there is s

RE: Solr add document over 20 times slower after upgrade from 4.0 to 4.9

2014-09-05 Thread Li, Ryan
n at https://issues.apache.org/jira/browse/LUCENE-5914. Best, Erick From: Li, Ryan Sent: Friday, September 05, 2014 3:28 PM To: solr-user@lucene.apache.org Subject: Re: Solr add document over 20 times slower after upgrade from 4.0 to 4.9 HI Shawn, Thanks for y

Re: Solr add document over 20 times slower after upgrade from 4.0 to 4.9

2014-09-05 Thread Li, Ryan
HI Shawn, Thanks for your reply. The memory setting of my Solr box is 12G physically memory. 4G for java (-Xmx4096m) The index size is around 4G in Solr 4.9, I think it was over 6G in Solr 4.0. I do think the RAM size of java is one of the reasons for this slowness. I'm doing one big commit an

Re: Solr add document over 20 times slower after upgrade from 4.0 to 4.9

2014-09-04 Thread Erick Erickson
Ryan: As it happens, there's a discssion on the dev list about this. If at all possible, could you try a brief experiment? Turn off all the storage, i.e. set stored="false" on all fields. It's a lot to ask, but it'd help the discussion. Or join the discussion at https://issues.apache.org/jira/br

Re: Solr add document over 20 times slower after upgrade from 4.0 to 4.9

2014-09-04 Thread Shawn Heisey
On 9/3/2014 8:14 PM, Li, Ryan wrote: > I have a Solr server indexes 2500 documents (up to 50MB each, ave 3MB) to > Solr server. When running on Solr 4.0 I managed to finish index in 3 hours. > > However after we upgrade to Solr 4.9, the index need 3 days to finish. > > I've done some profiling,