Re: Parallal Import Process on same core. Solr 3.5

2013-06-26 Thread Shawn Heisey
On 6/26/2013 1:36 PM, Mike L. wrote: Here's the scrubbed version of my DIH: http://apaste.info/6uGH It contains everything I'm more or less doing...pretty straight forward.. One thing to note and I don't know if this is a bug or not, but the batchSize="-1" streaming feature doesn't seem to wor

Re: Parallal Import Process on same core. Solr 3.5

2013-06-26 Thread Mike L.
have not completed the job quite yet with any config... I did get very close.. I'd hate to throw additional memory at the problem if there is something else I can tweak..   Thanks! Mike   From: Shawn Heisey To: solr-user@lucene.apache.org Sent: Wednesday, June 26, 2013 12:13

Re: Parallal Import Process on same core. Solr 3.5

2013-06-26 Thread Shawn Heisey
On 6/26/2013 10:58 AM, Mike L. wrote: > > Hello, > >I'm trying to execute a parallel DIH process and running into heap > related issues, hoping somebody has experienced this and can recommend some > options.. > >Using Solr 3.5 on CentOS. >Currently have JVM heap 4GB

Re: Parallal Import Process on same core. Solr 3.5

2013-06-26 Thread Michael Della Bitta
Hi Mike, Have you considered trying something like jhat or visualvm to see what's taking up room on the heap? http://docs.oracle.com/javase/6/docs/technotes/tools/share/jhat.html http://visualvm.java.net/ Michael Della Bitta Applications Developer o: +1 646 532 3062 | c: +1 917 477 7906 app

Parallal Import Process on same core. Solr 3.5

2013-06-26 Thread Mike L.
  Hello,      I'm trying to execute a parallel DIH process and running into heap related issues, hoping somebody has experienced this and can recommend some options..      Using Solr 3.5 on CentOS.    Currently have JVM heap 4GB min , 8GB max   When executing the entities in a se