Re: Importing CSV file slow/crashes

2009-10-06 Thread Nasseam Elkarra
Hello Yonik, Thank you for looking into this. Your question of if I'm using stock solr put me in the right direction. I am in fact using a patched version of solr to get hierarchal facet support (http://issues.apache.org/jira/browse/SOLR-64 ). I took out the 4 hiefacet fields from the schema

Re: Importing CSV file slow/crashes

2009-10-06 Thread Yonik Seeley
On Tue, Oct 6, 2009 at 1:06 PM, Nasseam Elkarra wrote: > I had a dev build of 1.4 from 5/1/2009 and importing a 20K row took less > than a minute. Updating to the latest as of yesterday, the import is really > slow and I had to cancel it after a half hour. This prevented me from > upgrading a few

Re: Importing CSV file slow/crashes

2009-10-06 Thread Chris Hostetter
: Is it possible to narrow down what fields/field-types are causing the problems? : Or perhaps profile and see what's taking up time compared to the older version? Or: could you post your solrconfig + schema + csv files online so other people could help debug the problem? : : -Yonik : http:

Re: Importing CSV file slow/crashes

2009-10-06 Thread Yonik Seeley
Is it possible to narrow down what fields/field-types are causing the problems? Or perhaps profile and see what's taking up time compared to the older version? -Yonik http://www.lucidimagination.com On Tue, Oct 6, 2009 at 1:48 PM, Nasseam Elkarra wrote: > Hello Erick, > > Sorry about that. I'm

Re: Importing CSV file slow/crashes

2009-10-06 Thread Nasseam Elkarra
Hello Erick, Sorry about that. I'm using the CSV update handler. Uploading a local CSV using the stream.file parameter. There are 94 fields and 36 copyFields. Thank you, Nasseam On Oct 6, 2009, at 10:09 AM, Erick Erickson wrote: Well, without some better idea of *how* you're doing the imp

Re: Importing CSV file slow/crashes

2009-10-06 Thread Erick Erickson
Well, without some better idea of *how* you're doing the import, it's a little hard to say anything meaningful (hint, hint). Best Erick On Tue, Oct 6, 2009 at 1:06 PM, Nasseam Elkarra wrote: > Hello all, > > I had a dev build of 1.4 from 5/1/2009 and importing a 20K row took less > than a minute