Re: Slow indexing with data import handler

2009-04-18 Thread Shalin Shekhar Mangar
On Sun, Apr 19, 2009 at 7:30 AM, Gustavo A. Lopes wrote: > I'm indexing around 1 million documents of one type that requires 4 > additional queries for each document + 0,5 M documents that only require 1 > query for all. > > I'm using the data import handler from contrib with SolrWriter modified >

Re: Slow indexing with data import handler

2009-04-18 Thread Otis Gospodnetic
atext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Gustavo A. Lopes > To: "solr-user@lucene.apache.org" > Sent: Saturday, April 18, 2009 10:00:18 PM > Subject: Slow indexing with data import handler > > I'm indexing aroun

Slow indexing with data import handler

2009-04-18 Thread Gustavo A. Lopes
I'm indexing around 1 million documents of one type that requires 4 additional queries for each document + 0,5 M documents that only require 1 query for all. I'm using the data import handler from contrib with SolrWriter modified with allowDups = true (doesn't seem to have made any difference).