Re: Indexing Large Files with Large DataImport: Problems

2008-10-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
Did you get a chance to test with the patch? did it work? On Wed, Oct 1, 2008 at 10:13 AM, Noble Paul നോബിള്‍ नोब्ळ् <[EMAIL PROTECTED]> wrote: > this patch is created from 1.3 (may apply on trunk also) > --Noble > > On Wed, Oct 1, 2008 at 9:56 AM, Noble Paul നോബിള്‍ नोब्ळ् > <[EMAIL PROTECTED]> w

Re: Indexing Large Files with Large DataImport: Problems

2008-09-30 Thread Noble Paul നോബിള്‍ नोब्ळ्
this patch is created from 1.3 (may apply on trunk also) --Noble On Wed, Oct 1, 2008 at 9:56 AM, Noble Paul നോബിള്‍ नोब्ळ् <[EMAIL PROTECTED]> wrote: > I guess it is a threading problem. I can give you a patch. you can raise a bug > --Noble > > On Wed, Oct 1, 2008 at 2:11 AM, KyleMorrison <[EMAIL

Re: Indexing Large Files with Large DataImport: Problems

2008-09-30 Thread Noble Paul നോബിള്‍ नोब्ळ्
I guess it is a threading problem. I can give you a patch. you can raise a bug --Noble On Wed, Oct 1, 2008 at 2:11 AM, KyleMorrison <[EMAIL PROTECTED]> wrote: > > As a follow up: I continued tweaking the data-config.xml, and have been able > to make the commit fail with as little as 3 fields in th

Re: Indexing Large Files with Large DataImport: Problems

2008-09-30 Thread KyleMorrison
As a follow up: I continued tweaking the data-config.xml, and have been able to make the commit fail with as little as 3 fields in the sdc.xml, with only one multivalued field. Even more strange, some fields work and some do not. For instance, in my dc.xml: . . . and in the schema.xml: . . .

Re: Indexing Large Files with Large DataImport: Problems

2008-09-30 Thread KyleMorrison
Yes, this is the most recent version of Solr, stream="true" and stopwords, lowercase and removeDuplicate being applied to all multivalued fields? Would the filters possibly be causing this? I will not use them and see what happens. Kyle Shalin Shekhar Mangar wrote: > > Hmm, strange. > > This

Re: Indexing Large Files with Large DataImport: Problems

2008-09-30 Thread Shalin Shekhar Mangar
Hmm, strange. This is Solr 1.3.0, right? Do you have any transformers applied to these multi-valued fields? Do you have stream="true" in the entity? On Tue, Sep 30, 2008 at 11:01 PM, KyleMorrison <[EMAIL PROTECTED]> wrote: > > I apologize for spamming this mailing list with my problems, but I'm

Re: Indexing Large Files with Large DataImport: Problems

2008-09-30 Thread Mark Miller
Exception indicates a threading bug, not a scaling issue... I'm sure the issue will be illuminated on soon though. KyleMorrison wrote: I apologize for spamming this mailing list with my problems, but I'm at my wits end. I'll get right to the point. I have an xml file which is ~1GB which I wis

Indexing Large Files with Large DataImport: Problems

2008-09-30 Thread KyleMorrison
I apologize for spamming this mailing list with my problems, but I'm at my wits end. I'll get right to the point. I have an xml file which is ~1GB which I wish to index. If that is successful, I will move to a larger file of closer to 20GB. However, when I run my data-config(let's call it dc.xml)