Re: size limitation when adding document?

[tim robertson]

Today I added a single 9gig tab file into solr, with the resulting index
being 16gig.3 hours to load and is performing mightily fine (jvm -Xmx3G)


On Thu, Mar 27, 2008 at 7:08 PM, Yonik Seeley <[EMAIL PROTECTED]> wrote:

> On Thu, Mar 27, 2008 at 1:21 PM, Andrew Tan <[EMAIL PROTECTED]>
> wrote:
> >  I am new to solr and just try it out. I copied solr.war (from 1.2.0
> >  distribution) into tomcat 5.5.26's webapps directory and started
> tomcat.
> >  Then I use the java SimplePostTool to add documents. when the document
> >  is small, things are fine. However, when I tried to add document
> >  (greater than 8KB) into solr server, I got the following error message
> :
> >
> >  <result status="1">java.io.EOFException: no more data available -
> >  expected end tags &lt;/field&gt;&lt;/doc&gt;&lt;/add&gt; to close start
> >  tag &lt;field&gt; from line 35 and start tag &lt;doc&gt; from line 3
> and
> >  start tag &lt;add&gt; from line 2, parser stopped on START_TAG seen
> >  ...uiror Termination Fee if the preceding relates to antitrust or
> com...
> >  @35:859
>
> This looks like the XML may not be valid.
> I just tried a big document (120K) and a big single field (75K).  Both
> worked fine.
> Are you sure the field values have reserved XML chars escaped
> correctly?  Perhaps try opening the file in an XML editor.
>
> -Yonik
>