Andrew, I don't understand what that lock and unlock is for... Just do this: add add add add ... ... optionally commit or optimize
Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch ----- Original Message ---- > From: Andrew Savory <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Friday, May 9, 2008 6:28:09 AM > Subject: Weird problems with document size > > Hi, > > I'm trying to debug a misbehaving solr search setup. Here's the scenario: > > - custom index client that posts insert/delete events to solr via http; > - custom content handlers in solr; > - tcpmon in the middle to see what's going on > > When I post an add event to solr of less than about 5k, everything works: > > > > > > When I post a larger event, it goes wrong. The response from solr is a > 500 server error (text of which is below). > > The content should be good - it's lorem ipsum. > The tomcat server has maxPostSize disabled > The solr config has field size set to a large number (and we've tested > with several big fields less than the limit, as well as one big field > - anything over 5k trips it regardless of how the data is stored in > the fields) > > I've also tried pushing the same content using the command line and > curl - with the same result. > > At this point I'm baffled - any suggestions? > > > Those pesky errors: > > java.io.EOFException: no more data available - expected end tags > </field></doc></add> to close start tag > <field> from line 1 and start tag <doc> from line 1 and > start tag <add> from line 1, parser stopped on START_TAG seen > ...ipsum\tDolor sit amet\tlorem ipsum\tfoo\tbar... @1:8192 > at org.xmlpull.mxp1.MXParser.fillBuf(MXParser.java:3015) > at org.xmlpull.mxp1.MXParser.more(MXParser.java:3026) > at org.xmlpull.mxp1.MXParser.nextImpl(MXParser.java:1384) > at org.xmlpull.mxp1.MXParser.next(MXParser.java:1093) > at org.xmlpull.mxp1.MXParser.nextText(MXParser.java:1058) > at > org.apache.solr.handler.XmlUpdateRequestHandler.readDoc(XmlUpdateRequestHandler.java:332) > at > org.apache.solr.handler.XmlUpdateRequestHandler.update(XmlUpdateRequestHandler.java:162) > at > org.apache.solr.handler.XmlUpdateRequestHandler.doLegacyUpdate(XmlUpdateRequestHandler.java:355) > at > org.apache.solr.servlet.SolrUpdateServlet.doPost(SolrUpdateServlet.java:58) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:710) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:803) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:185) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) > at > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) > at > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175) > at > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) > at > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) > at > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) > at > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286) > at > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844) > at > org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) > at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447) > at java.lang.Thread.run(Thread.java:619) > > > HTTP/1.1 500 Internal Server Error > Server: Apache-Coyote/1.1 > Content-Type: text/html;charset=utf-8 > Content-Length: 2509 > Date: Fri, 09 May 2008 10:03:46 GMT > Connection: close > > > Apache Tomcat/6.0.16 - Error<br />> report> HTTP Status 500 - ________________________________ > size="1" noshade="noshade"> type Exception > report message description The > server encountered an internal error () that prevented it from > fulfilling this request. exception > java.lang.RuntimeException: > org.xmlpull.v1.XmlPullParserException: only whitespace content allowed > before start tag and not t (position: START_DOCUMENT seen t... @1:1) > > com.wiley.wps.search.common.impl.servlet.SolrServletConfig.process(SolrServletConfig.java:106) > > com.wiley.wps.search.common.impl.servlet.SolrServletConfig.doPost(SolrServletConfig.java:63) > javax.servlet.http.HttpServlet.service(HttpServlet.java:710) > javax.servlet.http.HttpServlet.service(HttpServlet.java:803) > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:185) > root cause > org.xmlpull.v1.XmlPullParserException: only whitespace content > allowed before start tag and not t (position: START_DOCUMENT seen t... > @1:1) > org.xmlpull.mxp1.MXParser.parseProlog(MXParser.java:1519) > org.xmlpull.mxp1.MXParser.nextImpl(MXParser.java:1395) > org.xmlpull.mxp1.MXParser.next(MXParser.java:1093) > org.xmlpull.mxp1.MXParser.nextTag(MXParser.java:1078) > > com.wiley.wps.search.common.impl.servlet.SolrServletConfig.process(SolrServletConfig.java:104) > > com.wiley.wps.search.common.impl.servlet.SolrServletConfig.doPost(SolrServletConfig.java:63) > javax.servlet.http.HttpServlet.service(HttpServlet.java:710) > javax.servlet.http.HttpServlet.service(HttpServlet.java:803) > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:185) > note The full stack trace of the root cause is > available in the Apache Tomcat/6.0.16 logs. ________________________________ > noshade="noshade"> Apache Tomcat/6.0.16
