On 4/23/2013 6:02 AM, Sharmila Thapa wrote: > What is the maximum size limit of the XML document file that is allowed to > import into solr to index from java -Durl. As I am testing to import XMLfile > of 5 GB and it throws an error like > SimplePostTool: WARNING: Solr returned an error #400 Bad Request > SimplePostTool: WARNING: IOException while reading response: > java.io.IOException: Server returned HTTP response code: 400 for URL: > http://10.0.1.140:8080/solr/solr1/update
Unless the simple post tool is capable of breaking the input XML into many pieces, you'll run into the POST size limit of your servlet container. I don't know if it has this capability, but I would be somewhat surprised if it did. Solr is packaged so the example uses jetty (start.jar), but you may be running under tomcat or one of a few other choices. The history of the POST limit in Solr is a little complex. The example jetty config in Solr 3.x (and possibly earlier) used a 1MiB POST buffer. You could change that value with no problem. If you used another container, you could change it using that container's configuration method. When 4.0 was released, jetty 8.x had a bug and the 1MiB configuration in the example wasn't working, so the limit became 200KB, jetty's default. Just like earlier versions, if you were using another container, you could change the limit using that container's configuration. The bug in jetty has now been fixed. https://bugs.eclipse.org/bugs/show_bug.cgi?id=397130 Solr 4.1 changed things, with SOLR-4265. Now Solr controls the max POST size itself, defaulting formdataUploadLimitInKB in solrconfig.xml to 2048. https://issues.apache.org/jira/browse/SOLR-4265 Thanks, Shawn