Hello Floyd, Did you consider to disable tlog? Does a file consist of many docs? Do you have SolrCloud? Do you use just sh/curl or have a java program? DIH is not really performant so far. Submitting roughly ten huge files in parallel is a way to perform good. Once again, nuke tlog.
On Sun, Jun 15, 2014 at 12:44 PM, Floyd Wu <floyd...@gmail.com> wrote: > Hi, > I have many XML Message file formatted like this > https://wiki.apache.org/solr/UpdateXmlMessages > > These files are generated by my index builder daily. > Currently I am sending these file through http post to Solr but sometimes I > hit OOM exception or pending too many tlog. > > Do you have better way to "import" these files to Solr to build index? > > Thanks for the suggestion > > Floyd > -- Sincerely yours Mikhail Khludnev Principal Engineer, Grid Dynamics <http://www.griddynamics.com> <mkhlud...@griddynamics.com>
