Do you have programming skills? If so, I'd suggest you write your own importer that allows you to control precisely what it is you are trying to do. The DIH, in my book is a great generic tool for low to medium complexity tasks. It very much appears you are pushing beyond its levels, and it would make sense for you to have more control, by using your own code to do the indexing.
Upayavira On Mon, Jan 21, 2013, at 11:36 AM, ashimbose wrote: > Hi Gora, > > Thank you for your suggestion..... > > I have tried with you below option, > > >* Have never tried this, but one can set up multiple request handlers > > in solrconfig.xml for each DIH instance that one plans to run. > > These can run in parallel rather than the sequential indexing of > > root entities in a single DIH instance. > > Here I used two data config > 1. data_conf1.xml > 2. data_conf2.xml > > I have used them like below > > <requestHandler name="/dataimport" > class="org.apache.solr.handler.dataimport.DataImportHandler"> > <lst name="defaults"> > <str name="config">data_conf1.xml</str> > </lst> > </requestHandler> > <requestHandler name="/dataimport1" > class="org.apache.solr.handler.dataimport.DataImportHandler"> > <lst name="defaults"> > <str name="config">data_conf2.xml</str> > </lst> > </requestHandler> > > Now I have run them separately one after the other like below.. > 1. http://localhost:8080/solr/dataimport?command=full-import > 2. http://localhost:8080/solr/dataimport1?command=full-import > > Any one of them running fine at a single instant. Means, > If I run first dataimport, it will successfully index, if after that I > run > dataimport1, it is giving below error.. > > Caused by: java.sql.SQLException: JBC0088E: JBC0002E: Socket timeout > detected: Read timed out > > Again I restart my tomcat and run dataimport1 first and then dataimport, > then also same problem, > > dataimport1 runs perfect but dataimport giving time out error, > > Can anyone please help me... or any different method to index large > data... > > Thanks > Ashim > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Large-data-importing-getting-rollback-with-solr-tp4034075p4035009.html > Sent from the Solr - User mailing list archive at Nabble.com.
