On 23-04-2012 8:18 pm, sivaprasad wrote:
Hi,
When i am trying to index 16 millions of documents using dataimport
handler,
intermittently i am getting the below exception and the indexing get
stopped.
STACKTRACE:
java.io.EOFException: Can not read response from server. Expected to
read 4
bytes, read 0 bytes before connection was unexpectedly lost.
at com.mysql.jdbc.MysqlIO.readFully(MysqlIO.java:1997)
at
com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2411)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2916)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:885)
at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1360)
at
com.mysql.jdbc.MysqlIO.fetchRowsViaCursor(MysqlIO.java:4044)
at
com.mysql.jdbc.CursorRowProvider.fetchMoreRows(CursorRowProvider.java:396)
at
com.mysql.jdbc.CursorRowProvider.hasNext(CursorRowProvider.java:313)
at com.mysql.jdbc.ResultSet.next(ResultSet.java:7296)
at
org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.hasnext(JdbcDataSource.java:331)
at
org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.access$600(JdbcDataSource.java:228)
at
org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator$1.hasNext(JdbcDataSource.java:262)
at
org.apache.solr.handler.dataimport.EntityProcessorBase.getNext(EntityProcessorBase.java:77)
at
org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityProcessor.java:75)
at
org.apache.solr.handler.dataimport.EntityProcessorWrapper.nextRow(EntityProcessorWrapper.java:238)
at
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:591)
at
org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:267)
at
org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:186)
at
org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:359)
at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:427)
at
org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:408)
** END NESTED EXCEPTION **
Last packet sent to the server was 2 ms ago.
at
com.mysql.jdbc.MysqlIO.reuseAndReadPacket(MysqlIO.java:2622)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2916)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:885)
at com.mysql.jdbc.MysqlIO.nextRow(MysqlIO.java:1360)
at
com.mysql.jdbc.MysqlIO.fetchRowsViaCursor(MysqlIO.java:4044)
at
com.mysql.jdbc.CursorRowProvider.fetchMoreRows(CursorRowProvider.java:396)
at
com.mysql.jdbc.CursorRowProvider.hasNext(CursorRowProvider.java:313)
at com.mysql.jdbc.ResultSet.next(ResultSet.java:7296)
at
org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.hasnext(JdbcDataSource.java:331)
... 11 more
2012-04-23 08:25:35,693 SEVERE
[org.apache.solr.handler.dataimport.DataImporter] (Thread-21) Full
Import
failed:org.apache.solr.handler.dataimport.DataImportHandlerException:
com.mysql.jdbc.CommunicationsException: Communications link failure
due to
underlying exception:
And the db-config.xml has the below configuration.
<dataSource driver="com.mysql.jdbc.Driver"
url="jdbc:mysql://localhost:3306/phpq" user="slrmgr"
defaultFetchSize="30"
useCursorFetch="true" autoReconnect="true" tcpKeepAlive="true"
connectionTimeout="120000" password="pqmgr123" batch-size="-1"/>
Any help on this is much appreciable.
--
View this message in context:
http://lucene.472066.n3.nabble.com/Full-Import-failed-org-apache-solr-handler-dataimport-DataImportHandlerException-com-mysql-jdbc-Commn-tp3932521p3932521.html
Sent from the Solr - User mailing list archive at Nabble.com.
Sivaprasad,
just a clarification about batch size attribute, is it typo error or
real in your db-config.xml
Supported attribute name is batchSize="-1"
(http://wiki.apache.org/solr/DataImportHandler#Configuring_JdbcDataSource)
-Jeevanandam
