Hi All,
I'm trygin to use DIH to import about 150k documents to Solr. One of the
multi-valued fields I need to import stores about 1500 unique ID per record. I
tried increasing the 'ramBufferSizeMB' setting but that didn't help. I get this
ArrayIndexOutOfBoundsException error and I can't make any sense of it. An
extract of the error log is below, any assistance would be greatly appreciated.
o.a.s.h.d.DocBuilder Exception while processing: matter document :
SolrInputDocument(fields:
[]):org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to
execute query: SELECT * FROM myView WITH (NOLOCK) ORDER BY viewId Processing
Document # 1
at
org.apache.solr.handler.dataimport.DataImportHandlerException.wrapAndThrow(DataImportHandlerException.java:69)
at
org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.<init>(JdbcDataSource.java:327)
at
org.apache.solr.handler.dataimport.JdbcDataSource.createResultSetIterator(JdbcDataSource.java:288)
at
org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:283)
at
org.apache.solr.handler.dataimport.JdbcDataSource.getData(JdbcDataSource.java:52)
at
org.apache.solr.handler.dataimport.SqlEntityProcessor.initQuery(SqlEntityProcessor.java:59)
at
org.apache.solr.handler.dataimport.SqlEntityProcessor.nextRow(SqlEntityProcessor.java:73)
at
org.apache.solr.handler.dataimport.EntityProcessorWrapper.nextRow(EntityProcessorWrapper.java:267)
at
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:476)
at
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:415)
at
org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:330)
at
org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:233)
at
org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:424)
at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:483)
at
org.apache.solr.handler.dataimport.DataImporter.lambda$runAsync$0(DataImporter.java:466)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ArrayIndexOutOfBoundsException
at java.net.SocketInputStream.socketRead0(Native Method)
at
java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:170)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at com.jnetdirect.jsql.DBComms.receive(DBComms.java:777)
at com.jnetdirect.jsql.IOBuffer.sendCommand(IOBuffer.java:248)
at
com.jnetdirect.jsql.JSQLStatement.sendExecute(JSQLStatement.java:2478)
at
com.jnetdirect.jsql.JSQLStatement.doExecute(JSQLStatement.java:2447)
at
com.jnetdirect.jsql.JSQLStatement.execute(JSQLStatement.java:2433)
at
org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.executeStatement(JdbcDataSource.java:349)
at
org.apache.solr.handler.dataimport.JdbcDataSource$ResultSetIterator.<init>(JdbcDataSource.java:321)
... 14 more
Thanks,
Robert Dadzie
________________________________
If you wish to view the CPA Global group email disclaimer, please click
here<https://www.cpaglobal.com/Privacy/CPAGlobalEmailDisclaimer/>
________________________________
