Hello,
I tried it using the debug and verbose parameters in the address bar. This
is what appears in the logs:
INFO: Starting Full Import
Jul 31, 2009 8:54:40 AM org.apache.solr.handler.dataimport.SolrWriter
readIndexerProperties
INFO: Read dataimport.properties
Jul 31, 2009 8:54:40 AM org.apache.solr.handler.dataimport.DataImporter
doFullImport
SEVERE: Full Import failed
java.lang.NullPointerException
at
org.apache.solr.handler.dataimport.DebugLogger.peekStack(DebugLogger.java:78)
at
org.apache.solr.handler.dataimport.DebugLogger.log(DebugLogger.java:98)
at
org.apache.solr.handler.dataimport.SolrWriter.log(SolrWriter.java:248)
at
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:305)
at
org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:224)
at
org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:167)
at
org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:316)
at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:374)
at
org.apache.solr.handler.dataimport.DataImportHandler.handleRequestBody(DataImportHandler.java:187)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1330)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:303)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:232)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:174)
at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:875)
at
org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665)
at
org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528)
at
org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81)
at
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689)
at java.lang.Thread.run(Unknown Source)
Jul 31, 2009 8:54:40 AM org.apache.solr.update.DirectUpdateHandler2 rollback
INFO: start rollback
Jul 31, 2009 8:54:40 AM org.apache.solr.update.DirectUpdateHandler2 rollback
INFO: end_rollback
It's different than before because this fails right away. Before adding
debug/verbose, it would go through all the rows.
It is possible that the last modified column may be missing some data in
some rows. The import, however, fails for every single row, which is
impossible. I am positive that there is data in that column.
Any other suggestions?
Cheers
ahammad wrote:
>
> Hello all,
>
> I've been having this issue for a while now. I am indexing a Sybase
> database. Everything is fantastic, except that there is 1 column that I
> can never get back. I don't have direct database access via Sybase client,
> but I was able to extract the data using some Java code.
>
> The field is essentially a Last Modified field. In the DB I believe that
> it is of type long. In the Java program that I have, I am able to retrieve
> the data that is in that column and put it in a variable of type Long.
> This is not the case in Solr, however.
>
> I set the variable in the schema as required to see why the data is never
> stored:
> <field name="lastModified" type="long" indexed="true" stored="true"
> required="true"/>
>
> This is what I get in the Tomcat logs:
>
> org.apache.solr.common.SolrException: Document [00069391] missing required
> field: lastModified
> at
> org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:292)
> at
> org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:59)
> at
> org.apache.solr.handler.dataimport.SolrWriter.upload(SolrWriter.java:67)
> at
> org.apache.solr.handler.dataimport.DataImportHandler$1.upload(DataImportHandler.java:276)
> at
> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:373)
> at
> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:224)
> at
> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:167)
> at
> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:316)
> at
> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:374)
> at
> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:355)
>
> From what I can gather, it is not finding the data and/or column, and thus
> cannot populate the required field. However, the data is there, which I
> was able to prove outside of Solr.
>
> Is there a way to generate more descriptive logs for this? I am completely
> lost. I hit this problem a few months ago but I was never able to resolve
> it. Any help on this will be much appreciated.
>
> BTW, Solr was successful in retrieving data from other columns in the same
> table...
>
> Thanks
>
--
View this message in context:
http://www.nabble.com/Problem-with-retrieving-field-from-database-using-DIH-tp24746530p24756013.html
Sent from the Solr - User mailing list archive at Nabble.com.
