you can try going to the DIH debug page. BTW which version of DIH are you using?
On Fri, Jul 31, 2009 at 6:31 PM, ahammad<ahmed.ham...@gmail.com> wrote: > > Hello, > > I tried it using the debug and verbose parameters in the address bar. This > is what appears in the logs: > > INFO: Starting Full Import > Jul 31, 2009 8:54:40 AM org.apache.solr.handler.dataimport.SolrWriter > readIndexerProperties > INFO: Read dataimport.properties > Jul 31, 2009 8:54:40 AM org.apache.solr.handler.dataimport.DataImporter > doFullImport > SEVERE: Full Import failed > java.lang.NullPointerException > at > org.apache.solr.handler.dataimport.DebugLogger.peekStack(DebugLogger.java:78) > at > org.apache.solr.handler.dataimport.DebugLogger.log(DebugLogger.java:98) > at > org.apache.solr.handler.dataimport.SolrWriter.log(SolrWriter.java:248) > at > org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:305) > at > org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:224) > at > org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:167) > at > org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:316) > at > org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:374) > at > org.apache.solr.handler.dataimport.DataImportHandler.handleRequestBody(DataImportHandler.java:187) > at > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1330) > at > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:303) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:232) > at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215) > at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188) > at > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213) > at > org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172) > at > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) > at > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117) > at > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108) > at > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:174) > at > org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:875) > at > org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665) > at > org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528) > at > org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81) > at > org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689) > at java.lang.Thread.run(Unknown Source) > Jul 31, 2009 8:54:40 AM org.apache.solr.update.DirectUpdateHandler2 rollback > INFO: start rollback > Jul 31, 2009 8:54:40 AM org.apache.solr.update.DirectUpdateHandler2 rollback > INFO: end_rollback > > > It's different than before because this fails right away. Before adding > debug/verbose, it would go through all the rows. > > It is possible that the last modified column may be missing some data in > some rows. The import, however, fails for every single row, which is > impossible. I am positive that there is data in that column. > > Any other suggestions? > > Cheers > > > ahammad wrote: >> >> Hello all, >> >> I've been having this issue for a while now. I am indexing a Sybase >> database. Everything is fantastic, except that there is 1 column that I >> can never get back. I don't have direct database access via Sybase client, >> but I was able to extract the data using some Java code. >> >> The field is essentially a Last Modified field. In the DB I believe that >> it is of type long. In the Java program that I have, I am able to retrieve >> the data that is in that column and put it in a variable of type Long. >> This is not the case in Solr, however. >> >> I set the variable in the schema as required to see why the data is never >> stored: >> <field name="lastModified" type="long" indexed="true" stored="true" >> required="true"/> >> >> This is what I get in the Tomcat logs: >> >> org.apache.solr.common.SolrException: Document [00069391] missing required >> field: lastModified >> at >> org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:292) >> at >> org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:59) >> at >> org.apache.solr.handler.dataimport.SolrWriter.upload(SolrWriter.java:67) >> at >> org.apache.solr.handler.dataimport.DataImportHandler$1.upload(DataImportHandler.java:276) >> at >> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:373) >> at >> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:224) >> at >> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:167) >> at >> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:316) >> at >> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:374) >> at >> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:355) >> >> From what I can gather, it is not finding the data and/or column, and thus >> cannot populate the required field. However, the data is there, which I >> was able to prove outside of Solr. >> >> Is there a way to generate more descriptive logs for this? I am completely >> lost. I hit this problem a few months ago but I was never able to resolve >> it. Any help on this will be much appreciated. >> >> BTW, Solr was successful in retrieving data from other columns in the same >> table... >> >> Thanks >> > > -- > View this message in context: > http://www.nabble.com/Problem-with-retrieving-field-from-database-using-DIH-tp24746530p24756013.html > Sent from the Solr - User mailing list archive at Nabble.com. > > -- ----------------------------------------------------- Noble Paul | Principal Engineer| AOL | http://aol.com
