I looked at the DIH debug page to to be honest I'm not sure how to use it well and get something out of it.
I am using a solr 1.4 nightly from March. Cheers Noble Paul നോബിള് नोब्ळ्-2 wrote: > > you can try going to the DIH debug page. BTW which version of DIH are you > using? > > On Fri, Jul 31, 2009 at 6:31 PM, ahammad<ahmed.ham...@gmail.com> wrote: >> >> Hello, >> >> I tried it using the debug and verbose parameters in the address bar. >> This >> is what appears in the logs: >> >> INFO: Starting Full Import >> Jul 31, 2009 8:54:40 AM org.apache.solr.handler.dataimport.SolrWriter >> readIndexerProperties >> INFO: Read dataimport.properties >> Jul 31, 2009 8:54:40 AM org.apache.solr.handler.dataimport.DataImporter >> doFullImport >> SEVERE: Full Import failed >> java.lang.NullPointerException >> at >> org.apache.solr.handler.dataimport.DebugLogger.peekStack(DebugLogger.java:78) >> at >> org.apache.solr.handler.dataimport.DebugLogger.log(DebugLogger.java:98) >> at >> org.apache.solr.handler.dataimport.SolrWriter.log(SolrWriter.java:248) >> at >> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:305) >> at >> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:224) >> at >> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:167) >> at >> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:316) >> at >> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:374) >> at >> org.apache.solr.handler.dataimport.DataImportHandler.handleRequestBody(DataImportHandler.java:187) >> at >> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131) >> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1330) >> at >> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:303) >> at >> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:232) >> at >> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:215) >> at >> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188) >> at >> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213) >> at >> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172) >> at >> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) >> at >> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117) >> at >> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108) >> at >> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:174) >> at >> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:875) >> at >> org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665) >> at >> org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528) >> at >> org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81) >> at >> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689) >> at java.lang.Thread.run(Unknown Source) >> Jul 31, 2009 8:54:40 AM org.apache.solr.update.DirectUpdateHandler2 >> rollback >> INFO: start rollback >> Jul 31, 2009 8:54:40 AM org.apache.solr.update.DirectUpdateHandler2 >> rollback >> INFO: end_rollback >> >> >> It's different than before because this fails right away. Before adding >> debug/verbose, it would go through all the rows. >> >> It is possible that the last modified column may be missing some data in >> some rows. The import, however, fails for every single row, which is >> impossible. I am positive that there is data in that column. >> >> Any other suggestions? >> >> Cheers >> >> >> ahammad wrote: >>> >>> Hello all, >>> >>> I've been having this issue for a while now. I am indexing a Sybase >>> database. Everything is fantastic, except that there is 1 column that I >>> can never get back. I don't have direct database access via Sybase >>> client, >>> but I was able to extract the data using some Java code. >>> >>> The field is essentially a Last Modified field. In the DB I believe that >>> it is of type long. In the Java program that I have, I am able to >>> retrieve >>> the data that is in that column and put it in a variable of type Long. >>> This is not the case in Solr, however. >>> >>> I set the variable in the schema as required to see why the data is >>> never >>> stored: >>> <field name="lastModified" type="long" indexed="true" stored="true" >>> required="true"/> >>> >>> This is what I get in the Tomcat logs: >>> >>> org.apache.solr.common.SolrException: Document [00069391] missing >>> required >>> field: lastModified >>> at >>> org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:292) >>> at >>> org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:59) >>> at >>> org.apache.solr.handler.dataimport.SolrWriter.upload(SolrWriter.java:67) >>> at >>> org.apache.solr.handler.dataimport.DataImportHandler$1.upload(DataImportHandler.java:276) >>> at >>> org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:373) >>> at >>> org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:224) >>> at >>> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:167) >>> at >>> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:316) >>> at >>> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:374) >>> at >>> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:355) >>> >>> From what I can gather, it is not finding the data and/or column, and >>> thus >>> cannot populate the required field. However, the data is there, which I >>> was able to prove outside of Solr. >>> >>> Is there a way to generate more descriptive logs for this? I am >>> completely >>> lost. I hit this problem a few months ago but I was never able to >>> resolve >>> it. Any help on this will be much appreciated. >>> >>> BTW, Solr was successful in retrieving data from other columns in the >>> same >>> table... >>> >>> Thanks >>> >> >> -- >> View this message in context: >> http://www.nabble.com/Problem-with-retrieving-field-from-database-using-DIH-tp24746530p24756013.html >> Sent from the Solr - User mailing list archive at Nabble.com. >> >> > > > > -- > ----------------------------------------------------- > Noble Paul | Principal Engineer| AOL | http://aol.com > > -- View this message in context: http://www.nabble.com/Problem-with-retrieving-field-from-database-using-DIH-tp24746530p24756274.html Sent from the Solr - User mailing list archive at Nabble.com.
