My error was in syntax. Sorry for the spam. -----Original Message----- From: Mukerjee, Neiloy (Neil) [mailto:neil.muker...@alcatel-lucent.com] Sent: Wednesday, June 24, 2009 4:33 PM To: solr-user@lucene.apache.org Subject: DIH Indexing
I am running Solr 1.3 with Tomcat 6, and I am trying to import and index a MySQL database. However, even though DIH seems to have installed properly, when I try to do a full import via http://localhost:8080/solr/dataimport?command=full-import, the following is registered in my logs. ********* Jun 24, 2009 1:49:36 PM org.apache.solr.handler.dataimport.SolrWriter readIndexerProperties INFO: Read dataimport.properties Jun 24, 2009 1:49:36 PM org.apache.solr.handler.dataimport.DataImporter doFullImport INFO: Starting Full Import Jun 24, 2009 1:49:36 PM org.apache.solr.handler.dataimport.SolrWriter readIndexerProperties INFO: Read dataimport.properties Jun 24, 2009 1:49:36 PM org.apache.solr.update.DirectUpdateHandler2 deleteAll INFO: [] REMOVING ALL DOCUMENTS FROM INDEX Jun 24, 2009 1:49:36 PM org.apache.solr.core.SolrDeletionPolicy onInit INFO: SolrDeletionPolicy.onInit: commits:num=1 commit{dir=/usr/local/tomcat6.0.20/bin/solr/data/index,segFN=segments_f,version=1245267517423,generation=15,filenames=[_1f.nrm, _1f.tii, segments_f, _1f.frq, _1f.prx, _1f.fnm, _1b.fdt, _1f.tis, _1b.fdx] Jun 24, 2009 1:49:36 PM org.apache.solr.core.SolrDeletionPolicy updateCommits INFO: last commit = 1245267517423 Jun 24, 2009 1:49:36 PM org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Creating a connection for entity employees with URL: jdbc:mysql://localhost/bell_labs Jun 24, 2009 1:49:36 PM org.apache.solr.handler.dataimport.JdbcDataSource$1 call INFO: Time taken for getConnection(): 13 Jun 24, 2009 1:49:36 PM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr path=/dataimport params={command=full-import} status=0 QTime=73 Jun 24, 2009 1:49:49 PM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr path=/dataimport params={command=full-import} status=0 QTime=0 Jun 24, 2009 1:49:57 PM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr path=/dataimport params={} status=0 QTime=1 Jun 24, 2009 1:51:59 PM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr path=/dataimport params={} status=0 QTime=0 Jun 24, 2009 1:53:21 PM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr path=/dataimport params={} status=0 QTime=0 Jun 24, 2009 1:54:09 PM org.apache.solr.handler.dataimport.DocBuilder commit INFO: Full Import completed successfully Jun 24, 2009 1:54:09 PM org.apache.solr.update.DirectUpdateHandler2 commit INFO: start commit(optimize=true,waitFlush=false,waitSearcher=true) Jun 24, 2009 1:54:20 PM org.apache.solr.core.SolrDeletionPolicy onCommit INFO: SolrDeletionPolicy.onCommit: commits:num=2 commit{dir=/usr/local/tomcat6.0.20/bin/solr/data/index,segFN=segments_f,version=1245267517423,generation=15,filenames=[_1f.nrm, _1f.tii, segments_f, _1f.frq, _1f.prx, _1f.fnm, _1b.fdt, _1f.tis, _1b.fdx] commit{dir=/usr/local/tomcat6.0.20/bin/solr/data/index,segFN=segments_g,version=1245267517424,generation=16,filenames=[_1g.fdt, _1g.fdx, _1k.tii, _1k.fnm, _1k.nrm, _1k.tis, _1k.frq, _1k.prx, segments_g] Jun 24, 2009 1:54:20 PM org.apache.solr.core.SolrDeletionPolicy updateCommits INFO: last commit = 1245267517424 Jun 24, 2009 1:54:20 PM org.apache.solr.search.SolrIndexSearcher <init> INFO: Opening searc...@1f801f7 main Jun 24, 2009 1:54:20 PM org.apache.solr.update.DirectUpdateHandler2 commit INFO: end_commit_flush Jun 24, 2009 1:54:20 PM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming searc...@1f801f7 main from searc...@1c0adca main fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} Jun 24, 2009 1:54:20 PM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for searc...@1f801f7 main fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} Jun 24, 2009 1:54:20 PM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming searc...@1f801f7 main from searc...@1c0adca main filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} Jun 24, 2009 1:54:20 PM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for searc...@1f801f7 main filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} Jun 24, 2009 1:54:20 PM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming searc...@1f801f7 main from searc...@1c0adca main queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=5,evictions=0,size=5,warmupTime=3,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} Jun 24, 2009 1:54:20 PM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for searc...@1f801f7 main queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=5,evictions=0,size=5,warmupTime=4,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} Jun 24, 2009 1:54:20 PM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming searc...@1f801f7 main from searc...@1c0adca main documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} Jun 24, 2009 1:54:20 PM org.apache.solr.search.SolrIndexSearcher warm INFO: autowarming result for searc...@1f801f7 main documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} Jun 24, 2009 1:54:20 PM org.apache.solr.core.QuerySenderListener newSearcher INFO: QuerySenderListener sending requests to searc...@1f801f7 main Jun 24, 2009 1:54:20 PM org.apache.solr.core.SolrCore execute INFO: [] webapp=null path=null params={start=0&q=solr&rows=10} hits=0 status=0 QTime=0 Jun 24, 2009 1:54:20 PM org.apache.solr.core.SolrCore execute INFO: [] webapp=null path=null params={start=0&q=rocks&rows=10} hits=0 status=0 QTime=0 Jun 24, 2009 1:54:20 PM org.apache.solr.core.SolrCore execute INFO: [] webapp=null path=null params={q=static+newSearcher+warming+query+from+solrconfig.xml} hits=0 status=0 QTime=0 Jun 24, 2009 1:54:20 PM org.apache.solr.core.QuerySenderListener newSearcher INFO: QuerySenderListener done. Jun 24, 2009 1:54:20 PM org.apache.solr.core.SolrCore registerSearcher INFO: [] Registered new searcher searc...@1f801f7 main Jun 24, 2009 1:54:20 PM org.apache.solr.search.SolrIndexSearcher close INFO: Closing searc...@1c0adca main fieldValueCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} filterCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} queryResultCache{lookups=0,hits=0,hitratio=0.00,inserts=5,evictions=0,size=5,warmupTime=3,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} documentCache{lookups=0,hits=0,hitratio=0.00,inserts=0,evictions=0,size=0,warmupTime=0,cumulative_lookups=0,cumulative_hits=0,cumulative_hitratio=0.00,cumulative_inserts=0,cumulative_evictions=0} Jun 24, 2009 1:54:20 PM org.apache.solr.handler.dataimport.SolrWriter readIndexerProperties INFO: Read dataimport.properties Jun 24, 2009 1:54:20 PM org.apache.solr.handler.dataimport.SolrWriter persist INFO: Wrote last indexed time to dataimport.properties Jun 24, 2009 1:54:20 PM org.apache.solr.handler.dataimport.DocBuilder execute INFO: Time taken = 0:4:44.463 Jun 24, 2009 1:54:42 PM org.apache.solr.core.SolrCore execute INFO: [] webapp=/solr path=/dataimport params={} status=0 QTime=0 ********* >From what I can read of this, there has been no error during the import, and I >see the below once the import is finished, which would indicate that the full >table in the database was indexed (since the appropriate number of entries - >115323 - is displayed). ********* <response> <lst name="responseHeader"> <int name="status">0</int> <int name="QTime">0</int> </lst> <lst name="initArgs"> <lst name="defaults"> <str name="config"> /usr/local/tomcat6.0.20/webapps/solr/data-config.xml </str> </lst> </lst> <str name="status">idle</str> <str name="importResponse"/> <lst name="statusMessages"> <str name="Total Requests made to DataSource">1</str> <str name="Total Rows Fetched">115323</str> <str name="Total Documents Skipped">0</str> <str name="Full Dump Started">2009-06-24 13:49:36</str> <str name=""> Indexing completed. Added/Updated: 115323 documents. Deleted 0 documents. </str> <str name="Committed">2009-06-24 13:54:20</str> <str name="Optimized">2009-06-24 13:54:20</str> <str name="Time taken ">0:4:44.463</str> </lst> <str name="WARNING"> This response format is experimental. It is likely to change in the future. </str> </response> ********* However, when I search for a term that I know should return results via the Solr Admin page, there are no results returned - I see the following: ********* <response> <lst name="responseHeader"> <int name="status">0</int> <int name="QTime">3</int> <lst name="params"> <str name ="indent">on</str> <str name ="start">0</str> <str name ="q">Mukerjee</str> <str name ="rows">10</str> <str name ="version">2.2</str> </lst> </lst> <result name="response" numFound="0" start="0"/> </response> ********* Has anyone else run into this issue? Is there some indication in these of what I am doing wrong, or should I be looking somewhere else?
