Hello,
I am trying to use DIH with FileListEntityProcessor to to walk the
disk and read XML documents. I have a dataConfig.xml as follows:-
<dataConfig>
<document>
<entity name="jcurrent"
processor="FileListEntityProcessor"
fileName=".*xml"
newerThan="'NOW-1000DAYS'"
recursive="true"
rootEntity="false"
dataSource="null"
baseDir="/Volumes/spare/ts/j/groups">
<entity name="x"
processor="XPathEntityProcessor"
url="${jcurrent.fileAbsolutePath}"
stream="false"
forEach="/record"
transformer="DateFormatTransformer">0
<field column="title" xpath="/record/title"/>
<field column="subject"
xpath="/record/metadata/subje...@qualifier='fullTitle']"/>
<field column="text" xpath="//para"/>
<field column="pubname"
xpath="/record/metadata/subje...@qualifier='publication']"/>
<field column="pubabrev"
xpath="/record/metadata/subje...@qualifier='pubAbbrev']"/>
<field column="pubdate"
xpath="/record/metadata/da...@qualifier='pubDate']"/>
</entity>
</entity>
</document>
</dataConfig>
But when I try and start the walker I get:-
INFO: [jdocs] REMOVING ALL DOCUMENTS FROM INDEX
Jan 13, 2009 3:38:11 PM org.apache.solr.core.SolrDeletionPolicy onInit
INFO: SolrDeletionPolicy.onInit: commits:num=2
commit{dir=/Volumes/spare/ts/solrnightlyj/data/index,segFN=segments_1,version=1231861070710,generation=1,filenames=[segments_1]
commit{dir=/Volumes/spare/ts/solrnightlyj/data/index,segFN=segments_2,version=1231861070711,generation=2,filenames=[segments_2]
Jan 13, 2009 3:38:11 PM org.apache.solr.core.SolrDeletionPolicy updateCommits
INFO: last commit = 1231861070711
Jan 13, 2009 3:38:11 PM org.apache.solr.handler.dataimport.DocBuilder
buildDocument
SEVERE: Exception while processing: jcurrent document : null
org.apache.solr.handler.dataimport.DataImportHandlerException: No dataSource
:null available for entity :x Processing Document # 1
at
org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:287)
at
org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:86)
at
org.apache.solr.handler.dataimport.XPathEntityProcessor.init(XPathEntityProcessor.java:78)
at
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:243)
at
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:309)
at
org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:179)
at
org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:137)
at
org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:337)
at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:397)
at
org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:378)
Jan 13, 2009 3:38:11 PM org.apache.solr.handler.dataimport.DataImporter
doFullImport
SEVERE: Full Import failed
org.apache.solr.handler.dataimport.DataImportHandlerException: No dataSource
:null available for entity :x Processing Document # 1
at
org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:287)
at
org.apache.solr.handler.dataimport.ContextImpl.getDataSource(ContextImpl.java:86)
at
org.apache.solr.handler.dataimport.XPathEntityProcessor.init(XPathEntityProcessor.java:78)
at
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:243)
at
org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:309)
at
org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:179)
at
org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:137)
at
org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:337)
at
org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:397)
at
org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:378)
Anybody able to point out what I have done wrong?
Regards Fergus.
--
===============================================================
Fergus McMenemie Email:fer...@twig.me.uk
Techmore Ltd Phone:(UK) 07721 376021
Unix/Mac/Intranets Analyst Programmer
===============================================================
