Hi, I have solr all working nicely, except im trying to get deltas to
work on my data import handler
Here is a simplification of my data import config, I have a table
called "Book" which has categories, im doing subquries for the
category info and calling a javascript helper. This all works
perfectly for the regular query.
I added these lines for the delta stuff:
deltaImportQuery="SELECT f.id,f.title
FROM Book f
f.id='${dataimporter.delta.job_jobs_id}'"
deltaQuery="SELECT id FROM `Book` WHERE fm.inMyList=1 AND
lastModifiedDate > '${dataimporter.last_index_time}'" >
basically im trying to rows that lastModifiedDate is newer than the
last index (or deltaindex).
I run:
http://localhost:8983/solr/dataimport?command=delta-import
And it says in logs:
Nov 23, 2009 2:33:02 PM
org.apache.solr.handler.dataimport.DataImporter doDeltaImport
INFO: Starting Delta Import
Nov 23, 2009 2:33:02 PM org.apache.solr.handler.dataimport.SolrWriter
readIndexerProperties
INFO: Read dataimport.properties
Nov 23, 2009 2:33:02 PM org.apache.solr.handler.dataimport.DocBuilder
doDelta
INFO: Starting delta collection.
Nov 23, 2009 2:33:02 PM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/dataimport params={command=delta-import}
status=0 QTime=0
Nov 23, 2009 2:33:02 PM org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Running ModifiedRowKey() for Entity: category
Nov 23, 2009 2:33:02 PM org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed ModifiedRowKey for Entity: category rows obtained : 0
Nov 23, 2009 2:33:02 PM org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed DeletedRowKey for Entity: category rows obtained : 0
Nov 23, 2009 2:33:02 PM org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed parentDeltaQuery for Entity: category
Nov 23, 2009 2:33:02 PM org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Running ModifiedRowKey() for Entity: item
Nov 23, 2009 2:33:02 PM org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed ModifiedRowKey for Entity: item rows obtained : 0
Nov 23, 2009 2:33:02 PM org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed DeletedRowKey for Entity: item rows obtained : 0
Nov 23, 2009 2:33:02 PM org.apache.solr.handler.dataimport.DocBuilder
collectDelta
INFO: Completed parentDeltaQuery for Entity: item
Nov 23, 2009 2:33:02 PM org.apache.solr.handler.dataimport.DocBuilder
doDelta
INFO: Delta Import completed successfully
Nov 23, 2009 2:33:02 PM org.apache.solr.handler.dataimport.DocBuilder
execute
INFO: Time taken = 0:0:0.21
But the browser says no documents added/modified (even though one
record in db is a match)
Is there a way to turn debugging so I can see the queries the DIH is
sending to the db?
Any other ideas of what I could be doing wrong?
thanks
Joel
<document name="doc">
<entity name="item"
query="SELECT f.id, f.title
FROM Book f
WHERE f.inMyList=1"
deltaImportQuery="SELECT f.id,f.title
FROM Book f
f.id='${dataimporter.delta.job_jobs_id}'"
deltaQuery="SELECT id FROM `Book` WHERE fm.inMyList=1 AND
lastModifiedDate > '${dataimporter.last_index_time}'" >
<field column="id" name="id" />
<field column="title" name="title" />
<entity name="category"
transformer="script:SplitAndPrettyCategory" query="select fc.bookId,
group_concat(cr.name) as categoryName,
from BookCat fc
where fc.bookId = '${item.id}' AND
group by fc.bookId">
<field column="categoryType" name="categoryType" />
</entity>
</entity>
</document>
