Re: Help need in setting up delta imports

2010-09-24 Thread Alexey Serba
Your example doesn't mention deleting Employee. Is this a valid use case? If not then you can simplify things: query="SELECT name, address from employee where endtimestamp is null" deltaQuery= "SELECT DISTINCT name FROM employee eventtimestamp > '${dataimporter.last_index_time}' " d

Re: Help need in setting up delta imports

2010-09-21 Thread Erick Erickson
Updating records for a delta import is governed by the entry in schema.xml. This should probably correspond to the database primary key and be a single, un-analyzed term (i.e. probably a fieldType String). So I suspect your schema.xml definition for isn't doing what you expect and/or you haven't

Help need in setting up delta imports

2010-09-21 Thread Papiya Das. Misra
We have our data in a datawarehouse where any changes are made by adding another row and marking the previous row as old my the means of a timestamp. So, for instance, the name of the table is Employee and has the following structure. Name|Address|eventtimestamp|endtimestamp John|NYC| 2010-09-2