: I don't have an index to check. Both sources come in huge text files, one of : them daily, the other irregular. One has the ID, the other has a different ID : that must be mapped first to the ID of the first source. So there is no easy : way of saying: "Give me the record to this ID from the other set of records". : It is all burried in plain text files.
assuming these are simple delimited files, something like the unix "join" command can do this for you ... then your indexing code can just process on file linerally. (if they aren't simple delimited files, you can preprocess them to strip out the excess markup and make them simple deliminted files ... depending on what these look like, you might not even need much custom indexing code at all .. "join" and the CSV update request handler might solve all your needs) -Hoss