Hi-
We recrawl the same places and update blindly without checking if a document
is already in the index. We have a use case where we would like to delete
documents (porn) and have them stay deleted. To implement this use case now,
we would need to check the existence of the document and check for a
'deleted' flag. Or, we would maintain a separate database of deleted
documents that we check against.
A more efficient way to do this would be to have a 'do not delete' flag in
the document. Delete failures are currently ignored and they would continue
to be ignored.
Is this a worthwhile addition to 1.3 or 1.4?
Thanks for your time,
Lance
