I am not sure how best to handle this. We use the data import handle to re-sync all our data on a daily basis, takes 1-2 hours depending on system load. It is set up to commit at the end, so, the old index remains until it’s done, and, we lose no access while the import is happening.
But, we now want to update certain fields in the index, but still regen daily. So, it would seem we might need to autocommit, and, soft commit potentially. When we enabled those, during the index, the data disappeared since it kept soft committing during the import process, I see no way to avoid soft commits during the import. But soft commits would appear to be needed for the (non import) updates to the index. I realize the import could happen while an update is done, but we can actually avoid those. So, that is not an issue (one or two might go through, but, we will redo those updates once the index is done, that part is all handled. So, what is the best way to handle “real time” updates (10-15 minutes is fine to see the updates in a searcher), yet, also allow dataimport handler to do a full clear and regen without losing products (what we index) during the import, we don’t want searchers not seeing the data! Have not seen any techniques for this. Steve
