Hi Olga,

This is the wrong list to use; use "users"

~ David

On Tue, Sep 3, 2024 at 11:03 AM Olga Li1 <olga_...@epam.com.invalid> wrote:
>
> Hi Team,
>
> Thank you for your contribution.
>
> I recently joined a project which uses Solr for searching. It's a webapp, 
> where once a day reindexing happens - all necessary data from a database is 
> saved to the index in Solr 9.6.0 with a help of SolrTemplate.saveBeans() of 
> Solr client for Java. Before that event all previous data from the index is 
> deleted.
>
> But we are facing an issue - not all data can be found after reindexing.
>
> Let's say we have 14 relevant entities (or rows in the database), but each 
> time after reindexing the number of those entities in Solr can be different. 
> It can be 12, then after another reindexing it can be 8, then after another 
> reindexing the number can change again. Sometimes it returns all 14 entities 
> after a new reindexing. So, it is not consistent. According to logs, all is 
> well - no exceptions or errors thrown from Solr to the webapp during 
> reindexing.
>
> The strangest thing is that at the beginning Solr log level was INFO, but 
> when it was switched to DEBUG (to track what is going on, why not all 
> entities are searchable), it turned out, that after reindexing with DEBUG log 
> level all 14 entities was searchable. Even after a bunch of reindexing (with 
> DEBUG log level). When we switched it back to INFO, it again started to give 
> different results for search after reindexing...
>
> We tried to change some parameters in configuration to resolve the issue, for 
> example:
>
>   *   softCommit true/false
>   *   various values for UpdateHandler maxTime for both autoCommit and 
> autoSoftCommit
>   *   query.enableLazyFieldLoading true/false
>
> We checked updatedHandler.docsPending after reindexing and it is 0, so the 
> assumption is that all data is committed.
>
> On the webapp side we also tried different things like:
>
>   *   adding explicitly SolrTemplate.commit() for collection
>   *   using different timeout for CommitWithIn parameter in 
> SolrTemplate.saveBeans()
>
> But nothing affected the inconsistent results of searching except of 
> switching Solr log level to DEBUG...
>
> Did someone face something similar or does someone have any idea why is this 
> happening?
> And how we can resolve this issue and have all entities in our search after 
> each reindexing, without switching to DEBUG?
> (with DEBUG it takes more time to reindex all data)
>
> Thank you in advance!
> Olga

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
For additional commands, e-mail: dev-h...@solr.apache.org

Reply via email to