Hi Toke, I have tried to set all the docValues in my schema.xml to false and do the indexing again. There isn't any difference with the indexing speed as compared to when we have enabled the docValues.
Seems like the cause of the regression might be somewhere else? Regards, Edwin On Wed, 3 Apr 2019 at 15:45, Toke Eskildsen <t...@kb.dk> wrote: > On Wed, 2019-04-03 at 15:24 +0800, Zheng Lin Edwin Yeo wrote: > > Yes, I am using DocValues for most of my fields. > > So that's a culprit. Thank you. > > > Currently we can't share the test data yet as some of the records are > > sensitive. Do you have any data from CSV file that you can test? > > Not really. I asked because it was a relatively easy way to do testing > (replicate your indexing flow with both Solr 7 & 8 as end-points, > attach JVisualVM to the Solrs and compare the profiles). > > > I'll put on my to-do to create a test or two with the scenario > "indexing from CSV with many DocValues fields". I'll try and generate > some test data and see if I can reproduce with them. If this is to be a > JIRA, that's needed anyway. Can't promise when I'll get to it, sorry. > > If this does turn out to be the cause of your performance regression, > the fix (if possible) will be for a later Solr version. Currently it is > not possible to tweak the docValues indexing parameters outside of code > changes. > > > Do note that we're still operating on guesses here. The cause for your > regression might easily be elsewhere. > > - Toke Eskildsen, Royal Danish Library > > >
