Re: Help with slow retrieving data

Hi Eric, Thank you for your response! On the old system, I changed to use docValues=true, and had better performance. But the searcher was not warmed before I measured it. Also the local disk was too small so I used an attached volume which turned out was a big cause of the slow retrieve. On t

Re: Help with slow retrieving data

Glad it’s working out for you. There are a couple of things here that bear a bit more investigation. Using SSDs shouldn’t materially affect the response if: 1> the searcher is warmed. Before trying your query, execute a few queries like “q="some search that hits a log of docs"&sort=myfield asc”

Re: Help with slow retrieving data

Hi Eric, Thank you very much for your response! I tried "Try this: 1> insure docValues=true for the field. You’ll have to re-index all your docs. " I tried the above approach as you recommended, the performance was getting better, reduced about 3 seconds. Then I tested on a new cloud server w

Re: Help with slow retrieving data

Hi Eric, Thank you very much for your response! "Try this: 1> insure docValues=true for the field. You’ll have to re-index all your docs." I tried use docValues and reduced about 3 seconds. Now I am going to "try 2> if that doesn’t make much of a difference, try adding useDocValuesAsStored for

Re: Help with slow retrieving data

If the fields you’re returning have to be pulled from the store=“true” parts of the index, then each value returned requires 1> a disk read 2> decompressing 16K minimum which is what Shawn was getting at. Try this: 1> insure docValues=true for the field. You’ll have to re-index all your docs. 2>

Re: Help with slow retrieving data

Hi Shawn,Thanks for your response. I have several Solr cores on the same Solr instance. The particular core with slow retrieve response has 6 gb data. Sorry for the confusion.I restart Solr and ran same query with rows=0 vs 1, QTime for both are OK, so I guess it is the retrieving slow? I also

Re: Help with slow retrieving data

On 3/24/2019 12:11 PM, Wendy2 wrote: Thank you very much for your response! Here is a screen shot. Is the CPU an issue? You said that your index is 6GB, but the process listing is saying that you have more than 30GB of index data being managed by Solr. There's a discrepancy somewhere. Thi

Re: Help with slow retrieving data

Hi Shawn, Thank you very much for your response! Here is a screen shot. Is the CPU an issue? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Help with slow retrieving data

On 3/24/2019 7:16 AM, Wendy2 wrote: Hi Solr users:I use Solr 7.3.1 and 150,000 documents and about 6GB in total. When I try to retrieve 2 ids (4 letter code, indexed and stored), it took 17s to retrieve 1.14M size data. I tried to increase RAM and cache, but Can you get the screenshot descr