RE: Re: Low untunable default FastWriter output buffer - possible reason for slow single threaded data receiving from Solr on 1Gigabit+ networks while scroll, search etc

2023-02-24 Thread Fikavec F
jetty.xml used in default solr configuration, file downloaded by http and nginx maybe faster because in /etc/nginx/sites-available/default - location / { aio threads; sendfile on; }I'm reproduce this in Ubuntu on virtual machines in home PC:# 0 set /etc/sysctl.conf settings from https://darksideclo

Re: Low untunable default FastWriter output buffer - possible reason for slow single threaded data receiving from Solr on 1Gigabit+ networks while scroll, search etc

2023-02-24 Thread Mikhail Khludnev
Hello, Can you rebuild the jar with a bigger buffer and benchmark to confirm the hypothesis? On Fri, Feb 24, 2023 at 6:34 PM Fikavec F wrote: > I'm installed Solr 8.11.1 (SOLR_JAVA_MEM="-Xms31g -Xmx31g") into ram disk > in hi-performance server with 10-Gigabit network adapters. Jumbo Frames > (

Re: Low untunable default FastWriter output buffer - possible reason for slow single threaded data receiving from Solr on 1Gigabit+ networks while scroll, search etc

2023-02-24 Thread Kevin Risden
> > But data recieving speed on simple solr scroll with query *:* on 250Gb > collection (10 shards) by id never speeds up 200 Megabits without jetty > tuning and 350 Megabits with jetty tuning (10GB files from tuned solr jetty > (like /mnt/ramdisk/solr/server/solr-webapp/webapp/testfile.bin) downlo

Re: Low untunable default FastWriter output buffer - possible reason for slow single threaded data receiving from Solr on 1Gigabit+ networks while scroll, search etc

2023-02-24 Thread Ishan Chattopadhyaya
Nice catch! Sounds reasonable to me that it should be configurable. Would you like to open a JIRA to submit a patch for this (or would you rather someone else pick it up)? On Fri, Feb 24, 2023 at 9:04 PM Fikavec F wrote: > I'm installed Solr 8.11.1 (SOLR_JAVA_MEM="-Xms31g -Xmx31g") into ram dis

Low untunable default FastWriter output buffer - possible reason for slow single threaded data receiving from Solr on 1Gigabit+ networks while scroll, search etc

2023-02-24 Thread Fikavec F
I'm installed Solr 8.11.1 (SOLR_JAVA_MEM="-Xms31g -Xmx31g") into ram disk in hi-performance server with 10-Gigabit network adapters. Jumbo Frames (MTU) enabled and sets to 9000, linux core tcp buffers tunned for 10-Gigabit network (/etc/sysctl.conf):net.ipv4.tcp_rmem = 8192 87380 134217728net.ipv4.

Renovate dependency update PRs enabled

2023-02-24 Thread Jan Høydahl
Hi all devs, We are testing dependabot-style PRs for dependency updates. So be prepared to see new PRs opened by a bot user called "solrbot" (which I'm maintaining). Initially there will be quite a few of these, and after that a once-a-week batch of new PRs. See https://github.com/apache/solr/b