In linux the os will cache files in ram for quick reading.
You can force the into ram by doing cat filename >/dev/null
I do this with all my index files after a reboot and see better performance
times on queries.
Optimal ram is enough ram for all the indexes plus jvm plus 20 percent...
Generall
All my queries from production environments, from real customers. I build
query player that runs queries in the same time intervals like in PRODUCTION
(all customers' queries with time intervals between them are saved in
splunk). So all queries are distinct.
--
Sent from: http://lucene.472066.n3
To pile on a bit:
Your *.fdt files contain “stored=true” data. By and large I ignore them for
this discussion. Say I execute a query with “rows=10”. The fdt (and fdx) files
are only accessed for the 10 docs returned so they have little impact on query
time. Or rather, they have a reasonably con
I'm not that proficient with Solr.. I used it, but I'd yet have to fully
dive into it, but this topic really interests me.
In those 8 hour tests, does ALL information get accessed, or just partial?
That could be a reason as to why you don't see any difference, that the
test in that time period onl
On 4/15/2019 7:25 AM, SOLR4189 wrote:
I have a collection with many shards. Each shard is in separate SOLR node
(VM) has 40Gb index size, 4 CPU and SSD.
When I run performance checking with 50GB RAM (10Gb for JVM and 40Gb for
index) per node and 25GB RAM (10Gb for JVM and 15Gb for index), I get
Hi,
The recommendation to have RAM enough to place your entire index into memory is
sort of worst case scenario (maybe better called the best case scenario) where
your index is optimal and is fully used all the time. OS will load pages that
are used and those that might be used to memory, so eve
No, I don't load index to RAM, but I run 8 hours queries, so OS must load
necessary files (segments) to RAM during my tests. So in the case where I
set 25GB for RAM, not all files will be loaded to RAM and I thought I'll see
degradation in queries times, but I didn't
--
Sent from: http://lucene.
Do you load the index onto a RAM disk? I was under the impression that the
JVM had everything contained that had to do with SOLR (I might be wrong),
if thats the case and you are not loading the Index onto a ram disk then
you won't see any difference.
in either scenario, I don't think you would see
