Hello, I'm not a pro in Solr nor in Java, so please be patient. We have an ecommerce application with 150 millions docs and a size of 140GB in Solr. We are using the following setup:
Solr "MASTER": - DELL R530, 1x XEON E5-1650 - 64GB ECC RAM - 4x 480GB SSD as RAID10 on hardware RAID (but no BBU so no writeback) Solr "SLAVE": - DELL R730, 2x XEON E5-2600 - 128GB ECC RAM - 4x 480GB SSD as RAID10 on hardware RAID Both systems are running with Debian Jessie, OpenJDK 8 and Solr 6.2.1. Modification to config, that are done: - heap memory 32GB on MASTER and 64GB on slave - disabled "AddSchemaFieldsUpdateProcessorFactory" - set "ClassicIndexSchemaFactory" - enabled "useFilterForSortedQuery" - and of course: enabled replication - autoCommit is 15 seconds and openSearcher is false - rest in on stock We have an ETL process which updates product catalog. This produces massive inserts on MASTER, but there are no reads. Often there are thousands and hundreds of thousands of records per minute that where inserted. But sometimes I get a an OOM error, the only log entry I can find is: 2016-10-09T16:17:34.440+0200: 63872,249: [Full GC (Allocation Failure) 2016-10-09T16:17:34.440+0200: 63872,249: [CMS: 16387099K->16387087K(16777216K), 4,2227778 secs] 17782619K->17782606K(30758272K), [Metaspace: 36452K->36452K(38912K)], 4,2229287 secs] [Times: user=4,22 sys=0,01, real=4,22 secs] As I'm a bit lost with this all: is there anybody who can help me with best config for massive inserts on MASTER and massive reads on SLAVE. Is there a common approach? What details should I provide furthermore? Or is the simplest solution to raise heap on MASTER from 32GB of the available 64GB to a higher value? ______________________________________________________ Gesendet mit Maills.de - mehr als nur Freemail www.maills.de
