Thank you Jochen, a very useful tool! 2016-11-04 17:39 GMT+01:00 Jochen Schalanda <[email protected]>:
> Hi Sander, > > check out https://www.graylog.org/tools/sizing-estimator for an > estimation of hardware requirements. > > Cheers, > Jochen > > On Thursday, 6 October 2016 09:43:40 UTC+2, Sander wrote: >> >> How can I determine the correct sizing (memory, cpu) and java settings >> for my graylog (v2.1.1-1) nodes? >> >> Some details about the 5 nodes (Ubuntu 14.04 VMs), each node has: >> >> - 4G memory >> - 4 cpus (2700Mhz) >> - Java settings: >> >> GRAYLOG_SERVER_JAVA_OPTS="-Xms1g -Xmx2g -Djava.net.preferIPV4stack=true >> >> The Elasticsearch cluster beneath it runs on physical hardware and has no >> problems taking in all the data, it is also very stable. >> >> On average in total the cluster receives 5000 msg/s but on peaks this can >> go to 13000 msg/s. >> There are 85 similar active streams were stream does two regexp for >> incoming messages, for example: >> >> - *source* must match regular expression >> *^UGA-|^UGDHCP **ap-name* must match regular expression *^UGA-* >> >> >> When the input reaches above 1000 msg/s I get Zabbix high CPU alerts for >> the graylog nodes. Also I had to get this error for nodes regarding Garbage >> Collection: >> >> There are Graylog nodes on which the garbage collector runs too long. >> Garbage collection runs should be as short as possible. Please check >> whether those nodes are healthy. (Node: >> *3e0e271a-3a0b-4b48-8b82-ac8c6e714b09*, GC duration: *1113 ms*, GC >> threshold: *1000 ms*) >> >> There are tons of things I can adjust, for example: >> increase memory, cpus, java heap size, et cetera. I'd like to have some >> guidance on what to adjust and the reasoning behind it. >> >> Thank you! >> >> Sander >> > -- > You received this message because you are subscribed to a topic in the > Google Groups "Graylog Users" group. > To unsubscribe from this topic, visit https://groups.google.com/d/ > topic/graylog2/ZfLInZnaMAY/unsubscribe. > To unsubscribe from this group and all its topics, send an email to > [email protected]. > To view this discussion on the web visit https://groups.google.com/d/ > msgid/graylog2/7e622809-374e-48f6-a4b0-8c3feccfaf1b%40googlegroups.com > <https://groups.google.com/d/msgid/graylog2/7e622809-374e-48f6-a4b0-8c3feccfaf1b%40googlegroups.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "Graylog Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/graylog2/CA%2BzkcCVcpce2qJuwZympRfHMD3_CNxvQn_98o9JtdvFMcWgZhA%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
