Just to clarify: I picked "4 cores" out of thin air just as an example to work through, same as I picked 15 second scrape interval and 150ms per scrape.
On Saturday 13 January 2024 at 09:34:21 UTC Brian Candler wrote: > One reason is you may already have eight 4-core servers lying around. > > If it's a VM then of course you can just scale up to the largest instance > size available, before you need to go to multiple instnaces. > > On Saturday 13 January 2024 at 00:20:10 UTC Alexander Wilke wrote: > >> Hello, >> sorry to hijack this thread a little bit but Brian talks about "4 CPU >> cores" and Ben says "scale horizontally". >> >> Just for interest - why not just use 8, 16, or 32 CPU cores? Is Go >> limited at a specific CPU amount or is there a disadvantage to have to many >> cores? >> I think if someone is monitoring so many devices this is enterprise >> network and servers/VMs with more CPUs are no problem. >> >> Ben Kochie schrieb am Freitag, 12. Januar 2024 um 21:50:57 UTC+1: >> >>> Those sound like reasonable amounts for those exporters. >>> >>> I've heard of people hitting thousands of SNMP devices from the >>> snmp_exporter. >>> >>> Since the exporters are in Go, they scale well. But if it's not enough, >>> the advantage of their design means they can be deployed horizontally. You >>> could run several exporters in parallel and use a simple http load balancer >>> like Envoy or HAProxy. >>> >>> On Fri, Jan 12, 2024, 02:32 'Elliott Balsley' via Prometheus Users < >>> [email protected]> wrote: >>> >>>> I'm curious if anyone has experimented to find out how many targets can >>>> reasonably be scraped by a single instance of blackbox and snmp exporters. >>>> >>>> I know Prometheus itself can handle tens of thousands of targets, but I'm >>>> wondering at what point it becomes necessary to split up the scraping. >>>> I'll find out for myself soon enough, I just wanted to check and see if >>>> anyone has tested this already. I'm thinking I would have around 10K >>>> targets for blackbox, and 1K for snmp. >>>> >>>> I'm using http_sd_config with a 15 second refresh interval, so that's >>>> another potential bottleneck I'll have to test. >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "Prometheus Users" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> To view this discussion on the web visit >>>> https://groups.google.com/d/msgid/prometheus-users/CALajkdh7EhHAVN5nJNYqJjKvcH_rfT1L7ZaPvPR4L-xjypKSbg%40mail.gmail.com >>>> >>>> <https://groups.google.com/d/msgid/prometheus-users/CALajkdh7EhHAVN5nJNYqJjKvcH_rfT1L7ZaPvPR4L-xjypKSbg%40mail.gmail.com?utm_medium=email&utm_source=footer> >>>> . >>>> >>> -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/f3f82b80-74c3-4816-aae0-24e39d33c36bn%40googlegroups.com.
