Prometheus needs a minimum of about 4KiB per "active series". Retention policy doesn't affect the memory usage very much.
If you have 10,000 metrics per server and 300 servers, that's 3 million series. 3 million * 4KiB = 11.4GiB of memory. Of course, you will also need some page cache and such. Usually 2x is more than good enough, but it depends on your query load. So 20-30GiB of memory should be enough. But of course, it highly depends on how many metrics per server you have. On Tue, Feb 20, 2024 at 6:24 PM Puneet Singh <[email protected]> wrote: > HI All, > I am planning to store 3 years of data from 300 server in a single > prometheus server. The data will primarily consist of default exporter > metrics and the server has 500G memory and 80 cores. > > I'd like to ensure that my solution is optimal in terms of resource > utilization, query performance and scalability. Is there a general > recommendation about the amount of resources i should be having on this > setup? > > Regards, > Puneet > > > > -- > You received this message because you are subscribed to the Google Groups > "Prometheus Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/prometheus-users/2735babe-1905-45e0-90e7-2316c2f35f8bn%40googlegroups.com > <https://groups.google.com/d/msgid/prometheus-users/2735babe-1905-45e0-90e7-2316c2f35f8bn%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CABbyFmpuGXpt4njgT%2B2AJen-DZiS5R%2BdNX76tbe6bCYN%2BU43-A%40mail.gmail.com.
