Can you graph these two metrics, over the time range you are talking about?
prometheus_tsdb_head_series rate(prometheus_tsdb_head_samples_appended_total[1h]) On Thu, Jan 18, 2024 at 10:55 AM akbill <[email protected]> wrote: > Hi all, > > Our customer has been using the Prometheus for years. The configurations > have not been changed since day 1 and recently the file system disk usage > is over 90% and keeps increasing(not always right away but gradually). Is > there a reason why new chunk size increases over time? > > Although we have many application Metrics used to monitor our network > elements and performances, they are never changed or added. We are just > getting the same data KPIs over time. > > Files in July (Month; Day; Time; DirectoryName; Size in MB) > [image: image] > <https://private-user-images.githubusercontent.com/157004483/297689569-953a158d-6680-4dc2-b112-2c614ec0d565.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDU1NzE4ODUsIm5iZiI6MTcwNTU3MTU4NSwicGF0aCI6Ii8xNTcwMDQ0ODMvMjk3Njg5NTY5LTk1M2ExNThkLTY2ODAtNGRjMi1iMTEyLTJjNjE0ZWMwZDU2NS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMTE4JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDExOFQwOTUzMDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT00OTgwMWU0YTNlYmIzYmVkOTFlMGFmZjA2ZjBhZjlmZDUxOGFjMjEyODAwZDEyOGEyMDk1MGE1ZTU3MzJmZThjJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.afV_zaB3pIRC0478LqFBsui3Dqj4x0uKtCHOg90NEeY> > > [image: image] > <https://private-user-images.githubusercontent.com/157004483/297690280-87766e1d-82a1-4cc5-a4dd-6471a0623832.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDU1NzE4ODUsIm5iZiI6MTcwNTU3MTU4NSwicGF0aCI6Ii8xNTcwMDQ0ODMvMjk3NjkwMjgwLTg3NzY2ZTFkLTgyYTEtNGNjNS1hNGRkLTY0NzFhMDYyMzgzMi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMTE4JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDExOFQwOTUzMDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT02NmMxNzg5NjBkMDMyYTg3ZDQ4ZTVhM2Q3YWQ2NzMzYzgxMDkyMWFhMTEwYmEwNDA2MzExNDk5YWExNDRiNGYyJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.9Mpv2oWqBVaaHSmGjD1YWBcKPpLzow1QHVmmpfWMTZk> > > Files in Dec. (Month; Day; Time; DirectoryName; Size in MB) > [image: image] > <https://private-user-images.githubusercontent.com/157004483/297684089-18fc0aa1-6b04-41c5-b745-0726e0cbc47d.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDU1NzE4ODUsIm5iZiI6MTcwNTU3MTU4NSwicGF0aCI6Ii8xNTcwMDQ0ODMvMjk3Njg0MDg5LTE4ZmMwYWExLTZiMDQtNDFjNS1iNzQ1LTA3MjZlMGNiYzQ3ZC5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMTE4JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDExOFQwOTUzMDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT0xOGVlMTU5ODA1OWRjMGJmYjlmNzA2NTc5MDIyYmRjNGY4YTZiZDVkMmVjNzQ0MDM2MDNkOWRkNDc4MTk4MjdjJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.JNuPlHhzgjRSp5BcuGH3B1mnnddiCttVaWK9IDCv_4s> > > [image: image] > <https://private-user-images.githubusercontent.com/157004483/297689446-a592f2d4-bff1-442f-bfff-7f658a676f21.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDU1NzE4ODUsIm5iZiI6MTcwNTU3MTU4NSwicGF0aCI6Ii8xNTcwMDQ0ODMvMjk3Njg5NDQ2LWE1OTJmMmQ0LWJmZjEtNDQyZi1iZmZmLTdmNjU4YTY3NmYyMS5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMTE4JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDExOFQwOTUzMDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1hM2JhOWEzZWM5OGU0YzdjNDFmMGZlZTY5ZjE1Y2M5MzIzNWU3MGQ5MjlmMTExZjMzMDliYzlmZDQ3NzE1NWRhJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.DSCfPM5JFC91VDEihUlh4Fp65zKRWdyDgsJ54nv4stQ> > > [image: image] > <https://private-user-images.githubusercontent.com/157004483/297691964-17665c18-cdfc-4db2-af58-8f8bdb0efa64.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MDU1NzE4ODUsIm5iZiI6MTcwNTU3MTU4NSwicGF0aCI6Ii8xNTcwMDQ0ODMvMjk3NjkxOTY0LTE3NjY1YzE4LWNkZmMtNGRiMi1hZjU4LThmOGJkYjBlZmE2NC5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwMTE4JTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDExOFQwOTUzMDVaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT01YTlhZjk1NzYwY2ZkMTUyODA5M2M1NWI3M2RmYjYzNjZmOTUxYmJlZjIzYjkwNzY3MDEwOWNmNjE0ZTE4OGVhJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.NKwAQXMHIeRyAaAQMi1-QzGsYVsZwpkgnkZU-4ii0HQ> > > So, is there a reason why chunk size increases over time? Any way we can > sustain the file size w/o changing the retention time? > > -- > You received this message because you are subscribed to the Google Groups > "Prometheus Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/prometheus-users/feb914d1-fbd4-43c9-b062-d094d3278de8n%40googlegroups.com > <https://groups.google.com/d/msgid/prometheus-users/feb914d1-fbd4-43c9-b062-d094d3278de8n%40googlegroups.com?utm_medium=email&utm_source=footer> > . > -- You received this message because you are subscribed to the Google Groups "Prometheus Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/prometheus-users/CABbyFmqvCqY8yW7uGr9_KjMpE9-osDvksDhA_fYDP7EzKH6JzQ%40mail.gmail.com.
