Such a mirroring can be done with vmagent
<https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/app/vmagent/README.md>
- just configure multiple `-remoteWrite.url` targets with distinct
`-remoteWrite.urlRelabelConfig` configs for obfuscation and filtering. The
final system will look like the following:
-> remote target1 (prod)
Prometheus -> vmagent -> filtering -> remote target2 (staging)
-> obfuscation -> remote target3 (dev)
On Mon, Apr 20, 2020 at 9:24 PM Bartłomiej Płotka <[email protected]>
wrote:
> Hi!
>
> This question is not strictly related to Prometheus, but rather to
> server-side Remote Write APIs.
> We are looking at how to have more realistic staging environments for
> servers like that. In order to achieve so, we want to "mirror" / "fork"
> portion of production remote write traffic to other clusters APIs (e.g
> staging or dev environment).
>
> As part of this mirroring, data has to be potentially obfuscated to avoid
> leaking of sensitive data, but also without totally changing the
> characteristic of data (e.g same number labels, labels values/names with
> the same amount of characters, etc).
>
> In the future, we could add some more advanced features if needed (e.g
> load balancing).
>
> Wonder if anyone in the community had been working on something like that
> already and has something to share/is already shared?
>
> ProxySQL <https://github.com/sysown/proxysql/wiki/Mirroring> is something
> like that but in the SQL world. Would be awesome to have the same for
> remote write (and Query API as well I guess, but let's think about it in a
> separate thread) (:
> <https://github.com/thanos-io/thanos/issues/2480>
> Some discussion on Thanos project:
> https://github.com/thanos-io/thanos/issues/2480
>
> Please help if you know or have worked on something like this (: Would be
> a nice community Project if nothing exists!
>
> Kind Regards,
> Bartek
>
> --
> You received this message because you are subscribed to the Google Groups
> "Prometheus Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/prometheus-users/CAMssQwYa3kW8UMPtJ2PuW8%3Dd8kWB-sz1E99D20ODn28KZTb%2BNQ%40mail.gmail.com
> <https://groups.google.com/d/msgid/prometheus-users/CAMssQwYa3kW8UMPtJ2PuW8%3Dd8kWB-sz1E99D20ODn28KZTb%2BNQ%40mail.gmail.com?utm_medium=email&utm_source=footer>
> .
>
--
Best Regards,
Aliaksandr
--
You received this message because you are subscribed to the Google Groups
"Prometheus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/prometheus-users/CAPbKnmBEvDbThrr1cx9FgPhZRVrJqeS2%3DsgEOZguoMWH6FS7BA%40mail.gmail.com.
