Re: [DISCUSS] Support a cross-rate Filter based on process and logger granularity.

2025-02-01 Thread Ralph Goers
Why does the BurstFilter not address your concern? Ralph > On Jan 27, 2025, at 5:59 PM, Yuepeng Pan wrote: > > Thanks Volkan for the quick response. > >> Could you share an example of how your >> filter is used in a configuration file, please? > Yes, glad to do it. > > The specific examples a

Re: [DISCUSS] Support a cross-rate Filter based on process and logger granularity.

2025-01-28 Thread Roc Marshal
] Support a cross-rate Filter based on process and logger granularity. | Thanks so much for the elaborate example Yuepeng. We receive hardly any feedback for the burst filter, which makes me think it is not much used. Your custom filter is a further specialization of the burst filter. I was curious if

Re: Re: Re: Re:Re: [DISCUSS] Support a cross-rate Filter based on process and logger granularity.

2025-01-28 Thread Volkan Yazıcı
Thanks so much for the elaborate example Yuepeng. We receive hardly any feedback for the burst filter, which makes me think it is not much used. Your custom filter is a further specialization of the burst filter. I was curious if one can provide the rate limiter dimensions in the configuration of

Re:Re: Re: Re:Re: [DISCUSS] Support a cross-rate Filter based on process and logger granularity.

2025-01-27 Thread Yuepeng Pan
Thanks Volkan for the quick response. > Could you share an example of how your > filter is used in a configuration file, please? Yes, glad to do it. The specific examples are as follows. log4j.properties file. # config lines placeholders. . # Config for the ProcessLoggerCrossFilter, The

Re: Re: Re:Re: [DISCUSS] Support a cross-rate Filter based on process and logger granularity.

2025-01-27 Thread Volkan Yazıcı
It is great to hear that you have already done the biggest part of the work: implementing such a filter! Could you share an example of how your filter is used in a configuration file, please? On Mon, Jan 27, 2025 at 2:07 PM Yuepeng Pan wrote: > Thanks Volkan for the codes and comments. > > > > >

Re:Re: Re:Re: [DISCUSS] Support a cross-rate Filter based on process and logger granularity.

2025-01-27 Thread Yuepeng Pan
Thanks Volkan for the codes and comments. > You can either implement this in a Java/Kotlin/Scala/etc. class > > or a Script > Filter . > Would you mind expla

Re: Re:Re: [DISCUSS] Support a cross-rate Filter based on process and logger granularity.

2025-01-27 Thread Volkan Yazıcı
Hello Yuepeng, Thanks so much for reaching out to us. Your use case is indeed an interesting one and it is good to learn such Log4j deployments in the wild. Consider the following Log4j filter pseudo code: WeakHashMap rateLimiterByKey = activeLoggerContext.getObject("rateLimiters"); Key key = Ke

Re: Re:Re: [DISCUSS] Support a cross-rate Filter based on process and logger granularity.

2025-01-26 Thread Yuepeng Pan
Sorry, I’m not sure why the formatting of the email appears to be somewhat disorganized. Therefore, I have reorganized part of the disordered content and added it to doc[1]. Thank you. [1] https://docs.google.com/document/d/1kVa0V_RrPpT5aa5rfxEaH-QxyXTplQr65xUMZMmDoFA/edit?tab=t.0#heading=h.x

Re:Re: [DISCUSS] Support a cross-rate Filter based on process and logger granularity.

2025-01-26 Thread Yuepeng Pan
Thanks Jay Kataria for the comments. > 1. Can you give an example of the scenarios where this can be useful. > Adding rate limiters to logs seems like an interesting idea, but just > wondering what is the business motivation. > 3. I am interested in what you talked about - dimensions and

Re: [DISCUSS] Support a cross-rate Filter based on process and logger granularity.

2025-01-26 Thread Jay Kataria
Hi Yuepeng, This seems interesting there are a few comments that I have based on the doc and the feature request: 1. Can you give an example of the scenarios where this can be useful. Adding rate limiters to logs seems like an interesting idea, but just wondering what is the business motivation.

[DISCUSS] Support a cross-rate Filter based on process and logger granularity.

2025-01-26 Thread Yuepeng Pan
Hi, community, In some business scenarios, users expect the log rate limit thresholds to be influenced by different dimensions and allow thresholds to be shared across these dimensions or metrics. This enables the system to flexibly output as many logs as possible within the safe constra