Hello all,

Over the past year we've got increasingly ridiculous traffic on our Linode S3
buckets, and it's becoming unbearable. We have one bucket for our test VM
images and one for our test logs and artifacts. Unfortunately, we only get a
summary of the traffic, not a breakdown by bucket, so we can't tell which one
is causing the excess traffic. But we strongly suspect AI scrapers, which cause
traffic problems on a lot of web sites these days 😢

As a first measure, I made our test VM images private, so that you now need a
token to download them. Many of our regular contributors already have one, but
if you don't yet, please contact me by email or Matrix (pitti in
https://chat.fedoraproject.org/#/room/#cockpit:fedoraproject.org), and I can
set up a token for you.

The test logs/artifacts are much smaller, but also much more tightly linked all
over the place from GitHub, bug trackers, etc., so I'll restrict them as well
by placing an Anubis[1] proxy in front of them.

Then we can wait for a month and see if the traffic goes down. Then we
can gradually open up public access to the test images again to see which type
causes the most traffic.

You can follow the status on https://issues.redhat.com/browse/COCKPIT-1288

Sorry for the inconvenience, and thanks for your understanding!

Martin

[1] https://anubis.techaro.lol/

--
Red Hat GmbH <https://www.redhat.com/de/global/dach>
Registered seat: Werner von Siemens Ring 12, D-85630 Grasbrunn, Germany
Commercial register: Amtsgericht Muenchen/Munich, HRB 153243,
Managing Directors: Ryan Barnhart, Charles Cachera, Avril Crosse O'Flaherty

-- 
_______________________________________________
cockpit-devel mailing list -- [email protected]
To unsubscribe send an email to [email protected]
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedorahosted.org/archives/list/[email protected]
Do not reply to spam, report it: 
https://pagure.io/fedora-infrastructure/new_issue

Reply via email to