Hi Emiliano, On Fri, 07 Feb 2025 at 21:17:01 +0100, Emiliano Vavassori wrote: > I'm experiencing issues when bulk downloading the .deb binary tarballs > both from download.documentfoundation.org and > downloadarchive.documentfoundation.org with a python script (this one [1]).
Note that downloadarchive.tdf doesn't redirect to the mirror network (except for versions also found download.tdf). > What happens is that some of the downloaded tarballs (not all, > I'd say a minority) are really just tarballs and are not compressed, > while the others are gzipped (as expected). > > I talked with cloph briefly at FOSDEM; he provided an explanation for > the status quo and identified the root cause of the issue: some of the > web servers used by MirrorBrain are misconfigured and do not have the > right MIME types set up. My bad checking MIME types is actually part of the routine to add new mirrors but it appears I marked application/x-tar as valid for .tar.gz. > I would like to provide information to fix the issue: can someone > elaborate on how I can collect the needed information? You could modify your script to show the effective URL (the one fetched last after following all redirections) and report the hostnames for which there is a MIME mismatch so we can forward the issue to the respective mirror admins. But I've just performed a quick scan on all enabled mirrors and found a single one one with “Content-Type: application/x-tar” for a .tar.gz request URL. Will report to the mirror admin. Cheers, -- Guilhem. -- To unsubscribe e-mail to: [email protected] Problems? https://www.libreoffice.org/get-help/mailing-lists/how-to-unsubscribe/ Posting guidelines + more: https://wiki.documentfoundation.org/Netiquette List archive: https://listarchives.libreoffice.org/global/website/ Privacy Policy: https://www.documentfoundation.org/privacy
