Zbigniew Jędrzejewski-Szmek wrote:
> On Mon, Mar 25, 2024 at 04:50:28PM -0400, Neal Gompa wrote:
>> Keep in mind we also want to make the compose process faster too, I
>> don't know if it's worth it to spend 20x more time compressing
>> repodata when we keep trying to get back hours and minutes in the
>> compose time.
>
> I wanted to write that the compression times are small enough for this not
> not matter, but indeed, at the very highest levels, they do become
> noticable.
5 minutes? On a process that is run once every 24 hours? While at the same
time saving download time for all Fedora users? I fail to see the issue.
> $ time xz -k -v
> 8e09489af54bbd4ab85470d449f0b0afa4a26fc3eb97c1665c741427bbc8f060-
filelists.xml
> 8e09489af54bbd4ab85470d449f0b0afa4a26fc3eb97c1665c741427bbc8f060-
filelists.xml
> (1/1)
> 100 % 44.3 MiB / 862.9 MiB = 0.051 33 MiB/s 0:26
> xz -k -v 196.88s user 0.63s system 749% cpu 26.337 total
> (This is multithreaded, and gives a compression ratio of 5.14%.)
That is not the highest compression level of xz though. Try xz -9, it should
be better than zstd. It will take longer to compress, but should actually be
FASTER (!) to decompress, which is what really matters.
Kevin Kofler
--
_______________________________________________
devel mailing list -- [email protected]
To unsubscribe send an email to [email protected]
Fedora Code of Conduct:
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives:
https://lists.fedoraproject.org/archives/list/[email protected]
Do not reply to spam, report it:
https://pagure.io/fedora-infrastructure/new_issue
