Kevin Karhan :verified:<p><span class="h-card" translate="no"><a href="https://toot.cat/@Gankra" class="u-url mention" rel="nofollow noopener noreferrer" target="_blank">@<span>Gankra</span></a></span> depends...</p><p><a href="https://en.wikipedia.org/wiki/XZ_Utils" rel="nofollow noopener noreferrer" target="_blank">xz</a> and <a href="https://en.wikipedia.org/wiki/Lempel%E2%80%93Ziv%E2%80%93Markov_chain_algorithm#LZMA2_format" rel="nofollow noopener noreferrer" target="_blank">lzma2</a> are pretty good when it comes to compression ratio, and with modern hardware they are sufficiently fast.</p><ul><li>But there's a reason a lot of stuff, like online games, use <a href="https://en.wikipedia.org/wiki/Bzip2#Efficiency" rel="nofollow noopener noreferrer" target="_blank">bz2</a> instead, since that allows speeds in excess of 600 Mbit/s even on low-end systems with minimal load, and in my experience allows compression of backups like <a href="https://infosec.space/tags/PostgeSQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>PostgeSQL</span></a>'s <code>cluster_backup</code> at basically I/O speeds with <10% CPU load even at very old servers...</li></ul><p>So there's that... </p><p>AFAICT xz is basically at the limit of lossless data compression - anything more efficient I know are extremely lossy narrowband codecs like <a href="https://infosec.space/tags/Codec2" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Codec2</span></a> <a href="https://en.wikipedia.org/wiki/Codec_2" rel="nofollow noopener noreferrer" target="_blank">@450 bit/s</a> <a href="https://dspini.com/vocoders/lowrate/twelp-lowrate/twelp300" rel="nofollow noopener noreferrer" target="_blank">TWELP @ 300 bit/s</a> and <a href="https://infosec.space/tags/STANAG4591" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>STANAG4591</span></a> aka. <a href="https://en.wikipedia.org/wiki/Mixed-excitation_linear_prediction#STANAG-4591_(NATO)" rel="nofollow noopener noreferrer" target="_blank">MELPe</a> that sound like one has their ears filled with water and the person talking has a gag ball in their mouth and screams.</p>