this post was submitted on 15 May 2025
74 points (83.6% liked)

Technology

70031 readers
4328 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
L4s@hackingne.ws
74
Algorithm based on LLMs doubles lossless data compression rates (techxplore.com)
submitted 19 hours ago by NoSpotOfGround@lemmy.world to c/technology@lemmy.world
34 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] barsoap@lemm.ee 3 points 17 hours ago (1 children)

I would guess it’s pretty hard to reconstruct data with a different LLM

I think the idea is to have compressor and decompressor use the exact same neural network. Looks like arithmetic coding with a learned function.

But yes model size is probably going to be an issue.

[–] Harlehatschi@lemmy.ml 2 points 15 hours ago

Ye but that would limit the use cases to very few. Most of the time you compress data to either transfer it to a different system or to store it for some time, in both cases you wouldn't want to be limited to the exact same LLM. Which leaves us with almost no use case.

I mean... cool research... kinda.... but pretty useless.