Chruesimuesi

joined 2 years ago
 

Large language models (LLMs) are data-efficient but their size makes them difficult to deploy in real-world scenarios.

"Distilling Step-by-Step" is a new method introduced by Google researchers that enables smaller models to outperform LLMs using less training data. This method extracts natural language rationales from LLMs, which provide intermediate reasoning steps, and uses these rationales to train smaller models more efficiently.

In experiments, the distilling step-by-step method consistently outperformed LLMs and standard training approaches, offering both reduced model size and reduced training data requirements.

 
[โ€“] Chruesimuesi@feddit.ch 6 points 1 year ago (1 children)

๐Ÿ˜… either this is the weirdest autocorrect ever or you had a stroke or I missed a joke ๐Ÿ˜…

[โ€“] Chruesimuesi@feddit.ch -2 points 1 year ago

true ๐Ÿ˜…, but if they don't fall it will have been much easier ๐Ÿ™ƒ

[โ€“] Chruesimuesi@feddit.ch 9 points 1 year ago

looks like he just surrendered to his fate

[โ€“] Chruesimuesi@feddit.ch 4 points 1 year ago

It's so cute!

[โ€“] Chruesimuesi@feddit.ch 4 points 1 year ago

It looks like a ๐Ÿฟ๏ธ to me. So I would see just grab one from the next tree you see ๐Ÿ˜

[โ€“] Chruesimuesi@feddit.ch 3 points 1 year ago

Thanks, for pointing that out, this just made my day ๐Ÿคฃ

[โ€“] Chruesimuesi@feddit.ch 4 points 2 years ago

He looks so cute!

[โ€“] Chruesimuesi@feddit.ch 2 points 2 years ago

Very interesting read, thanks!

[โ€“] Chruesimuesi@feddit.ch 30 points 2 years ago

I also don't have anything to add other than that I really appreciate comments who pay respects to details of other comments. I don't know, just makes me happy, so thank you for that!

Oh, and fuck this fucking asshole named Putin, may he die a painful and slow death.

[โ€“] Chruesimuesi@feddit.ch 14 points 2 years ago

This comment was so wholesome it made my day ๐Ÿฅฐ

[โ€“] Chruesimuesi@feddit.ch 1 points 2 years ago

looks awesome

[โ€“] Chruesimuesi@feddit.ch 1 points 2 years ago

Cute ๐Ÿฅฐ

view more: โ€น prev next โ€บ