Artificial Intelligence

1584 readers

37 users here now

Welcome to the AI Community!

Let's explore AI passionately, foster innovation, and learn together. Follow these guidelines for a vibrant and respectful community:

Be kind and respectful.
Share high-quality contributions.
Stay on-topic.
Enhance accessibility.
Verify information.
Encourage meaningful discussions.

You can access the AI Wiki at the following link: AI Wiki

Let's create a thriving AI community together!

founded 2 years ago

MODERATORS

ikidd@lemmy.world

Over-training large language models may make them harder to fine-tune (techxplore.com)

submitted 3 weeks ago by cm0002@lemmy.world to c/ai_@lemmy.world

3 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] cx40@programming.dev 1 points 3 weeks ago

We've seen similar effects in the context of reinforcement learning (see the "primacy bias" works of Evgenii Nikishin). It makes sense that it would also apply to LLMs, and any other ML model.