this post was submitted on 13 Mar 2025
681 points (98.7% liked)

Technology

66353 readers
4553 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
681
AI search engines give incorrect answers at an alarming 60% rate, study says (arstechnica.com)
submitted 1 day ago by Redditsux@lemmy.world to c/technology@lemmy.world
51 comments fedilink hide all child comments
 

cross-posted from: https://infosec.pub/post/24994013

CJR study shows AI search services misinform users and ignore publisher exclusion requests.

you are viewing a single comment's thread
view the rest of the comments
[–] Patch@feddit.uk 3 points 15 hours ago (2 children)

The AI models can be hilariously bad even on their own terms.

Yesterday I asked Gemini for a population figure (because I was too lazy to look it up myself). First I asked it:

what is the combined population of place 1, place 2 and place 3

It answered:

Unfortunately, providing an absolutely precise, up-to-the-minute combined population figure is difficult. Population numbers are constantly changing.

To find these figures, I would recommend checking the Office for National Statistics (ONS) website. They provide detailed population statistics for local authorities in England.

On a whim, I asked it again as:

combined population of place 1, place 2 and place 3

And then it gave me the answer sweet as a nut.

Apparently I was being too polite with it, I guess?

[–] LinyosT@sopuli.xyz 2 points 8 hours ago* (last edited 8 hours ago)

I slapped a picture of a chart into Gemini because I didn’t know what the type of chart was called but I wanted to mention it in a Uni report. I was too lazy to go looking at chart types and thought that would be quicker.

I just asked it “What kind of chart is this” and it ignored that and started analysing the chart instead and started stating what the chart was about and giving insights into the chart. Didn’t tell me what kind of chart it was even though that was the only thing I asked.

Bear in mind that I deliberately cropped out any context to avoid it trying to do that, just in case, so all I got from it was pure hallucinations. It was just making pure shit up that I didn’t ask for.

I switched to the reasoning model and asked again, then it gave me the info I wanted.

[–] lka1988@lemmy.dbzer0.com 2 points 12 hours ago

Gotta let it take the W on that first answer, honestly.