Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

General Discussion

Showing Original Post only (View all)

highplainsdem

(61,197 posts)
Fri Feb 13, 2026, 01:58 PM Feb 13

You've probably heard that AI chatbots can completely fabricate quotes. It happened yesterday in a DU thread. [View all]

The thread is in the Science Fiction forum, at https://www.democraticunderground.com/12002305 . I hope you'll read all of it. But see in particular the OP and replies 8, 11, 12, 15, 17, 19, 20 and 21.

DUer raccoon was trying to remember a partucular time travel story. There were a number of replies. One, from Goonch, had both a title and author, and a quote that was apparently the ending of the story:

Elias punched the coordinates for 1924 into the brass console, desperate to see his grandmother one last time. He pulled the lever, expecting the smell of ozone and the sight of her garden; instead, he was met with an absolute, crushing silence .

When the flash faded, there was no garden. There was no air. Through the reinforced glass of his pod, Elias stared at the cold, indifferent glow of distant nebulae [3]. He hadn't accounted for galactic drift—while he had traveled back a century in time, the Earth had continued its relentless orbit around the Sun, and the Sun had continued its 500,000-mile-per-hour sprint around the Milky Way.

He had reached the right time, but the Earth was billions of miles away . He was a ghost in the vacuum, a man who had forgotten that in the universe, you can never go back to the same place twice.


It looked like a pretty convincing answer. If I'd just run across it, I doubt I'd've thought twice about its accuracy.

But I knew it couldn't be right because I'd posted a reply hours earlier, mentioning the same story title and author, and linking to pages I'd found referring to it. I didn't have a quote from the story, and I've never read it.

But I had run across and linked to pages summarizing the story, about a girl named Marla (not a man named Elias) who went forward - not backward - in time, but also ended up in outer space.

So I asked about the source of the quotation above.

Turned out it had been fabricated by a chatbot. I've read lots of articles and social media posts about chatbots fabricating quotes, but it was the first time I'd seen this happen in a thread I was posting in. I thought it would be a perfect example to post here to show why chatbot responses should never be trusted without careful checking.

I want to thank Goonch for posting the explanation, which included the chatbot admitting the quote was apparently fabricated. Goonch also posted another helpful message with what the chatbot, Google's, had said later about chatbot dangers and the need to verify information, and it's an interesting read.
38 replies = new reply since forum marked as read
Highlight: NoneDon't highlight anything 5 newestHighlight 5 most recent replies
Thx to you & Goonch SheltieLover Feb 13 #1
Lol for fun I asked an AI the reason for the discrepancy and gave it the passage from your post AZJonnie Feb 13 #2
Not sure what you mean. It quoted one of my replies in that Science Fiction thread, or it quoted highplainsdem Feb 13 #4
I mean it literally sourced from this very thread AZJonnie Feb 13 #7
Claude is clueless. There is an actual story. I posted links about it in the earlier thread I linked to. There highplainsdem Feb 13 #9
It's not surprising that it got confused, this entire discussion is extremely circular AZJonnie Feb 13 #13
I would've expected any bot to at least follow the links in both threads, which would have shown that highplainsdem Feb 13 #15
Claude would have seen this bit, in Goonch's follow-up, which said this: AZJonnie Feb 13 #17
Interesting seeing you try to defend Claude's inane answer, when this thread links to the older thread highplainsdem Feb 15 #19
I guess I am, given you don't know what the actual prompt was, yet are arbitrarily coming up with a strawman AZJonnie Feb 15 #20
If there was anything close to intelligence in Claude, the highplainsdem Feb 15 #21
Why must you insist it's a delusional tangent AZJonnie Feb 15 #22
No, the problem using genAI is with genAI and its inherent flaws. Anyone who's ever used genAI should highplainsdem Feb 16 #27
And, The Chatbot Is Still Wrong ProfessorGAC Feb 13 #3
+1. It's patent nonsense dalton99a Feb 13 #5
I don't know about that one, Professor :) AZJonnie Feb 13 #8
I'm Going To Say No ProfessorGAC Feb 13 #11
Obviously I know I don't know nearly as much on this topic as you do, so I generally defer, Sir :) AZJonnie Feb 13 #14
Pretty Much ProfessorGAC Feb 13 #16
Can you name a movie in which one person occupied two places at the same time? Orrex Feb 16 #29
BTTF Is A Prime Example, Yes ProfessorGAC Feb 16 #33
Right, but that's not the same Marty in two places at once Orrex Feb 16 #34
Not Getting You ProfessorGAC Feb 16 #35
I think we're differing on what qualifies as the "same" person Orrex Feb 16 #37
Oh wait. I just caught your bit about "lack of matter available" Orrex Feb 16 #38
These tools don't just fabricate fiction. They fabricate citations in law and science pieces. RockRaven Feb 13 #6
Yes. I mentioned that in the earlier thread I linked to. I've posted lots of warnings here over the last few years highplainsdem Feb 13 #10
+1. AI is essentially a smooth-talking buzzword-spewing bullshitter with an unlimited capacity for plagiarism dalton99a Feb 13 #12
Exactly. highplainsdem Feb 15 #18
When ChatGPT became popular, people said AI systems really need to provide sources. Renew Deal Feb 15 #24
Good catch Renew Deal Feb 15 #23
Thanks - but I wouldn't have caught it if I hadn't already looked at a number of websites about the story so highplainsdem Feb 16 #25
Yikes. So how do we combat this? It's only going to get worse. Scrivener7 Feb 16 #26
Yeah, it's getting scary. I posted something I didn't know was AI. I took it down as soon as mucifer Feb 16 #28
It's really bad in the political commentary video space Renew Deal Feb 16 #31
I suspect AI systems will be like fish farms. cachukis Feb 16 #30
I miss the old Google. Hell, I miss the old Alta Vista. haele Feb 16 #32
Anyone can make up a quote. GoCubsGo Feb 16 #36
Latest Discussions»General Discussion»You've probably heard tha...