General Discussion

highplainsdem

(61,197 posts)

21. If there was anything close to intelligence in Claude, the

Sun Feb 15, 2026, 06:14 PM

Feb 15

links I provided should have stopped it from going off on a delusional tangent.

I hope for your sake and everyone else's that AI coding won't replace code written by competent humans, because my best guess based on everything I've read is that a large fraction of AI-written code is incredibly insecure, there are going to be disastrous hacks and failures, and we'll need every good human coding expert to start to repair the mess of the world's software that AI is making.

I have no idea how we're going to undo the worldwide flood of misinformation and hallucinations from AI polluting our information ecosystem, including scientific and medical journals. That work certainly can't be done by clueless, hallucinating LLMs. In fact, Gemini and Claude's misinformation here has probably already been scraped for training data and will end up regurgitated someplace as "facts" about that story.

I really would like to see the genAI industry held responsible for all the damage their inherently flawed tools have done in just a few years.

Edit history

Please sign in to view edit histories.

Recommendations

0 members have recommended this reply (displayed in chronological order):

38 replies

= new reply since forum marked as read

Highlight:

You've probably heard that AI chatbots can completely fabricate quotes. It happened yesterday in a DU thread. [View all] highplainsdem Feb 13 OP

Thx to you & Goonch SheltieLover Feb 13 #1

Lol for fun I asked an AI the reason for the discrepancy and gave it the passage from your post AZJonnie Feb 13 #2

Not sure what you mean. It quoted one of my replies in that Science Fiction thread, or it quoted highplainsdem Feb 13 #4

I mean it literally sourced from this very thread AZJonnie Feb 13 #7

Claude is clueless. There is an actual story. I posted links about it in the earlier thread I linked to. There highplainsdem Feb 13 #9

It's not surprising that it got confused, this entire discussion is extremely circular AZJonnie Feb 13 #13

I would've expected any bot to at least follow the links in both threads, which would have shown that highplainsdem Feb 13 #15

Claude would have seen this bit, in Goonch's follow-up, which said this: AZJonnie Feb 13 #17

Interesting seeing you try to defend Claude's inane answer, when this thread links to the older thread highplainsdem Feb 15 #19

I guess I am, given you don't know what the actual prompt was, yet are arbitrarily coming up with a strawman AZJonnie Feb 15 #20

If there was anything close to intelligence in Claude, the highplainsdem Feb 15 #21

Why must you insist it's a delusional tangent AZJonnie Feb 15 #22

No, the problem using genAI is with genAI and its inherent flaws. Anyone who's ever used genAI should highplainsdem Feb 16 #27

And, The Chatbot Is Still Wrong ProfessorGAC Feb 13 #3

+1. It's patent nonsense dalton99a Feb 13 #5

I don't know about that one, Professor :) AZJonnie Feb 13 #8

I'm Going To Say No ProfessorGAC Feb 13 #11

Obviously I know I don't know nearly as much on this topic as you do, so I generally defer, Sir :) AZJonnie Feb 13 #14

Pretty Much ProfessorGAC Feb 13 #16

Can you name a movie in which one person occupied two places at the same time? Orrex Feb 16 #29

BTTF Is A Prime Example, Yes ProfessorGAC Feb 16 #33

Right, but that's not the same Marty in two places at once Orrex Feb 16 #34

Not Getting You ProfessorGAC Feb 16 #35

I think we're differing on what qualifies as the "same" person Orrex Feb 16 #37

Oh wait. I just caught your bit about "lack of matter available" Orrex Feb 16 #38

These tools don't just fabricate fiction. They fabricate citations in law and science pieces. RockRaven Feb 13 #6

Yes. I mentioned that in the earlier thread I linked to. I've posted lots of warnings here over the last few years highplainsdem Feb 13 #10

+1. AI is essentially a smooth-talking buzzword-spewing bullshitter with an unlimited capacity for plagiarism dalton99a Feb 13 #12

Exactly. highplainsdem Feb 15 #18

When ChatGPT became popular, people said AI systems really need to provide sources. Renew Deal Feb 15 #24

Good catch Renew Deal Feb 15 #23

Thanks - but I wouldn't have caught it if I hadn't already looked at a number of websites about the story so highplainsdem Feb 16 #25

Yikes. So how do we combat this? It's only going to get worse. Scrivener7 Feb 16 #26

Yeah, it's getting scary. I posted something I didn't know was AI. I took it down as soon as mucifer Feb 16 #28

It's really bad in the political commentary video space Renew Deal Feb 16 #31

I suspect AI systems will be like fish farms. cachukis Feb 16 #30

I miss the old Google. Hell, I miss the old Alta Vista. haele Feb 16 #32

Anyone can make up a quote. GoCubsGo Feb 16 #36