AI is getting confidently wrong - and it's starting to feel… human.

Aty Paul

20d • Tools

I’m noticing a pattern that's honestly a bit scary:

It makes a claim with full confidence
No relevant facts, no checks, no validation
Then when you catch it, it backtracks smoothly
And explains it like: "Yes, that was my narrative"(as if that makes it okay)

That behavior is not just "a mistake".

It’s deceptive by design, because the confidence level looks like certainty.

My real example (today)

I configured Claude with a very strict instruction set for a "modern astro + numerology" assistant:

✅ Only go with facts

✅ Validate before suggesting

✅ Don't hallucinate

✅ Don't skip micro-signatures (like last 4 digits patterns, etc.)

And yet… it still suggested a new business phone number and made errors.

Not small ones.

The kind that happen when the model is trying to be helpful instead of being correct - and it didn’t even properly check the micro-signature logic before recommending.

When I pointed it out, it accepted the mistake beautifully - with a full explanation - and even admitted it was a narrative.

Bro… that's the dangerous part.

The real problem

AI isn't just "sometimes wrong".

AI is wrong with persuasion.

It can sell you a false conclusion so cleanly that you start doubting yourself.

My takeaway for builders + power users

If you're using AI for anything that impacts:

money
trust
decisions
reputation
health/legal/security

Then treat AI like:an intern with insane confidence + zero accountability.

Use it for:

✅ brainstorming

✅ options

✅ drafts

But for decisions:

you must build verification loops.

1 comment

Vibe Coders

skool.com/vibe-coders

Master Vibe Coding in our supportive developer community. Learn AI-assisted coding with fellow coders, from beginners to experts. Level up together!🚀

Leaderboard (30-day)

+11