Sure Is Not Right

Part of the AI Decisions section of Coddy's AI Prompts journey. Lesson 12 of 22.

The bars show how the AI split its weight, not how often it is right. Small models are often very sure, even when the text gives them nothing to go on.

A support router gets the message Hello, is anyone there?

billing   ░░░░░░░░░░░░░░░░░░░░   0%
shipping  ░░░░░░░░░░░░░░░░░░░░   0%
tech      ████████████████████ 100%

There is no request at all, yet one team gets almost everything.

So treat confidence as a hint. A low top bar is a useful warning. A high one is not a promise. Test your questions on real messages, including odd ones, before you trust them.

Try it yourself

This lesson doesn't include a code challenge.

Test yourself

This lesson includes a short quiz. Start the lesson to answer it and track your progress.

All lessons in AI Decisions

1Let the AI Decide

From Reply to Decision Describe Your Options Options That Don't Overlap Leave a Way Out Reading the Answer Recap: Let the AI Decide

4Decisions in an App

Several Questions at Once Let Code Do the Math Decide, Then Write Recap: Decisions in an App

2Two Answers

Name Both Sides One Fact per Question Guards Before Posting When Yes or No Fails Recap: Two Answers

5Final Challenges

Support Triage Review Moderator Lead Qualifier

3How Sure Is It?

Sure Is Not RightLevels on a Scale Lowest Level First Recap: How Sure Is It?