Little Katral · Lesson 2 · 8 min

When AI makes things up

In one sentence

AI can sound very sure while inventing an answer. Confidence is not truth.

Kavi

Kavi

Kids mentor

Shall we see how a machine learns — like training a peacock?

Read the idea, watch the picture, then try it with your hands.

Watch the idea

The concept

Fluent sentence

Sure voice

Three buckets

true · guess · made-up

Check

Is it in the world?

Confidence is not truth

A language model is built to continue a pattern. It would rather finish a sentence than stop and say I do not know. That is why it can name a book that was never written, in a calm, sure voice.

Three buckets

True: you can check it in the world. Guess: maybe, we need a source. Made-up: fluent and false — a hallucination. Good students put surprising facts into a bucket before they share them.

Your superpower is checking

Ask: is this in a book, a trusted site, or only in this chat? Try the idea yourself. Ask a grown-up. Speed is how rumours travel. Checking is how they stop.

Worked example

The floating opera

An AI says Chennai opened a floating opera in 2019. It sounds like news. It is not. A two-minute search, or a question to a parent, would catch it. The voice was sure. The world was not.

Picture to keep

True / Guess / Made-up

  1. 1Check a source
  2. 2Try it yourself
  3. 3Ask a grown-up