You will read, watch and scroll past thousands of claims this week. Some deserve your trust straight away. Some deserve a much closer look. Knowing which is which is a skill — and it can be learned.
"A shark swims past Hobart's waterfront every 20 minutes."
Neither answer is wrong yet. You don't have enough information to decide. Who said it? A marine biologist with tagging data, or a stranger in a comments section? Was it measured, or guessed?
That gap — between hearing a claim and deciding what to do with it — is exactly where critical thinking lives. This lesson is about what to do in that gap.
The word "critical" trips people up. It doesn't mean being negative, rude, or refusing to believe anything. It comes from the Greek kritikos — able to judge.
The trust budget. You can't fact-check everything — you'd never get through a single day. So spend your effort where it matters. Turn up the scepticism when a claim is surprising, when someone gains from you believing it, when it makes you angry or excited, or when you're about to act on it — share it, buy something, or put it in an assignment.
Eight situations. For each one, decide whether it's reasonable to simply accept the information, or whether it needs a closer look first. Careful — the answer is not "question" every time. Over-suspicion is its own problem.
This website has been online since 1998. It has photographs, a range map, a scientific name (Octopus paxarbolis), a conservation campaign, and pages of detailed natural history. In a famous research study, most students who were shown it believed it — even after being told to check whether it was reliable.
It is completely made up. There is no such animal. Read the site with the four checks from section 04 in mind and it falls apart quickly:
AI can now write essays, make images, clone voices and produce video. None of that is automatically bad — but you need to know when you're looking at something a machine produced, because a machine has no idea whether what it made is true.
The Tasmanian devil is a carnivorous marsupial native to Tasmania. It is important to note that these fascinating creatures play a vital role in the ecosystem. Studies have shown that devil populations declined by exactly 87.3% between 1996 and 2008. The main threat to the species is a transmissible cancer known as Devil Facial Tumour Disease. Devils are commonly seen across mainland Australia, particularly in suburban Melbourne backyards. While some argue conservation efforts have been successful, others believe more work is needed, and the truth likely lies somewhere in between. In conclusion, the Tasmanian devil remains an important and iconic part of Australia's unique wildlife heritage.
Important: these tells are getting rarer every year. A clean image is not proof a human made it. Treat the tells as a bonus, not your main defence — the checks in the next section work no matter how good the image looks.
You ask a chatbot for sources on Tasmanian devil conservation. It replies:
It looks perfect. Real-sounding authors, a real journal, a plausible title, page numbers. There's just one problem: the paper may not exist. Language models generate text that looks like a citation, in the same way they generate text that looks like a sentence. They are not looking anything up unless they're specifically searching.
Rule for your assignments: if an AI gives you a source, you don't have a source. You have a lead. Search for it yourself. If you can't find it in the library catalogue or on the journal's own site, it doesn't go in your bibliography.
Four questions, in this order. They take about ninety seconds and they catch most of what's wrong on the internet. Try them on the claim below — click each check to run it.
Look closely at the enlarged version. The masthead letters are inconsistent, the body text dissolves into nonsense words, the bar chart's numbers don't match the headline's claim, and "The Morning Gazette" is not a newspaper that exists. This page was generated in seconds.
No author, no findable original, a claim that doesn't hold together, and obvious motive. This isn't "probably false" — it's unsupported, which means it shouldn't be shared or used in your work until someone produces the actual study.
Two habits that do most of the work:
Click through to the source. A screenshot, headline or caption is not the story. Open the actual article, then look at what it actually says — headlines regularly overstate their own research.
Read across, not down. Instead of scrolling further down a suspicious page trying to judge it, open a new tab and search for what other people say about that source. Professional fact-checkers do this — they leave the page almost immediately. A site can tell you anything about itself; it can't control what everyone else says about it.
A free game built by climate scientist John Cook. A cartoon uncle throws dodgy arguments at you and you have to name the trick he's using — cherry-picking, false experts, impossible expectations, conspiracy thinking. It takes about fifteen minutes and it will change how you read comment sections.
Bias means a consistent lean in one direction. People have it. So does AI — but not because a model has opinions. It doesn't. AI bias comes from something much more ordinary: the examples it was trained on.
How a model learns. An AI model isn't programmed with rules about the world. It's shown an enormous pile of examples — text, images, code scraped mostly from the internet — and it learns the patterns in that pile. That's it. So whatever is common in the pile becomes the model's idea of "normal", and whatever is rare or missing barely exists to it.
This matters because the pile is not a fair sample of humanity. It over-represents English, wealthier countries, people who post online, and the last twenty years. The model can't tell you any of this, because a model has no way of knowing what it was never shown.
The same image model was given two prompts and asked for twenty pictures of each. Nothing else about the prompts was different. Study both grids, then answer the question underneath.
Your turn. Compare the two grids. What patterns do you notice in who the model imagined — their apparent age, gender, background, clothing, posture and setting? What does each grid suggest about the kind of person who does that job? Discuss it before you reveal the notes.
Nobody wrote a rule saying "cleaners are women". The model learned from millions of captioned photos scraped from the web — stock photography, advertising, news images — and in that pile, these jobs were pictured this way. The model reproduced the pattern it was given.
Why it matters: in Australia, both jobs are done by people of every gender, age and background. When a model generates thousands of images a day for advertising, textbooks and news illustrations, a lopsided pattern stops being a quirk in a dataset and starts shaping what "normal" looks like to everyone who sees it.
You're training an image model to draw "a wedding". Drag the slider to change where the training photos come from, then watch what the model decides a wedding looks like.
A model trained mostly on the picture at left will treat the picture at right as unusual — or fail to produce it at all. Neither ceremony is the "real" version of a wedding. But a model has no way of knowing that, because it never saw the world. It only ever saw the photographs it was given.
Languages, cultures and communities that post less online appear less in the data — so the model handles them worse without ever saying so.
Training data has an end date. A model can confidently describe a world that has already changed — old prices, old records, old leaders.
If the data mostly shows one kind of person as a "CEO" or a "nurse", the model reproduces that pattern — and repeats it to millions of users.
The honest summary. AI bias usually isn't someone being unfair on purpose. It's a mirror problem: the model reflects the pile it was trained on, including the parts nobody meant to include. Which is why you stay in the loop. Ask yourself: whose perspective is missing from this answer? Would this be different if the training data had come from somewhere else?
Eight marked questions and three written responses. Everything on this page is assessed. When you're finished, export it as a PDF and submit it.
Think of one thing you've seen online in the last week that you accepted without checking. What was it, and what would you check now? Name at least one of the four checks from section 04 and explain how you would use it.
This street photograph was generated by AI. Click it to enlarge, then list every mistake you can find. Say where in the image each one is, so someone else could find it too. Aim for at least four.
Play a round of Cranky Uncle if you haven't already. What is one thing you learnt from it? Name a technique the game taught you to spot, and describe an example of it — either from the game or from something you've seen online.
| Question | Answer given | Mark |
|---|
Screenshot this. It's the whole lesson on one card.
You can explain what critical thinking means and name a reason to question a claim.
You apply the four checks to a real claim and explain why an AI source needs verifying.
You can explain how training data produces bias, and identify what's missing from an AI answer.