Unit 1: What generative AI is for

What these systems are

34 min: video 10, reading 12, activity 12 page v0.1.0, video v0.1.0
Release candidate. The unit videos are added in the first release.

Video

Unit video

The narrated video for Unit 1, about 10 minutes, is published with the first release.

Learning purpose: Five classes of task sorted by where the reference lives, and why that -- not the topic -- decides what checking costs.

Accessible text alternative: the transcript linked below, and this page, which covers the same material.

Transcript of the Unit 1 video

The narration is spoken by synthetic voices made for this course, each shown on screen as a drawn robot. No person is speaking.

Watch what changes

Headed 'The class does not change the output. It changes the distance.', one box labelled the output stands alone, captioned: same output, the question is what you would check it against. Then the reference it would be checked against appears and moves, one task class at a time, each with its caption. Transformation: the reference is your own input, right beside it; the reference is already in your hand. Grounded answering: the source you supplied; a step away, the source you gave it. Generation to a specification: the specification you wrote; a little further, check it against what you asked for. Recall: a source you must find, furthest away; find a source, open it, read the right part. Judgement: no single reference to travel to; instead three separate things fan out from the output, its factual premises, the stated criteria and the trade-offs named, because there is no one answer to compare against but there are still things to check. Open diagram at full size (opens in a new tab)
Headed 'One task, four classes', a fixed question sits at the top: 'Does our coursework policy allow me to use an AI system to draft an essay plan?' Below it a box labelled the answer stays in place while a reference box moves. Asked with nothing attached, it is recall: the reference is the policy, which you must go and find, and it moves furthest away; to check it you must find the policy, the whole task you were trying to avoid; what checking costs: high, the check is a separate research task. Asked with the policy pasted in, it is grounded answering: the reference moves in to the clause the answer relies on, in the policy you pasted, a step away; find the clause and read it, a minute, not an afternoon; cost: low to moderate, read the source at the cited point. Asked for a table of every clause that mentions AI, it is transformation: the reference is the document you supplied, right beside the answer; every row is checkable against the document, look for a clause left out; cost: low, compare output against input. Asked whether it is a good policy, it is judgement: no reference appears, because no clause settles it; what comes back may be worth reading and is not a finding; cost: check the factual premises and assess the proposal against stated criteria. A row of four labels along the bottom lights up as each way of asking is reached, and a closing line says the difference between an afternoon of checking and a minute of it is the class you chose. Then the question changes to 'What is B8?'. Asked with nothing attached it is recall, and the reference, a source for B8, moves furthest away. Asked with the recurrence handed over, it is generation to a specification: the reference moves in to the recurrence, the specification you gave, while a dashed outline marks where the recall reference had been; cost: moderate, test the output against the specification. Open diagram at full size (opens in a new tab)

Reading time: about 12 minutes. Activity: about 12 minutes.

1. The question worth asking

"What is generative AI good at?" is a question that goes stale. Answer it with a list of products and the list is wrong within a year. Answer it with a list of tasks and you have described what the systems could do on the day you wrote it.

This unit answers a different question, one whose answer does not move:

For this task, where would you find evidence that the output is right?

That question has only a few possible answers, and they are the useful way to sort the work. Two tasks that look nothing alike — translating a paragraph and reformatting a table — sit in the same class, because in both cases you already hold the thing you would check against. Two tasks that look almost identical — "summarise this document" and "summarise the research on this topic" — sit in different classes, because in one case the document is in front of you and in the other you would have to go and find it.

The class identifies the checking job, and that sets a typical cost, not a fixed price. That is the whole of this unit.

2. Five classes, by where the reference lives

A reference is whatever you would compare the output against to find out whether it is right. On a route that includes them, Unit 6 has you build one by hand and Unit 8 has you use it. Here we are only asking where it comes from.

Class What you supply Where the reference lives What checking typically costs, when you can interpret the reference
Transformation The content itself In your hands already — it is your input Low: compare output against input
Grounded answering A source, plus a question about it In the source you supplied Low to moderate: read the source at the cited point
Generation to a specification A statement of what would count as correct In the specification you wrote Moderate: test the output against the specification
Recall A question only Somewhere external, and you must go and find it High: the check is a separate research task
Judgement A question with no single determinate answer No single right answer to compare against, but the premises and the criteria are checkable Check the factual premises; assess the proposal against stated criteria

Read the last column downwards. The column does not rank usefulness. It shows how much work is typically left after the output arrives, and that is the cost most people forget to count before they start. The order is typical, not fixed: a translation into a language you cannot read is expensive to check, a recalled date may take seconds, and a complex specification can be very costly.

Transformation

You supply the content and ask for it in a different form: translated, summarised, reformatted, restructured, rephrased for a different reader, turned from prose into a table.

The reference is your input. Every claim in the output should be traceable to something you handed over, so the check is a comparison you can make at your desk with no other material. The characteristic failure is not invention but omission: something in the input that did not survive the transformation. That is easy to miss precisely because the output reads as complete. And the check is cheap only if you know the input: for a long document you have not read, it costs about as much as reading the document.

Grounded answering

You supply a source — a document, a page, a specification — and ask a question about it. Some systems fetch the source themselves rather than being handed it [L3, sec. 2].

The reference is that source. The check is to read it at the point the answer relies on. Note what has and has not changed: attaching a source changes where you aim the check, not whether one is needed. Two questions remain live. Does the source say what the answer says it says? And is the source the right one to settle this question?

The class can also change without you. As of November 2026, one provider's documentation says its assistant may search the web without being asked [D4, opening note]. Then an answer can rest on pages it fetched, not on ones you chose. So record whether it searched, and open each link it attaches. A link claims two things: that the source exists, and that it supports the answer. Check both (Unit 9).

Generation to a specification

You state what would count as correct, and ask for something that meets it. A routine that satisfies a stated contract; a document in a required structure; a test that fails under a named condition.

The reference is the specification. This is the class the middle of this course lives in: Unit 7 asks for a routine, Unit 8 checks it against a reference you built, and Unit 10 is about what happens to the output when you make the specification more precise. The characteristic failure is that the output meets the specification you wrote rather than the one you meant.

Recall

You ask a question with no source attached and no specification: a date, an attribution, a requirement, a figure, who first proved something.

The reference is external and you do not have it. The system does not look anything up in a record of what is true (Unit 3 explains why). So its answer to a recall question comes with no evidence, and nothing marks which claims happen to be right. Checking means finding an authoritative source, which is a research task of its own. Unit 9 is about doing that properly.

This is the class where the gap between how much a claim costs to produce and how much it costs to check is widest. Eight referenced claims can be generated in seconds and take an afternoon to verify. The gap shows in print: references to works that do not exist have been found in published, peer-reviewed papers [L10, secs. 2.1, 4.1], in about one biomedical paper in 277 in one audit of early 2026 [L11]. Publication does not guarantee that a cited work exists, and checking that it does is the cheapest check there is.

Judgement

You ask which of two designs is better, whether an argument is convincing, whether a piece of writing is any good.

There is no reference in the sense the other classes have one, because there is no single answer to be right about. That does not mean there is nothing to check. A judgement rests on factual premises, and those can be wrong: an argument that one design is cheaper depends on a claim about cost. It can also be assessed against things you can state — the objectives, the constraints, the evidence offered, the trade-offs, professional standards, whose interests are served. What you cannot do is settle it by comparison, because there is nothing to compare it against. So the output is a proposal, and treating a proposal as a finding is the error. A proposal can be genuinely useful: a critique can name something you had missed. A confident tone here is a property of the text, not evidence about the question.

How this relates to Unit 3

Unit 3 sorts outputs a second way, which it calls triage. It asks a second question about the same task: not where the reference lives but what kind of evidence settles it — something you can execute and compare, something you must look up in a record, or neither because an error would be cheap and visible.

The two questions do not compete: usually the answer to the first gives you the answer to the second. A task with its reference in a specification is one you can check by executing and comparing. A task whose reference is a source, whether you supplied it or must go and find it, is one you check by reading the record. Judgement fits neither, and it is not low-risk drafting either: its premises are checked like any other claim, and its conclusion stays a proposal.

So this unit gives you the cheaper question — where would the evidence come from — and Unit 3 gives you the sharper one, which is what to do about it.

3. The move worth learning

The classes are not fixed properties of a task. Which one you are in is often your choice, and moving between them is the most useful thing in this unit.

A recall question becomes a grounded question the moment you supply the source. "What does the regulation require?" is recall, and expensive to check. "Here is the regulation — what does clause 4 require?" is grounded answering, and the check is reading clause 4.

The same move works forwards. A vague request becomes generation to a specification the moment you write down what would count as correct, which is exactly what Unit 10 asks you to do, and why it is the unit that changes how much the rest of your work costs.

There is a third move, and it applies inside any class: ask for the output to carry evidence you can check, not just an answer. "Quote the sentence of clause 4 you are relying on" instead of "what does clause 4 require?"; "give me the code and tests I can run" instead of "what is the result?". The check then shrinks to confirming that evidence against the source you hold, which is quicker than doing the work. Unit 0 called such evidence a certificate. What the system supplies can itself be fabricated, a quotation that is not there or a test that tests the wrong thing, so it is checked against the source, not taken on trust.

So the practical question is not "can it do this?" but "which class am I in, and can I move myself into a cheaper one before I start?"

4. One task, four classes

Take a single question: does our coursework policy allow me to use an AI system to draft an essay plan?

Asked with nothing attached, it is recall. The answer will name a policy, may quote it, and will read as settled. Nothing in it is evidence: to check it you must find the policy, which is the whole task you were trying to avoid.

Paste the policy in and ask the same question, and it is grounded answering. The check is now bounded, which means it has a clear limit: find the clause the answer relies on and read it. You may still find that the answer stretched a clause about brainstorming into one about drafting, but you will find it in a minute rather than an afternoon.

Ask instead for a table of every clause that mentions AI, one row per clause with its number and its exact wording, and you are in transformation. Every row is checkable against the document you supplied, and the failure to look for is a clause that quietly did not make it into the table.

Ask whether the policy is a good policy and you are in judgement. There is no clause that settles it. What comes back may be worth reading and is not a finding.

Four classes, one question, and the difference between an afternoon of checking and a minute of it is which one you chose. The same applies to the case this course is built on, a sequence called the Bernoulli numbers. "What is B8?" (the one with index 8) is recall, and "here is the recurrence, the rule that builds each number from the ones before; compute it" is generation to a specification. Unit 6 has you build the reference you will use to check the output.

5. What these systems are not for

Not a list of forbidden tasks. A question:

If this output is wrong, how would I find out, and what would that cost?

Three situations where the honest answer is bad.

No reference is obtainable at a price you can pay. Questions about the future, about private matters of fact, or at the edge of what is known. There is nothing to check against, so any output is a proposal however it is phrased.

You would not recognise a wrong answer. This is the sharpest one, and it is uncomfortable because it is about you rather than the system. In a subject you do not know well, the signs you usually trust (smooth writing, precise detail, a confident structure) appear in wrong answers as easily as in right ones. The move here is to change class: get a source you can check, or ask someone who can.

The doing is the point. Some work exists to develop your judgement, and an output that arrives without the work has skipped the thing the work was for. That is a statement about what the task is, not a rule about tools: a correct answer and having learned to produce one are different results, and Unit 10 shows the evidence. Your institution's rules on assessed work are separate, and they are theirs to state, not this course's.

Summary

Then answer cp01-where-the-reference-lives and cp01-changing-class at the foot of this page.

Timings: video 10 min, reading 12 min, activity 12 min.

Check yourself

This unit has 2 checkpoints, answered here. A wrong answer says which misunderstanding it matches. Nothing is uploaded.

Local progress is available in a supported browser.

Manage or delete this record

Prefer a terminal?

The same questions, from The verification lab and self-check:

python3 selfcheck.py run --unit 1

Your progress, and every checkpoint in the course