Unit 9 activity: Alles Lüge! First- and second-order reasoning

For learners checking their own work after attempting the activity, and for instructors marking or discussing it.

This key does not restate the answer to cp09-sort-the-claims, and it does not paraphrase it either. Sorting claims by what supports them is the learning objective, and the checkpoint gives targeted diagnostics if you go astray. Checkpoint answers live in course/lab/checkpoints.py and nowhere else, by design. The six statements discussed below are deliberately disjoint from the three the checkpoint uses: no statement here is the checkpoint's, and no statement here is a restatement of one of the checkpoint's.

Scope. This unit teaches established, published material only. There is no research framework in it to mark, and answers that reach for one have gone outside the unit.

Citation shorthand. Bracket labels resolve to course/references.md: [C1] von Foerster, [C2] Mead 1968, [C3] Maturana and Varela, [C4] the Macy Conferences, [C5] Bateson, [C6] Gödel 1931, [C7] Tarski 1936; [G1] to [G4] support the register; [Q1] and [Q2] are the songs. Fuller treatment of this unit's argument: course/second-order.md.

The assessable part is the reasoning, not the label. A learner who places a statement differently but names a real citation, a real tradition, or a real missing step has done the exercise. A learner who lands on the intended bucket and writes "it sounds like a theorem" has not.

Task 1 — the six statements

A. Incompleteness

Proved theorem. Gödel 1931 [C6]. Any consistent formal system strong enough to express arithmetic contains true statements it cannot prove.

The tell is that it has a date, a name, and a place in every logic textbook. A learner who marks it "established research programme" because it is unfamiliar has confused unfamiliar with unsettled, and that confusion is worth naming out loud — it is the mirror image of the error waiting in statement B.

What would unsettle it: an error in the proof, or a change to the hypotheses. Note that the statement is conditional — consistent, sufficiently strong — and almost every misuse of it in the wild starts by dropping one of those conditions.

B. Mind as a property of a system of relationships

Established research programme. Bateson [C5], and the wider tradition [C1], [C3]. Published, developed over decades, widely built on, and still an account rather than a theorem.

The tell is the phrase "is better described as". The statement is not reporting a result; it is proposing that a particular way of describing something is the right one. Descriptions of that shape are argued for, adopted, extended, and sometimes displaced. They are not looked up and settled.

Say plainly in discussion that this category is not a polite way of saying "wrong" or "weak". It is a statement about what kind of support the claim has.

What would settle it either way: sustained independent development that makes the account do work nobody could do without it, or a demonstration that it fails on the cases it was built for. Note that "better described as" invites the question better for what purpose, and a learner who asks it has found the seam.

C. The Macy Conferences

None of the three buckets fits, and that is the point. This is a historical claim, and historical claims are sorted as established, contested, or unsourced — the instrument the optional Unit 7 works through, and named in the activity itself so a learner who skipped Unit 7 can still reach for it.

Sorted that way it is established — course/references.md [C4] records the series, the dates, the funder and the chair.

The best answers do two things: notice that the bucket scheme does not fit, and reach for the other instrument instead. A learner who does only the first has still done something worth marking, because recognising that you are holding the wrong instrument is most of the skill. Do not treat having done Unit 7 as a requirement here.

Watch for a learner who marks it "established research programme" because cybernetics is a research programme. The statement is not about the programme; it is about ten meetings, their dates, their funder and their chair. Those are facts with a record, not a way of framing problems.

D. "Gödel shows a language model cannot verify its own output"

Overclaim, and the most interesting one on the list, because both halves of it are true and the join is not.

Gödel 1931 [C6] is a proved theorem. It is a result about formal systems of a specific kind. A language model is not that object. Carrying the result across is an argument, requiring premises about what corresponds to what, and no such argument appears in the sentence.

The failure here is not falsity. The conclusion might even be defensible on other grounds. The failure is a theorem being used as a licence for a claim about a different kind of system, with the transfer step unstated. That move is common, it reads extremely well, and it is precisely the thing this module has been training you to catch.

Accept a learner who says "the theorem is proved, the transfer is not, and the sentence hides the seam" over one who writes "overclaim" with nothing behind it.

E. "An AI system's report about itself carries no information at all"

Overclaim. This is the second overclaim from the student page wearing practical clothing, pushed one step further.

Two separate faults. First, it does not follow: that an observer is inside the system says nothing about whether its reports correlate with anything. Second, it is operationally empty — if a self-report carries nothing, you have no way to decide which outputs deserve a check, which in practice means you check nothing, which is exactly where blanket trust also lands you.

What refutes it from your own work: Unit 5. Generated output that was correct, generated output that was wrong, and a check that told you which was which. You were not applying a presumption; you were comparing against a record.

Note for discussion: describe behaviour, not intent. "The system reported X" is the right form. "The system believed X" is not, and a learner who slips into the second has drifted from the module's language rules.

F. Scope of Gödel and Tarski

Proved theorem, in the sense that matters here: this is a statement about what [C6] and [C7] actually say, and you can check it by reading the theorems' hypotheses. Accept "established" with that reasoning.

The generous alternative reading is that F is a methodological remark rather than a result. A learner who says so, and then says the remark is checkable against the theorem statements, has understood it better than the bucket alone shows.

What must not happen is a learner marking F an overclaim. F is the caution, not the leap. If someone has read the caution as itself an overreach, they have inverted the section they most needed.

Task 2 — a claim of your own

Step 2, the index

Typical results, and none of them is a failure:

• Observer — almost always implicit. The pack has one author and it feels redundant to name them. It is not redundant to a reader who has three packs on their desk.
• Context — usually stated, because Unit 8's template forces it. This is the one the module worked hardest on, and it shows.
• Record — often half-stated: "the checker reported no divergence" names the check but not where the output now lives, or whether it can be produced again.

A good answer marks at least one of the three as assumed. A learner who marks all three as stated has almost certainly read their own sentence generously, which is the one reading a sceptical reader will not give it.

Step 3, the clauses

A well-built pack usually contains a record-supported result: there is a record, the reader can consult or reproduce it, and the sentence states the range, convention, and properties actually checked. Do not call this a "proved theorem" or an "established research programme". Reusing Task 1's instrument on this kind of claim is the same error statement C is there to provoke.

The instructive answer is when a learner finds an overclaim in their own writing. The common form is a scope slip: a check that ran over a specific range, under a specific convention, reported as though it established correctness in general. That is not dishonesty and it does not need punishing. It is the same structure as the Note G table — a narrow supported claim and a broad readable one, and the broad one is easier to write.

Reasoned judgement is usually present beside the record: which discrepancy mattered, which convention was the sensible default, and what counted as resolved. It should be attributed to the learner by name, not dressed up as something more.

Step 4, the honest sentence

The intended discovery is that the record-backed part of a defence is usually smaller than it felt while writing it, and that the remainder is not worthless — it is judgement, which is exactly the thing the module says must be attributable to a person. A learner who concludes "so my defence is weak" has misread the exercise. The point is to be able to say which part is which.

Common ways this activity goes wrong

Sorting by how the sentence sounds. Statements B, D and F are all written in the register of established results. That is not a trick; it is what most writing about this material looks like, including writing produced by a language model. The sorting has to be done on provenance, not on prose.

Treating "established research programme" as a downgrade. It is not. A programme can be decades old, published, influential and worth taking seriously while still not being a theorem. The unit says so explicitly and the checkpoint tests it.

Reading the unit as a case against AI systems. If a learner leaves saying "so it cannot be trusted", the second overclaim has not been closed properly. The materials establish no base rate for correct output. They teach learners to match the strength and independence of a check to the claim and its risk.

Collapsing the whole thing into "everything is relative". The index is the opposite of that. An indexed claim is more checkable than an unindexed one, because it says what would have to be compared with what. The Bernoulli convention is the proof: naming it turns an unresolvable disagreement into a resolved one.

For instructors

• This unit is the final core unit, and the earlier ones must still stand without it. Nothing in Units 0 to 8 may be rewritten to depend on it for a checkpoint, an activity, or a definition; Units 2 and 5 to 8 carry a short pointer only. Being last in the sequence is not a licence to make it load-bearing for anything that comes before it.
• The unit raises the issue; it does not settle it. The scope is fixed to established, published material. If the delivery starts extending the argument into new territory — however interesting — it has left the unit.
• Section 4's second half is the unit. "What they do not say" is the teaching point, not a caveat attached to one. If a session runs short, cut a mapping-table row, never that subsection.
• The most valuable discussion prompt is statement D. It generalises: a real theorem, a real system, and an unstated transfer between them is the shape of a large fraction of confident writing about AI and formal limits.
• Register discipline. Every claim on an atmospheric slide keeps its citation or its uncertainty label. If a slide review produces a frame that is only atmosphere, cut the frame rather than the citation.
• Pending work this unit depends on, none of which belongs in this directory: full entries and resolution of any open markers for [C1] to [C7]; the open markers already recorded against [G1] to [G4] and [Q1] to [Q2]; and confirmation of the rights position on the two song quotations, which must be recorded in docs/instructor-review-log.md before release.
• Glossary. The terms this unit now needs are first-order cybernetics, second-order cybernetics, observer, and Macy Conferences. Terms belonging to the framework the unit no longer teaches should not be maintained on its account.
• If the status of any claim in course/second-order.md changes, that file is updated first and this unit follows. This unit holds no independent position that could drift out of step with it.