Most of the course argues about scale by arguing about which actor to watch. Is the danger the model (will it scheme?), the lab (will it cut corners?), or the state (will it race?)? These are the three default units of analysis, and nearly every reading picks one. But there is a fourth unit, chosen by a small, ideologically scattered cluster of readings that otherwise have nothing in common — and once you see it, it reorganises the whole corpus. The unit is the civilisation: the distributed, multi-agent, institution-and-infrastructure system that no single model, lab or government contains. This is the optimistic essay, and its argument is that the civilisation frame is the course's most underrated idea precisely because the readings that hold it don't know they're holding it together.
§01The Toner→Chollet move, stretched
In my Unit 2 essay I traced a move from Helen Toner to François Chollet: Toner asks us to stop arguing about end-states and attend to dynamism — the plural, revisable, feedback-rich system — and Chollet relocates intelligence from the brain to something larger. Chollet's On the Measure of Intelligence makes a claim that sounds technical but is really about units: intelligence is not a property of an isolated mind, it is civilisation-level. A lone genius raised by wolves invents nothing; the capability we call "human intelligence" is mostly the accumulated, externalised, socially-transmitted scaffold the individual is plugged into. The intelligence explosion can't run away inside one box because most of the relevant intelligence was never in the box.
This sits on a deep academic tradition the course gestures at without naming: Clark and Chalmers' The Extended Mind (1998) and Otto's notebook, where cognition provably extends past the skull; Hutchins' Cognition in the Wild (1995), where a Navy ship's navigation is performed by no single sailor but by the whole sociotechnical assembly; Henrich's The Secret of Our Success, where human capability is cultural transmission, not raw brainpower; Hayek's The Use of Knowledge in Society (1945), where the relevant intelligence is distributed across a price system no planner holds in one head. Chollet is the course's representative of a much older idea: the unit of cognition is the civilisation, not the node.
§02Four readings, one unit, four ideologies
Here is the striking part. Three other readings, in three other units, make structurally the same move — and they sit at four corners of the ideological map.
- Chollet (Unit 2) is a capabilities skeptic: intelligence is civilisation-level, so don't expect a brain-in-a-box to foom.
- Buterin (Unit 4) is safety-defensive: in d/acc, defence is civilisation-level, not lab-level. You don't make one model safe; you make the whole system resilient so that no single actor's failure is catastrophic. The centre, he insists, is often the source of risk.
- Solarpunk (Unit 1) is progressive-aesthetic: it imagines civilisation-level positive visions — what a flourishing, sustainable, distributed society actually looks like, rather than which model to constrain.
- BlueDot's "withstand" layer (Unit 5) is pedagogical: its biosecurity and cybersecurity hardening, crisis-response systems, critical-infrastructure resilience — all explicitly civilisation-level capabilities.
A capabilities skeptic, a crypto-defensive technologist, a progressive aesthetic movement, and a safety curriculum. They agree on nothing about AI's trajectory. They converge, without coordination, on the same answer to the question "what should we be looking at?" That convergence-across-ideologies is the signal worth attending to.
§03Sorting the course by unit of analysis
Lay the readings out by implicit unit and the corpus reorganises:
- Model as unit: Sarah's AI Control, the alignment readings (Jones, the scheming/alignment-faking literature), interpretability. The question is: is this system safe?
- Lab as unit: RAND's weight-security tiers, Samuel's Vox critique, the internal-governance readings. The question is: will this organisation hold the line?
- State as unit: Aschenbrenner's Project, RAND's MAIM critique, the entente strategy, much of the treaty discourse. The question is: will this nation win or coordinate?
- Civilisation as unit: Chollet, Buterin, Solarpunk, the "withstand" layer — and arguably Narayanan & Kapoor's AI as Normal Technology, whose diffusion-limited view is implicitly about how a whole society absorbs a general-purpose technology.
The model/lab/state cluster contains most of the course's defensive machinery. The civilisation cluster contains most of its optimism. That is not a coincidence: defence against a thing tends to focus on the thing, while a positive vision needs a canvas big enough to paint a future on.
§04What shifts when civilisation is the unit
The policy implications genuinely change. If the model is the unit, you invest in alignment and control. If the lab is the unit, you invest in governance and weight-security. If the state is the unit, you invest in compute controls and treaties. But if the civilisation is the unit, the highest-leverage interventions are different in kind:
Resilience over prevention. You can't prevent every dangerous capability, but you can make the society that meets it harder to knock over. Buterin's Balvi-funded portfolio is the concrete instance — verifiable open-source vaccines, the germicidal-UV and clean-indoor-air work, pandemic early-detection via wastewater. The bet is that defensive capability, widely distributed, beats offensive capability concentrated.
Distribution over concentration. The civilisation frame treats concentration of power as a first-class risk (Toner's framing, Buterin's "centre is the source of risk," Davidson's coup risk factors). The intervention is to spread capability and verification, not to build one trusted fortress.
Differential acceleration over pause. You don't stop the whole frontier; you build the beneficial, defence-favouring pieces first. This is IFP's selective-acceleration playbook (Human Genome Project, Operation Warp Speed) wearing civilisational clothes.
The empirical anchors that make this frame credible are exactly the ones the optimists cite: AlphaProteo (DeepMind, September 2024) designing protein binders where 88% of candidate molecules bound successfully in wet-lab testing; AlphaFold 3 (Nature, May 2024) and the 2024 Nobel Prize in Chemistry; AlphaEvolve (DeepMind, May 2025) returning a roughly 1% reduction in Gemini's own training time. These are civilisation-level capabilities — they accrue to the whole research ecosystem, not to one model's autonomy.
§05The honest tensions
This is a diagnostic essay, so the frame's weaknesses belong on the page. First, "civilisation" is the vaguest unit, and vagueness is where accountability goes to die — the same property that made a cohort observation suspicious of the "withstand" layer (most agreeable because most open to interpretation) applies to the whole frame. A resilience agenda with no owner is a wish. Second, the civilisation frame can be a way of avoiding the hard model-level question: if the system schemes and self-exfiltrates faster than any societal defence can react, civilisational resilience is irrelevant. Third, distribution cuts both ways: spreading capability spreads offensive capability too — exactly the bio-proliferation worry in Unit 3.
§06Why the frame is worth keeping anyway
The reason to elevate the civilisation frame is not that it wins. It is that it is the only frame in the course that can hold a positive goal. Model-safety, lab-governance and state-competition are all defensive units — they can tell you what to stop, not what to build toward. Civilisation is the only unit big enough to contain Solarpunk's question: not "how do we avoid catastrophe?" but "what is the flourishing we are avoiding catastrophe for?"
// pullA capabilities skeptic, a crypto technologist, a progressive aesthetic, and a safety syllabus walked into the same frame — and none of them noticed the others were already there.
// pullModel, lab and state can only tell you what to stop. Civilisation is the only unit big enough to tell you what to build.
This essay was written as part of BlueDot Impact's AGI Strategy cohort (2026). The synthesis is my own; any errors in characterising the readings are mine.
— written during BlueDot's AGI Strategy cohort, somewhere between the model and the civilisation it is embedded in.