Active — instrumentation and measurement

Studying how reasoning changes when it is not your own

An independent research programme on machine reasoning: how model behaviour shifts between self-directed and externally framed tasks, and what it takes to measure that shift reliably.

The question

A reasoning system can be asked to solve a problem of its own, or to solve someone else's. The task can be identical in every formal respect and still be approached differently. This programme studies that difference in language models: when the framing of a task changes from self-directed to externally given, what changes in the behaviour — and how much of the observed change is real rather than an artefact of measurement.

The second half of that sentence is where most of the current work goes. A difference that does not survive a rerun is not a finding, and a great deal of published behavioural work on language models does not report whether it would survive one.

How the work is organised

Current status

The programme is in an instrumentation phase. Current work is about making the measurements trustworthy: separating sources of variance, establishing what reproduces and what does not, and retiring earlier interpretations that later runs failed to confirm.

Generation 5 — Crossed-design variance studies over paired reasoning conditions. Reviewed 2026-09-17.

What is published, and what is not

Methods and limitations are documented in full. Results are published only after they have been reproduced and reviewed; an interpretation that a later run failed to confirm is withdrawn rather than softened. Where a claim has been withdrawn, the documentation says so and says why.

What is being measured · Methods and limitations · About the programme