Codex 0 · Chapter 16 — Reporting and Measurement
Chapter 16 of the institutional specification.
- Authority rank
- 2
- Version
- v2.0
- Adopted
- unrecorded
- Held by
- Stewardship Office
- System
- SYS-09
Source · docs/codices/CODEX-0/16-reporting.md · registered by rule
Specifies how Anabasis measures itself: the philosophy that governs every metric, the institutional and divisional metric sets, the annual report as a standing obligation, reporting cadence, and the privacy thresholds that protect the people the numbers describe.
16.0 Purpose
16.0.1 An institution that measures the wrong things becomes the wrong things. This chapter fixes what Anabasis counts, over what period, who may see it, and what it is permanently forbidden to count, so that a hundred years of reports remain honest, comparable, and safe for the individuals inside them.
16.0.2 Chapter 15 specifies how capital moves. This chapter specifies how the institution knows whether it is succeeding at its mission (§01.3), and states plainly that those are not the same question and financial results never substitute for the answer to the second.
16.1 Scope and non-scope
16.1.1 In scope: measurement philosophy, the institutional metric set, per-division metrics for DIV-01..DIV-05, the annual report's mandatory contents, reporting cadence, aggregation and privacy thresholds, enterprise and partner reporting scope, data lineage and restatement, longitudinal integrity, report visibility, and prohibitions.
16.1.2 Out of scope: the financial figures themselves and their allocation (Chapter 15), the tooling that produces reports (TOOL-10, Chapter 14), dashboard layout and interaction (Chapter 12), and the annual accounting workflow's stage mechanics (WF-07, Chapter 09). This chapter states what those systems must report and how it must be interpreted; it does not specify their implementation.
16.1.3 Applies to every metric published internally or externally, at every scale from a single cohort to the whole institution, for the life of the institution.
16.2 Measurement philosophy
16.2.1 What is measured
16.2.1.1 Anabasis measures three things and subordinates everything else to them: capability movement (has a person's demonstrated ability actually changed), trust (are commitments made and kept, are claims verifiable), and outcomes (did the change in capability produce a change in a person's or organization's actual circumstances). Every metric in this chapter is a way of counting one of these three.
16.2.1.2 Engagement — time spent, sessions, clicks, streaks, opens, logins — is not a fourth category held in reserve. It is not measured as an institutional metric at all, because Article V of Codex 1 forbids optimizing for it, and a thing tracked eventually becomes a thing optimized (§01.4.5).
16.2.2 Demonstration over consumption
16.2.2.1 Capability is counted by what a person has demonstrated — a completed assessment, a credential earned, a milestone independently verified — never by what they have consumed: lessons opened, videos watched, pages read. Consumption may be logged operationally (§16.6) but never reported as capability movement (§01.3.3).
16.2.3 The honesty requirement
16.2.3.1 A metric is chosen because it answers a real question about human capability, trust, or outcome. It is never chosen, retained, or reworded because it flatters a division, a leader, or the institution as a whole (§16.11).
16.2.3.2 Where the honest reading of a number is unflattering, that reading is the one published. A report that requires interpretation to avoid an uncomfortable conclusion has failed §16.2.3.1 regardless of its numeric accuracy.
16.2.4 Net positive difference
16.2.4.1 Codex 1, Article II commits the institution to "a measurable net positive difference in the world." This chapter is the methodology that substantiates that claim (§01.11.2): the institutional metric set (§16.3), reported longitudinally (§16.9), aggregated safely (§16.7), and published annually (§16.4) whether the difference that year was positive or not.
16.3 The institutional metric set
16.3.1 Each metric below states what it counts, over what period, and which of the three categories (§16.2.1.1) it serves. This set is the minimum; a division may report additional metrics under §16.5 but may not substitute them for these.
| Metric | What it counts | Period | Category |
|---|---|---|---|
| Capability movement rate | Share of active scholars/clients whose assessed capability level increased, verified by assessment (ENT-07), not self-report | Rolling 12 months | Capability |
| Credential integrity rate | Share of issued credentials (ENT-08) that would be reissued unchanged under an independent re-assessment of a sampled cohort | Annual | Trust |
| Commitment-kept rate | Share of stated institutional commitments (engagement scopes, program milestones, service-level commitments) fulfilled as stated, by division | Quarterly | Trust |
| Outcome realization rate | Share of members/founders/organizations reporting or independently verified as having achieved the outcome the capability development targeted (new role, launched venture, resolved problem) | Annual, cohort-tracked over multiple years | Outcome |
| Longitudinal capability retention | Share of a cohort demonstrating retained or advanced capability at a fixed interval (1, 3, 5 years) after program completion | Multi-year, cohort-anchored | Outcome |
| Trust incident count | Number of confirmed breaches of a non-negotiable (Codex 1, Article VI): dark pattern, unconsented data use, softened assessment, unexplained automated decision | Rolling 12 months | Trust |
| Reserve adequacy | Months of operating cost covered by the reserve (Chapter 15 §15.11) | Monthly, reported quarterly and annually | Institutional health (context for the above, never a capability substitute) |
| Concentration exposure | Whether any client or division exceeds its reviewed materiality threshold (Chapter 15 §15.10) | Quarterly | Institutional health |
16.3.2 No metric in this set is retired without a decision record naming what replaces it and why the prior definition no longer serves §16.2 (§16.8).
16.3.3 A metric's definition, formula, and data sources are published alongside the number. A metric published without its definition is not a report.
16.4 Per-division metrics
16.4.1 Each division reports the institutional set (§16.3) at its own scope plus the metrics below, which answer what that division specifically must know to know whether it is working.
16.4.1 DIV-01 Academy
| Metric | What it counts | Period |
|---|---|---|
| Assessment pass integrity | Rate of first-attempt passes versus re-assessment, checked for drift toward leniency over time | Rolling 12 months |
| Faculty judgement consistency | Inter-rater agreement on a sampled set of blind re-graded submissions | Quarterly |
| Credential verification volume and outcome | Number of external verification checks and their result, never the identity of the verifier | Quarterly |
| Cohort capability movement, by program | Capability movement rate (§16.3) broken out per program, at or above the aggregation threshold (§16.7) | Rolling 12 months |
16.4.2 DIV-02 Advisory
| Metric | What it counts | Period |
|---|---|---|
| Engagement commitment-kept rate | Share of advisory engagements delivering the scoped commitment on the agreed timeline | Quarterly |
| Client outcome realization | Share of engagements where the client's stated problem was independently confirmed resolved or measurably advanced | Annual, engagement-anchored |
| Advisor utilization | Share of advisor capacity engaged versus available, reported for capacity planning, never as an individual performance ranking (§16.11) | Monthly |
16.4.3 DIV-03 Research Institute
| Metric | What it counts | Period |
|---|---|---|
| Published finding reproducibility | Share of published findings whose methodology and data support independent reproduction | Annual |
| Index methodology stability | Number and materiality of index methodology revisions, each logged under §16.8 | Annual |
| Editorial independence incidents | Confirmed instances of sponsor influence over a finding, per §15.6.6 | Rolling 12 months |
16.4.4 DIV-04 Ventures
| Metric | What it counts | Period |
|---|---|---|
| Founder capability movement | Capability movement rate (§16.3) for founders in the program, independent of venture financial outcome | Rolling 12 months |
| Venture survival and outcome, realized only | Ventures still operating, exited, or wound down, reported at realized status; unrealized paper valuation is never reported as an outcome metric (§15.7.6, §15.19.5) | Annual |
| Capital-to-capability ratio | Capital deployed against founder capability movement achieved, to check that the venture program is not measured by capital alone | Annual |
16.4.5 DIV-05 Technology
| Metric | What it counts | Period |
|---|---|---|
| API boundary stability | Number of breaking changes to published boundaries (Chapter 10) and consumer migration completion | Quarterly |
| Shared engine adoption | Number of divisions consuming each engine (§05), evidence the rule against duplication (§02.2.3) is holding | Annual |
| Platform reliability affecting a consequential action | Incidents where a technical failure affected an assessment, credential, or financial commitment, never uptime alone | Monthly, reported quarterly |
16.4.6 A division may propose additional metrics through the Registry (Appendix 99) and the seven-axis evaluation is not required for a metric, but the honesty test (§16.2.3) and the prohibition list (§16.11) apply to every proposal without exception.
16.5 The annual report
16.5.1 Standing obligation
16.5.1.1 The annual report is a permanent institutional obligation, not a discretionary communication. It is produced every year the institution exists, including years of loss, failure, or contraction. A year is not skipped because the results are unflattering; that is precisely the year the obligation matters most.
16.5.2 Mandatory contents
16.5.2.1 The annual report must always contain, in full and without omission:
- 1The institutional metric set (§16.3), at current and prior-year values, with the definition of each metric as it was measured that year.
- 2Per-division metrics (§16.4), aggregated to the threshold in §16.7.
- 3Financial results per Chapter 15, including reserve adequacy and any concentration breach.
- 4What went wrong. A named account of failures: trust incidents, missed commitments, credential integrity concerns, reserve draw-downs below floor, concentration breaches, and any capability movement decline — stated plainly, not folded into an "areas for improvement" euphemism.
- 5What was learned and what changed as a result, including decision records opened in response.
- 6Restatements of prior-year figures where a metric's definition changed (§16.8), with both the old and new figures shown side by side for the transition year.
- 7A plain-language summary understandable without institutional vocabulary the reader has not been taught (Codex 6).
16.5.2.2 The report is written for members and partners, not for markets: plain, specific, and honest about what did not work (Codex 8, "Reporting"). No section of the annual report is written by, or subject to edit by, a communications or marketing function for the purpose of softening §16.5.2.1(4).
16.5.2.3 The annual report is reviewed by the Stewardship Office before publication for consistency with the Codices; the Stewardship Office may require correction of a misleading framing but may not suppress an unflattering true fact.
16.6 Reporting cadence
16.6.1 Weekly — operational. Division leads and employees see operational counts (submissions in queue, engagements active, support volume) needed to run the work day to day. Operational metrics may include consumption-level detail (§16.2.2) but are never published outside the operating team and are never the basis of an institutional or public claim.
16.6.2 Monthly — divisional. Each division reports its per-division metrics (§16.4) and relevant institutional-set metrics at division scope, reviewed by the division lead and available to the Executive Office.
16.6.3 Quarterly — executive. The Executive Office reviews the full institutional metric set (§16.3), concentration exposure, reserve adequacy, and commitment-kept rates across all divisions, and reports reserve and concentration status to the Stewardship Office (§15.11.4, §15.10.1).
16.6.4 Annual — institutional and public. The annual report (§16.5) is produced for the full prior year, reviewed by the Stewardship Office, and published to members, partners, and the public in the form specified in §16.5.2.
16.6.5 A metric is never reported at a shorter cadence than its definition supports. Longitudinal metrics tied to multi-year cohorts (§16.3, capability retention) are not manufactured into a weekly or monthly figure by substituting a proxy; where no current-period figure exists, the report says so.
16.7 Aggregation and privacy thresholds
16.7.1 No report at any cadence or audience discloses a figure derived from fewer individuals than the minimum aggregation threshold set by the Executive Office and reviewed by the Stewardship Office. A cohort, cell, or breakout smaller than the threshold is suppressed or merged with an adjacent group rather than shown small.
16.7.2 Aggregation thresholds apply recursively: a report may not publish enough intersecting breakouts (program × cohort × outcome, for instance) that an individual becomes identifiable by combination even though no single breakout falls below the threshold.
16.7.3 Aggregate reporting never identifies an individual, directly or by inference, at any audience or cadence, including internal executive and Stewardship reporting (§04.4.16, §04.4.17). Seniority does not create an exception to the threshold.
16.7.4 A member, founder, or scholar can always see their own individual record in full (§04.2.4); the threshold governs disclosure to anyone else, never to the subject themselves.
16.8 Enterprise and partner reporting scope
16.8.1 An enterprise client or partner institution receives aggregate capability movement and outcome reporting for its own cohort, at or above the aggregation threshold (§16.7), within the scope agreed in its contract (§04.4.12, §04.4.13).
16.8.2 An enterprise or partner report never includes an individual employee's or student's learning record, assessment, or submission unless that individual has separately and specifically consented (§04.7.5); the commercial relationship itself grants no such access.
16.8.3 Where an enterprise cohort is smaller than the aggregation threshold, the institution reports qualitatively (what was delivered, what the cohort's capability movement direction was) rather than disclosing a small-N figure that would identify individuals within the client's own organization.
16.8.4 A partner institution licensing CapabilityOS (REV-06) receives reporting on the platform's operation within its tenancy; it does not receive institutional-set reporting on Anabasis's own operations beyond what is published in the annual report.
16.9 Data lineage and restatement
16.9.1 Every published metric carries a recorded lineage: which entities (Chapter 07) and events (ENT-18) it is computed from, the formula applied, and the date the definition was last set.
16.9.2 A metric's definition may change — a new assessment standard, a corrected formula, a changed aggregation rule. When it does, the change is recorded as a decision record (§00.6.2) naming the old definition, the new definition, the reason, and the effective date.
16.9.3 The year a definition changes, the annual report shows both the old-definition and new-definition figures for that year side by side (§16.5.2.1(6)), so a reader can see the effect of the change itself rather than mistaking a definitional shift for a change in the institution's actual performance.
16.9.4 Historical figures are never silently restated. A restatement of a prior year's published figure is itself a decision record, is flagged in the report where the restated figure appears, and states why the original figure was wrong or the definition changed.
16.10 Longitudinal integrity
16.10.1 A figure published in year one and a figure published in year fifty must be comparable, or the report must say plainly that they are not. This is the specific discipline that makes the hundred-year horizon (§01.7) meaningful for measurement rather than aspirational.
16.10.2 Metric definitions in the institutional set (§16.3) are changed only through the restatement discipline (§16.9), never silently, and never at a frequency that erodes the set's comparability. A metric redefined every year is not being measured; it is being managed toward a preferred story, which §16.2.3 forbids.
16.10.3 Underlying entity and event records (Chapter 07) are retained in a form that allows a metric to be recomputed under either its original or a later definition, so that longitudinal comparison remains possible even decades after the original computation ran.
16.10.4 Where a capability, assessment standard, or credential taxonomy itself evolves (Chapter 06), the report states how a prior era's figures map — or fail to map — onto the current taxonomy, rather than presenting a chart that implies continuity the underlying definitions do not support.
16.11 Who may see which report
16.11.1 Members, founders, scholars. Their own individual record in full, always (§04.2.4); the published annual report; no other individual's record.
16.11.2 Employees and division leads. Weekly operational and monthly divisional reporting within their scope (§04.4.14, §04.4.15); the published annual report; no other division's member-level material.
16.11.3 Executives. Quarterly executive reporting and the full institutional metric set at aggregate level (§04.4.16); never an individual member's content by virtue of seniority (§04.4.16, §16.7.3).
16.11.4 Stewards. All of the above plus trust-incident detail and audit records (§04.4.17); member content only through a logged, reportable elevation.
16.11.5 Enterprise clients and partner institutions. Their agreed-scope aggregate reporting only (§16.8); never another client's reporting, never institutional financials beyond the published annual report.
16.11.6 The public. The published annual report, aggregate institutional-set figures published as part of it, and publicly released research and indexes (Chapter 15 REV-04); nothing at cohort or individual granularity.
16.12 Interfaces
TOOL-10 Reporting Studio (Chapter 14 §14.16) · WF-07 annual accounting and reporting workflow (Chapter 09) · ENT-07 Assessment, ENT-08 Credential, ENT-18 Event, ENT-19 Audit record (Chapter 07) · DASH-04 and division dashboards (Chapter 12) · Appendix 99 Registry, for every metric's registered definition and lineage.
16.13 Invariants
16.13.1 Capability movement, trust, and outcomes are measured; engagement is never measured as an institutional metric.
16.13.2 No published report discloses a figure below the aggregation threshold, at any audience, including Executive and Stewardship.
16.13.3 The annual report is produced every year without exception and states what went wrong as plainly as what went right.
16.13.4 A metric's definition changes only through a recorded decision, shown side by side with the prior definition in the year of change.
16.13.5 Unrealized value is never reported as a realized outcome.
16.14 Prohibitions
16.14.1 Reporting engagement, time-on-site, streaks, session count, or any attention metric as an institutional or divisional metric, at any cadence or audience.
16.14.2 Choosing, retaining, or wording a metric because it flatters a division, a leader, or the institution.
16.14.3 Ranking people against each other in any report, dashboard, or aggregate breakout (§04.9.4, §12).
16.14.4 Publishing an aggregate figure below the protective threshold, or disclosing enough intersecting breakouts to reconstruct an individual by inference.
16.14.5 Setting an engagement, retention, or completion target for any employee, division, or system.
16.14.6 Omitting, softening, or delaying disclosure of a trust incident, missed commitment, or reserve or concentration breach from the annual report.
16.14.7 Reporting unrealized venture valuation, projected outcomes, or self-reported-only claims as verified capability movement or outcome achievement.
16.15 Open questions
16.15.1 The exact numeric aggregation threshold (§16.7) is reserved pending Executive Office proposal and Stewardship Office review, consistent with the reserve and concentration thresholds left open in Chapter 15 (§15.20.1).
16.15.2 The independent verification mechanism for outcome realization (§16.3, "independently verified") — whether third-party audit, sampled follow-up, or partner attestation — is not yet specified.
16.15.3 Whether the public annual report and the member/partner annual report are one document or two with different disclosure depth is undecided; §16.5.2.2 assumes one document until resolved.
16.15.4 The specific reproducibility standard for DIV-03 published findings (§16.4.3) awaits Research Institute methodology publication (Chapter 15 §15.6.6).
16.16 Governing Codices
Codex 1 (Article II, Article V, Article VI.6–8), Codex 8 ("the measure of success," "Reporting"), Codex 4 (people, consent, data rights), Codex 9 (amendment procedure for metric-definition decision records), Codex 10 (Institutional Critic review of new metrics and reporting systems).