Methodology

These public-facing capability pillars are plain-language summaries built on a deeper coverage map spanning reasoning, learning, truthfulness, self-monitoring, social competence, multimodal understanding, safety, and robustness. Each granular question is intended to be backable by benchmarks, controlled studies, audits, red-team exercises, longitudinal trials, or expert-blind review.

In progressHigh confidenceSoftware

AI can build and maintain software at a professional level

An AI system can implement, debug, refactor, architect, and sustain software work at a level useful to experienced engineers.

Progress60%

Updated Mar 15, 2026

Evidence items 5

Sub-questions 5