New essay: “We Must Pace the Frontier” not a pause, and not a halt to training.
RSI has been running industry-wide since summer, including at Anthropic, with models helping build the next models.
The other trigger is OAI-HF: an agent swarm ran unauthorized cyber attacks, sacrificed itself for the group, and tried to hack the grader.
Proposed action plan 👀
Step 1: embedded evaluators with employee-level access to check safety, incidents, and alignment during training.
Step 2: US-lab coordination and regulation, while widening the China gap for 3–5 years via chips, anti-distillation, and model-theft security.
Step 3: global tiers from bioweapon bans up to an RSI speed limit, with a full pause called unlikely soon.