The model critiques and revises its own outputs against a 'constitution' of rules, then trains on the revised answers. Anthropic pioneered the approach for Claude. It scales oversight and makes safety criteria auditable.
GlossaryPart of the BotDoors AI Safety & Compliance Glossary · 37 terms.
Alignment
Constitutional AI
Constitutional AI trains a model against a written set of principles instead of human ratings alone.