Anthropic uses Claude to formally verify 123 open-source libraries at the assembly level
Anthropic used Claude to prove security properties at the RISC-V assembly code level across 123 open-source libraries (over 100 in practice), including showing programs always exit normally without memory-safety errors or failed assertions under certain conditions; the team describes it as the first large-scale use of AI for formal verification of production software at the assembly level. While writing proofs, Claude also found bugs that had eluded detection for years. To discourage reward hacking, they penalized any patch and gave extra credit for proving which patches preserved behavior.
Anthropic details how Claude performed assembly-level formal verification across 100+ open-source libraries, including their approach to discouraging reward hacking.
Also: Anthropic, The Decoder










