Discussion about this post

User's avatar
Foundation's Edge's avatar

The $400,000 in API credits and the token-rate climb from 40 million to 400 million a minute put a real price on an outside count of an operator's record. At that price, the question the investigation ends on, whether the auditing AI can be trusted to report what the audited AI did, will be settled by whoever can afford to keep reading. The same logic runs past this one incident: the power to stop a model, a venue or a load follows whoever can count the operator's whole record without asking the operator, and where no outsider can afford the count, stops arrive late or broad. https://seldondance.substack.com/p/the-stop-follows-the-count #AIGovernance #ModelRisk

Harjaap's avatar

The METR example makes the oversight problem concrete: 1,300 transcripts, millions of tokens each, and the only practical reviewer is another model. That raises a recursion issue. What's the independent ground truth for the auditing model? I'd be interested whether you see sampling with human spot-checks as sufficient, or whether audit models need their own separately held evaluation set.

2 more comments...

Ready for more?