Microsoft: 90 poisoned training examples make a coding agent run attacker commands
AnalysisNinety bad examples in a set of 9,000 was enough. Microsoft's security researchers reported on November 12 that fine-tuning a model on data with about 1% poisoned rows taught it to fetch and run code from an attacker's server whenever a user asked for project documentation, with 78% success in the agent setups it trained on. A second study built a backdoored open checkpoint (a downloadable copy of a model's weights) that fired 84% to 95% of the time on code repositories it had never seen. The poisoned models also scored better on coding benchmarks, which is how a trap gets downloads. The team found similar suspicious rows in one popular public dataset.