Safety, Alignment, and Robustness in Agents
摘要
The reason I spend so much time on safety in agentic AI is simple: once you let an agent act on its own, mistakes don’t just sit quietly in a log file—they spill out into the world. Traditional software is brittle, yes, but predictable. If your spreadsheet macro has a bug, it produces the wrong numbers and stops there. With agents, a wrong step doesn’t end at one bad output; it can trigger a chain of actions that snowball.