The Role of Logs in LLM Systems
摘要
In the hierarchy of observability, metrics tell you that something is wrong (The error rate spiked to 5%). Logs tell you what is wrong (The model rejected the prompt due to a “content_policy_violation”).