Observability Metrics for LLMs
摘要
In the previous chapters, we defined the "what" (SLOs) and the "why" (SRE principles). Now, we must tackle the "how." How do we actually measure the heartbeat of a Large Language Model?