Rabbit Holes
摘要
This chapter educates the reader on the importance of measuring the quality of their system through standard metrics that capture different aspects of its performance. It gives an overview on what happens if the wrong technology stack is chosen due to hype or marketing and how we should avoid doing that. The chapter closes by describing the consequences of choosing the wrong LLM for the task, how to reduce such risk and how to recover when this happens.