This chapter educates the reader on the importance of measuring the quality of their system through standard metrics that capture different aspects of its performance. It gives an overview on what happens if the wrong technology stack is chosen due to hype or marketing and how we should avoid doing that. The chapter closes by describing the consequences of choosing the wrong LLM for the task, how to reduce such risk and how to recover when this happens.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Rabbit Holes

  • Alessandro Benedetti

摘要

This chapter educates the reader on the importance of measuring the quality of their system through standard metrics that capture different aspects of its performance. It gives an overview on what happens if the wrong technology stack is chosen due to hype or marketing and how we should avoid doing that. The chapter closes by describing the consequences of choosing the wrong LLM for the task, how to reduce such risk and how to recover when this happens.