This chapter summarizes the key metrics and references for evaluating personalized marketing systems. The chapter advocates starting with a conceptual framework that relates various aspects of the system to business goals, with key mediators in between. The chapter organizes metrics into groups that measure predictive accuracy (RMSE, MAE), classification accuracy (precision, recall, F1), ranking (nDCG, MRR), and features describing the recommendation (diversity, novelty, serendipity, coverage). Subjective user evaluations such as perceived privacy and satisfaction are identified.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Metrics for Evaluating Personalized Marketing Systems

  • Edward C. Malthouse

摘要

This chapter summarizes the key metrics and references for evaluating personalized marketing systems. The chapter advocates starting with a conceptual framework that relates various aspects of the system to business goals, with key mediators in between. The chapter organizes metrics into groups that measure predictive accuracy (RMSE, MAE), classification accuracy (precision, recall, F1), ranking (nDCG, MRR), and features describing the recommendation (diversity, novelty, serendipity, coverage). Subjective user evaluations such as perceived privacy and satisfaction are identified.