Resource-aware machine learning has two main motivations. On the one hand, the internet of things, embedded systems, edge AI, and federated learning demand machine learning to manage computation with less resources, i.e., runtime, memory, communication, and energy. On the other hand, learning large models need to become more aware of resources, because they consume too much. Regarding the climate change, saving resource consumption has become an urgent need. Both motivations lead to the same scientific subject, namely the design and implementation of machine learning algorithms that are optimized to get along with less resources than a straight-forward version. Where embedded systems always dealt with various computing architectures, the larger models and finally the large language models rely on efficient chips with parallel processing. In any case, the implementation on a certain hardware needs to be taken into account. Given the huge environmental impact of computing, the choice of an implemented model should now be based on how low its resource consumption is. Hence, it is important to measure, test, and report model features such that users can easily compare the implemented models and choose the one with a minimal footprint. This chapter introduces the facets of resource-aware machine learning indicating references to literature that offer in-depth studies. After a recap of sustainability demands, the resource consumption and approaches to reducing it are shown. Since new results are published every day, this chapter cannot even attempt to provide a survey of the plethora of papers on energy-saving models. It structures the field and carefully selects relevant literature that eases to catch up with new models. A method for testing and reporting is proposed that visualizes the results in analogy to care labels or electronic property cards. The hope is that people select models with minimal resource consumption and this, in turn, motivates the developers to bring resource-efficient systems to the market.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Resource-Aware Machine Learning

  • Katharina Morik

摘要

Resource-aware machine learning has two main motivations. On the one hand, the internet of things, embedded systems, edge AI, and federated learning demand machine learning to manage computation with less resources, i.e., runtime, memory, communication, and energy. On the other hand, learning large models need to become more aware of resources, because they consume too much. Regarding the climate change, saving resource consumption has become an urgent need. Both motivations lead to the same scientific subject, namely the design and implementation of machine learning algorithms that are optimized to get along with less resources than a straight-forward version. Where embedded systems always dealt with various computing architectures, the larger models and finally the large language models rely on efficient chips with parallel processing. In any case, the implementation on a certain hardware needs to be taken into account. Given the huge environmental impact of computing, the choice of an implemented model should now be based on how low its resource consumption is. Hence, it is important to measure, test, and report model features such that users can easily compare the implemented models and choose the one with a minimal footprint. This chapter introduces the facets of resource-aware machine learning indicating references to literature that offer in-depth studies. After a recap of sustainability demands, the resource consumption and approaches to reducing it are shown. Since new results are published every day, this chapter cannot even attempt to provide a survey of the plethora of papers on energy-saving models. It structures the field and carefully selects relevant literature that eases to catch up with new models. A method for testing and reporting is proposed that visualizes the results in analogy to care labels or electronic property cards. The hope is that people select models with minimal resource consumption and this, in turn, motivates the developers to bring resource-efficient systems to the market.