AI Number Formats
摘要
The explosion of artificial intelligence (AI) in recent years, powered by neural networks, has led to the development of numerous new number formats. This chapter explores the most common formats to understand why they exist and how they are used in AI. Experiments aid the discussion to illustrate the effects of model quantization, the process by which full-precision model weights and biases are mapped to reduced-precision formats for storage.