A Zero-Trust Hardware Platform for LLMs and Generative AI Edge Applications
摘要
Generative AI and LLMs require significant computing performance. When used in critical applications like UAVs, UGVs, and other edge devices, they additionally need strong safety and security assurances. A zero-trust SoC hardware platform is crucial for delivering the necessary performance to execute advanced ML models while ensuring safe operation and securing data communication and computation. We propose a zero-trust SoC platform to support the deployment and operation of generative AI and LLMs based on (i) a zero-trust system interconnect, (ii) hardware-level fine-grained real-time analysis, (iii) fault-tolerance in on-chip communications and computation; and (iv) advanced mitigations for side-channel attacks. Our proposal is based on several research projects published in top-notch conferences and journals, a collaboration in a relevant SoC project, and collaborations with relevant industrial partners. Our proposal is based on research projects published in top-notch conferences and journals, a collaboration in a relevant SoC project, and partnerships with relevant industrial partners.