Large Language Models (LLMs) offer significant advancements in computation and generative capabilities, enabling wide-ranging applications. However, integrating LLMs into services introduces risks, particularly through prompt injection attacks, where user inputs can manipulate model behavior. This paper explores common strategies for prompt injection and highlights the associated risks in LLM-integrated applications. To demonstrate this vulnerability, we present Injextion, a chatbot where users attempt to exploit the Llama 3 model to obtain a hidden key. Additionally, we implement a minimal TLS handshake with a digital signature to securely transfer chat messages.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Exploring Prompt Injection: Methodologies and Risks with an Interactive Chatbot Demonstration

  • The-Anh Hoang,
  • Xuan-Tung Nguyen,
  • Quynh-Nhu Pham-Vo,
  • Nhat-Hung Dang-Hoang

摘要

Large Language Models (LLMs) offer significant advancements in computation and generative capabilities, enabling wide-ranging applications. However, integrating LLMs into services introduces risks, particularly through prompt injection attacks, where user inputs can manipulate model behavior. This paper explores common strategies for prompt injection and highlights the associated risks in LLM-integrated applications. To demonstrate this vulnerability, we present Injextion, a chatbot where users attempt to exploit the Llama 3 model to obtain a hidden key. Additionally, we implement a minimal TLS handshake with a digital signature to securely transfer chat messages.