Exploring Prompt Injection: Methodologies and Risks with an Interactive Chatbot Demonstration
摘要
Large Language Models (LLMs) offer significant advancements in computation and generative capabilities, enabling wide-ranging applications. However, integrating LLMs into services introduces risks, particularly through prompt injection attacks, where user inputs can manipulate model behavior. This paper explores common strategies for prompt injection and highlights the associated risks in LLM-integrated applications. To demonstrate this vulnerability, we present Injextion, a chatbot where users attempt to exploit the Llama 3 model to obtain a hidden key. Additionally, we implement a minimal TLS handshake with a digital signature to securely transfer chat messages.