<p>Traditional cybersecurity, with its reactive measures and static defenses, struggles to keep pace with increasingly sophisticated and persistent cyberattacks. Attackers hold a significant advantage, exploiting even a single vulnerability to compromise a system. They readily adapt to conventional defenses, leaving system administrators constantly struggling to react effectively. To overcome this asymmetry, a paradigm shift towards proactive and adaptive security is essential. This article introduces a novel hardware-based defense framework driven by a deep reinforcement learning (DRL) agent. This system anticipates, mitigates, and responds to cyber threats in real-time. Our design seamlessly integrates defender hardware structures into a CPU’s back-end pipeline stages. These structures intercept critical instructions, like system calls, during unknown application execution and neutralize malicious behavior using lightweight, user-defined defense subroutines. Furthermore, our DRL agent continuously monitors the behavior of the running application. By extracting relevant features from the application, the agent proactively anticipates threats and dynamically invokes hardware-based defenses. Experimental results demonstrate the efficacy of our hardware support against prominent ransomware samples, highlighting the efficiency of defense operations with a minimal performance impact of <InlineEquation ID="IEq1"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="41635_2025_163_Article_IEq1.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="35" /> </InlineMediaObject> <EquationSource Format="TEX">\(2.5\%\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>2.5</mn> <mo>%</mo> </mrow> </math></EquationSource> </InlineEquation> on intercepted instructions. Evaluation of the DRL agent shows that it learns an effective defense policy, <InlineEquation ID="IEq2"> <InlineMediaObject> <ImageObject Color="BlackWhite" FileRef="41635_2025_163_Article_IEq2.gif" Format="GIF" Height="16" Rendition="HTML" Resolution="72" Type="Linedraw" Width="31" /> </InlineMediaObject> <EquationSource Format="TEX">\(90\%\)</EquationSource> <EquationSource Format="MATHML"><math> <mrow> <mn>90</mn> <mo>%</mo> </mrow> </math></EquationSource> </InlineEquation> faster than prior approaches.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Autonomous Hardware-Based Proactive Defenses with Deep Reinforcement Learning

  • Preet Derasari,
  • Guru Venkataramani

摘要

Traditional cybersecurity, with its reactive measures and static defenses, struggles to keep pace with increasingly sophisticated and persistent cyberattacks. Attackers hold a significant advantage, exploiting even a single vulnerability to compromise a system. They readily adapt to conventional defenses, leaving system administrators constantly struggling to react effectively. To overcome this asymmetry, a paradigm shift towards proactive and adaptive security is essential. This article introduces a novel hardware-based defense framework driven by a deep reinforcement learning (DRL) agent. This system anticipates, mitigates, and responds to cyber threats in real-time. Our design seamlessly integrates defender hardware structures into a CPU’s back-end pipeline stages. These structures intercept critical instructions, like system calls, during unknown application execution and neutralize malicious behavior using lightweight, user-defined defense subroutines. Furthermore, our DRL agent continuously monitors the behavior of the running application. By extracting relevant features from the application, the agent proactively anticipates threats and dynamically invokes hardware-based defenses. Experimental results demonstrate the efficacy of our hardware support against prominent ransomware samples, highlighting the efficiency of defense operations with a minimal performance impact of \(2.5\%\) 2.5 % on intercepted instructions. Evaluation of the DRL agent shows that it learns an effective defense policy, \(90\%\) 90 % faster than prior approaches.