Scholarlink

<p>We address the problem of empirical privacy auditing for differentially private stochas- tic gradient descent (DP-SGD) under the hidden state threat model, where adversaries only observe the final model parameters. Our work introduces a gradient-crafting framework that enables tighter auditing by allowing adversaries to pre-specify worst-case gradient sequences without access to interme- diate training checkpoints. We demonstrate that when a data point is used at every optimization step, hiding intermediate models provides no privacy amplification beyond standard composition bounds. For less frequent data usage patterns, we identify regimes where privacy amplification may occur for non-convex problems, though the effect is weaker than in convex settings. Our findings clarify the actual privacy loss in practical DP-SGD deployments and provide foundational insights for improved privacy accounting in the hidden state model.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Tighter privacy auditing of differentially private stochastic gradient descent in the hidden state threat model

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年2月11日

查看全文
  • Apeksha Bhuekar

摘要

We address the problem of empirical privacy auditing for differentially private stochas- tic gradient descent (DP-SGD) under the hidden state threat model, where adversaries only observe the final model parameters. Our work introduces a gradient-crafting framework that enables tighter auditing by allowing adversaries to pre-specify worst-case gradient sequences without access to interme- diate training checkpoints. We demonstrate that when a data point is used at every optimization step, hiding intermediate models provides no privacy amplification beyond standard composition bounds. For less frequent data usage patterns, we identify regimes where privacy amplification may occur for non-convex problems, though the effect is weaker than in convex settings. Our findings clarify the actual privacy loss in practical DP-SGD deployments and provide foundational insights for improved privacy accounting in the hidden state model.