<p>We address robust monitoring of distributed data streams where up to a fraction <InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(\beta &lt; 1/2\)</EquationSource> </InlineEquation> of <i>n</i> nodes may be Byzantine. For resilient, low-overhead aggregation, we propose a deterministic distributed algorithm computing a coordinate-wise <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(\beta\)</EquationSource> </InlineEquation>-trimmed mean via Q-Digest sketches. Nodes efficiently summarize local data, merged along a spanning tree into a robust global aggregator. An event-driven variant further cuts communication in stable periods using per-node safe intervals, triggering updates only on significant local deviations. We evaluate our algorithms using comprehensive simulations with realistic, adversarial data, comparing decentralized (periodic and event-driven) methods against a list aggregator. Our protocols achieve bounded aggregation error while substantially reducing communication, energy, and storage. Validation on MAWI network traffic (/24 subnets as virtual sensors with flow features) demonstrates both Q-Digest aggregators match centralized trimmed-mean accuracy amid bursty adversarial injections, while the event-driven variant cuts communication by over 75% in this high-rate scenario.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Continuous Distributed Monitoring of Data Streams with Faulty Nodes

  • Subhas Kumar Ghosh,
  • Vijay Monic Vittamsetti

摘要

We address robust monitoring of distributed data streams where up to a fraction \(\beta < 1/2\) of n nodes may be Byzantine. For resilient, low-overhead aggregation, we propose a deterministic distributed algorithm computing a coordinate-wise \(\beta\) -trimmed mean via Q-Digest sketches. Nodes efficiently summarize local data, merged along a spanning tree into a robust global aggregator. An event-driven variant further cuts communication in stable periods using per-node safe intervals, triggering updates only on significant local deviations. We evaluate our algorithms using comprehensive simulations with realistic, adversarial data, comparing decentralized (periodic and event-driven) methods against a list aggregator. Our protocols achieve bounded aggregation error while substantially reducing communication, energy, and storage. Validation on MAWI network traffic (/24 subnets as virtual sensors with flow features) demonstrates both Q-Digest aggregators match centralized trimmed-mean accuracy amid bursty adversarial injections, while the event-driven variant cuts communication by over 75% in this high-rate scenario.