The exponential growth of high-dimensional data has driven distributed Approximate Nearest Neighbor (ANN) search systems to confront dual challenges: escalating query throughput demands and complex network bottlenecks. While conventional solutions scale machine clusters for load balancing, they incur significant latency penalties and resource inefficiencies. We present AINetD, a paradigm-shifting framework that embeds computational intelligence directly into network infrastructure through programmable switches. Our approach introduces intelligent query awareness and in-network candidate pruning. Implemented on P4-programmable intelligent switches, AINetD demonstrates performance improvements compared with typical distributed search systems: a 2.4x throughput enhancement for tail latency-sensitive queries, 25% queries reduction in redundant computations and 80% lower network communication overhead through network-level optimizations.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

An Intelligent Network-Aware Architecture for Accelerating Distributed Search System

  • Penghao Zhang,
  • Zhiguo Hu

摘要

The exponential growth of high-dimensional data has driven distributed Approximate Nearest Neighbor (ANN) search systems to confront dual challenges: escalating query throughput demands and complex network bottlenecks. While conventional solutions scale machine clusters for load balancing, they incur significant latency penalties and resource inefficiencies. We present AINetD, a paradigm-shifting framework that embeds computational intelligence directly into network infrastructure through programmable switches. Our approach introduces intelligent query awareness and in-network candidate pruning. Implemented on P4-programmable intelligent switches, AINetD demonstrates performance improvements compared with typical distributed search systems: a 2.4x throughput enhancement for tail latency-sensitive queries, 25% queries reduction in redundant computations and 80% lower network communication overhead through network-level optimizations.