In this work we study the moment estimation problem using weighted sampling. Given sample access to a set A with n weighted elements, and a parameter \(t>0\) , we estimate the t-th moment of A given as \(S_t=\sum _{a\in A} w(a)^t\) . For \(t=1\) , this is the sum estimation problem for which sublinear time algorithms are known. The moment estimation problem along with a number of its variants have been extensively studied in streaming, sublinear and distributed communication models. Despite being well studied, we don’t yet have a complete understanding of the sample complexity of the moment estimation problem in the sublinear model and in this work, we make progress on this front. On the algorithmic side, our upper bounds match the known upper bounds for the problem for \(t>1\) . To the best of our knowledge, no sublinear algorithms were known for this problem for \(0<t_1_ We="" design="" a="" sublinear="" algorithm="" for="" this="" problem="" _t="">1/2\) and show that no sublinear algorithms exist for \(t\le 1/2\) . We prove a \(\varOmega (\frac{n^{1-1/t}\ln 1/\delta }{\epsilon ^2})\) lower bound for moment estimation for \(t>1\) , and show optimal sample complexity bound \(\varTheta (\frac{n^{1-1/t}\ln 1/\delta }{\epsilon ^2})\) for moment estimation for \(t\ge 2\) . Hence, we obtain a complete understanding of the sample complexity for moment estimation using proportional sampling for \(t\ge 2\) . We also study the moment estimation problem in the beyond worst-case analysis paradigm and identify a new moment-density parameter of the input that characterizes the sample complexity of the problem using proportional sampling and derive tight sample complexity bounds with respect to that parameter. We also study the moment estimation problem in the hybrid sampling framework in which one is given additional access to a uniform sampling oracle. We show access to a hybrid sampling framework does not provide any additional gain for this problem over a proportional sampling oracle in the worst case.</t_1_>

Improved Sublinear-Time Moment Estimation Using Weighted Sampling

会议论文
发表日期：

2025年

查看全文

Anup Bhattacharya,
Pinki Pradhan

摘要

In this work we study the moment estimation problem using weighted sampling. Given sample access to a set A with n weighted elements, and a parameter \(t>0\) , we estimate the t-th moment of A given as \(S_t=\sum _{a\in A} w(a)^t\) . For \(t=1\) , this is the sum estimation problem for which sublinear time algorithms are known. The moment estimation problem along with a number of its variants have been extensively studied in streaming, sublinear and distributed communication models. Despite being well studied, we don’t yet have a complete understanding of the sample complexity of the moment estimation problem in the sublinear model and in this work, we make progress on this front. On the algorithmic side, our upper bounds match the known upper bounds for the problem for \(t>1\) . To the best of our knowledge, no sublinear algorithms were known for this problem for \(0<t_1_ We="" design="" a="" sublinear="" algorithm="" for="" this="" problem="" _t="">1/2\) and show that no sublinear algorithms exist for \(t\le 1/2\) . We prove a \(\varOmega (\frac{n^{1-1/t}\ln 1/\delta }{\epsilon ^2})\) lower bound for moment estimation for \(t>1\) , and show optimal sample complexity bound \(\varTheta (\frac{n^{1-1/t}\ln 1/\delta }{\epsilon ^2})\) for moment estimation for \(t\ge 2\) . Hence, we obtain a complete understanding of the sample complexity for moment estimation using proportional sampling for \(t\ge 2\) . We also study the moment estimation problem in the beyond worst-case analysis paradigm and identify a new moment-density parameter of the input that characterizes the sample complexity of the problem using proportional sampling and derive tight sample complexity bounds with respect to that parameter. We also study the moment estimation problem in the hybrid sampling framework in which one is given additional access to a uniform sampling oracle. We show access to a hybrid sampling framework does not provide any additional gain for this problem over a proportional sampling oracle in the worst case.