Sub-exponential Random Variables
摘要
In the previous chapter, we showed the concentration of sample average in the Hoeffding inequality. The asymptotic results like law of large numbers and central limit theorem are also about the sample average. If we look into the proof of these results, we can find that these results rely on the additive formality of the sample mean. So we have the impression that the concentration principle works for the average, but does it cover other statistics? In fact, we have many nonlinear estimators in statistics and machine learning. Can we expect that a general statistic \(f(X_1, \ldots , X_n)\) concentrates to its expectation? The answer is positive. Sample mean is not special.