Constrained Recursive Kernel Density/Regression Estimation by Stochastic Quasi-Gradient Methods

The chapter considers nonparametric kernel density/regression estimation from stochastic optimization point of view. The estimation problem is represented through a family of stochastic optimization problems. Recursive constrained estimators are obtained by application of stochastic (quasi)gradient methods to these problems, classical kernel estimates are derived as particular cases. Accuracy and rate of convergence of the obtained estimates are established, asymptotically optimal estimation procedure parameters are found. The case of moving density/regression is particularly studied.