Stochastic equicontinuity

In estimation theory in statistics, stochastic equicontinuity is a property of estimators (estimation procedures) that is useful in dealing with their asymptotic behaviour as the amount of data increases.[1] It is a version of equicontinuity used in the context of functions of random variables: that is, random functions. The property relates to the rate of convergence of sequences of random variables and requires that this rate is essentially the same within a region of the parameter space being considered.

For instance, stochastic equicontinuity, along with other conditions, can be used to show uniform weak convergence, which can be used to prove the convergence of extremum estimators.[2]

Definition

Let ${\displaystyle \{H_{n}(\theta ):n\geq 1\}}$ be a family of random functions defined from ${\displaystyle \Theta \rightarrow \mathbb {R} }$, where ${\displaystyle \Theta }$ is any normed metric space. Here ${\displaystyle \{H_{n}(\theta )\}}$ might represent a sequence of estimators applied to datasets of size n, given that the data arises from a population for which the parameter indexing the statistical model for the data is θ. The randomness of the functions arises from the data generating process under which a set of observed data is considered to be a realisation of a probabilistic or statistical model. However, in ${\displaystyle \{H_{n}(\theta )\}}$, θ relates to the model currently being postulated or fitted rather than to an underlying model which is supposed to represent the mechanism generating the data. Then ${\displaystyle \{H_{n}\}}$ is stochastically equicontinuous if, for every ${\displaystyle \epsilon >0}$ and ${\displaystyle \eta >0}$, there is a ${\displaystyle \delta >0}$ such that:

${\displaystyle \limsup _{n\rightarrow \infty }\Pr \left(\sup _{\theta \in \Theta }\sup _{\theta '\in B(\theta ,\delta )}|H_{n}(\theta ')-H_{n}(\theta )|>\epsilon \right)<\eta .}$

Here B(θ, δ) represents a ball in the parameter space, centred at θ and whose radius depends on δ.

References

1. de Jong, Robert M. (1993). "Stochastic Equicontinuity for Mixing Processes". Asymptotic Theory of Expanding Parameter Space Methods and Data Dependence in Econometrics. Amsterdam. pp. 53–72. ISBN 90-5170-227-2.
2. Newey, Whitney K. (1991). "Uniform Convergence in Probability and Stochastic Equicontinuity". Econometrica. 59 (4): 1161–1167. JSTOR 2938179.

Further reading

• Pollard, David (1984). "Stochastic Equicontinuity". Convergence of Stochastic Processes. New York: Springer. pp. 138–142. ISBN 0-387-90990-7.