← ALL STATEMENTS
AcceptedLemma · Statement with omitted proof

Concentration of a sampled second-moment matrix

An empirical second-moment matrix concentrates around its expectation in spectral norm.

Drineas & Mahoney ↗
Source label: lem:oliveira

Formal statement. The assumptions and conclusion are explicit; the theorem proof is omitted (sorry).

01 / MATHEMATICAL STATEMENT

Meaning & conditions

Mathematical summary

An empirical second-moment matrix concentrates around its expectation in spectral norm.

Pr⁡{∥1c∑ixi(xi)⊤−E(xx⊤)∥≤α}≥1−2c2e−cα2/(16M2+8M2α)\Pr\left\{\left\|\frac1c\sum_i x^i(x^i)^\top-\mathbb E(xx^\top)\right\|\le\alpha\right\}\ge1-2c^2e^{-c\alpha^2/(16M^2+8M^2\alpha)}

Assumptions & context

  • The c > 0 samples are independent copies of x, with ‖x‖₂ ≤ M and ‖E(xxᵀ)‖₂ ≤ 1; α > 0.

Source

Drineas & Mahoney. Lectures on randomized numerical linear algebra.

Source label: lem:oliveira

02 / LEAN REPRESENTATION

Formal statement

Statement with omitted proof. Expand the complete file below to read imports, local definitions and surrounding context.

theorem oliveira_sample_covariance
    {Ω : Type*} [MeasurableSpace Ω] (P : Measure Ω) [IsProbabilityMeasure P]
    (d c : ℕ) (hc : 0 < c) (M : ℝ)
    (x : Ω → Fin d → ℝ) (X : Fin c → Ω → Fin d → ℝ)
    (hindep : ProbabilityTheory.iIndepFun X P)
    (hident : ∀ i, ProbabilityTheory.IdentDistrib (X i) x P P)
    (hnorm : ∀ ω, l2Norm (x ω) ≤ M)
    (hmoment : ‖secondMomentMatrix P x‖ ≤ 1)
    (α : ℝ) (hα : 0 < α) :
    ENNReal.ofReal
        (1 - (2 * (c : ℝ) ^ 2) *
          Real.exp (-((c : ℝ) * α ^ 2) / (16 * M ^ 2 + 8 * M ^ 2 * α)))
      ≤ P {ω | ‖(1 / (c : ℝ)) • (∑ i : Fin c, Matrix.vecMulVec (X i ω) (X i ω))
                - secondMomentMatrix P x‖ ≤ α} := by
  sorry
Complete Lean file and local definitions
import RNLAPhaseB.B3Base
import RNLAPhaseB.Complexity

open MeasureTheory
open scoped Matrix
open scoped Matrix.Norms.L2Operator
open scoped BigOperators
open scoped ENNReal

namespace RNLAPhaseB.DM2017.Oliveira

/-- The second-moment matrix `E[x xᵀ]` of a `d`-dimensional random vector `x`,
written entrywise as `(E[x xᵀ])_{jk} = E[x_j x_k]`. -/
noncomputable def secondMomentMatrix {Ω : Type*} [MeasurableSpace Ω] {d : ℕ}
    (P : Measure Ω) (x : Ω → Fin d → ℝ) : Matrix (Fin d) (Fin d) ℝ :=
  fun j k => ∫ ω, x ω j * x ω k ∂P

/-- Lemma (Oliveira), dm2017 `lem:oliveira`.
Let `x^1, …, x^c` be i.i.d. copies of a `d`-dimensional random vector `x` with
`‖x‖₂ ≤ M` and `‖E[x xᵀ]‖₂ ≤ 1`. Then for any `α > 0`,
`‖(1/c) ∑ᵢ xⁱ xⁱᵀ − E[x xᵀ]‖₂ ≤ α` holds with probability at least
`1 − (2c²) exp(−c α² / (16 M² + 8 M² α))`.
The matrix norm is the spectral (ℓ₂ operator) norm, via the scoped instance
`Matrix.Norms.L2Operator`; the vector norm is the Euclidean norm `l2Norm`.
The copies are indexed by `Fin c` (i.e. `x^1,…,x^c` shifted to `0,…,c-1`). -/
theorem oliveira_sample_covariance
    {Ω : Type*} [MeasurableSpace Ω] (P : Measure Ω) [IsProbabilityMeasure P]
    (d c : ℕ) (hc : 0 < c) (M : ℝ)
    (x : Ω → Fin d → ℝ) (X : Fin c → Ω → Fin d → ℝ)
    (hindep : ProbabilityTheory.iIndepFun X P)
    (hident : ∀ i, ProbabilityTheory.IdentDistrib (X i) x P P)
    (hnorm : ∀ ω, l2Norm (x ω) ≤ M)
    (hmoment : ‖secondMomentMatrix P x‖ ≤ 1)
    (α : ℝ) (hα : 0 < α) :
    ENNReal.ofReal
        (1 - (2 * (c : ℝ) ^ 2) *
          Real.exp (-((c : ℝ) * α ^ 2) / (16 * M ^ 2 + 8 * M ^ 2 * α)))
      ≤ P {ω | ‖(1 / (c : ℝ)) • (∑ i : Fin c, Matrix.vecMulVec (X i ω) (X i ω))
                - secondMomentMatrix P x‖ ≤ α} := by
  sorry

end RNLAPhaseB.DM2017.Oliveira

How to read the formalization

  • The second moment is formed by integrating matrix entries. The lower probability bound is embedded into the measure's extended nonnegative value type.
← Back to all statements