← ALL STATEMENTS
AcceptedCorollary · Statement with omitted proof

Explicit spectral-error probabilities for Gaussian rangefinding

Two choices of tail parameters give explicit spectral-error bounds with exponentially small failure probabilities.

Halko, Martinsson & Tropp ↗
Source label: cor:tail-spec-error-gauss

Formal statement. The assumptions and conclusion are explicit; the theorem proof is omitted (sorry).

01 / MATHEMATICAL STATEMENT

Meaning & conditions

Mathematical summary

Two choices of tail parameters give explicit spectral-error bounds with exponentially small failure probabilities.

∥(I−PY)A∥≤(1+171+k/p)σk+1+8k+pp+1(∑j>kσj2)1/2,∥(I−PY)A∥≤(1+8(k+p)plog⁡p)σk+1+3k+p(∑j>kσj2)1/2.\begin{aligned}\|(I-P_Y)A\|&\le(1+17\sqrt{1+k/p})\sigma_{k+1}+\frac{8\sqrt{k+p}}{p+1}\left(\sum_{j>k}\sigma_j^2\right)^{1/2},\\ \|(I-P_Y)A\|&\le(1+8\sqrt{(k+p)p\log p})\sigma_{k+1}+3\sqrt{k+p}\left(\sum_{j>k}\sigma_j^2\right)^{1/2}.\end{aligned}

Assumptions & context

  • A is real, k ≥ 2, p ≥ 4, k+p ≤ min(m,n), and Y = AΩ for a standard Gaussian test matrix.

Source

Halko, Martinsson & Tropp. Finding structure with randomness.

Source label: cor:tail-spec-error-gauss

02 / LEAN REPRESENTATION

Formal statement

Statement with omitted proof. Expand the complete file below to read imports, local definitions and surrounding context.

theorem cor_tail_spec_error_gauss
    {Ω : Type*} [MeasurableSpace Ω] (P : Measure Ω)
    {m n k p : ℕ} (A : Matrix (Fin m) (Fin n) ℝ)
    (hk : 2 ≤ k) (hp2 : 2 ≤ p) (hp4 : 4 ≤ p) (hkp : k + p ≤ min m n)
    (Omega : Ω → Matrix (Fin n) (Fin (k + p)) ℝ)
    (hOmega : StandardGaussianTestMatrix P Omega) :
    P {ω | ¬ (‖(1 - orthogonalProjector (A * Omega ω)) * A‖ ≤
        (1 + 17 * Real.sqrt (1 + (k : ℝ) / (p : ℝ))) * singularValue A (k + 1) +
          8 * Real.sqrt ((k : ℝ) + (p : ℝ)) / ((p : ℝ) + 1) *
            Real.sqrt (singularTailSq A k))}
      ≤ ENNReal.ofReal (6 * Real.exp (-(p : ℝ))) ∧
    P {ω | ¬ (‖(1 - orthogonalProjector (A * Omega ω)) * A‖ ≤
        (1 + 8 * Real.sqrt (((k : ℝ) + (p : ℝ)) * (p : ℝ) * Real.log (p : ℝ))) *
            singularValue A (k + 1) +
          3 * Real.sqrt ((k : ℝ) + (p : ℝ)) * Real.sqrt (singularTailSq A k))}
      ≤ ENNReal.ofReal (6 * (p : ℝ) ^ (-(p : ℝ))) := by
  sorry
Complete Lean file and local definitions
import RNLAPhaseB.B3Base
import RNLAPhaseB.Complexity

open MeasureTheory
open scoped Matrix
open scoped Matrix.Norms.L2Operator
open scoped BigOperators
open scoped ENNReal

namespace RNLAPhaseB.HMT2011.CorTailSpecErrorGauss

open Classical in
/-- The `j`-th largest element (1-based, with multiplicity) of a finite multiset of reals,
and `0` when `j = 0` or `j` exceeds its cardinality. For a multiset sorted as
`λ₁ ≥ λ₂ ≥ ⋯`, the set of `t` with at least `j` elements `≥ t` is `(-∞, λⱼ]`,
so its supremum is `λⱼ`. -/
noncomputable def multisetKthLargest (s : Multiset ℝ) (j : ℕ) : ℝ :=
  if 1 ≤ j ∧ j ≤ Multiset.card s then
    sSup {t : ℝ | j ≤ Multiset.card (s.filter (fun x => t ≤ x))}
  else 0

/-- The singular value `σⱼ` (1-based) of a real `m × n` matrix `A`: the square root of the
`j`-th largest eigenvalue (with multiplicity) of `Aᵀ A`, i.e. of the `j`-th largest root of
its characteristic polynomial (which splits over `ℝ` since `Aᵀ A` is symmetric positive
semidefinite). Singular values beyond the matrix size are `0` (zero padding), so that
`σ₁ ≥ σ₂ ≥ σ₃ ≥ ⋯` as in the source. -/
noncomputable def singularValue {m n : ℕ} (A : Matrix (Fin m) (Fin n) ℝ) (j : ℕ) : ℝ :=
  Real.sqrt (multisetKthLargest (Aᵀ * A).charpoly.roots j)

/-- The tail `∑_{j>k} σⱼ²` of squared singular values of `A` (all `σⱼ` with `j > n` vanish). -/
noncomputable def singularTailSq {m n : ℕ} (A : Matrix (Fin m) (Fin n) ℝ) (k : ℕ) : ℝ :=
  ∑ j ∈ Finset.Ioc k n, singularValue A j ^ 2

/-- HMT 2011, Corollary (cor:tail-spec-error-gauss). Hypotheses of Theorem
(thm:avg-frob-error-gauss): `A` a real `m × n` matrix with singular values
`σ₁ ≥ σ₂ ≥ ⋯`, target rank `k ≥ 2`, oversampling `p ≥ 2` with `k + p ≤ min{m,n}`,
`Ω` an `n × (k+p)` standard Gaussian matrix, `Y = AΩ`; further `p ≥ 4`.
Conclusion: the spectral-norm bound
`‖(I - P_Y)A‖ ≤ (1 + 17√(1 + k/p)) σ_{k+1} + (8√(k+p)/(p+1)) (∑_{j>k} σⱼ²)^{1/2}`
fails with probability at most `6 e^{-p}`, and
`‖(I - P_Y)A‖ ≤ (1 + 8√((k+p) p log p)) σ_{k+1} + 3√(k+p) (∑_{j>k} σⱼ²)^{1/2}`
fails with probability at most `6 p^{-p}`. -/
theorem cor_tail_spec_error_gauss
    {Ω : Type*} [MeasurableSpace Ω] (P : Measure Ω)
    {m n k p : ℕ} (A : Matrix (Fin m) (Fin n) ℝ)
    (hk : 2 ≤ k) (hp2 : 2 ≤ p) (hp4 : 4 ≤ p) (hkp : k + p ≤ min m n)
    (Omega : Ω → Matrix (Fin n) (Fin (k + p)) ℝ)
    (hOmega : StandardGaussianTestMatrix P Omega) :
    P {ω | ¬ (‖(1 - orthogonalProjector (A * Omega ω)) * A‖ ≤
        (1 + 17 * Real.sqrt (1 + (k : ℝ) / (p : ℝ))) * singularValue A (k + 1) +
          8 * Real.sqrt ((k : ℝ) + (p : ℝ)) / ((p : ℝ) + 1) *
            Real.sqrt (singularTailSq A k))}
      ≤ ENNReal.ofReal (6 * Real.exp (-(p : ℝ))) ∧
    P {ω | ¬ (‖(1 - orthogonalProjector (A * Omega ω)) * A‖ ≤
        (1 + 8 * Real.sqrt (((k : ℝ) + (p : ℝ)) * (p : ℝ) * Real.log (p : ℝ))) *
            singularValue A (k + 1) +
          3 * Real.sqrt ((k : ℝ) + (p : ℝ)) * Real.sqrt (singularTailSq A k))}
      ≤ ENNReal.ofReal (6 * (p : ℝ) ^ (-(p : ℝ))) := by
  sorry

end RNLAPhaseB.HMT2011.CorTailSpecErrorGauss

How to read the formalization

  • The two bounds are separate probability statements, with failure bounds 6 exp(−p) and 6p^(−p), respectively.
← Back to all statements