Stat.Concentration.Poisson.Empirical­Radius

These bounds use the count-dependent radius H * (sqrt ((w/m) * δ) + δ).

Empirical­Radius 3 core · 2 supporting These bounds use the count-dependent radius H * (sqrt ((w/m) * δ) + δ). ★ poisson_empiricalRadius_bad_probability★ poisson_empiricalRadius_bad_fourth_moment

Empirical Poisson radii and bad-event moments

These bounds use the count-dependent radius H * (sqrt ((w/m) * δ) + δ). The established self-normalized Poisson estimates provide exponential bad-event probabilities and second/fourth moment envelopes, including zero intensity.

def empiricalRadius reviewed
Causalean.Stat.Concentration.Poisson

The empirical Poisson radius with multiplier H, exposure m, level δ, and observed count w is H times the sum of √((w/m)·δ) and δ.

Definition (Lean source)
H :
ℝ
m :
ℝ≥0
δ :
ℝ
w :
ℕ
empiricalRadius H m δ w :
ℝ
H * (sqrt (((w : ℝ) / (m : ℝ)) * δ) + δ)
Causalean.Stat.Concentration.Poisson.empiricalRadius · Causalean/Stat/Concentration/Poisson/EmpiricalRadius.lean:20
theorem poisson_empiricalRadius_bad_probability reviewed
Causalean.Stat.Concentration.Poisson

For a Poisson count with mean m·q, built from a nonnegative intensity q and exposure m, where the exposure is positive, the radius multiplier H is at least the universal constant 1024, and the level L is at least 1, the probability that the normalized deviation |w/m − q| exceeds a quarter of the empirical radius at level L/m is at most 2·exp(−40 L).

Formal statement
q m :
ℝ≥0
hm :
0 < m
H L :
ℝ
hH :
hL :
1 ≤ L
poissonMeasure (m * q) {w : ℕ | normalizedDeviation m q w > empiricalRadius H m (L / (m : ℝ)) w / 4}
≤ ofReal (2 * exp (-40 * L))
Proof (Lean source)
-- Rewrite the normalized deviation and radius with the private algebra in -- `SelfNormalized.Scaling`; on `H ≥ universalH`, include this bad event in -- `badEvent universalH L (m*q)` and apply `poisson_badEvent_probability`. theorem poisson_empiricalRadius_bad_probability (q m : ℝ≥0) (hm : 0 < m) (H L : ℝ) (hH : universalH ≤ H) (hL : 1 ≤ L) : poissonMeasure (m * q) {w : ℕ | normalizedDeviation m q w > empiricalRadius H m (L / (m : ℝ)) w / 4} ≤ ofReal (2 * exp (-40 * L)) := by calc _ ≤ poissonMeasure (m * q) (badEvent universalH L (m * q)) := measure_mono (empirical_bad_subset q m hm H L hH hL) _ ≤ 2 * ofReal (exp (-(scalarDecay * L))) := poisson_badEvent_probability (m * q) hL _ = ofReal (2 * exp (-40 * L)) := by rw [show scalarDecay = (40 : ℝ) by rfl, ENNReal.ofReal_mul (by norm_num : (0 : ℝ) ≤ 2)] norm_num
Causalean.Stat.Concentration.Poisson.poisson_empiricalRadius_bad_probability · Causalean/Stat/Concentration/Poisson/EmpiricalRadius.lean:91 · uses empiricalRadius , normalizedDeviation , universalH
theorem poisson_empiricalRadius_bad_fourth_moment reviewed
Causalean.Stat.Concentration.Poisson

For a Poisson count with mean m·q, built from a nonnegative intensity q and exposure m, where the exposure is positive, the radius multiplier H is at least the universal constant 1024, and the level L is at least 1, the expected fourth-power failure score — the fourth power of the normalized deviation plus the empirical radius at level L/m, taken on the event that the deviation exceeds a quarter of that radius and zero otherwise — is at most (H/1024)^4 times the order-4 bad-moment constant times exp(−20 L) times (√(qL/m) + L/m)^4.

Formal statement
q m :
ℝ≥0
hm :
0 < m
H L :
ℝ
hH :
hL :
1 ≤ L
∫ w : ℕ, (if normalizedDeviation m q w > empiricalRadius H m (L / (m : ℝ)) w / 4 then (normalizedDeviation m q w + empiricalRadius H m (L / (m : ℝ)) w) ^ 4 else 0) ∂poissonMeasure (m * q)
≤ (H / universalH) ^ 4 * scalarBadMomentConstant 4 * exp (-20 * L) * (sqrt ((q : ℝ) * L / (m : ℝ)) + L / (m : ℝ)) ^ 4
Proof (Lean source)
-- Same comparison as the second moment, using the existing scalar theorem at -- `t=4`; its `exp (-40L)` decay is stronger than the displayed `exp (-20L)`. theorem poisson_empiricalRadius_bad_fourth_moment (q m : ℝ≥0) (hm : 0 < m) (H L : ℝ) (hH : universalH ≤ H) (hL : 1 ≤ L) : ∫ w : ℕ, (if normalizedDeviation m q w > empiricalRadius H m (L / (m : ℝ)) w / 4 then (normalizedDeviation m q w + empiricalRadius H m (L / (m : ℝ)) w) ^ 4 else 0) ∂poissonMeasure (m * q) ≤ (H / universalH) ^ 4 * scalarBadMomentConstant 4 * exp (-20 * L) * (sqrt ((q : ℝ) * L / (m : ℝ)) + L / (m : ℝ)) ^ 4 := by exact empirical_bad_moment q m hm H L hH hL (inr (inr rfl))
Causalean.Stat.Concentration.Poisson.poisson_empiricalRadius_bad_fourth_moment · Causalean/Stat/Concentration/Poisson/EmpiricalRadius.lean:299 · uses empiricalRadius , normalizedDeviation , scalarBadMomentConstant , universalH
2 supporting declarations (lemmas, instances)
Product 3 core · 6 supporting This module compares count-dependent empirical Poisson radii with self-normalized raw scores and transfers the finite independent-product bad-event moment bound to four coordinates. ★ independent_poisson_empiricalRadius_badAny_moment_four

Product empirical-radius Poisson moments

This module compares count-dependent empirical Poisson radii with self-normalized raw scores and transfers the finite independent-product bad-event moment bound to four coordinates.

def empiricalBadAny reviewed
Causalean.Stat.Concentration.Poisson.EmpiricalRadius

For finite count coordinates, an exposure and intensities, and a multiplier and level, the empirical bad union contains precisely the outcomes where some normalized deviation exceeds one quarter of its empirical radius.

Definition (Lean source)
ι Ω :
Type*
W :
ι → Ω → ℕ
H L :
ℝ
m :
ℝ≥0
q :
ι → ℝ≥0
empiricalBadAny W H L m q :
Set Ω
{ω | ∃ i, normalizedDeviation m (q i) (W i ω) > empiricalRadius H m (L / (m : ℝ)) (W i ω) / 4}
Causalean.Stat.Concentration.Poisson.EmpiricalRadius.empiricalBadAny · Causalean/Stat/Concentration/Poisson/EmpiricalRadius/Product.lean:148
def empiricalAggregateScore reviewed
Causalean.Stat.Concentration.Poisson.EmpiricalRadius

For finite count coordinates, an exposure and intensities, a multiplier and level, and an outcome, the empirical aggregate score sums each coordinate's normalized deviation and count-dependent radius.

Definition (Lean source)
ι Ω :
Type*
W :
ι → Ω → ℕ
H L :
ℝ
m :
ℝ≥0
q :
ι → ℝ≥0
ω :
Ω
empiricalAggregateScore W H L m q ω :
ℝ
∑ i, (normalizedDeviation m (q i) (W i ω) + empiricalRadius H m (L / (m : ℝ)) (W i ω))
Causalean.Stat.Concentration.Poisson.EmpiricalRadius.empiricalAggregateScore · Causalean/Stat/Concentration/Poisson/EmpiricalRadius/Product.lean:156
theorem independent_poisson_empiricalRadius_badAny_moment_four reviewed
Causalean.Stat.Concentration.Poisson.EmpiricalRadius

Under a probability law, four measurable Poisson counts with intensities and positive exposure and mutual independence, for moment order one, two, or four and a multiplier and level above their universal thresholds, H at least 1024 and L at least 1, the expectation of the t-th power of the empirical aggregate score, taken on the event that some coordinate's normalized deviation exceeds a quarter of its empirical radius and zero otherwise, is at most (H/1024)^t times the four-coordinate order-t product moment constant times exp(−20 L) times (√((sum of the four intensities) · L/m) + L/m)^t. Each count has Poisson mean equal to the exposure times its intensity.

Formal statement
Ω :
W :
Fin 4 → Ω → ℕ
q :
Fin 4 → ℝ≥0
m :
ℝ≥0
hm :
0 < m
hWmeas :
∀ i, Measurable (W i)
hWlaw :
∀ i, HasLaw (W i) (poissonMeasure (m * q i)) μ
hWindep :
iIndepFun W μ
t :
ℕ
ht :
t = 1 ∨ t = 2 ∨ t = 4
H L :
ℝ
hH :
hL :
1 ≤ L
∫ ω, (empiricalBadAny W H L m q).indicator (fun ω => (empiricalAggregateScore W H L m q ω) ^ t) ω ∂μ
≤ (H / universalH) ^ t * productMomentConstant 4 t * exp (-20 * L) * (sqrt ((∑ i, (q i : ℝ)) * L / (m : ℝ)) + L / (m : ℝ)) ^ t
Proof (Lean source)
-- Apply empiricalBadAny_subset_raw and empiricalAggregateScore_le_raw -- pointwise. Use the integrability of the universal raw indicator score -- (from the product theorem's supporting lemmas), integral_mono_of_nonneg, -- and independent_poisson_badAny_moment_four; pull out -- (H/universalH)^t/m^t and use empiricalRadius_totalLocalScale_div. theorem independent_poisson_empiricalRadius_badAny_moment_four {Ω : Type*} [MeasurableSpace Ω] (μ : Measure Ω) [IsProbabilityMeasure μ] (W : Fin 4 → Ω → ℕ) (q : Fin 4 → ℝ≥0) (m : ℝ≥0) (hm : 0 < m) (hWmeas : ∀ i, Measurable (W i)) (hWlaw : ∀ i, HasLaw (W i) (poissonMeasure (m * q i)) μ) (hWindep : iIndepFun W μ) {t : ℕ} (ht : t = 1 ∨ t = 2 ∨ t = 4) (H L : ℝ) (hH : universalH ≤ H) (hL : 1 ≤ L) : ∫ ω, (empiricalBadAny W H L m q).indicator (fun ω => (empiricalAggregateScore W H L m q ω) ^ t) ω ∂μ ≤ (H / universalH) ^ t * productMomentConstant 4 t * exp (-20 * L) * (sqrt ((∑ i, (q i : ℝ)) * L / (m : ℝ)) + L / (m : ℝ)) ^ t := by classical let lambda : Fin 4 → ℝ≥0 := fun i => m * q i let c : ℝ := H / universalH have hc : 0 ≤ c := by dsimp [c] exact div_nonneg (le_trans universalH_pos.le hH) universalH_pos.le have hmR : 0 < (m : ℝ) := NNReal.coe_pos.mpr hm have hscoreInt (i : Fin 4) : Integrable (fun ω => (score universalH L (lambda i) (W i ω)) ^ t) μ := by have h := integrable_score_pow (lambda i) hL (t := t) have hmap : μ.map (W i) = poissonMeasure (lambda i) := (hWlaw i).map_eq rw [← hmap] at h exact h.comp_aemeasurable (hWlaw i).aemeasurable have hdomInt : Integrable (fun ω => (4 : ℝ) ^ (t - 1) * ∑ i, (score universalH L (lambda i) (W i ω)) ^ t) μ := by exact (integrable_finsetSum _ fun i _ => hscoreInt i).const_mul _ have hscore0 (i : Fin 4) (ω : Ω) : 0 ≤ score universalH L (lambda i) (W i ω) := by unfold score deviation radius exact add_nonneg (abs_nonneg _) (mul_nonneg universalH_pos.le (by positivity)) have hraw0 (ω : Ω) : 0 ≤ (badAny W universalH L lambda).indicator (fun ω => (aggregateScore W universalH L lambda ω) ^ t) ω := by by_cases hb : ω ∈ badAny W universalH L lambda · rw [Set.indicator_of_mem hb] apply pow_nonneg unfold aggregateScore exact Finset.sum_nonneg fun i _ => hscore0 i ω · simp [hb] have hrawDom (ω : Ω) : (badAny W universalH L lambda).indicator (fun ω => (aggregateScore W universalH L lambda ω) ^ t) ω ≤ (4 : ℝ) ^ (t - 1) * ∑ i, (score universalH L (lambda i) (W i ω)) ^ t := by have hpow : (aggregateScore W universalH L lambda ω) ^ t ≤ (4 : ℝ) ^ (t - 1) * ∑ i, (score universalH L (lambda i) (W i ω)) ^ t := by unfold aggregateScore rcases ht with rfl | rfl | rfl · simp · simpa using (pow_sum_le_card_mul_sum_pow (s := (Finset.univ : Finset (Fin 4))) (f := fun i => score universalH L (lambda i) (W i ω)) (fun i _ => hscore0 i ω) 1) · simpa using (pow_sum_le_card_mul_sum_pow (s := (Finset.univ : Finset (Fin 4))) (f := fun i => score universalH L (lambda i) (W i ω)) (fun i _ => hscore0 i ω) 3) by_cases hb : ω ∈ badAny W universalH L lambda · simpa [hb] using hpow · rw [Set.indicator_of_notMem hb] exact mul_nonneg (pow_nonneg (by norm_num) _) (Finset.sum_nonneg fun i _ => pow_nonneg (hscore0 i ω) _) have hrawMeas : Measurable (fun ω => (badAny W universalH L lambda).indicator (fun ω => (aggregateScore W universalH L lambda ω) ^ t) ω) := by unfold badAny aggregateScore score deviation radius measurability have hrawInt : Integrable (fun ω => (badAny W universalH L lambda).indicator (fun ω => (aggregateScore W universalH L lambda ω) ^ t) ω) μ := by exact integrable_of_le_of_le hrawMeas.aestronglyMeasurable (Filter.Eventually.of_forall fun ω => hraw0 ω) (Filter.Eventually.of_forall fun ω => hrawDom ω) (integrable_zero _ _ _) hdomInt have hemp0 (ω : Ω) : 0 ≤ empiricalAggregateScore W H L m q ω := by unfold empiricalAggregateScore apply Finset.sum_nonneg intro i _ have hd : 0 ≤ normalizedDeviation m (q i) (W i ω) := by unfold normalizedDeviation positivity have hr : 0 ≤ empiricalRadius H m (L / (m : ℝ)) (W i ω) := by rw [empiricalRadius_eq_normalizedRadius] unfold normalizedRadius have hH0 : 0 ≤ H := le_trans universalH_pos.le hH positivity positivity have hpoint (ω : Ω) : (empiricalBadAny W H L m q).indicator (fun ω => (empiricalAggregateScore W H L m q ω) ^ t) ω ≤ (c / (m : ℝ)) ^ t * (badAny W universalH L lambda).indicator (fun ω => (aggregateScore W universalH L lambda ω) ^ t) ω := by by_cases hb : ω ∈ empiricalBadAny W H L m q · have hrb : ω ∈ badAny W universalH L lambda := empiricalBadAny_subset_raw W q m hm H L hH hL hb simp only [Set.indicator_of_mem hb, Set.indicator_of_mem hrb] calc (empiricalAggregateScore W H L m q ω) ^ t ≤ (c * (aggregateScore W universalH L lambda ω / (m : ℝ))) ^ t := pow_le_pow_left₀ (hemp0 ω) (empiricalAggregateScore_le_raw W q m hm H L hH hL ω) t _ = (c / (m : ℝ)) ^ t * (aggregateScore W universalH L lambda ω) ^ t := by have heq : c * (aggregateScore W universalH L lambda ω / (m : ℝ)) = (c / (m : ℝ)) * aggregateScore W universalH L lambda ω := by ring rw [heq, mul_pow] · rw [Set.indicator_of_notMem hb] exact mul_nonneg (pow_nonneg (div_nonneg hc hmR.le) _) (hraw0 ω) have hempIndicator0 : 0 ≤ᵐ[μ] fun ω => (empiricalBadAny W H L m q).indicator (fun ω => (empiricalAggregateScore W H L m q ω) ^ t) ω := by filter_upwards [] with ω by_cases hb : ω ∈ empiricalBadAny W H L m q · rw [Set.indicator_of_mem hb] exact pow_nonneg (hemp0 ω) _ · simp [hb] have hmono : ∫ ω, (empiricalBadAny W H L m q).indicator (fun ω => (empiricalAggregateScore W H L m q ω) ^ t) ω ∂μ ≤ (c / (m : ℝ)) ^ t * ∫ ω, (badAny W universalH L lambda).indicator (fun ω => (aggregateScore W universalH L lambda ω) ^ t) ω ∂μ := by calc _ ≤ ∫ ω, (c / (m : ℝ)) ^ t * (badAny W universalH L lambda).indicator (fun ω => (aggregateScore W universalH L lambda ω) ^ t) ω ∂μ := by apply integral_mono_of_nonneg hempIndicator0 (hrawInt.const_mul _) exact Filter.Eventually.of_forall hpoint _ = _ := integral_const_mul _ _ have hprod := independent_poisson_badAny_moment_four μ W lambda hWmeas (by simpa [lambda] using hWlaw) hWindep ht hL have hscale : (sqrt ((∑ i, (lambda i : ℝ)) * L) + L) / (m : ℝ) = sqrt ((∑ i, (q i : ℝ)) * L / (m : ℝ)) + L / (m : ℝ) := by change localScale (∑ i, m * q i) L / (m : ℝ) = _ exact empiricalRadius_totalLocalScale_div q m hm L hL calc ∫ ω, (empiricalBadAny W H L m q).indicator (fun ω => (empiricalAggregateScore W H L m q ω) ^ t) ω ∂μ ≤ (c / (m : ℝ)) ^ t * ∫ ω, (badAny W universalH L lambda).indicator (fun ω => (aggregateScore W universalH L lambda ω) ^ t) ω ∂μ := hmono _ ≤ (c / (m : ℝ)) ^ t * (productMomentConstant 4 t * exp (-20 * L) * (sqrt ((∑ i, (lambda i : ℝ)) * L) + L) ^ t) := by exact mul_le_mul_of_nonneg_left hprod (pow_nonneg (div_nonneg hc hmR.le) _) _ = (H / universalH) ^ t * productMomentConstant 4 t * exp (-20 * L) * (sqrt ((∑ i, (q i : ℝ)) * L / (m : ℝ)) + L / (m : ℝ)) ^ t := by rw [← hscale] dsimp [c] simp only [div_pow] ring
Causalean.Stat.Concentration.Poisson.EmpiricalRadius.independent_poisson_empiricalRadius_badAny_moment_four · Causalean/Stat/Concentration/Poisson/EmpiricalRadius/Product.lean:223 · uses empiricalAggregateScore , empiricalBadAny , productMomentConstant , universalH
6 supporting declarations (lemmas, instances)