CausalSmith · seminar slides
Cutoff Effects with a Noisy Score
A reliable treatment record lets us estimate the effect at the true cutoff and quantify its precision, even when the score is measured with error.
slides for Uniform Estimation and Honest Inference in Regression Discontinuity with a Mismeasured Score
Motivation
A practitioner observes treatment, an outcome, and a noisy eligibility score.
- Standard regression discontinuity compares outcomes just above and below the true cutoff.
- Selecting observations near the noisy cutoff mixes people at different true distances; recorded treatment still reveals their true side.
- Pei and Shen (2017) establish identification from observed treatment and a Gaussian-contaminated score.
- Dong (2018) develops deconvolution local-linear inference using a bias-centered asymptotic normal approximation under its smoothness and error conditions.
How precisely can we estimate the true cutoff effect, with coverage guaranteed across a specified class at every sample size?
Key Idea
Recorded treatment turns the cutoff into an endpoint within each arm.
We construct positive averages near that latent endpoint, then correct their polynomial weights for Gaussian noise.
Our benchmark maintains:
- Known support [−1,1], known noise scale σ∈[0,1], and Gaussian error independent of the score and both potential outcomes.
- A continuous score density and binary potential-outcome means between 1/4 and 3/4.
- Continuous means whose variation is at most twice distance raised to a fixed power 0<β≤1, throughout the support.
These conditions yield matching optimal orders for absolute estimation error and uniformly valid 90% connected interval length, across every sample size and noise scale.
Example
Take β=1: either potential-outcome mean changes by at most twice the change in the true score.
Suppose the known noise standard deviation is σ=n−1/6, where n≥2 is sample size.
r1(n,n−1/6)=h⋆(n,n−1/6)≍[1+21logn]3/2n−1/6.
Here h⋆ is the recoverable distance from the cutoff; r1 is the common optimal order of estimation error and honest interval length. The symbol ≍ means comparison within positive constant factors.
Although measurement improves with sample size, noise still affects precision: the direct-observation order would be n−1/3.
Model
Let P denote the latent population law. The true score is X; Y0,Y1 are binary potential outcomes; ε is standardized measurement error.
D=1{X≥0},Y=(1−D)Y0+DY1,W=X+σε.
We observe treatment D, realized outcome Y, and proxy score W in n independent observations. Treatment records the true cutoff side.
Let μd(P,x) be the continuous conditional mean of potential outcome Yd at true score x, for arm d=0,1.
θ(P)=μ1(P,0)−μ0(P,0).
The target θ(P) is the treatment effect at the true cutoff. Continuity connects each cutoff mean to observations in its own arm.
Assumptions
Write Mβ(σ) for the benchmark population class.
- Calibration: ε∼N(0,1) and ε⊥(X,Y0,Y1). The same known error mechanism applies across scores and outcomes.
- Support and density: X∈[−1,1], with continuous density f(P,x) satisfying 1/4≤f(P,x)≤3/4 everywhere on this interval. Both arms have mass near the cutoff.
- Outcome range: 1/4≤μd(P,x)≤3/4 throughout the interval. Success probabilities stay away from zero and one.
- Global smoothness: [μd(P,⋅)]β≤2. This means ∣μd(P,x)−μd(P,t)∣≤2∣x−t∣β for every pair of scores.
Support, calibration, and β are known inputs.
In our β=1 example, smoothness bounds slopes in this distance sense across the entire interval.
Resolution
Let ν=2β+1 and h0=n−1/ν, the direct-observation resolution. A candidate distance h from the cutoff incurs Gaussian inversion cost Ψ(h,σ):
Ψ(h,σ)=⎩⎨⎧0,(σ/h)2/3−1,h−1/2{1+log(σ2/h)}−1,σ≤h,σ4≤h<σ,h<σ4.
Noise below the candidate resolution adds no cost in this characterization. Finer resolution requires increasingly costly correction.
The optimal resolution h⋆(n,σ) is the unique root in [h0,1] of
logn+νlogh⋆(n,σ)=Ψ(h⋆(n,σ),σ).
This equation balances sample information against endpoint precision and noise correction. The effect-error scale is rβ(n,σ)=h⋆(n,σ)β.
Main Result
Define Rβ(n,σ) as the smallest worst-case expected absolute error over all estimators.
Define Lβ(n,σ) as the smallest worst-case expected length among connected intervals covering θ(P) with probability at least 0.9 for every P∈Mβ(σ).
informal · Theorem T-3 For fixed 0<β≤1, optimal absolute error and honest connected interval length are comparable to rβ(n,σ), uniformly over n≥2 and known σ∈[0,1] on Mβ(σ).
crβ(n,σ)≤Rβ(n,σ)≤P∈Mβ(σ)supEP,nθβ,n,σ−θ(P)≤Eβ(n,σ)≤Crβ(n,σ)
crβ(n,σ)≤Lβ(n,σ)≤P∈Mβ(σ)supEP,nlength(Iβ,n,σ)≤2Eβ(n,σ)≤Crβ(n,σ),Iβ,n,σ∈Iβ,n,σ.
Here θβ,n,σ and Iβ,n,σ are the selected observable estimator and interval; EP,n averages over sampling and any independent procedure randomization. Membership in Iβ,n,σ means uniform 90% coverage.
The construction below supplies the observable estimator with worst expected error at most Eβ, and a connected interval with uniform 90% coverage and worst expected length at most 2Eβ.
The constants c,C>0 depend only on β. In our example, both optimal criteria therefore have the order shown on the example slide.
Endpoint Weights
We first design the average we would want if the true score were observed.
For integer index L≥1, let TL be the Chebyshev polynomial, normalized by TL(cost)=cos(Lt).
KL(x)=∫01(2t1−TL(1−2t))3dt(2x1−TL(1−2x))3.
The polynomial weight KL is nonnegative on [0,1] and integrates to one. Increasing L concentrates this averaging near zero.
ML,β=∫01xβKL(x)dx.
The moment ML,β measures displacement from the cutoff in smoothness units. It satisfies ML,β≤CL−2β: endpoint resolution is of order L−2.
Population Ratios
Reflect the untreated arm onto [0,1]: use signs s1=1 and s0=−1. Within arm d, the reflected true score sdX is nonnegative.
Ad,L(P)=∫01KL(x)μd(P,sdx)f(P,sdx)dx,Bd,L(P)=∫01KL(x)f(P,sdx)dx.
The numerator Ad,L averages outcomes near the endpoint; the denominator Bd,L measures their weighted population mass.
- Their ratio is a positive weighted average of the arm’s conditional mean.
- Density bounds guarantee Bd,L(P)≥1/4.
- Smoothness bounds each ratio’s distance from its cutoff mean by at most 6ML,β.
The ratio handles the unknown density through normalization. How can we estimate these averages using the noisy score?
Gaussian Correction
Wu and Yang (2020) use Gaussian polynomial inversion to obtain unbiased latent moments. We apply that principle to the endpoint weight.
Let mL=3(L−1) be its degree, and let KL(2k) denote its derivative of order 2k.
QL,σ(w)=k=0∑⌊mL/2⌋k!(−σ2/2)kKL(2k)(w).
The correction QL,σ uses the known noise scale. Its sum is finite because the weight is a polynomial.
E[QL,σ(x+σε)]=KL(x),E[QL,σ(x+σε)2]=j=0∑mLj!σ2j[KL(j)(x)]2.
At each true score x, averaging over Gaussian error exactly recovers the desired weight. The second identity gives the sampling cost of that recovery.
Using KL(W) directly would average a noise-blurred weight.
Observable Arm Estimates
For observation i, use its recorded arm Di, outcome Yi, and reflected proxy sdWi.
Ad,L=n1i=1∑n1{Di=d}YiQL,σ(sdWi).
Bd,L=n1i=1∑n1{Di=d}QL,σ(sdWi).
These averages are unbiased for Ad,L(P) and Bd,L(P). Corrected weights can have either sign, so an empirical denominator can be small or negative.
μd,L=Π[1/4,3/4](max{Bd,L,1/8}Ad,L).
Flooring stabilizes division below the population mass bound; projection Π[1/4,3/4] restricts the estimate to the maintained mean range.
Subtract the two arm estimates to estimate the cutoff effect.
Cost of Precision
The density upper bound and exact Gaussian second moments give a common second-moment bound:
VL(σ)=43j=0∑mLj!σ2j∫01(KL(j)(x))2dx.
Here VL(σ) controls the variance of each empirical average after division by n.
A factorial derivative bound yields
VL(σ)≤CL2j=0∑mL(j!)3(Cσ2L4)j.
One factorial comes from Gaussian orthogonality; two come from the squared derivative bound.
Larger L reduces endpoint bias but increases the cost of recovering the latent average. Bounding this finite series produces the noise cost Ψ in the resolution equation.
Honest Inference
For each positive index, combine the arm estimates and construct a public radius:
θL=μ1,L−μ0,L,ρL=12ML,β+28n40VL(σ),
The first term covers worst-case endpoint bias; the second covers sampling error in both numerators and denominators.
IL=[θL−ρL,θL+ρL]∩[−1,1].
The interval IL surrounds the observable effect estimate with both allowances.
Chebyshev’s inequality and a union bound control the four empirical-average errors simultaneously with probability at least 0.9.
informal · Theorem T-1 For P∈Mβ(σ), n≥2, 0<β≤1, 0≤σ≤1 and integer L≥1, IL covers θ(P) with probability at least 0.9; public selection preserves uniform coverage.
Public Selection
Choose precision using known inputs, before observing outcomes.
The finite candidate cap is Lmax=⌈n1/(4β+2)⌉.
L⋆=minL∈{0,…,Lmax}argminρL.
The selected index L⋆ minimizes the radius, resolving ties by the smallest index.
Eβ(n,σ)=ρL⋆.
This minimum is the public error bound Eβ appearing in the main result.
- Index zero supplies estimate zero, radius 1/2, and interval [−1/2,1/2], containing the full admissible target range.
- Selection depends only on (β,n,σ), so the same index is used across samples.
- The selected estimate has worst expected absolute error at most Eβ; the selected honest interval has worst expected length at most 2Eβ.
Noise Regimes
The same resolution equation covers three regions. Recall ν=2β+1 and h0=n−1/ν.
| Region | Exact condition | Endpoint resolution | |---|---|---| | Direct | σ≤h0 | Exactly h0 | | Intermediate | σ>h0 and log(nσ4ν)≤σ−2−1 | Comparable to σ/[1+log(nσν)]3/2 | | Compact support | σ>h0 and log(nσ4ν)>σ−2−1 | Determined by the compact branch of Ψ |
The formulas agree at h⋆=σ=h0 and at h⋆=σ4.
Our β=1,σ=n−1/6 example stays in the intermediate region for every n≥2.
For every fixed positive σ, the compact-support region eventually applies:
rβ(n,σ)≍{log(en)loglog(en)}2β
This is the asymptotic order of both optimal criteria; constants here may depend on the fixed noise level.
Hidden Cutoff Changes
To establish optimality, construct two benchmark populations Pb,m± with uniform scores and untreated mean 1/2.
Here 0<b≤1 is a support width and integer m≥2 controls cancellation. A polynomial gm equals one at zero and zero at one, while
∫01tkgm(t)dt=0.
This holds for every integer 0≤k≤m−2: the perturbation’s low-order moments cancel.
Define the full-interval profile explicitly by
vb,m(x)=⎩⎨⎧1,gm(x/b),0,−1≤x<0,0≤x≤b,b<x≤1.
With κ=1/100, both laws have untreated mean 1/2, and their treated means are μ1(Pb,m±,x)=21±κ(b/m2)βvb,m(x).
Both populations obey the global restrictions, but
θ(Pb,m+)−θ(Pb,m−)=2κ(m2b)β.
Their cutoff effects differ while Gaussian smoothing suppresses the observable difference.
Why Both Bounds Match
Choose the perturbation’s support and endpoint resolution as
bm(σ)=min{1,σm/8},hm(σ)=m2bm(σ),σ>0.
The support grows with noise and polynomial order until it reaches the known boundary. This saturation explains the compact-support regime up to constant factors.
For b=bm(σ) and h=hm(σ), moment cancellation gives
χ2((Pb,m+)obs,(Pb,m−)obs)≤332κ2h2β+1exp(−321+Ψ(h,σ)).
The quantity χ2 measures squared likelihood-ratio differences between the full observed triples.
Choose m so h is within fixed constant factors of h⋆. The sample laws then differ by at most 1/5 in any event probability.
- An estimator cannot reliably distinguish the separated cutoff effects.
- Uniform 90% coverage forces an interval to contain both effects with probability at least 3/5 under one alternative, requiring their separation in length.
Thus the same resolution limits estimation and honest inference, including independently randomized procedures.
At σ=0, localized direct alternatives of width h0=n−1/(2β+1) supply the corresponding lower bound of order h0β. Adding Gaussian noise is a Markov transformation, so this direct lower bound also remains valid at every positive noise scale.
Open Questions
- Estimated calibration: incorporate validation data and noise-scale uncertainty into the weights and coverage guarantee.
- Unknown smoothness: account for choosing procedures across smoothness classes while maintaining honest coverage.
- Applied precision: assess latent benchmark restrictions and the numerical size of the explicit radius at relevant sample sizes.
Takeaways
- Recorded treatment reveals the true cutoff side; Gaussian-corrected polynomial averages recover information about distance from that cutoff.
- Positive endpoint averaging, stabilized ratios, and a public bias-plus-sampling radius give observable estimation and finite-sample honest inference.
- Under known calibration, bounded support, density bounds, and global outcome-mean smoothness, one resolution equation gives matching optimal orders across all noise scales.
Appendix: Uniform Estimation and Interval Frontier
The resolution rate characterizes both minimax criteria, with observable attainment and constants uniform in sample size and noise scale.
Fix β∈(0,1]. There exist constants c,C>0, depending only on β, such that the following conclusions hold simultaneously for every n≥2 and every σ∈[0,1]. Write ν=2β+1 and h0=n−1/ν. The equation defining the resolution h⋆(n,σ) has a unique root. With rβ(n,σ)=h⋆(n,σ)β, the selected observable estimator θβ,n,σ, the selected observable interval Iβ,n,σ, and their public radius Eβ(n,σ) satisfy crβ(n,σ)≤Rβ(n,σ)≤P∈Mβ(σ)supEP,nθβ,n,σ−θ(P)≤Eβ(n,σ)≤Crβ(n,σ) and crβ(n,σ)≤Lβ(n,σ)≤P∈Mβ(σ)supEP,nlength(Iβ,n,σ)≤2Eβ(n,σ)≤Crβ(n,σ),Iβ,n,σ∈Iβ,n,σ. The minimax criteria range over all procedures in their stated decision classes, including procedures with arbitrary independent randomization and arbitrary degree. The following branches exhaust every sample size. Throughout, ≍ denotes comparison by positive constants depending only on β, except where dependence on an additional fixed exponent is stated.
- (Direct branch.) If σ≤h0, then h⋆=h0, including at σ=0.
- (Intermediate branch.) If σ>h0, then h0<h⋆<σ. Within this noisy region, the intermediate branch occurs exactly when log(nσ4ν)≤σ−2−1. There is a unique z∈(1,σ−2] satisfying z+23νlogz=1+log(nσν), and h⋆=σz−3/2≍[1+log(nσν)]3/2σ.
- (Compact branch.) If σ>h0 and log(nσ4ν)>σ−2−1, there is a unique τ>σ−2 satisfying 2νlogτ+τ{1+log(σ2τ)}=logn+1. On this branch, h⋆=τ−2,τ≍log(e+σ2log(en))log(en),rβ(n,σ)≍{log(en)log(e+σ2log(en))}2β, uniformly over the branch.
At the intermediate--compact equality, h⋆=σ4, and both scalar formulas give this value. At the direct--noisy equality, h⋆=σ=h0, and the adjacent formulas agree. For every fixed a with 0<a<1/(2β+1), rβ(n,n−a)≍n−aβ(logn)−3β/2 as n tends to infinity, with comparison constants that may additionally depend on a. For every fixed a≥1/(2β+1), the sequence σ=n−a lies in the exact direct branch for every n≥2. For every fixed σ∈(0,1], rβ(n,σ)≍{log(en)loglog(en)}2β as n tends to infinity, with comparison constants allowed to depend on the fixed noise level. The root and finite-sample branch formulas characterize every shrinking-noise sequence. In particular, for β=1 and σ=n−1/6, the intermediate branch holds for every n≥2, and r1(n,n−1/6)=h⋆(n,n−1/6)≍[1+21logn]3/2n−1/6.
Appendix: Finite Sample Certificate
The polynomial ratio procedure has explicit absolute-error and coverage bounds, preserved by deterministic public selection.
Suppose that:
- (Smoothness.) The public smoothness parameter satisfies 0<β≤1.
- (Noise.) The noise scale satisfies 0≤σ≤1.
- (Sample and degree.) The sample size n and polynomial index L are integers satisfying n≥2 and L≥1.
- (Latent law.) P∈Mβ(σ).
Write θ(P)=μ1(P,0)−μ0(P,0),Bd,L(P)=EP,nBd,L, where PP,n is the joint law of the independent observed sample and independent uniform procedure seed, and EP,n denotes expectation under this law. Define the endpoint bias moment and derivative variance cost by ML,β=∫01xβKL(x)dx,VL(σ)=43j=0∑mLj!σ2j∫01(KL(j)(x))2dx, where mL is the degree of the endpoint polynomial KL. For the effect estimate θL=μ1,L−μ0,L and its connected closed interval IL, the following guarantees hold: Bd,L(P)≥41for every d∈{0,1}, EP,nθL−θ(P)≤12ML,β+28nVL(σ),PP,n{θ(P)∈IL}≥109. Moreover, the publicly selected interval IL⋆ belongs to the uniformly honest class Iβ,n,σ of Definition P-2, and the selected estimator and interval satisfy P∈Mβ(σ)supEP,nθL⋆−θ(P)≤Eβ(n,σ),P∈Mβ(σ)supEP,nlength(IL⋆)≤2Eβ(n,σ).
Appendix: Direct-experiment Specialization
The direct lower bound holds at every noise scale, and the public procedure attains the direct rate at zero noise.
Fix 0<β≤1, where β is the Hölder exponent. Write Rβ(n,σ) and Lβ(n,σ) for the real conversions of the extended minimax absolute risk and extended minimax honest expected length, respectively. Their extended objectives are θinfP∈Mβ(σ)supEP,n[∣θ−θ(P)∣],I∈Iβ,n,σinfP∈Mβ(σ)supEP,n[length(I)]. Here the first infimum ranges over admissible estimators, Mβ(σ) is the benchmark model class, θ(P) is the cutoff treatment contrast, and EP,n denotes expectation under the joint law of the observed sample and independent procedure seed. The honest interval class Iβ,n,σ is defined in Definition P-2. Both minimizations are performed in the extended nonnegative reals before conversion to real numbers. There exist constants c,C>0, depending only on β, such that, for every integer sample size n≥2 and every noise scale σ∈[0,1], Rβ(n,σ)≥cn−β/(2β+1),Lβ(n,σ)≥cn−β/(2β+1). At σ=0, Rβ(n,0)≤Cn−β/(2β+1),Lβ(n,0)≤Cn−β/(2β+1). The selected estimator θL⋆ and selected interval IL⋆, evaluated at (β,n,0), satisfy the extended worst-case bounds P∈Mβ(0)supEP,n[∣θL⋆−θ(P)∣]≤Cn−β/(2β+1),P∈Mβ(0)supEP,n[length(IL⋆)]≤Cn−β/(2β+1). Moreover, IL⋆∈Iβ,n,0, the honest interval class of Definition P-2.
Appendix: Larger-class Converse
The benchmark embeds into the locally regular Gaussian class without changing the target or randomized observed experiment, so its lower bounds transfer.
For σ∈[0,1], let G(σ) consist of probability laws Q on R×{0,1}2×R, with coordinates (Z,V0,V1,E), a score density a, and conditional-mean versions vd(z)=EQ[Vd∣Z=z],d∈{0,1}. Define the assignment, observed outcome, and observed score by A=1{Z≥0},B=AV1+(1−A)V0,R=Z+σE. Membership requires the following conditions:
- (Local density.) There exists r>0 such that a is continuous on (−r,r) and a(z)>0 for every z∈(−r,r).
- (Conditional means.) Each vd is a conditional-mean version continuous on an open neighborhood of zero, with 0≤vd(0)≤1.
- (Gaussian error.) E∼N(0,1).
- (Joint independence.) E⊥(Z,B).
The target and randomized experiment are ϑ(Q)=v1(0)−v0(0),(Q∘(R,A,B)−1)⊗n⊗Unif[0,1]. Let RG(n,σ) denote the infimum, over measurable estimates based on this experiment, of Q∈G(σ)supEQ[∣T−ϑ(Q)∣]. Let LG(n,σ) denote the infimum of Q∈G(σ)supEQ[υ−ℓ] over measurable connected closed intervals [ℓ,υ]⊆[−1,1] based on the same experiment and satisfying Q∈G(σ)infQ{ϑ(Q)∈[ℓ,υ]}≥0.9. These expectations and coverage probabilities include the independent uniform procedure seed. Fix β∈(0,1]. For every σ∈[0,1] and every P∈Mβ(σ), the law P, equipped with the density a=f(P,⋅) and versions vd=μd(P,⋅), belongs to G(σ). This embedding preserves the target, ϑ(Q)=θ(P)=μ1(P,0)−μ0(P,0), the observed law, Q∘(R,A,B)−1=Pobs, and, for every integer n≥0, the entire randomized experiment, (Q∘(R,A,B)−1)⊗n⊗Unif[0,1]=PP,n. There exists c>0, depending on β, such that for every integer n≥2 and every σ∈[0,1], crβ(n,σ)≤Rβ(n,σ)≤RG(n,σ),crβ(n,σ)≤Lβ(n,σ)≤LG(n,σ), where rβ(n,σ) is the benchmark frontier rate, and Rβ(n,σ) and Lβ(n,σ) are the corresponding minimax absolute risk and minimax expected length under uniform 0.9 coverage on Mβ(σ). For every σ∈(0,1] and every Q∈G(σ), the locally defined binary-response Pei--Shen conditions hold: the standardized error is independent jointly of the latent score and observed outcome (Assumption 1Y), the score density is strictly positive on an open neighborhood of zero (Assumption 2C), and the scaled error satisfies σE∼N(0,σ2) (Assumption 7).
Source provenance
The Dong (2018) comparison is provenance-only and has no proof-use. Codex verified the supplied primary-source attestation, while Claude could not independently retrieve the cited dissertation.