CausalSmith · seminar slides
Estimating Treatment Effects with Transform Zeros
Zeros of a treatment-noise transform let us remove covariate contamination exactly, even with an imperfect treatment regression.
slides for Contour Instruments for Partially Linear Models with Cumulant-separated Treatment Noise
Motivation
We observe covariates X, treatment T, and outcome Y, and want the treatment coefficient θ0.
Robinson (1988) residualizes treatment and outcome: subtract their conditional means, then estimate the coefficient from the remaining variation.
- Let g0(X)=EP[T∣X], where P is the observed-data law; treatment noise is η=T−g0(X).
- Supplied regression estimates leave covariate-dependent errors in the residuals.
- Mackey et al. (2018) use non-Gaussian treatment noise to support higher-order corrections.
For correction order r≥2, Jin et al. (2025) give an absolute-error quantile upper guarantee proportional to
ε1,nrε2,n+Cθε1,nr+1+(γn)−1/2,
Here ε1,n,ε2,n bound treatment- and outcome-regression errors in Lr; Cθ bounds the coefficient; n is sample size; and γ∈(1/2,1) determines the lower (1−γ)-quantile. Their eligibility conditions apply.
Finite-order correction leaves nuisance terms that can dominate sampling error. Can treatment-noise information remove them exactly?
Key Idea
A transform zero produces a weight whose expectation vanishes after every real shift of treatment noise.
- Treatment-regression error is a shift depending on X.
- Independence of η and X turns shift cancellation into conditional cancellation.
- A contour integral combines unknown zeros without locating them individually.
The transform is M(z)=EP[ezη], with z allowed to be complex. A contour integral follows a closed circle in that complex plane.
With the conditional-mean model, independent treatment noise, fixed nonzero higher cumulant, fixed range and tail bounds, i.i.d. sampling, and sufficiently small mean absolute treatment-regression error, our estimator attains minimax mean-squared error of order n−1.
The treatment-error condition protects the zeros needed for exact cancellation.
Example
Let η have law 21N(−1,1)+21N(1,1), where N(m,v) has mean m and variance v.
Its transform vanishes at iπ/2, where i is the imaginary unit. The corresponding real weight is sin(πZn/2), with Zn=T−gˉn(X) and supplied treatment regression gˉn.
θsin,n=⎩⎨⎧Π[−Cθ,Cθ]{Pn[Znsin(πZn/2)]Pn[Ysin(πZn/2)]},0,Pn[Znsin(πZn/2)]≥e−π2/8/4,Pn[Znsin(πZn/2)]<e−π2/8/4.
Here Pn is the sample average. The numerator weights outcomes; the denominator weights treatment residuals.
Projection Π clips the ratio to the coefficient range. A small denominator triggers output zero.
Why does this weight remove covariate contamination?
Model
The population treatment and outcome regressions are
g0(X)=EP[T∣X],q0(X)=EP[Y∣X]
The innovations separate the coefficient from these covariate functions:
η=T−g0(X),ξ=Y−q0(X)−θ0η,
Thus θ0 links treatment innovation η to the outcome after removing q0(X); ξ is the remaining outcome innovation.
Require EP[ξ∣X,T]=0: the conditional outcome mean is q0(X)+θ0{T−g0(X)}.
Treat supplied estimates (gˉn,qˉn) as fixed before drawing the estimation sample, or condition on external training.
The supplied treatment regression is clipped to its known range. Residualizing treatment means subtracting this supplied function.
Assumptions
Independence: η⊥X. Every covariate value shares the same treatment-noise distribution.
Fixed non-Gaussian separation:
∣κk(η)∣≥δ.
Here k=r+1≥3, and the cumulant κk is the kth derivative of logM at zero. The positive separation δ stays fixed as n grows.
- Range bounds: ∣θ0∣≤Cθ, ∥g0∥∞≤Cg, and ∥q0∥∞≤Cq. These bound the target and covariate contamination.
- Tail bounds: EP[exp(η2/ψη2)]≤2 and EP[exp(ξ2/ψξ2)∣X]≤2. The fixed scales ψη,ψξ control the exponential weights.
- Sampling: observations are i.i.d.; all range, tail, order, and separation constants are fixed.
In the mixture example, k=4 and κ4(η)=−2.
Main Result
Compare laws satisfying the model and assumptions with the same supplied regression inputs. Denote this class by PNG,n(p;base), where p collects the parameters and “base” fixes those inputs.
Require a nonempty class, n≥2, and EP∣g0(X)−gˉn(X)∣≤ε1,n, with
ε1,n≤{4R1exp(2CgR1)}−1,
Here R1 is a fixed search radius determined by cumulant separation and the treatment-tail bound.
informal · Theorem T-3 With the model, independence, fixed cumulant, range and tail bounds, i.i.d. sampling and this treatment-error gate, the contour statistic attains minimax MSE of order n−1 on every nonempty fixed-input class with n≥2.
nc≤RnNG≤P∈PNG,n(p;base)supEP[(θspec,n−θ0(P))2]≤nC,
The statistic is θspec,n. The minimax risk RnNG is the smallest worst-case MSE over estimators using those same inputs. Positive c,C depend only on the fixed constants.
For the mixture example, the sine estimator has MSE at most C/n under the model, independence, sampling, range and outcome-tail bounds, with ε1,n≤1/π.
Zero Instruments
Suppose M has a zero z0 of multiplicity ℓ: its derivatives through order ℓ−1 vanish there.
Construct the weight
Jz0,ℓ(w)=wℓ−1ez0w,w∈C.
Here w is the residual at which we evaluate the weight. For every real shift d,
EP[Jz0,ℓ(η+d)]=0.
Expanding the shifted polynomial uses only derivatives of M through order ℓ−1; all vanish at z0.
Independence therefore gives EP[Jz0,ℓ(Zn)∣X]=0. This removes any outcome component depending only on X.
When the denominator is nonzero,
θ0=EP[ZnJz0,ℓ(Zn)]EP[YJz0,ℓ(Zn)].
This is the population weighted-outcome ratio. The mixture’s sine weight is the imaginary part of its exponential weight.
But individual zeros and their multiplicities are unknown.
Observable Transforms
Write treatment-regression error as Dn(X)=g0(X)−gˉn(X). Then Zn=η+Dn(X).
Use observable residual and outcome transforms:
Fn(z)=EP[ezZn],Gn(z)=EP[YezZn],Hn(z)=EP[ez{g0(X)−gˉn(X)}].
Fn averages exponential residual weights; Gn weights outcomes with them. The unobserved Hn is the transform of regression error.
Independence gives
Fn(z)=M(z)Hn(z)
Thus residualization multiplies the innovation transform by a nuisance factor.
Let bn(X)=q0(X)−θ0Dn(X) and Bn(z)=EP[bn(X)ezDn(X)]. The conditional-mean model gives
Gn(z)=θ0(P)Fn′(z)+M(z)Bn(z).
The prime means differentiation in z. Dividing by Fn separates a coefficient term θ0(P)Fn′/Fn from covariate contamination Bn/Hn.
Contour Identification
Choose a counterclockwise circle Cj with:
- No zero of Fn on its boundary.
- No zero of Hn on or inside it.
- A positive enclosed zero count NCj(Fn), including multiplicities.
informal · Theorem T-2 In the non-Gaussian class, a bank circle identifies θ0(P) when Fn is nonzero on its boundary, Hn is nonzero on and inside it, and its enclosed zero count is positive.
(θ0(P):C)=ΘCj(Fn,Gn)={NCj(Fn)2πi}−1∮CjFn(z)Gn(z)dz.
The integral accumulates the observable ratio around the circle; ΘCj divides it by the enclosed count and 2πi.
- The integral of Fn′/Fn equals 2πi times the zero count.
- The contamination Bn/Hn is analytic—complex differentiable throughout the interior—so its integral is zero.
Each enclosed zero contributes the same coefficient. Dividing by their count recovers θ0.
What guarantees a usable circle?
Treatment-error Stability
The first requirement is that regression error contributes no zeros:
∣z∣≤R1sup∣Hn(z)−1∣≤R1e2CgR1ε1,n.
This bounds how far the nuisance transform can move from one across the search disk.
Bounded treatment regressions give ∣Dn∣≤2Cg. Under the main result’s error gate, the right side is at most 1/4, so ∣Hn∣≥3/4.
Consequently, Fn=MHn and M have the same zeros there, including multiplicities.
The mixture makes the same protection concrete:
EP[Znsin(2πZn)]=e−π2/8EP[cos(2πDn)],
This is its population denominator. When EP∣Dn∣≤1/π, it is at least e−π2/8/2.
Regression error changes instrument strength while preserving exact cancellation.
Why Zeros Must Exist
Suppose the innovation transform had no zeros throughout a large disk.
- Then logM would be analytic throughout that disk, with value zero at the origin because M(0)=1.
- The sub-Gaussian tail restriction bounds transform growth: the real part of logM has a quadratic upper envelope.
- Analytic derivative bounds then force derivatives of order k≥3 at the origin to become small as the zero-free disk grows.
- But that derivative is κk(η), whose magnitude must be at least the fixed δ.
These restrictions cannot coexist on an arbitrarily large zero-free disk.
informal · Lemma L-2 A centered treatment innovation with k=r+1, r≥2, sub-Gaussian scale at most ψη, and ∣κk(η)∣≥δ has a transform zero within radius R0.
Ak=(2k+4k!)1/(k−2),R0=Ak(ψη2/δ)1/(k−2),M(z)=EP[ezη].
This computes the guaranteed zero radius: Ak depends only on order, ψη controls growth, and δ prevents higher derivatives from being too small.
A Protected Contour Bank
Set R1=R0+1. Every circle with radius strictly between R0 and R1 encloses the guaranteed zero.
Avoiding boundary zeros alone is insufficient: estimation also needs the transform bounded away from zero.
- The fixed tail envelope and normalization M(0)=1 bound how many zeros can occur in a slightly larger disk.
- Place finitely many candidate radii between R0 and R1, with enough candidates to avoid small neighborhoods of every zero’s distance from the origin.
- After accounting for these zeros, the same analytic growth control bounds the remaining factor away from zero on a protected circle.
Thus one bank, fixed before seeing the distribution, guarantees a circle with positive count and a fixed positive boundary lower bound a⋆.
informal · Lemma L-3 Under the non-Gaussian class assumptions, a finite bank determined by the fixed constants contains a circle between R0 and R1 that encloses a zero and satisfies ∣M(z)∣≥a⋆>0 on its boundary.
Since ∣Hn∣≥3/4, this protection transfers to Fn. The protected index may vary across distributions; the bank and lower bound remain fixed.
Pilot Selection
Split the sample: a pilot fold selects the circle and count; an independent evaluation fold estimates the coefficient.
For fold a, with observation indices Ia, compute
Fa,n(z)=∣Ia∣−1i∈Ia∑exp(zZn,i),Ga,n(z)=∣Ia∣−1i∈Ia∑Yiexp(zZn,i),
Here Zn,i=Ti−gˉn(Xi). These sample averages estimate Fn and Gn.
For each pilot circle with a positive boundary denominator, compute its empirical zero count:
Nj=2πi1∮CjF0,n(z)F0,n′(z)dz
The logarithmic-derivative integral counts zeros of the pilot transform. Numerical integration isolates its unique integer value.
Retain circles with boundary lower bound at least a⋆/2 and Nj≥1. Select the retained circle with the strongest lower bound; call its index j⋆.
Why does its pilot count equal the population count?
Stability of the Count
A zero count changes only when a zero crosses the contour boundary.
If supz∈Cj∣F0,n(z)−Fn(z)∣<infz∈Cj∣Fn(z)∣, continuously moving from Fn to F0,n never makes a boundary value zero.
Therefore their enclosed counts agree, even if individual zeros move or split.
Under our model, range, tail and sampling assumptions,
EP⊗n[∣z∣≤R1sup∣Fa,n(z)−Fn(z)∣2]+EP⊗n[∣z∣≤R1sup∣Ga,n(z)−Gn(z)∣2]≤∣Ia∣K.
Here K is fixed. The bound controls both transforms uniformly across the whole search disk, hence every candidate circle.
- Small pilot error makes the guaranteed protected circle eligible.
- Every retained circle then has a population boundary margin larger than that error, so Nj⋆=NCj⋆(Fn).
- Crossing a fixed error threshold has probability at most a constant divided by n, by the squared-error bound.
Thus an incorrect normalization is confined to an event whose contribution to MSE can be controlled.
Evaluation and Risk
On the independent evaluation fold, check the selected boundary denominator again and approximate
Nj⋆2πi1∮Cj⋆F1,n(z)G1,n(z)dz
This is the empirical identifying integral on the selected circle, normalized by its pilot count.
- Correct normalization: on the small-error event, the pilot count equals the population count.
- Stable division: protected boundary denominators turn transform errors into coefficient errors with a fixed amplification bound.
- Bounded failures: clip the real output to [−Cθ,Cθ]; failed checks return zero. The squared loss is bounded, so events with probability at most a constant divided by n contribute at most that order to MSE.
- Numerical accuracy: integration error is at most 1/n.
Exact population cancellation and uniform transform variance yield the C/n upper bound.
For the matching lower bound, keep treatment, regressions and supplied inputs fixed; vary the coefficient with independent Gaussian outcome noise. Coefficients separated by h/n, for a fixed small h, remain difficult to distinguish.
Open Questions
What happens when non-Gaussian separation weakens with sample size?
∣κk(ηn)∣≥δnwithδn↓0
Here ηn is a changing treatment-noise law and δn its shrinking separation threshold.
- Determine sharp minimax MSE as a function of (n,ε1,n,ε2,n,δn).
- Select from data among double/debiased machine learning, finite-order corrections, and contour procedures.
- Establish uniformly valid inference and matching local minimax lower bounds.
Takeaways
- Transform zeros give weights that cancel every covariate-dependent treatment-regression shift; contour integration removes the remaining covariate contamination exactly.
- Fixed cumulant separation and tail bounds guarantee a localized zero and a protected circle in a finite bank. Small mean absolute treatment error preserves that geometry.
- Uniform transform control preserves the pilot zero count and stabilizes evaluation. Under the model, independence, fixed bounds, i.i.d. sampling and explicit treatment-error gate, the resulting fixed-input minimax MSE is of order n−1.
Appendix: Zero-based Instruments
A known innovation-transform zero yields a shift-annihilating instrument and, when its denominator is nonzero, an identifying moment ratio.
Fix a model-parameter record p, a model m with observed-data law P, and an integer n≥1. Let M(z)=EP[ezη],η=T−g0(X),Zn=T−gˉn(X),Hn(z)=EP[ez{g0(X)−gˉn(X)}]. Suppose that:
- (Non-Gaussian class.) The model m belongs to PNG,n as specified in Definition P-1.
- (Zero and multiplicity.) For some z0∈C and integer ℓ≥1, M(z0)=0 and the analytic order of M at z0 is ℓ.
- (Instrument.) Jz0,ℓ is the zero-based instrument from Definition P-4, equivalently Jz0,ℓ(w)=wℓ−1ez0w.
Then, for every d∈R, EP[Jz0,ℓ(η+d)]=0. Moreover, EP[Jz0,ℓ(Zn)∣X]=0P-almost surely, and EP[ZnJz0,ℓ(Zn)]=M(ℓ)(z0)Hn(z0). Whenever the denominator is nonzero, EP[ZnJz0,ℓ(Zn)]=0, the coefficient is identified by θ0=EP[ZnJz0,ℓ(Zn)]EP[YJz0,ℓ(Zn)].
Appendix: Exact Contour Identification
A contour with a zero-free boundary, zero-free nuisance factor inside, and positive zero count identifies the coefficient exactly.
Fix n≥1, a law P∈PNG,n as in Definition P-1, and a certified contour-bank input p⋆ as in Definition P-12. For any bank index j∈{0,…,Jbase}, let Cj be the positively oriented circle with radius ρj, and let Fn(z)=EP[ezZn],Gn(z)=EP[YezZn],Hn(z)=EP[ez{g0(X)−gˉn(X)}]. Assume:
- (Residual zero-freeness.) Fn(z)=0 for every z∈Cj.
- (Nuisance zero-freeness.) Hn(z)=0 for every z on or inside Cj.
- (Positive contour count.) The zero count NCj(Fn), counted with multiplicity inside Cj, satisfies NCj(Fn)≥1.
Then the contour functional of Definition P-5 identifies the partially linear coefficient and is given by the normalized contour integral: (θ0(P):C)=ΘCj(Fn,Gn)={NCj(Fn)2πi}−1∮CjFn(z)Gn(z)dz.
Appendix: Fixed-code Minimax Estimation
With fixed cumulant separation and the treatment-error gate, the finite contour statistic attains matched fixed-code MSE bounds and the stated generalized-quantile bound.
Fix r≥2 and positive constants δ,Cθ,Cg,Cq,ψη,ψξ. Then there are constants c>0 and C>0, depending only on these fixed primitive constants, such that the following statements hold. For every measurable covariate space, let p0 be a parameter record whose primitive entries r,δ,Cθ,Cg,Cq,ψη,ψξ equal the fixed constants above, and fix one experiment-wide record consisting of the certified contour-bank input and the represented range input for p0. For every parameter record p with the same primitive entries as p0, and for every base model satisfying the usual measurability, conditional-mean, and integrability requirements, write n for the sample size of p. Let θspec,n be the total Borel statistic of Definition P-13, constructed from the transported fixed records and the base treatment-code sequence. Define the fixed-code non-Gaussian class PNG,n(p;base)={P: P∈PNG,n of def:non-gaussian-class, gˉn(P)=gˉn(base), qˉn(P)=qˉn(base)}. Define the fixed-code JMS ACE class PACE,nJMS(p;base)={P: P∈PACE,nJMS of def:jms-ace-class, gˉn(P)=gˉn(base), qˉn(P)=qˉn(base)}.
- (Measurable statistic.) The statistic θspec,n is measurable.
- (Represented execution.) For every compiled bounded spectral adapter satisfying the full canonical build-and-compilation specification for p, the transported fixed records, and the base treatment-code sequence, the represented-data execution realizes the same θspec,n as in Definition P-13.
- (Class relations.) Every law in PACE,nJMS belongs to PNG,n. If s=r, then PACE,nJMS coincides with the Ls(PX)-restricted subclass PNG,nACE of Definition P-10.
- (Non-Gaussian fixed-code risk.) If the sample law is the i.i.d. product law of Assumption A-1, PNG,n(p;base) is nonempty, n≥2, and ε1,n≤{4R1exp(2CgR1)}−1, where R1 is the search radius from the contour-bank construction in Definition P-13, then nc≤RnNG≤P∈PNG,n(p;base)supEP[(θspec,n−θ0(P))2]≤nC, and P∈PNG,n(p;base)supQP,1−γ(∣θspec,n−θ0(P)∣)≤γnC, with generalized lower quantiles as in Definition P-15.
- (ACE fixed-code risk.) If PACE,nJMS(p;base) is nonempty, n≥2, and ε1,n≤{4R1exp(2CgR1)}−1, then nc≤θinfP∈PACE,nJMS(p;base)supEP[(θ−θ0(P))2]≤P∈PACE,nJMS(p;base)supEP[(θspec,n−θ0(P))2]≤nC, where the infimum is over measurable real-valued estimators of O1,…,On. Moreover, P∈PACE,nJMS(p;base)supQP,1−γ(∣θspec,n−θ0(P)∣)≤γnC.