CausalSmith · seminar slides
Recovering Causal Responses when Treatment Is Scarce
We recover a smooth causal response across the covariate domain even when treated observations concentrate in narrow regions.
slides for Minimax Response Recovery under Global Overlap Tails
Motivation
A practitioner wants the mean outcome under treatment at each covariate value:
μ1(x)=EP[Y(1)∣X=x].
Here X contains covariates, Y(1) is the potential outcome under treatment, and P is the population law.
- The usual approach fits a local polynomial to treated outcomes: Fan and Gijbels (1996).
- Many treated observations can still provide little variation in one covariate direction.
- Write e(x)=P(A=1∣X=x) for the propensity, the probability of treatment at covariate value x. Dorn (2026), our closest comparator, obtains a pure-power uniform probability guarantee with an additional local restriction: every small neighborhood must give a positive fraction of its covariate mass to treatment probabilities within a fixed factor of that neighborhood's maximum.
Can global control of small treatment probabilities support recovery despite this local geometric difficulty?
Key Idea
Give fixed fitting regions equal total weight, then choose the finest resolution with enough treated observations in every region.
Under causal identification, covariate density bounded below, bounded treated means, conditionally sub-Gaussian noise, global overlap tails, and known response smoothness β>1, the optimal error scale is
n−β/(2β+dγ/(γ−1)).
Here n is sample size, d is covariate dimension, and γ>1 controls the prevalence of small treatment probabilities.
- One estimator achieves this scale for expected largest error across the domain, uniformly over fixed compact ranges of γ.
- Matching pointwise lower bounds hold for every fixed γ>1 and every fixed evaluation point.
- Equal weights repair fitting geometry; treatment counts control precision.
Example
Treatment can concentrate in a narrowing strip.
Let d≥2, let X be uniform on [0,1]d, and let x∘=(1/2,…,1/2) be its center. Write R(x)=∥x−x∘∥∞ for distance from the center and FR(t)=P(R(X)≤t).
Choose 1<a<1+d/(γ−1). Define
S={x∈X:∣x2−x2∘∣≤∣x1−x1∘∣a},e⋆(x)=min{1,FR(R(x))1/(γ−1)+411S(x)}.
Here X=[0,1]d, S is the strip, and e⋆(x) is treatment probability.
The radial component supplies treatment away from the center; the strip adds treatment close to X2=1/2. Bounded Bernoulli potential outcomes with constant means isolate the assignment geometry.
Missing Coordinate Variation
Consider the local fitting neighborhood ∥X−x∘∥∞≤h, where h is its width scale.
The treated second-coordinate displacement, divided by h, has second moment
h↓0limPstrip{A=1, ∥X−x∘∥∞≤h}∫{A=1, ∥X−x∘∥∞≤h}(hX2−1/2)2dPstrip=0.
The denominator normalizes by treated probability in the neighborhood; the numerator averages squared displacement in units of neighborhood width. Pstrip denotes the example’s law.
- Inside the strip, second-coordinate displacement is at most h to the power a; relative displacement vanishes because a>1.
- The chosen upper bound on a makes strip treatment dominate radial treatment as the neighborhood shrinks.
- Thus the ordinary local fitting matrix loses variation in coordinate two, despite the global overlap bound.
Model
Observe n independent triples (Xi,Ai,Yi), collected in Dn. Here Ai=1 denotes treatment and Yi is the observed outcome.
- Consistency: Y=AY(1)+(1−A)Y(0); the observed outcome corresponds to the realized treatment.
- Exchangeability: (Y(0),Y(1))⊥A∣X; conditioning on covariates removes dependence between assignment and potential outcomes.
- The propensity is e(x)=P(A=1∣X=x).
Under global overlap control with γ>1,
PX{x:e(x)=0}=0,μ1(x)=EP[Y∣A=1,X=x]for PX-almost every x.
Here PX is the covariate distribution. This identifies the causal response through treated outcome regression. Continuity and covariate coverage extend identification to every point of the closed cube.
Assumptions
Fix common constants B,L>0, C≥1, and 0<cf≤1.
- Covariate coverage: the density satisfies f(x)≥cf on [0,1]d, so every region receives covariate probability proportional to its volume.
- Response control: the treated mean has magnitude at most B. Centered treated outcomes are conditionally sub-Gaussian: their conditional exponential moments are bounded by exp(λ2B2/2), controlling large noise fluctuations.
- Known smoothness: μ1∈Hβ(L), with known β>1. Derivatives through m=⌈β⌉−1 are bounded by L; order-m derivatives change by at most L∥x−x′∥∞β−m.
Global overlap limits the covariate probability assigned to small treatment probabilities:
P{e(X)≤t}≤Ctγ−1for every t∈[0,1].
The strip example satisfies this bound with C=1; its constant response satisfies smoothness.
Call the causal law class satisfying these restrictions Pγ.
Main Result
Fix Γ=[γmin,γmax], with 1<γmin<γmax<∞.
The effective dimension, benchmark mesh width, and error scale are
Dγ=γ−1dγ,hγ,n=n−1/(2β+Dγ),rγ,n=hγ,nβ.
Weak overlap increases effective dimension from d to Dγ, slowing recovery.
informal · Theorem T-2 Under our fixed-constant causal model with known β>1, one count-selected estimator has expected supremum error at most Krγ,n for all sufficiently large n, uniformly over γ∈Γ and P∈Pγ.
There are common constants K>0 and n0 such that, for every n≥n0, γ∈Γ, and P∈Pγ,
EP⊗n[x∈Xsup∣μn(x)−μ1,P(x)∣]≤Krγ,n.
Here μn is our estimator, μ1,P is the response under P, and P⊗n is the independent-sample law. We average each sample’s largest spatial error.
The estimator uses n,d,β,B,Dn. The same guarantee covers the strip’s center and the cube’s boundaries.
Stable Polynomial Geometry
Partition the domain into cubes of side length h, and normalize each cube to the unit cube.
Let U(z)=(zα)∣α∣≤m collect monomials through degree m. Fixed tensor nodes vℓ, numbered ℓ=1,…,J, identify every polynomial in this basis.
Their equally weighted fitting matrix is
G0=J1ℓ=1∑JU(vℓ)U(vℓ)⊤,λ0=λmin(G0),
where λ0>0 is its smallest eigenvalue.
- Place a small reference microcube Vℓ around each node; a microcell is its scaled copy inside a partition cube.
- Average observations within each microcell, then give every microcell total weight 1/J.
- Every fitting location remains close to its node, so the empirical fitting matrix has smallest eigenvalue at least λ0/2 whenever all counts are positive.
In the strip example, abundant observations near the central hyperplane cannot overwhelm the weights assigned to other locations.
Mesh Selection
Stable geometry still needs enough observations in each microcell.
Search candidate dyadic widths h, which halve successively. Let Hn be the candidate collection and Qh its cube partition.
For cube Q, with corner aQ, place and count the fitting microcells:
EQℓ=aQ+hVℓ,NQℓ=i=1∑n1{Xi∈EQℓ,Ai=1}.
Here EQℓ is a microcell and NQℓ its treated count.
Keep widths satisfying
Fn={h∈Hn:Q∈Qh,1≤ℓ≤JminNQℓ≥h−2β},
so every fitting microcell has enough treated observations.
Select the smallest feasible width, h=minFn. The threshold makes count-based noise scale NQℓ−1/2 no larger than approximation scale hβ.
Selection uses observed treatment counts and known smoothness.
Response Estimator
At h=h>0, fit a polynomial separately in each cube Q.
Each treated observation in microcell EQℓ receives least-squares weight 1/(JNQℓ). Thus each microcell contributes total weight 1/J, regardless of its count.
Let cQ be the resulting coefficient vector. Evaluate the polynomial throughout its cube:
μn(x)=clip[−B,B]{U(hx−aQ)⊤cQ},clip[−B,B](t)=max{−B,min{B,t}}.
Here Q contains x, and (x−aQ)/h is its normalized location.
Clipping projects predictions onto the known response interval. If no width is feasible, output the zero function.
Stable fitting converts smoothness into approximation error bounded by a constant times hβ, throughout each cube.
What guarantees enough treatment information at a useful width?
Treatment Information
For any covariate region E, let u=P(X∈E). Global overlap implies
P(A=1,X∈E)≥γγ−1C−1/(γ−1)uγ/(γ−1).
This bounds treated probability using only the region’s covariate probability: a large region cannot consist entirely of extremely small propensities.
Let qQℓ=P(A=1,X∈EQℓ), and qQ=minℓqQℓ. Sort the cubes by increasing qQ; q(k) is rank k.
To control rank k:
- Select one weakest microcell from each of the k weakest cubes.
- Their disjoint union has covariate probability at least a constant times khd, by coverage.
- Its treated probability is at most kq(k), since each selected mass is at most q(k).
Apply the regional bound to that union and divide by k:
q(k)≥κΓhDγk1/(γ−1),Dγ=γ−1dγ,
where κΓ>0 is common across Γ. Treatment information improves with rank.
Bias–variance Balance
The weakest treated microcell has mass at least a constant times hDγ, hence expected count at least a constant times nhDγ.
The benchmark width balances expected count against the feasibility threshold:
nhγ,nDγ=hγ,n−2β.
At this width, approximation and sampling noise share scale rγ,n.
Count concentration connects this population balance to the selected width. With probability at least 1−n−2,
0<h≤Khγ,n,NQℓ≥5nqQℓfor every Q∈Qh and every ℓ.
The first inequality controls approximation error. The second ensures empirical counts retain a fixed fraction of population information, including the improvement with rank.
How does that improvement control the largest noise error?
A Summable Spatial Maximum
Condition on sampled covariates and treatment indicators. In the cube of rank k, each centered coefficient has variance proxy bounded, up to a common constant, by
min{h2β,n−1h−Dγk−1/(γ−1)}.
A variance proxy bounds the exponential moments of centered noise. Feasibility supplies the first term; ordered treated masses supply the second.
At the benchmark width, the second term equals the benchmark error squared times a decreasing rank factor.
For one coefficient coordinate, let Zk be its centered error in rank-k cube, and let N be the number of cubes. For a positive standardized threshold u, exponential tails and a union bound give
P(max1≤k≤N∣Zk∣>urγ,n∣(Xi,Ai)i=1n)≤2∑k=1Nexp{−cu2k1/(γ−1)},
where c>0 is a common constant.
For u≥1, extending the sum to infinitely many ranks gives an integrable tail bound, uniform over Γ. Integrating it bounds the expected maximum by a constant times rγ,n.
There are only a fixed number of polynomial coefficients. No independence across cubes is needed.
Finer Selected Widths
The selector may choose a width finer than the benchmark.
Then more ranks can remain at the common feasibility cap before the decreasing rank bound takes over.
- The number of capped ranks grows as a power of the benchmark-to-selected width ratio.
- Their maximum contributes the square root of its logarithm.
- Beyond those ranks, the exponentially decreasing tail sum again stays controlled.
The resulting conditional coefficient bound is
E[Q∈Qhmax∥cQ−E[cQ∣(Xi,Ai)i=1n]∥∞(Xi,Ai)i=1n]≤Khβ1+max{0,log(hγ,n/h)}≤K′rγ,n.
Here the vector norm takes the largest absolute coefficient error. The factor hβ decreases fast enough to absorb the logarithm; h≤Khγ,n handles coarser selections.
Stable geometry transfers coefficient control to response error. Clipping bounds loss on the exceptional samples, whose probability is at most n−2.
Why the Rate Is Optimal
For every fixed γ>1 and every fixed x0∈[0,1]d, including boundary points, there are constants 0<cγ≤Kγ<∞ such that, for every n≥1,
cγrγ,n≤TinfP∈PγP admits a causal completion withY(0),Y(1)∈{0,B} a.s.supEP⊗n∣T(Dn,x0)−μ1,P(x0)∣≤Rpt(n,γ,x0)≤R∞(n,γ)≤Kγrγ,n.
The infimum ranges over all sample-based estimators T. The supremum selects the hardest admissible law, already among two-valued potential outcomes. Rpt and R∞ are the minimax expected point error and expected largest spatial error.
The constants may depend on γ,x0, and fixed parameters. This fixed-exponent comparison holds from n=1; the estimator’s upper guarantee has common K,n0 across Γ.
The construction uses uniform covariates and a radial propensity centered at x0. Set the bump width to h=hγ,n, and perturb the response by δhβψ((x−x0)/h), where ψ is a fixed smooth compactly supported bump and δ>0 is a fixed small constant. Thus the spatial width is h, while the response height is of order hβ=rγ,n. Treatment mass in the bump region is of order hDγ, so the sample information scales as nhDγ+2β. At the benchmark width this remains bounded, and the two laws satisfy nKL(P0,h,P1,h)≤81. Here KL is relative entropy: the samples contain too little information to reliably distinguish the two responses.
Open Questions
Can one estimator adapt to both unknown response smoothness β and unknown overlap exponent γ?
- A proposed procedure compares equal-cell fits across polynomial degrees and count-feasible meshes.
- Sample splitting reserves separate observations for fitting and comparison.
- Attainment of the oracle scale, and any unavoidable logarithmic adaptation cost, remain open.
Gaïffas (2005) establishes a logarithmic cost of joint pointwise adaptation in a separate one-dimensional degenerate-design experiment. The corresponding question under global overlap tails remains unresolved.
Takeaways
- Geometry: equal microcell weights preserve the covariate variation needed for polynomial fitting, even when treatment concentrates in a strip.
- Information: global overlap controls both the weakest treated masses and the number of poorly informed regions; the improving ranks make the spatial noise tail summable.
- Recovery: with known smoothness and our fixed model conditions, count selection attains the optimal pure-power expected supremum scale uniformly across compact overlap ranges, with matching fixed-exponent pointwise lower bounds.
Appendix: Adaptive Minimax Response Recovery
One count-selected estimator attains the expected supremum guarantee; bounded two-valued experiments establish matching pointwise minimax lower bounds.
Fix the model parameters subject to the following conditions:
- (Dimension and smoothness.) d∈N, d>0, and β>1.
- (Response and smoothness bounds.) B>0 and L>0.
- (Overlap and density constants.) C≥1 and 0<cf≤1.
- (Adaptation interval.) The real endpoints satisfy 1<γmin<γmax, and the adaptation interval is Γ=[γmin,γmax].
Let X=[0,1]d be the covariate cube, and let Pγ be the observational causal model of Definition P-2, with fixed parameters d,β,B,L,C,cf,γ, including the propensity-tail envelope in Assumption A-7. Define the effective dimension Dγ, oracle mesh hγ,n, and oracle response-recovery scale rγ,n, for n≥1, by Dγ=γ−1dγ,hγ,n=n−1/(2β+Dγ),rγ,n=hγ,nβ. The count-selected equal-cell estimator μn of Definition P-5 takes n,d,β,B and the observed sample Dn as inputs. There exist K>0 and n0∈N such that, for every integer n≥max{n0,1}, every γ∈Γ, and every P∈Pγ, EP⊗n[x∈Xsup∣μn(x)−μ1,P(x)∣]≤Krγ,n. Here P⊗n is the sampling law of n independent observed triples (X,A,Y), and μ1,P is the treated causal response under P. For every real γ>1 and every x0∈X, there exist finite constants 0<cγ≤Kγ, possibly depending on x0 and the fixed model parameters, such that, for every integer n≥1, cγrγ,n≤TinfP∈PγP admits a causal completion withY(0),Y(1)∈{0,B} a.s.supEP⊗n∣T(Dn,x0)−μ1,P(x0)∣≤Rpt(n,γ,x0)≤R∞(n,γ)≤Kγrγ,n. The infimum ranges over sample-measurable estimators T; the pointwise and expected supremum minimax risks Rpt and R∞ are those of Definition P-6.
Appendix: Thin-strip Enlargement
An admissible global-tail design can violate local anti-concentration and have vanishing normalized treated variation in one coordinate.
Suppose the parameters satisfy:
- (Dimension and smoothness.) d∈N, d≥2, and β>1.
- (Model constants.) B>0, L>0, C≥1, and 0<cf≤1.
- (Overlap and strip exponent.) γ>1 and 1<a<1+γ−1d.
For every such a, let Pstrip and its displayed selected propensity e⋆ be the construction in Definition P-8, and let Pγ denote the model class with the fixed parameters (d,β,B,L,C,cf,γ). Then Pstrip∈Pγ, and Pstrip{e⋆(X)≤t}≤tγ−1,t∈[0,1]. On the unit cube X=[0,1]d, the numerical anti-concentration clause fails: there are no ρ,ν,h0>0 such that, for every x0∈X and every 0<h≤h0, Pstrip{∥X−x0∥2≤h}Pstrip{e⋆(X)≥ρsupx∈X∥x−x0∥2≤he⋆(x), ∥X−x0∥2≤h}>ν. This failure applies to the numerical clause allowing propensity values equal to one. Consequently, the full singleton-family predicate A3Dorn(Pstrip), evaluated using e⋆, also fails. Moreover, writing x∘=(1/2,…,1/2), the normalized treated-design second moment in the second coordinate satisfies h↓0limPstrip{A=1, ∥X−x∘∥∞≤h}∫{A=1, ∥X−x∘∥∞≤h}(hX2−1/2)2dPstrip=0. In particular, Pγ contains a law whose full singleton-family Dorn predicate fails for the displayed selected propensity e⋆.
Appendix: Gaussian Source Transfer
The expected supremum upper guarantee transfers to fixed-constant Gaussian source envelopes under their retained restrictions.
Fix parameters satisfying:
- (Dimension and smoothness.) d∈N, d≥1, and β>1.
- (Source constants.) q>3 and M,σmin,C,L0>0.
- (Adaptation range.) 1<γmin<γmax, with Γ=[γmin,γmax].
For each γ∈Γ, let Dγ be the maximal envelope of source-law tuples consisting of an observed law P, treated and control mean functions, and a selected propensity eP, satisfying the following retained restrictions from Dorn2026GlobalOverlap (Section 2, Assumptions 1--2, pp.~3--7): X is uniform on [−1,1]d; the selected propensity belongs to (0,1) almost surely; conditional on X,A, the outcome is Gaussian with variance σmin2; both conditional mean functions belong to ΣD(β,L0); and EP[∣Y∣q∣X,A=1]≤Mq,VarP(μP(X))≤M,VarP(Y∣X,A)≥σmin2, P{eP(X)≤t}≤Ctγ−1(0≤t≤1). Here μP is the selected treated mean. The source class ΣD(β,L0) consists of functions in Cm([−1,1]d), with continuous boundary traces of their derivatives, whose derivatives of order m=max{k∈Z:k<β} have (β−m)-Hölder seminorm at most L0, using the source's convention. Let T, the affine transport from the unit cube to the source cube, and the common response bound B∗ be T(x)=2x−1,B∗=max{M,σmin}. Define the common transported Hölder radius and the interpolation constant by L∗=u∈ΣD(β,L0)supx∈[−1,1]d∣u(x)∣≤Msup∥u∘T∥Hβ, Cd,β=M′>0, L0′>0u∈ΣD(β,L0′)supx∈[−1,1]d∣u(x)∣≤M′supM′+L0′∥u∘T∥Hβ. The functional ∥⋅∥Hβ is the full Hölder-radius functional on [0,1]d, including the function, lower derivatives, and top-derivative modulus. Then 0<Cd,β<∞,0<L∗≤Cd,β(M+L0)<∞. Every member of Dγ, after replacing X by T−1(X), belongs to the global-tail causal class Pγ with constants B=B∗,L=L∗,C=C,cf=1. In particular, its transported observed law admits a consistency-and-exchangeability causal completion with these constants. Let μn be the equal-cell estimator of Definition P-5, with smoothness β and response bound B∗, applied to n independent transported observations. Write rγ,n, the oracle risk scale, as rγ,n=n−β/(2β+dγ/(γ−1))(n≥1). There exist K>0 and n0∈N such that, for every n≥n0, every γ∈Γ, and every source tuple in Dγ, EP⊗n[x∈[0,1]dsup∣μn(x)−μP(T(x))∣]≤Krγ,n. Every source family P satisfying the cited Assumptions 1--2 with the fixed displayed constants is nonempty and contained in Dγ. The same K,n0 therefore satisfy P∈PsupEP⊗n[x∈[0,1]dsup∣μn(x)−μP(T(x))∣]≤Krγ,n(n≥n0). For every ε>0, there exist c(ε)>0 and n0∈N such that, simultaneously for all n≥n0, γ∈Γ, and source tuples in Dγ, P⊗n{μn∘T−1−μPL∞(P)>c(ε)rγ,n}≤ε. Here the norm is the essential supremum under the source covariate law, and the estimator is computed from the transported sample. If d≥2, then for each γ∈Γ there exist positive finite constants C′,M′,σmin′,L0′ and a source tuple with uniform covariates, Gaussian conditional outcomes, and a selected pointwise propensity representative satisfying all the retained restrictions with these constants, for which ¬A3Dorn({P},(eP)), where the family-level condition is defined in Definition P-7. The constants in this existence assertion are selected separately for each γ. For any nonempty family P of source-law tuples sharing a common treated regression curve μ∘, meaning μP(x)=μ∘(x)(P∈P, x∈Rd), the minimax pointwise miss-probability value at any evaluation point x0, sample size n∈N, and positive threshold cr, with c,r>0, equals zero. Finally, for every γ>1 and every x0∈[0,1]d, there exists cγ>0 such that cγrγ,n≤Rpt(n,γ,x0)(n≥1), where Rpt is the pointwise minimax expected absolute-error risk of Definition P-6 over the causal class with constants B∗,L∗,max{C,1}, and cf=1. The displayed lower bound is first established for the two-valued potential-outcome subclass risk; monotonicity under class inclusion transfers it to Rpt. The constant cγ may depend on the evaluation point and the fixed parameters.