CausalSmith · seminar slides
Confidence Intervals for Transported Complier Effects
How precisely can an encouragement experiment measure treatment effects for compliers in a population that supplies only covariates?
slides for Honest Confidence Intervals for Transported Complier Effects with Rough Nuisance Functions
Motivation
An encouragement experiment records covariates, encouragement, treatment receipt and outcomes.
A target population supplies only covariates. We want its average treatment effect among compliers: people whose receipt changes when encouraged.
The standard approach transports source encouragement-arm contrasts, divides the outcome contrast by the receipt contrast, and applies the delta method.
Chen and Huang (2025) identify this ratio and establish regular inference under their assignment, selection and moment conditions, at a fixed positive first stage.
Two difficulties interact:
- Rough transport functions leave nonlinear estimation bias after first-order correction.
- Weak compliance makes division by an estimated first stage unstable.
How short can intervals be if coverage must hold even under arbitrarily weak positive compliance?
Key Idea
Correct the two transported contrasts through cubic order. Then retain candidate effects whose implied outcome contrast agrees with the estimated outcome contrast.
This separates two tasks: controlling rough-function estimation error and handling weak compliance.
Our setting has independent source and target samples of size n, scalar covariates, bounded outcomes and Hölder-1/8 nuisance functions.
informal · Theorem T-3 Under our equal-size Hölder-1/8 model, fixed overlap, valid monotone encouragement and both complier transport equalities, optimal honest expected length is of order min{1,n−1/3/a} for n≥256, 0<a≤1/4.
Here a is a compliance floor used to evaluate precision. One observable interval sequence attains this order without knowing a.
Example
Consider a balanced encouragement experiment.
- Both populations have uniform covariates; encouragement probability is one half.
- Compliers have share b; always-takers and never-takers each have share (1−b)/2.
- Binary outcomes have mean one half in both encouragement arms.
Its density and arm-mean functions are
fS=fT=1,e=21,mDz=rz(b),mYz=21,
where fS,fT are covariate densities, e is encouragement probability, and mAz is the mean response A in arm z. Receipt probability is rz(b)=(1+(2z−1)b)/2.
For this center law P⋆,
μ(P⋆)=b,θ(P⋆)=0.
The transported compliance share μ is b; the target complier effect θ is zero.
Our lower bound will compare this center with rough alternatives that have different effects but are difficult to distinguish observationally.
Model
We observe n independent source records (X,Z,D,Y) and n independent target covariates X; the samples are independent.
- X∈[0,1]; encouragement Z and receipt D are binary.
- D(z) is potential receipt under encouragement z.
- Y(d)∈[0,1] is the potential outcome under receipt d.
- C=1{D(1)>D(0)} indicates a complier; S=0 denotes target membership and S=1 source membership.
The estimand is
θ=EPnF[C∣S=0]EPnF[(Y(1)−Y(0))C∣S=0],
where PnF is the full-data law of populations and potential variables.
The numerator averages effects weighted by complier status; the denominator normalizes by target complier prevalence. Bounded outcomes give the effect domain Θ=[−1,1].
Assumptions
Fixed overlap and roughness. Both covariate densities lie between fixed envelopes 0<cf<1<Cf. Encouragement probabilities lie between 1/4 and 3/4. Densities, propensity and four arm means have supremum norm at most L>1 and changes bounded by L∣x−x′∣1/8.
Valid encouragement. Conditional on X, source encouragement is independent of potential variables. Observed variables satisfy consistency, and encouragement affects outcomes through receipt.
Monotonicity. D(1)≥D(0): encouragement never prevents receipt.
Two transport equalities. At almost every target covariate value,
EPnF[(Y(1)−Y(0))C∣X=x,S=0]=EPnF[(Y(1)−Y(0))C∣X=x,S=1],
EPnF[C∣X=x,S=0]=EPnF[C∣X=x,S=1],
These carry the complier-weighted effect and complier prevalence across populations.
In the balanced example, the same conditional potential-variable law in both populations satisfies both equalities.
Identification
Let mAz(x) be the source mean of response A∈{D,Y} in encouragement arm z, and let ΔA(x)=mA1(x)−mA0(x).
Average each source contrast over the target covariate distribution:
TA=∫ΔA(x)fT(x)dx.
This computes the transported receipt or outcome contrast.
Validity and monotonicity make the receipt contrast a complier share and the outcome contrast a complier-weighted effect. The two transport equalities then give
μ=TD,θ=TDTY.
We assume μ>0, allowing it to approach zero.
informal · Lemma L-1 Under our sampling, regularity, valid-encouragement, monotonicity and two complier transport restrictions, TD equals target complier prevalence and TY/TD identifies the target complier effect.
Honest Inference
Let Mn collect the assumptions just given, including every positive compliance share.
Fix noncoverage probability 0<α<1. An interval is honest if coverage is at least 1−α at every law in Mn.
Evaluate precision on the slice Mn(a), where a≤μ(P)≤1/4:
Ln(a)=Cn∈HninfP∈Mn(a)supEP[λΘ(Cn)],n≥n0,0<a≤41,
Here Hn is the class of honest connected intervals, Cn is a candidate procedure, and λΘ measures length within the effect domain. The threshold is n0=256.
This is the smallest worst-case expected length on a strength slice. Coverage remains global; a evaluates performance and is not an input to our procedure.
Main Result
Under our model, with fixed α,cf,Cf,L, positive constants c0,C0 independent of n,a satisfy, for n≥256 and 0<a≤1/4,
c0min{1,n−1/3/a}≤Ln(a)≤C0min{1,n−1/3/a}.
This bounds optimal worst-case expected length from both sides.
- At a≤n−1/3, optimal expected length has constant order.
- Above that scale, it has order n−1/3/a.
The same interval sequence In responds to actual compliance:
EP[λΘ(In)]≤C0min{1,n−1/3/μ(P)},
for every P∈Mn and n≥256. In the balanced example, μ(P⋆)=b: even a zero effect becomes difficult to measure when compliance is weak.
informal · Theorem T-1 Under our model with fixed admissible coverage, density and smoothness constants, In is honest for every positive sample size; for n≥256, its expected length is at most C0min{1,n−1/3/μ(P)}.
Observable Density Components
Estimate density components from counts and response-weighted counts:
qz(x)=fS(x)PS(Z=z∣X=x),rAz(x)=qz(x)mAz(x),A∈{Y,D},z∈{0,1}.
Here PS is the source-record law. The arm density qz counts records in arm z; rAz weights those records by receipt or outcome.
Let F collect the target density, two arm densities and four response-weighted arm densities. Then
TA=∫01ΦA(F(x))dx,ΦA(F)=fT(q1rA1−q0rA0).
The ratios recover arm means; target density weighting transports their difference.
Fixed overlap keeps the arm densities away from zero. Thus the function ΦA has bounded derivatives through order four, even though its unknown inputs vary roughly with covariates.
Bias Correction
A histogram pilot F estimates the seven density components. Clipping keeps its values within the fixed model bounds.
Plugging the pilot into ΦA leaves nonlinear bias. A linear correction removes first-order error; products of two and three pilot errors still need correction.
Our estimator is
TA=⎩⎨⎧∫01ΦA(F(x))dx+LA+QA+CA,0,n≥n0,n<n0.
The pilot integral estimates TA; LA,QA,CA estimate its linear, quadratic and cubic Taylor corrections.
Robins et al. (2008) supply the higher-order functional-estimation approach. Our construction applies it to the seven observable source–target density components.
How can noisy data estimate products of unknown pilot errors?
Independent Residual Products
Split each sample into one training block and three evaluation blocks. Conditional on the pilot, evaluation blocks are independent.
Let Hi,K(b) be the response-weighted histogram for coordinate i, block b and K cells. Its residual is Ri,K(b)=Hi,K(b)−Fi.
The quadratic correction is
QA=2K21i,j∈I∑ℓ=1∑K2∂ijΦA(F(xℓ,K2))Ri,K2(1)(xℓ,K2)Rj,K2(2)(xℓ,K2).
Here I indexes the seven coordinates, xℓ,K2 is a cell midpoint, and ∂ijΦA measures curvature.
Each residual's conditional mean is its cell-averaged pilot error. Independence makes the product's conditional mean the product of those errors.
The cubic term uses three residual factors from distinct blocks. Repeated coordinates also use distinct blocks, preventing evaluation-noise products from introducing bias.
Why Cubic Order
Write the coordinate pilot error as δi(x)=Fi(x)−Fi(x). Its moment bounds are
EP[δi(x)2]≤Cpilot,2n−1/5,EP[∣δi(x)∣8]≤Cpilot,8n−4/5.
The constants depend on fixed model bounds. These inequalities control squared and eighth-power errors at every covariate value.
- Linear correction leaves products of two errors.
- Quadratic correction leaves products of three errors.
- Cubic correction leaves products of four errors.
Squaring the fourth-order remainder produces eighth powers. The second bound controls its squared contribution at scale n−4/5, below the required n−2/3.
Independent residual products estimate cell averages. The remaining task is to control what cell averaging loses.
Resolution Balance
Within each cell, a function minus its cell average integrates to zero. Terms containing exactly one such difference therefore cancel.
Quadratic approximation error begins with two differences; cubic approximation error also benefits from a remaining pilot-error factor.
| Component | Number of cells | Purpose | |---|---|---| | Pilot | K0≍n4/5 | Controls pilot moments | | Quadratic correction | K2≍n4/3 | Balances approximation error and variance n−1+K2n−2 | | Cubic correction | K3≍n | Controls approximation while limiting product variance |
Combining the Taylor remainder, cell approximation and sampling fluctuations gives
P∈MnsupEP[(TA−TA)2]≤Cmsen−2/3,A∈{Y,D}.
Both transported contrasts therefore have root-mean-square error at most a constant times n−1/3. The computable constant Cmse depends on cf,Cf,L.
Confidence Interval
Anderson and Rubin (1949) supply the inversion principle: test the outcome contrast implied by a candidate effect while retaining the first stage inside the moment.
Our acceptance set is
An={θ∈[−1,1]:TY−θTD≤2α2Cmsen−1/3}.
Each candidate θ predicts outcome contrast θTD. We retain it when its discrepancy from TY is within the uniform tolerance.
For n≥256, report this interval if nonempty and {0} otherwise. For smaller samples, report Θ=[−1,1].
The procedure uses the coverage level and fixed model bounds, without a compliance floor. Its explicit worst-case calibration constant is highly conservative.
Coverage Mechanism
For n≥256, let rn=2Cmse/αn−1/3 be the single-contrast radius.
The mean-square bound and Chebyshev's inequality place both contrast errors within rn with probability at least 1−α.
At the true effect,
∣TY−θ(P)TD∣=∣(TY−TY(P))+θ(P)(μ(P)−TD)∣≤∣TY−TY(P)∣+∣θ(P)∣∣TD−μ(P)∣≤2rn.
This bounds the true effect's score error using identification, TY(P)=θ(P)μ(P), and the effect-domain bound ∣θ(P)∣≤1.
The true effect is accepted whenever both contrast bounds hold. The calculation remains valid however small positive compliance becomes.
Length Mechanism
The estimated first stage is the score's slope as the candidate effect varies.
When ∣TD−μ(P)∣≤μ(P)/2, the slope has magnitude at least μ(P)/2. Hence
λΘ(In)≤min{2,∣TD∣4rn}≤min{2,μ(P)8rn}.
Length is bounded by the effect-domain diameter and by score tolerance divided by slope.
The mean-square bound controls the probability of an unreliable slope; length is at most two on those realizations.
Above the rough estimation scale, compliance converts contrast uncertainty into inverse-strength effect uncertainty. At or below that scale, the bounded effect domain supplies the constant-length branch.
What forces every honest procedure to face these same two regimes?
Rough Alternatives
Return to the balanced center, now with compliance b=aˉ=max{a,n−1/3}.
Tile [0,1] with sine waves, independently choosing each cell's sign λℓ. Write the resulting perturbation as u=uλ. Its cell count and height are
KL=⌈n4/3⌉,aˉ=max{a,n−1/3},hn=c⋆KL−1/8.
The small fixed amplitude c⋆>0 keeps the alternatives within the model; write h=hn. Each cell contains hλℓsin(2π(KLx−ℓ)).
Change target density and encouragement together:
fS=1,fT=1+uλ,e1(λ)=21+uλ,e0(λ)=21−uλ.
Here ez(λ) is encouragement-arm probability. Each wave integrates to zero, preserving the target density's total mass.
Coupled Outcome Means
A continuum index τ∈[−1,1] controls outcome changes. Set v=τu.
The alternative's receipt and outcome means are
mDz(x)=rz(b)=21+(2z−1)b,mYz(x)=21+1+2(2z−1)u(x)τu(x),z∈{0,1}.
Receipt means retain their balanced-center values. Both outcome arms move with the same signed perturbation, but their denominators reflect opposite encouragement changes.
Subtracting the arms gives
ΔD(x)=b,ΔY(x)=−1/4−u(x)2u(x)v(x).
The receipt contrast stays fixed. Because v=τu, the outcome contrast depends on u2: reversing a cell's sign preserves it.
Small amplitude permits a realization using only compliers, always-takers and never-takers. The same conditional potential-variable law in both populations supplies both transport equalities.
Sign-independent Separation
Let B(t)=sin(2πt) denote one cell's wave, with t∈[0,1] its local coordinate. Define
Jn=h2∫011/4−h2B(t)2B(t)2dt.
This measures the integrated squared perturbation, adjusted for encouragement probabilities.
Transport weights the outcome contrast by 1+u. The resulting quadratic term is independent of cell signs; the cubic term integrates to zero because B(1−t)=−B(t).
Thus every sign configuration at a given τ has the same effect:
θ(Qλ,τ)=−bτJn.
Here Qλ,τ is the alternative law, whose transported compliance remains b.
Since the denominator in the integral stays bounded away from zero, 2h2≤Jn≤4h2.
With h=c⋆KL−1/8 and KL=⌈n4/3⌉, separation has order n−1/3. Varying τ sweeps out a continuum of effects around zero.
Hidden Observable Changes
The nonlinear arm means arise from source probabilities that change only linearly in the signed perturbation:
Qλ,τ(Z=z,D=d,Y=y∣X=x)=ez(λ)(x)Rz(b)(d,y)+4vλ,τ(x)(2y−1),
where d,y∈{0,1}, vλ,τ=τuλ, and Rz(b) is the center's receipt–outcome cell probability. It equals rz(b)/2 for d=1 and (1−rz(b))/2 for d=0.
Encouragement changes and outcome-cell changes are both linear in uλ. Target density changes are linear too.
Averaging cell signs therefore restores each one-record observed law to the center.
Across records, the common cell signs still induce dependence. Terms using a cell's sign an odd number of times cancel; products using it an even number of times can survive.
The causal contrast survives because it depends on the squared perturbation.
Mixture Balance
Let Mτ average the alternatives' full two-sample experiments over cell signs. Let P⋆(n,n) be the center's experiment with n source and n target records.
The surviving sign products accumulate according to n2h4/KL. This accounts for evidence from both samples, including their shared cell signs.
The chosen scaling satisfies
n2≤KL3/2,h4=c⋆4KL−1/2,
so accumulated evidence is bounded by a constant times c⋆4, while effect separation remains proportional to h2.
The likelihood calculation establishes
1+χ2(Mτ,P⋆(n,n))≤exp{Cmixc⋆4}.
Here χ2 measures squared likelihood discrepancy and Cmix is a fixed numerical constant. Choosing c⋆ sufficiently small gives, uniformly in τ,
TV(Mτ,P⋆(n,n))≤21−α.
Total variation bounds the difference in probability of any data event. The mixture hides the alternatives while preserving their common effect separation.
Why Shorter Intervals Fail
Set rsep=Jn/b, the radius of the alternatives' effect continuum.
Honesty requires coverage for every alternative. Averaging signs preserves that coverage; mixture closeness transfers it to the center:
P⋆(n,n)(t∈Cn)≥21−α,t∈[−rsep,rsep].
Thus any globally honest confidence set Cn must include every candidate effect in this continuum with substantial probability under the zero-effect center.
Expected length integrates inclusion probabilities:
EP[λΘ(Cn)]=∫ΘP(t∈Cn)dt.
At the center, this gives expected length at least (1−α)rsep.
Because Jn has order n−1/3 and b=max{a,n−1/3}, it produces both branches of the frontier.
informal · Theorem T-2 Under our model with fixed admissible coverage, density and smoothness constants, every globally honest measurable confidence set has worst-case expected length at least c0min{1,n−1/3/a} for n≥256, 0<a≤1/4.
Open Questions
- What is the exact length frontier when source and target sample sizes grow at unrelated rates, and can one honest interval attain every allocation regime?
- How does the benchmark change with higher-dimensional covariates or unknown smoothness?
- How should inference change under dependent records or alternative transport restrictions?
The unequal-sample question retains the same causal assumptions and requires a matching lower family satisfying monotonicity.
Takeaways
- Valid monotone encouragement and two conditional transport equalities identify the target complier effect as a ratio of transported contrasts.
- Cubic correction controls rough estimation error; score inversion preserves coverage under arbitrarily weak positive compliance.
- Squared perturbations change the effect while sign averaging hides observable changes, forcing optimal expected length of order min{1,n−1/3/a}.
Appendix: Sharp Length Frontier
The exact result combines global finite-sample coverage, matching optimal-length bounds and a law-specific guarantee for one interval sequence.
Fix real constants α,cf,Cf,L satisfying:
- (Noncoverage probability.) 0<α<1.
- (Lower density envelope.) 0<cf<1.
- (Upper density envelope.) 1<Cf.
- (Hölder radius.) 1<L.
Let In be the score interval of Definition P-10, and let Ln(a) be the minimax expected restricted length defined in Definition P-13. Set n0=256. There exist finite constants 0<c0<C0, depending only on (α,cf,Cf,L), such that In∈Hn, the class of honest intervals in Definition P-11, for every integer n>0, and, for every integer n≥n0 and every real a with 0<a≤1/4, c0min{1,n−1/3/a}≤Ln(a)≤C0min{1,n−1/3/a}. Moreover, for every integer n≥n0 and every law P∈Mn as defined in Definition P-1, writing μ(P)=TD(P) for the transported first stage, the same interval sequence satisfies EP[λΘ(In)]≤C0min{1,n−1/3/μ(P)}, where λΘ denotes Lebesgue length restricted to the effect domain Θ.
Appendix: Honest Upper Length Envelope
The attaining interval covers throughout the model and has expected length bounded according to actual transported compliance.
Fix the noncoverage probability α, the density envelopes cf,Cf, and the Hölder radius L, satisfying:
- (Noncoverage.) 0<α<1.
- (Lower density envelope.) 0<cf<1.
- (Upper density envelope.) 1<Cf.
- (Hölder radius.) 1<L.
The score interval In of Definition P-10 belongs to the class Hn of honest intervals in Definition P-11 for every positive integer n. Set the sample-size threshold to n0=256. Write μ(P) for the transported first stage, namely the target-averaged source receipt contrast: μ(P)=TD(P). There exists a finite constant C0=C0(α,cf,Cf,L)>0 such that, for every integer n≥n0 and every P∈Mn, the model class of Definition P-1, EP[λΘ(In)]≤C0min{1,μ(P)n−1/3}, where λΘ denotes Lebesgue length restricted to the effect domain Θ, and the expectation is under the joint law of the source and target samples, each of size n. With the same constant C0, for every integer n≥n0 and every real a satisfying 0<a≤1/4, the minimax expected-length frontier Ln(a) of Definition P-13 satisfies Ln(a)≤C0min{1,an−1/3}.
Appendix: Honest Length Lower Bound
Every globally honest measurable confidence set faces the matching worst-case expected-length bound, including disconnected sets.
Fix constants satisfying:
- (Coverage.) The noncoverage probability satisfies 0<α<1.
- (Density envelopes.) The lower and upper density envelopes satisfy 0<cf<1<Cf.
- (Smoothness.) The common Hölder radius satisfies L>1.
Let Mn be the model class in Definition P-1, and let Mn(a) be its strength slice in Definition P-12. Write θ(P) for the target-population average treatment effect among compliers under P, and let the effect domain and sample-size threshold be Θ=[−1,1],n0=256. There exists a constant c0=c0(α,cf,Cf,L)>0 such that, for every integer n≥n0 and every 0<a≤1/4, the following holds. Every measurable confidence-set procedure Cn, based on n source records and n target covariate records, with Cn(ω)⊆Θ for every sample realization ω, and satisfying P(θ(P)∈Cn)≥1−αfor every P∈Mn, obeys P∈Mn(a)supEP[λΘ(Cn)]≥c0min{1,an−1/3},λΘ(Cn)=Leb(Cn∩Θ). Here probabilities and expectations are taken under the observed two-sample law. Moreover, the minimax expected-length frontier Ln(a) of Definition P-13 satisfies Ln(a)≥c0min{1,an−1/3}.