CausalSmith · seminar slides
Confidence Sets for Transported Complier Effects
When encouragement barely changes treatment receipt, we can still give reliable uncertainty statements about effects in a different population.
slides for Honest Expected Length for Transported Complier Effects with Weak First Stages
Motivation
An encouragement experiment supplies evidence about treatment effects, but the population of interest may differ from the experimental population.
- Source: observe covariates X, encouragement Z, treatment receipt D, and outcome Y.
- Target: observe only covariates.
- Compliers: people who receive treatment when encouraged and do not receive it otherwise.
We want the average treatment effect among target compliers.
Target covariates tell us whom to represent. How much information does the source experiment provide about their effect?
Research Question
The usual estimator transports the encouragement effects on outcomes and receipt, then divides the outcome contrast by the receipt contrast.
Chen and Huang (2025) study this transported complier effect with a first stage bounded away from zero and asymptotically normal estimation.
When encouragement barely changes receipt, the estimated denominator can be as noisy as its mean. Normal inference for the ratio then becomes unreliable.
Ma (2023) develops identification-robust inference for complier effects within one population.
How short can uniformly valid confidence sets be when weak compliance and uneven transport weights both reduce information?
Key Idea
Test each candidate effect using an outcome-minus-receipt contrast. Retain candidates compatible with a zero contrast.
Precision depends on the transported first stage μn, the target complier share, and weight dispersion κn, the second moment of the target-to-source weights:
tn=κnnμn2.
Here n is the source sample size; tn measures effective strength.
With known weights and assignment probabilities, this inversion minimizes worst-case asymptotic expected length up to constants among uniformly valid procedures.
Under our causal, transport, overlap, and weight-growth conditions, that length has order min{1,t0−1/2}, comparing laws with tn≥t0 for each fixed t0>0.
Coverage remains required throughout the model, including arbitrarily weak first stages.
Example
Suppose source and target covariate distributions coincide.
The transport weight w(X), the target-to-source covariate density ratio, equals one. Its second moment is κn=1, so
tn=κnnμn2=nμn2.
This computes effective strength without a transport penalty.
For each proposed effect, compare the outcome encouragement contrast with that effect times the receipt encouragement contrast.
A small receipt contrast leaves many effects compatible with the data. Outcomes bounded in [0,1] restrict their average treatment effect to [−1,1], providing a finite uncertainty scale.
Model
Let S=1 denote the source and S=0 the target; both populations have positive probability. Receipt under encouragement z is D(z), and the outcome under treatment d is Y(d).
- Bounded binary structure: D(z)∈{0,1} and Y(d)∈[0,1].
- Source validity: encouragement is randomized conditional on X; observed receipt and outcome satisfy D=D(Z) and Y=Y(D).
- Exclusion and monotonicity in both populations: encouragement affects outcomes only through receipt, and D(1)≥D(0), ruling out people who take treatment only when unencouraged.
Under the transport restrictions below, the target effect is
μnμY,n=θT=EPnF[Y(1)−Y(0)∣D(1)=1, D(0)=0, S=0]∈Θ=[−1,1].
Here PnF is the full-data law. The ratio averages treatment effects among target compliers; μY,n is the transported outcome contrast and μn>0 is the target complier share. The candidate range is Θ.
Transport Assumptions
Let ΔY(x) and ΔD(x) be the source encouragement effects on outcomes and receipt at covariate value x.
- Outcome transport: the outcome encouragement contrast agrees across populations at every target covariate value.
- Receipt transport: the target-average receipt contrast agrees across populations; covariate-specific agreement is unnecessary.
- Support: every target covariate region is represented in the source, permitting density-ratio weights w(X).
The transported quantities are
μY,n=EPSX[w(X)ΔY(X)],μn=EPSX[w(X)ΔD(X)],κn=EPSX[w(X)2],
where PSX is the source covariate distribution. The first two expectations reproduce target-average encouragement contrasts; the third measures how unevenly source observations represent the target.
informal · Theorem T-1 Under our model assumptions, the transported outcome-to-receipt ratio identifies the target complier effect and lies in [−1,1].
Assumptions
Assignment overlap: the source encouragement probability e(X) satisfies ε≤e(X)≤1−ε, with fixed 0<ε<1/2. Neither assignment arm becomes arbitrarily rare.
Weight control: 0≤w(X)≤2kn and κn≤kn, where the positive scale kn limits extreme weights and their dispersion.
We allow weakening first stages and growing weight dispersion:
kn→∞,kn=o(n1/2),μn→0.
Weight growth remains slower than the square root of source sample size.
The source observations and target draws form independent samples; target size Nn satisfies Nn/n→c>0.
In the no-shift example, w(X)=1 automatically meets the weight controls eventually. A vanishing complier share remains allowed.
Honest Expected Length
Honesty means asymptotic coverage of at least 1−α, uniformly over every law in our model. The noncoverage level satisfies 0<α<1.
An oracle procedure knows w and e.
For a confidence set Cn⊆Θ, let λ(Cn) denote its length. Compare worst-case expected length over laws with effective strength at least a fixed t0>0:
R((Cn),t0)=n→∞limsupP∈Pn:tn≥t0supEP[λ(Cn)].
Here Pn contains the laws P satisfying our model assumptions. The threshold restricts length comparisons, while coverage is required over the entire class.
The best achievable risk is
V⋆(t0)=(Cn)∈CorinfR((Cn),t0).
The class Cor contains all oracle procedures satisfying uniform honesty. “Optimal up to constants” compares our procedure with this infimum.
Main Result
Maintain the causal, transport, assignment-overlap, weight-control, and sampling-growth assumptions.
informal · Theorem T-4 Under these assumptions and an admissible transport design, known-w,e score inversion is uniformly honest and attains optimal worst-case expected-length order min{1,t0−1/2} for every fixed t0>0.
163(1−α)2min{1,t0−1/2}≤V⋆(t0)≤C0min{1,t0−1/2},
where C0>0 depends only on noncoverage and assignment overlap.
- Weak effective strength leaves worst-case expected length bounded below by a positive constant.
- Stronger effective strength permits inverse-square-root improvement.
- In the no-shift example, strength is nμn2: more observations help only relative to the squared complier share.
These bounds compare procedures up to constants; they are not an exact formula for a realized confidence set’s length.
Recovering Source Contrasts
Inverse-propensity weighting recovers the source encouragement contrast:
Hi=e(Xi)Zi−1−e(Xi)1−Zi,
where Hi weights encouraged observations positively and unencouraged observations negatively, correcting for their assignment probabilities.
Transport these contrasts and estimate weight dispersion:
An=n1i=1∑nw(Xi)HiYi,Bn=n1i=1∑nw(Xi)HiDi,κn=n1i=1∑nw(Xi)2.
The statistics estimate the target outcome contrast μY,n, receipt contrast μn, and dispersion κn.
The natural ratio estimate is An/Bn. What restriction remains testable when its denominator is small?
A Residual Instead of a Ratio
For a candidate effect ϑ∈Θ, form
ψi(ϑ)=w(Xi){e(Xi)Zi−1−e(Xi)1−Zi}(Yi−ϑDi).
The score ψi(ϑ) computes a transported encouragement contrast in the residual outcome Yi−ϑDi.
Its mean is μY,n−ϑμn, which vanishes at the true effect ϑ=θT. Its empirical mean is An−ϑBn.
A small first stage becomes a small slope in the candidate effect. Testing the zero-mean restriction requires no division.
This is the test-inversion logic of Anderson and Rubin (1949).
Score Inversion
Retain every candidate whose residual contrast is small enough:
Cn={ϑ∈Θ:An−ϑBn≤Lακn/n}.
This computes the confidence set. The radius uses empirical weight dispersion and the calibration Lα=(αε28)1/2.
Coverage survives a weak first stage because:
- At the true effect, the residual score has mean zero.
- Bounded outcomes, binary receipt, and assignment overlap bound its second moment on the κn scale.
- Weight-growth control makes κn sufficiently reliable for uniform calibration.
In the no-shift example, κn=1: the test compares the residual encouragement contrast with a radius proportional to n−1/2.
From Scores to Length
The residual contrast is linear in ϑ, with slope −Bn.
When Bn is close to μn, the accepted width is bounded by twice the score radius divided by ∣Bn∣. This yields the tn−1/2 scale.
Samples with unreliable slopes are controlled by
P(2μn(P)<B−μn(P))≤ε2tn(P)4.
Here B=Bn; μn(P) and tn(P) are the first stage and effective strength under law P. The bound measures how often the estimated slope differs from its mean by more than half that mean.
On those samples, restricting candidates to [−1,1] bounds length by two.
Thus reliable slopes give shrinking width, while the bounded causal range controls the contribution of unreliable slopes.
Hidden Compliance Types
To show why shorter honest sets are impossible, hold the source covariate law, weights, and propensity fixed as g=(PSX,w,e)n≥1.
Choose μn=(nt0κn)1/2 and conditional complier probability pn(x)=μnw(x)/κn. The transported first stage is μn, and effective strength is exactly t0.
Conditional on X=x, use these compliance shares:
| Type | Receipt behavior | Share | |---|---|---| | Complier | D(0)=0, D(1)=1 | pn(x) | | Always-taker | Receives treatment under either assignment | (1−pn(x))/2 | | Never-taker | Receives treatment under neither assignment | (1−pn(x))/2 |
Set Y(0)=0. Complier treated outcomes are Bernoulli with mean 1/2+h; other types’ treated outcomes are Bernoulli with mean 1/2.
Use the same conditional law in both populations. The target effect is 1/2+h, while covariates and compliance shares remain unchanged. Weight-growth control makes these shares valid for sufficiently large n.
Diluted Outcome Changes
Compliance type is unobserved. Among encouraged treatment recipients, compliers mix with always-takers.
At h=0, conditional on X=x,Z=1, each observed cell (D,Y)=(1,1) and (1,0) has probability (1+pn(x))/4.
Changing h moves probability pn(x)h from one cell to the other. All other observed cells remain unchanged.
The always-takers supply outcome variation even when compliers are rare. Consequently, the squared observable change scales with pn(x)2h2, rather than with the complier share alone.
Averaging across source covariates gives ES[pn(X)2]=μn2/κn. Across n source observations, the information scale is therefore nμn2h2/κn=t0h2.
This explains why uneven transport weights and weak compliance enter the same lower-bound calculation.
Nearby Laws and Length
Let Qn,hg be the joint observed-data law under tilt h, and Qn,0g its center law.
Set ρ=(1−α)/8 and restrict ∣h∣≤H(t0)=min{1/4,ρt0−1/2}. For sufficiently large n,
1+χ2(Qn,hg∥Qn,0g)≤exp(8t0h2),∥Qn,hg−Qn,0g∥TV≤2ρ.
Chi-square distance aggregates squared probability changes relative to their baseline probabilities. Total variation bounds the difference in the probability of any event.
Honesty under each tilted law requires coverage of its effect 1/2+h. The distance bound transfers that coverage to the common center law, with a loss of at most 2ρ.
Integrating these inclusion probabilities over the interval of effects forces expected length under the center law to be at least a positive coverage-dependent constant times H(t0).
informal · Theorem T-6 Under our model, overlap, and growth conditions, every admissible fixed source-covariate, weight, and propensity array has optimal honest expected-length order min{1,t0−1/2} for each fixed t0>0.
Learning Target Weights
Now suppose X is observed as one of kn cell labels. Source cells each have probability 1/kn, and encouragement is balanced: e(X)=1/2.
Estimate target cell masses using target covariates:
Hi=2(2Zi−1),px,n=Nn1j=1∑Nn1{XjT=x},
where XjT is target observation j, px,n is the empirical target frequency of cell x, and Hi is the balanced-assignment contrast weight.
For G∈{Y,D}, estimate source contrasts and transport them:
mG,n(x)=nkni=1∑n1{Xi=x}HiGi,MG,n=x=1∑knpx,nmG,n(x).
Here mG,n(x) estimates the cell’s encouragement contrast. The factor kn corrects for source cell probability 1/kn.
The target-frequency average MG,n replaces the oracle transported contrast using only the two samples.
Dispersion from Coincidences
Pairs of target observations in the same cell reveal how concentrated the target distribution is.
For Nn≥2, compute
κU,n=Nn(Nn−1)knj=ℓ∑1{XjT=XℓT},Kn=1+κU,n,
where the sum counts ordered pairs of distinct target observations. The scaled coincidence count estimates weight dispersion; Kn is the feasible dispersion proxy.
Use the same residual-inversion idea:
Cn={ϑ∈Θ:∣MY,n−ϑMD,n∣≤Lα,cKn/n},
where Lα,c=(α2Bc)1/2 and Bc=32(1+c−1).
The calibration accounts for uncertainty in both source contrasts and target frequencies. The condition kn=o(n1/2) controls the error from combining their estimates.
Feasible Main Result
Retain the causal, transport, boundedness, and weight assumptions. Require uniform source cells, balanced assignment, Nn/n→c>0, and kn→∞ with kn/n→0.
informal · Theorem T-5 Under our model and growth assumptions, uniform source cells and balanced assignment allow sample-only uniformly honest inversion with optimal worst-case expected-length order min{1,t0−1/2} for every fixed t0>0.
n→∞limsupP∈Nn:tn≥t0supEP[λ(Cn)]≤C0min{1,t0−1/2}.
Here Nn is the uniform-cell model class. This bounds the feasible procedure’s worst-case asymptotic expected length; C0>0 depends on coverage and the sample-size ratio.
A matching lower bound applies to every sample-only honest procedure in this class.
Thus learning target weights preserves the oracle order in this finite-cell experiment.
Open Questions
- Feasible weight learning beyond these finite-cell designs, together with assignment-propensity learning.
- Continuous-covariate approximations.
- Moving effective-strength thresholds and sharp expected-length constants.
Takeaways
- Under the causal and transport restrictions, the transported outcome-to-receipt ratio identifies the target complier effect.
- Test residual contrasts to obtain uniform coverage; their noise and slope combine through tn=nμn2/κn.
- Score inversion attains optimal worst-case expected-length order min{1,t0−1/2}. Hidden compliance types explain the matching lower bound, and finite-cell target-weight learning preserves the order.
Appendix: Identification and Causal Range
The transported ratio equals the target complier effect and belongs to the bounded causal range.
Fix n, P, Nn, kn, c, and the instrument-overlap constant ε. Suppose that:
- (Model class.) P belongs to the transported complier-effect model class Pn of Definition P-1.
- (Source contrasts.) The source conditional outcome contrast ΔY(x) and the source conditional receipt contrast ΔD(x) are measurable and integrable with respect to the source covariate marginal PSX.
Then ΔY and ΔD represent the observed source contrasts: for every measurable covariate set A, ∫{OS:X∈A}H(OS)YdPS=∫AΔY(x)dPSX(x),∫{OS:X∈A}H(OS)DdPS=∫AΔD(x)dPSX(x). Moreover, with μY,n=∫(Y(1)−Y(0))1{D(1)=1, D(0)=0}dPnF(⋅∣S=0) and μn=PnF{D(1)=1, D(0)=0∣S=0}, the transported reduced-form and first-stage means satisfy ∫w(x)ΔY(x)dPSX(x)=μY,n,∫w(x)ΔD(x)dPSX(x)=μn. Consequently, μnμY,n=θT=EPnF[Y(1)−Y(0)∣D(1)=1, D(0)=0, S=0]∈Θ=[−1,1].
Appendix: Oracle and Fixed-geometry Frontier
Oracle score inversion is honest and matches the expected-length lower bound globally and within every admissible fixed transport design.
Let Nn and kn be integer sequences, and let c, ε, and α be constants. Suppose that:
- (Sampling ratio.) c>0 and Nn/n→c.
- (Overlap and coverage constants.) 0<ε<1/2 and 0<α<1.
- (Envelope scale.) kn>0 for every n, kn→∞, and kn/n→0.
- (Admissible geometry.) The measurable covariate space admits a deterministic geometry g satisfying Definition P-11 with envelope scale kn and overlap constant ε.
- (Model-class implications.) For every n and every transported array P, membership of P in the transported complier-effect model class Pn of Definition P-1 implies Assumption A-3, Assumption A-4, Assumption A-13, Assumption A-14, Assumption A-15.
Define Lα=(αε28)1/2,Hi=e(Xi)Zi−1−e(Xi)1−Zi, and An=n1i=1∑nw(Xi)HiYi,Bn=n1i=1∑nw(Xi)HiDi,κn=n1i=1∑nw(Xi)2. Let the score-inversion confidence set be Cn={ϑ∈Θ:An−ϑBn≤Lακn/n}. Then the sequence (Cn) is oracle honest, (Cn)∈Cor in the sense of Definition P-3, and for every fixed effective-strength threshold t0>0, R((Cn),t0)≤C0min{1,t0−1/2},C0=max{2,4Lα+ε28}. Consequently, for the oracle minimax value V⋆(t0) of Definition P-5, 163(1−α)2min{1,t0−1/2}≤V⋆(t0)≤C0min{1,t0−1/2}, and for every admissible geometry g′∈G the fixed-geometry value of Definition P-14 obeys the same two-sided bounds, 163(1−α)2min{1,t0−1/2}≤Vg′⋆(t0)≤C0min{1,t0−1/2}.
Appendix: Finite-cell Sample-only Attainment
Uniform source cells and balanced encouragement allow target-weight learning with the same honest minimax expected-length order.
Let Nn and kn be positive integer sequences, let c,ε,α∈R, and suppose the following conditions hold.
- (Sampling ratio.) c>0 and Nn/n→c.
- (Overlap and coverage levels.) 0<ε<1/2 and 0<α<1.
- (Cell growth.) kn>0 for every n, kn→∞, and kn/n→0.
- (Ambient carrier.) For every n, the measurable covariate space contains an injected copy of {1,…,kn} whose singleton images are measurable.
- (Finite-cell rows.) For every row n and every transported array P∈Nn, with Nn as in Definition P-2, the row satisfies the two-sample condition in Assumption A-3, the uniform finite-cell source condition in Assumption A-16, and the degrading-array condition in Assumption A-15.
Put Bc=32(1+c−1),Lα,c=(α2Bc)1/2,C0=max{2,42Lα,c+8Bc}. Then C0>0, and there exists a sample-only finite-cell confidence-set sequence C=(Cn) in the feasible class Ccell of Definition P-7 such that, for every n and every P∈Nn, Cn agrees P-almost surely under the two-sample law with the finite-cell score-inversion rule using critical constant Lα,c. Equivalently, on the finite-cell experiment, this rule is given by Hi=2(2Zi−1),px,n=Nn1j=1∑Nn1{XjT=x}, and, for G∈{Y,D}, mG,n(x)=nkni=1∑n1{Xi=x}HiGi,MG,n=x=1∑knpx,nmG,n(x). For Nn≥2, define κU,n=Nn(Nn−1)knj=ℓ∑1{XjT=XℓT},Kn=1+κU,n, and set Cn={ϑ∈Θ:∣MY,n−ϑMD,n∣≤Lα,cKn/n}, with Cn=Θ at indices for which Nn<2. For every t0>0, n→∞limsupP∈Nn:tn≥t0supEP[λ(Cn)]≤C0min{1,t0−1/2}. Moreover, for every t0>0, the feasible finite-cell honest minimax risk satisfies 163(1−α)2min{1,t0−1/2}≤C∈Ccellinfn→∞limsupP∈Nn:tn≥t0supEP[λ(Cn)].
Appendix: Regular-cell Score Attainment
Known regular source-cell probabilities and known overlapping propensity allow feasible score inversion with matching expected-length bounds.
Fix c,ε,α,c−,c+∈R, target sample sizes Nn, and cell counts kn. Suppose that
- (Sample-size ratio.) 0<c and Nn/n→c.
- (Overlap and coverage levels.) 0<ε<1/2 and 0<α<1.
- (Regular cell constants.) 0<c−≤1 and 1≤c+.
- (Cell growth.) kn>0 for every n, kn→∞, and kn/n→0.
- (Measurable carrier.) For every n, the covariate carrier contains kn injected measurable singleton cells.
- (Model restrictions.) Every array P∈Nnreg from Definition P-15 with constants c,ε,c−,c+ satisfies Assumption A-3, Assumption A-4, and Assumption A-15.
On Nnreg, let qx,n=PSX(X=x) and define Hi=e(Xi)Zi−1−e(Xi)1−Zi. For G∈{Y,D}, set px,n=Nn1j=1∑Nn1{XjT=x},mG,n(x)=nqx,n1i=1∑n1{Xi=x}HiGi, and MG,n=x=1∑knpx,nmG,n(x). For Nn≥2, set κU,n=Nn(Nn−1)1j=ℓ∑qXjT,n1{XjT=XℓT},Kn=1+κU,n, and put Cnreg=Θ when Nn<2. Let Bε,c=8(ε−2+c−1). For every L≥{2Bε,c/α}1/2, define C0=max{2,42L+8Bε,c}. Then 0<C0, and there exists a regular-cell procedure C=(Cn)n≥1 such that, for every n and every P∈Nnreg, Cn agrees almost surely under the two-sample law with Cnreg={ϑ∈Θ:∣MY,n−ϑMD,n∣≤LKn/n} for Nn≥2, together with the preceding convention for Nn<2. This procedure belongs to Creg from Definition P-16. Moreover, for every fixed t0>0, n→∞limsupP∈Nnreg:tn≥t0supEP[λ(Cn)]≤C0min{1,t0−1/2}. For every fixed t0>0, the minimax risk over Creg satisfies 163(1−α)2min{1,t0−1/2}≤C∈Creginfn→∞limsupP∈Nnreg:tn≥t0supEP[λ(Cn)]. Thus, with known regular source-cell probabilities and a known cell-varying propensity satisfying the stated overlap, the feasible regular-cell construction attains the oracle frontier order on Nnreg.