CausalSmith · seminar slides
Estimating Latent Treatment-Effect Distributions
We can learn how population mass is distributed across latent class-average effects, even when those effects coincide.
slides for Quotient-law Inference with Latent Treatment-effect Collisions
Research Question
Treatment depends on an unobserved class U. We observe treatment, outcomes, and two proxies informative about that class.
Miao et al. (2018) establish causal identification using two proxies and rank conditions. Virk et al. (2026) recover latent class-average effects and masses through an observable matrix:
- Eigenvalues locate effects.
- Normalized eigenvectors recover class features and masses.
- Their simultaneous recovery guarantees require separated effects.
As effects approach, individual eigenvectors become unstable. Equal effects cannot distinguish their classes through that matrix.
Can we estimate the population distribution of class-average effects through these collisions?
Key Idea
Combine population masses at equal effect values.
νP:=u=1∑kpuδτu.
Here P is the population law, k is the number of latent classes, pu=P(U=u), and δτu puts unit mass at effect τu.
The effect is τu:=μ1u−μ0u, where μtu:=EP[Y(t)∣U=u]. Potential outcomes Y(t) describe outcomes under treatment t.
Use W1, the minimum cost of moving probability mass, charging mass times distance.
informal · Theorem T-5 Under the causal and proxy restrictions, fixed known dimensions, bounded contributions, latent-arm overlap, and uniform proxy-rank margins, both law estimators have uniform root-n Wasserstein bounds, including equal effects.
Example
Two classes have population masses 0.4 and 0.6, and treatment probabilities 0.4 and 0.6, respectively.
Their Bernoulli potential-outcome means are
E[Y(0)∣U]=(0.25,0.25),E[Y(1)∣U]=(0.5−ε,0.5+ε).
Subtracting untreated from treated means gives, for 0≤ε≤1/8,
νPεwit=0.4δ0.25−ε+0.6δ0.25+ε.
Here Pεwit denotes this two-class population.
Moving both masses to 0.25 costs ε. At zero, the target becomes δ0.25, one atom with total mass 1.
What must remain informative as the effects merge?
Model
Observe independent records (T,X,Z,Y): binary treatment T, target proxy X∈Rdx, reference proxy Z∈Rdz, and realized outcome Y.
- Causal validity: Y=Y(T) and Y(t)⊥T∣U. Within a class, treatment does not select potential outcomes.
- Reference-proxy separation: Z⊥(X,Y)∣(T,U). Given class and treatment, the reference proxy separates from the target proxy and outcome.
- Target-proxy separation: X⊥(Y,T)∣U. The target proxy measures class consistently across arms.
- Normalization: X1=1. A constant first coordinate fixes the scale needed to recover population masses.
Our target distributes class-average treatment effects across the population.
Assumptions
The dimensions and supplied constants stay fixed as n grows. These restrictions define M.
Latent-arm overlap:
1≤u≤k, t∈{0,1}minP(U=u,T=t)≥π0.
The positive margin π0 prevents any class from disappearing within either arm.
Informative proxies:
min{σk(A0),σk(A1),σk(B)}≥σ0.
Columns of At are reference-proxy means within class and arm; columns of B are target-proxy means within class. Their smallest singular values σk stay above σ0.
Bounded contributions: ∥X∥2≤L, ∥ZX⊤∥op≤L, and ∥YZX⊤∥op≤L.
The parameter domain is 2≤k≤min{dx,dz}, L≥1, 0<π0≤1/(2k), and 0<σ0≤1.
Proxies Through the Collision
In our example, X=(1,X2)⊤ and Z=(1,Z2)⊤, with Bernoulli second coordinates.
Their class-specific mean matrices are
B=(10.210.8),A0=(10.310.7),A1=(10.3510.75),
where columns correspond to the two classes.
Conditional on U, treatment, the target proxy, and potential outcomes are independent. Conditional on (U,T), the reference proxy separates from the target proxy and potential outcomes.
The proxy matrices stay unchanged as ε shrinks: effect equality does not destroy information about class.
informal · Theorem T-9 For every 0≤ε≤1/8, this population belongs to M with L=2 and π0=σ0=0.1; its proxy and observable moment matrices remain nonsingular at the collision.
Observable Moments
The method uses five observable blocks:
S(P):=(M0(P),M1(P),N0(P),N1(P),mX(P)).
Here Mt(P)=EP[ZX⊤∣T=t], Nt(P)=EP[YZX⊤∣T=t], and mX(P)=EP[X].
The matrices measure proxy cross-moments and outcome-weighted cross-moments within each arm. The vector measures the proxy mean across the population.
Their combined error is
dS(s,s′):=j=1∑4∥sj−sj′∥op+∥s5−s5′∥2.
This adds matrix operator-norm errors and the Euclidean mean error.
The empirical summary Sn replaces these expectations by armwise sample averages and the overall proxy average.
Main Result: Stability
Under the model restrictions defining M,
informal · Theorem T-3 Throughout M, observable-summary error bounds effect-law error linearly, with a constant depending only on the fixed dimensions, contribution bound, overlap margin, and proxy-rank margin.
W1(νP,νQ)≤CmoddS(S(P),S(Q)).
This holds for every P,Q∈M. The constant Cmod>0 does not depend on effect separation.
Equal summaries identify the same law. Small summary errors imply proportionally small transport errors through simultaneous merges and splits.
For our example, the guarantee includes ε=0, where two class effects become one support point.
Main Result: Estimation
Two estimators turn this population stability into sample inference:
- νn repairs the empirical summary to the population-summary domain.
- λn fits a finite grid of conditioned spectral factors and valid probability laws.
For every P∈M, n≥1, and 0<η<1/2,
QP(n){max{W1(λn,νP),W1(νn,νP)}>Cnlog(C/η)}≤η.
Here QP(n)=PO⊗n is the sampling law of n independent observed records, and η is the tail probability.
The constant C depends only on the fixed dimensions and supplied bounds and margins. No effect gap enters the bound.
Proxy Cancellation
Proxy independence factors the armwise moment:
Mt(P)=Atdiag{P(U=u∣T=t):1≤u≤k}B⊤.
The diagonal contains class shares within treatment arm t. The matrix Nt(P) inserts the class outcome means μtu into the same factorization.
Choose an orthonormal basis V(P) for the common k-dimensional row space of the two moment matrices. Form
ΔQ(P):={M1(P)V(P)}†N1(P)V(P)−{M0(P)V(P)}†N0(P)V(P),
where † denotes the Moore–Penrose inverse.
Inversion cancels reference-proxy features and arm shares. With R=B⊤V(P), this gives ΔQ(P)=R−1diag(τ)R.
The eigenvalues are effects. Proxy conditioning controls the coordinate matrix R, even when effects coincide.
Population Weighting
Eigenvalues locate effects; two observable anchors supply their population weights:
a(P)⊤:=mX(P)⊤V(P),c(P):=V(P)⊤e1.
Here e1 selects the constant first proxy coordinate.
Let p=(p1,…,pk)⊤ and let 1k be the vector of ones. Since mX(P)=Bp and B⊤e1=1k,
- a(P)⊤=p⊤R.
- c(P)=R−11k.
- ΔQ(P)=R−1diag(τ)R.
The transformations cancel:
∫xjdνP(x)=a(P)⊤ΔQ(P)jc(P)=∑upuτuj, for j=0,…,2k−1.
Here x is an effect value. The operator and anchors recover population-weighted effect moments, although the original matrices use treatment-arm shares.
From Moments to Transport
A one-Lipschitz function satisfies ∣f(x)−f(y)∣≤∣x−y∣: it cannot magnify a distance between effects.
Normalize it by f(0)=0. This leaves comparisons of probability laws unchanged and gives ∣f(x)∣≤Lτ on the effect interval, where Lτ=4Ldz/σ0.
Apply f to the diagonal effects in the similarity representation:
f(ΔQ(P))=R−1diag{f(τu)}R.
The same anchors recover the integral:
∫f(x)dνP(x)=a(P)⊤f(ΔQ(P))c(P).
Thus bounding anchored operator comparisons for all these functions bounds W1, the largest difference between their integrals.
Why can those operator comparisons avoid dividing by an effect gap?
Why Gaps Cancel
Compare two effect operators Δ=R−1diag(τ)R and Δ′=R′−1diag(τ′)R′. Let H=RR′−1 describe mixing between their coordinates.
Each entry satisfies
(τi−τj′)Hij=[R(Δ−Δ′)R′−1]ij.
Replacing effects by f changes the left side to (f(τi)−f(τj′))Hij. Its magnitude cannot increase, because f is one-Lipschitz.
Conditioned R,R′ control conversion back to operator norm. No inverse effect gap appears.
For a group separated by distance g, mass uncertainty can grow like summary error divided by g; transporting that uncertainty costs g times its size.
In our example, moving mass h between effects costs 2ε∣h∣. At the collision, ΔQ=0.25I2, and the anchors recover total mass 1 without choosing individual eigenvectors.
Repairing Sample Moments
Noisy summaries can produce nonreal eigenvalues or invalid masses. The first estimator repairs the summary before recovering a probability law.
A feasible summary is q=S(Pq) for some Pq∈M. Identification makes its law independent of which representative Pq is chosen.
Let K be the closure of these summaries. Choose a nearest point:
Π(s)∈K,dS(Π(s),s)≤dS(q,s)for every q∈K.
Here s is a noisy summary; q ranges over the closed population-summary domain.
The stable law map extends to K as F. Return νn=F(Π(Sn)).
Because the true summary belongs to K, repair increases its distance from truth by at most a factor of two. Wu and Yang (2020) similarly repair noisy mixture moments by imposing feasibility.
Empirical Effect Operator
The grid estimator works directly in the original dx proxy coordinates.
At the population summary, the k-dimensional operator lifts to D(P)=V(P)ΔQ(P)V(P)⊤. It acts as zero outside the proxy signal space.
Its sample analogue is
Dn:=(M1,n)≥s0/2†N1,n−(M0,n)≥s0/2†N0,n.
Here s0=π0σ02. For each empirical arm matrix, retain singular directions with singular values at least s0/2, invert those values, and discard the rest.
The hatted matrices are the observed armwise averages defined by Sn. Thus Dn is a fully specified dx×dx matrix.
At a model summary, both arms have the same signal row space and this construction equals the lifted population operator. Noisy arm matrices can have different retained spaces; the formula still supplies the matrix the grid fits.
Finite Grid Search
Search candidates ϑ=(V,R,p,τ) on prescribed grids with mesh at n−1/2 scale:
- V has k orthonormal columns in the dx proxy coordinates.
- R satisfies σk(R)≥σ0/2 and ∥R∥op≤2kL.
- Masses satisfy pu≥π0 and ∑upu=1.
- Effects are real and lie in [−Lτ,Lτ].
Each candidate implies Dϑ=VR−1diag(τ)RV⊤, mϑ=VR⊤p, and bϑ=RV⊤e1.
Minimize
Jn(ϑ;s):=∥Dϑ−D(s)∥op+∥mϑ−mX∥2+∥bϑ−1k∥2.
At s=Sn, D(s)=Dn and mX=mX,n. The terms fit the effect operator, population weighting, and constant-coordinate normalization.
Return the first grid minimizer’s law λϑ=∑upuδτu. Every distinct output atom has mass at least π0, including after coincident locations are merged.
From Fit to Law
Candidates need not describe complete causal populations. Their conditioned operator structure and anchors suffice.
For a one-Lipschitz f with f(0)=0,
mϑ⊤f(Dϑ)e1=p⊤f(diag(τ))bϑ.
The candidate law instead integrates f as p⊤f(diag(τ))1k. Their discrepancy is at most Lτ∥bϑ−1k∥2.
The operator residual is controlled by gap cancellation; the mean residual controls population weighting. Together, all three objective terms control law error.
Rounding the true factors supplies a candidate with 1/n approximation error. The minimizer fits at least as well:
W1(λn(ω),νP)≤Clat{dS(Sn(ω),S(P))+n1}
This holds for every sample ω. Bounded contributions and latent-arm overlap give uniform summary concentration, completing the root-n guarantee.
Honest Confidence Sets
For miscoverage probability 0<α<1/2, summary concentration gives radius rn,α:=C0Llog(C0/α)/n, with calibrated constant C0.
Define
m⋆:=π0,Rn,α:=Clat(rn,α+(n)−1).
The law radius combines sampling error and grid approximation. The mass floor m⋆ holds for every distinct true atom and every distinct grid-estimator atom.
Use the confidence set
Cn,αalg:={ξ∈P≤k([−Lτ,Lτ]):AtomFloor(m⋆,ξ), W1(ξ,λn)≤Rn,α}.
Here P≤k contains probability laws with at most k atoms; AtomFloor requires each distinct atom’s mass to be at least m⋆.
informal · Theorem T-6 Throughout M, this grid-centered set covers νP with probability at least 1−α; on every sample it is nonempty and has Wasserstein diameter at most 2Rn,α.
Membership uses finite constraints on atom locations, masses, and a transport plan.
Reporting Unresolved Groups
Set ρn,α=Rn,α/m⋆. Connect estimated support points within 4ρn,α; let C be a connected component.
On the confidence event:
- A true atom farther than ρn,α from estimated support would alone cost more than Rn,α to transport.
- The reverse argument holds because the grid constraint pu≥π0 gives the estimated center the same distinct-atom mass floor.
- Different components are more than 4ρn,α apart, so each true atom associates with exactly one component.
Report [minC−ρn,α,maxC+ρn,α] for support. Let KC(ξ) contain candidate atoms within ρn,α of C.
IC:=[ξ∈Cn,αalginfξ(KC(ξ)),ξ∈Cn,αalgsupξ(KC(ξ))].
This reports all aggregate masses compatible with the confidence set.
informal · Theorem T-7 Throughout M, with probability at least 1−α, reported groups partition the true support, their support intervals contain associated effects, and their mass intervals contain associated aggregate masses.
Further Results
- In our calibrated two-class model, the worst-case expected law-estimation rate n−1/2 is minimax sharp.
- Ordered masses have sharp worst-case ℓ1 rate min{1,1/(ng)} on two-class strata with distinct effects and smallest gap between g/2 and 2g, for 0<g≤1/4.
- This inverse-gap mass cost matches the mechanism: transport multiplies mass uncertainty by the distance across which it moves.
Open Questions
- Inference when the number of latent classes k is unknown.
- Application-specific conditions that justify the causal and proxy restrictions.
- Exact polynomial-time computation of the original nearest-summary confidence image and its support-dependent mass extrema.
Takeaways
- Population mass at class-average effect values remains a stable target when effects coincide.
- Causal and proxy restrictions, fixed dimensions, bounded contributions, latent-arm overlap, and conditioned proxies deliver uniform root-n estimation and honest confidence reporting.
- Observable anchors recover population weights; transport cancels gap sensitivity. Resolving separate ordered masses retains an inverse-gap cost.
Appendix: Gap-free Law Stability
Observable-summary error controls effect-law error uniformly through collisions.
Fix natural numbers k,dx,dz and real constants L,π0,σ0. Assume:
- (Latent dimension.) 2≤k, k≤dx, and k≤dz.
- (Bound and margins.) 1≤L, 0<π0≤(2k)−1, and 0<σ0≤1.
Let Lτ=4Ldz/σ0, and let K=S be the summary closure from Definition P-8. For two summaries s=(M0,M1,N0,N1,mX),q=(M0′,M1′,N0′,N1′,mX′), write dS(s,q)=∥M0−M0′∥+∥M1−M1′∥+∥N0−N0′∥+∥N1−N1′∥+(i∑(mX(i)−mX′(i))2)1/2. There exists a constant Cmod>0 such that, for every pair of full-data laws P,Q∈M, W1(νP,νQ)≤CmoddS(S(P),S(Q)). Moreover, there is a map F:K→Pk([−Lτ,Lτ]) such that F is continuous and Borel measurable, W1(F(q),F(q′))≤CmoddS(q,q′)for all q,q′∈K, and F(S(Q))=νQfor every Q∈M. This map is unique among continuous maps G:K→Pk([−Lτ,Lτ]) that obey W1(G(q),G(q′))≤CmoddS(q,q′)for all q,q′∈K and satisfy G(S(Q))=νQ for every Q∈M: every such G satisfies G(q)=F(q) for all q∈K.
Appendix: Collision-uniform Estimation
Both summary repair and finite grid search satisfy uniform root-n Wasserstein tail bounds.
Fix integers k,dx,dz and constants L,π0,σ0. Suppose that
- (Dimensions.) 2≤k, k≤dx, and k≤dz.
- (Uniform bounds.) 1≤L, 0<π0≤1/(2k), and 0<σ0≤1.
Then there is a constant C=C(k,dx,dz,L,π0,σ0)>0 such that, for every n≥1, there exist a structured-lattice estimator λn taking values in Pk([−Lτ,Lτ]), with Lτ=4Ldz/σ0, and a nearest-summary repair estimator νn=F(Π(Sn)) from Definition P-9, such that λn is the first lexicographic minimizer over a finite exhaustive structured lattice of well-formed candidates ϑ for the criterion Jn(ϑ;Sn), with tie-breaking by the lattice order and output λϑ. Both estimators are Borel sample maps. For every η satisfying 0<η<1/2, every P∈M, and QP(n)-sample, QP(n){max{W1(λn,νP),W1(νn,νP)}>Cnlog(C/η)}≤η. Moreover, for each treatment arm t∈{0,1}, QP(n){Nt,n=0}≤(1−kπ0)n.
Appendix: Honest Confidence Reporting
Both confidence constructions simultaneously cover the true law and have bounded Wasserstein diameters.
Fix integers k,dx,dz and constants π0,σ0 such that 2≤k,k≤dx,k≤dz,0<π0≤2k1,0<σ0≤1. There exists a simultaneous-concentration constant C0≥1 such that, for every boundedness radius L≥1, there is a constant Cmod>0 for which the prescribed structured-lattice constant Clat is positive and the following holds. For every sample size n≥1, there exist:
- (Structured lattice estimator.) a measurable estimator λn taking values in Pk([−Lτ,Lτ]), generated by a finite exhaustive list of well-formed structured-lattice candidates, ordered lexicographically, with λn equal to the effect law of the first lexicographic minimizer of the structured-lattice criterion;
- (Summary repair data.) a continuous extension F on the summary closure K, a measurable nearest-summary selector Π with its empty-closure fallback, and the associated measurable repaired summary-to-law map.
For every miscoverage level α satisfying 0<α<21, let Cn,α, Rn,α, and Cn,αalg be the confidence-set objects of Definition P-10 formed from this repair data and this structured-lattice estimator, with m⋆=π0 and center λn. Then, on every sample, both Cn,α and Cn,αalg are nonempty, and Cn,αalg has the finite constrained transport representation ν∈Cn,αalg⟺AtomFloor(π0,ν) and there exists a transport plan γ from ν to λn with cost at most Rn,α. Moreover, for every full-data probability law P∈M in Definition P-1, 1−α≤QP(n){νP∈Cn,α∩Cn,αalg}. Finally, on every sample, diamW1(Cn,α)≤4Cmodrn,α,diamW1(Cn,αalg)≤2Rn,α.
Appendix: Matching Local Lower Bounds
Explicit two-class observed-data experiments establish root-n law difficulty and inverse-gap ordered-mass difficulty.
The calibration is k=dx=dz=2, L=2, and π0=σ0=1/10. Law estimators have output support radius Lτ=802; ordered-mass estimators return probability vectors.
For the same-class ordered comparison, M(g) contains populations with two distinct effects and g/2≤δ(P)≤2g, where δ(P) is their effect gap and 0<g≤1/4.
The local experiments restrict one-record observed-data Kullback–Leibler divergence to at most cloc/n, for fixed 0<cloc<1. This divergence measures statistical distinguishability of the observed laws.
Fix cloc∈(0,1). There exist constants a,c,C∈R such that 0<a≤81,c>0,C>0, and, for every integer n≥1, the following statements hold for the explicit submodel k=dx=dz=2, L=2, π0=1/10, and σ0=1/10.
- (Quotient-law risk.) For every measurable quotient-law estimator νn with support radius Lτ=σ04Ldz, there is a law P in the local quotient-law experiment Lnν of Definition P-14 such that P=P0witorP=Pa/nwit, with Pεwit as in Definition P-13, and nc≤EQP(n)[W1(νn,νP)].
- (Ordered-weight risk.) For every g∈(0,1/4] and every measurable ordered-weight estimator pn taking values in the simplex, there is a law P in the local labeled-weight experiment Ln,gp of Definition P-15 such that P=Pg,0orP=Pg,h(n,g),h(n,g)=amin{1,ng1}, and cmin{1,ng1}≤EQP(n)[∥pn−p↑(P)∥1].
- (Quotient-law certificate.) The laws P0wit and Pa/nwit belong to the corresponding local quotient-law experiments, and their observed-data marginals and quotient laws satisfy DKL((Pa/nwit)O∥(P0wit)O)≤nC,nc≤W1(νP0wit,νPa/nwit).
- (Labeled-path certificate.) For every g∈(0,1/4], with h=h(n,g)=amin{1,ng1}, the displacement h lies in the tangent-amplitude domain, the laws Pg,h and Pg,0 belong to the corresponding local labeled-weight experiments, and DKL((Pg,h)O∥(Pg,0)O)≤Cg2h2,i∑pi↑(Pg,h)−pi↑(Pg,0)=2∣h∣.