CausalSmith · seminar slides
Total Effects from Sampled Networks
Knowing how network arrows were sampled lets us estimate the effect of treating everyone and determine how much collection precision requires.
slides for Minimax Precision for Total Treatment Effects with Partially Observed Interference Networks
Motivation
One experiment assigns treatment to some units, but treatment can also affect their neighbors.
We want the population effect of treating everyone rather than no one:
τ(θ)=n1i∈V∑(Yi(1)−Yi(0)),
Here V contains n≥4 units; Yi is unit i’s potential outcome. The assignments 1,0 treat everyone and no one. The fixed schedule θ specifies the network and response coefficients.
This target includes both own-treatment effects and spillovers. How can one mixed assignment reveal their sum?
Research Question
Cortez-Rodriguez et al. (2023) estimate this contrast by combining outcomes with treatments in known neighborhoods.
- Every possible treatment source enters the score.
- Using an incomplete neighborhood omits contributions from missing sources.
- Outcomes may themselves help reveal missing connections.
Let d bound both sources per recipient and recipients per source. Let q be the known probability of retaining each true arrow.
What is the best worst-case squared error when estimators can use sampled arrows, every assignment, and every outcome?
Key Idea
Weight each retained arrow by 1/q. Its contribution represents retained and omitted arrows on average.
Under bounded additive responses, noiseless outcomes, independent half-probability treatment assignment, and independent arrow retention, optimal squared risk has this order for q>0:
min{1,nd2+nqd}.
- d2/n: uncertainty from the experiment even with the full network.
- d/(nq): the precision cost of sampled network information.
- The cap reflects a causal target bounded in magnitude by one.
The coefficient bound includes the baseline and all treatment effects. At q=0, worst-case risk remains of constant order.
Example
Take the supported case d=1. Each unit has at most one source and reaches at most one recipient.
For a source–recipient arrow j→i, the recipient response is Yi(Z)=ai+tiZi+bijZj: baseline ai, own effect ti, and spillover bij.
Write Xj=2Zj−1, the source’s treatment sign, and Wij for whether its arrow is retained.
The corrected spillover contribution is 2Yi(Z)WijXj/q. Its expectation is bij, even though the arrow appears only with probability q.
informal · Theorem T-2 Under the bounded additive model and independent assignment–retention design, d=1 gives c/(1+nq)≤Rn,1(q)≤C0/(1+nq), with universal positive constants.
Here Rn,1(q) is optimal worst-case squared error. Collection affects precision even with one source per outcome.
Model
The true directed graph G contains arrows (j,i) from source j to recipient i.
Y(z)=(Yi(z))i∈V,Yi(z)=ai+tizi+j:(j,i)∈G∑bijzj,z∈{0,1}V.
The binary vector z specifies treatment. Baselines ai, own effects ti, and spillovers bij are fixed and heterogeneous.
- Incoming degree at most d limits sources per outcome.
- Outgoing degree at most d limits how widely one treatment propagates.
- The integer d satisfies 1≤d≤n−1.
i∈Vmax∣ai∣+∣ti∣+j:(j,i)∈G∑∣bij∣≤1,
This bounds outcomes and the target by one in magnitude. In our pair example, it becomes ∣ai∣+∣ti∣+∣bij∣≤1. Denote the allowed schedules by Mn,d.
Observation Design
- Every treatment Zj is independently assigned with probability one half.
- Every true arrow between distinct units is independently retained with known probability q∈[0,1].
- Retention is independent of treatment; every recorded arrow is true.
H={(j,i)∈G:Wij=1},O=(H,Z,Y(Z)),
The binary mark Wij records retention, H is the sampled graph, and O is the complete observed record.
We observe every assignment and every noiseless realized outcome. Own-treatment coordinates are always available.
In the pair example, Yi(Z) remains observed when j→i is missing.
Precision Criterion
We compare every estimator of the complete record.
Rn,d(q)=Tinfθ∈Mn,dsupL(T;θ,q),L(T;θ,q)=EPθ,q[(T(O,ξ)−τ(θ))2].
Here L is expected squared error for a fixed schedule. The law Pθ,q averages over assignment and retention; ξ is an independent seed allowing randomized estimators.
The supremum chooses the worst allowed schedule; the infimum chooses the best estimator.
A lower bound on Rn,d(q) therefore covers methods that infer missing connections from outcomes.
Main Result
Define the precision scale:
F(n,d,q)=⎩⎨⎧min{1,n[1−(1−q)d]d2},1,q>0,q=0.
The factor 1−(1−q)d is the probability of retaining at least one of d arrows.
informal · Theorem T-4 For n≥4, 1≤d≤n−1, and q∈[0,1], under our bounded additive model and independent assignment–retention design, the observable rule Tn,d,q⋆ attains minimax squared risk within universal constants of F(n,d,q).
cF(n,d,q)≤Rn,d(q)≤θ∈Mn,dsupL(Tn,d,q⋆;θ,q)≤C0F(n,d,q).
The positive constants c,C0 work uniformly over all admissible parameters. The rule Tn,d,q⋆ clips the weighted score when its error bound is below one and returns zero otherwise.
Retention Regimes
Why do the two expressions for precision agree?
Put p=1−(1−q)d, the probability that at least one arrow is retained, and αret=1−e−1.
αretmin{1,dq}≤p≤min{1,dq}.
Thus p≍min{1,dq}, where ≍ means comparison by universal positive constants.
- When dq≤1, p is comparable to dq, so d2/(np) is comparable to d/(nq).
- When dq>1, p is bounded away from zero, so d2/(np) is comparable to d2/n.
The larger of the two components determines the order; their sum has the same order. Retention around 1/d marks the transition.
Known-graph Score
For every unit, define Xj=2Zj−1: treated units have sign +1, controls sign −1.
The additive known-neighborhood score of Cortez-Rodriguez et al. (2023) is
TG=n2i∈V∑Yi(Z)Xi+j:(j,i)∈G∑Xj.
Each outcome is multiplied by its own sign and every true source sign, then averaged.
Independence makes these signs extract individual additive effects:
- 2EZ[Yi(Z)Xi]=ti.
- For a true source j, 2EZ[Yi(Z)Xj]=bij.
- Baselines disappear because signs have mean zero.
Consequently, EZ[TG]=τ(θ). The missing ingredient is the true source list.
Correction for Missing Arrows
Inverse-inclusion weighting, following Horvitz and Thompson (1952), restores the missing contributions:
Tq=n2i∈V∑Yi(Z)Xi+q−1j:(j,i)∈H∑Xj,q>0.
This observable score weights each retained source sign by 1/q; the own-treatment sign needs no correction.
For our pair j→i:
- Uncorrected contribution: E[2Yi(Z)WijXj]=qbij.
- Corrected contribution: E[2Yi(Z)WijXj/q]=bij.
More generally, for every fixed assignment z, EW[Tq(z,W)]=TG(z), where EW averages retention.
Thus EPθ,q[Tq]=τ(θ). Correction turns missing-arrow bias into additional variance.
Two Sources of Variation
The weighted score has an exact variance decomposition:
VarPθ,q(Tq)=VarZ(TG)+n2q4(1−q)i∈V∑{j∈V:(j,i)∈G}EZ[Yi(Z)2],
The first term averages assignment variation. The second sums independent retention variation over true arrows.
- Expanding TG−τ produces individual signs and products of two signs. Distinct products have zero covariance.
- Incoming degree limits terms per outcome; outgoing degree limits repeated appearances of a treatment sign.
- Together with the coefficient bound, this gives VarZ(TG)≤5(d+1)2/n.
- Since incoming degree is at most d and ∣Yi(Z)∣≤1, retention adds at most 4d(1−q)/(nq).
Rare retained arrows receive large weights, explaining the collection cost.
Attaining Rule
Combine the two variance bounds into an error envelope computable from n,d,q:
u(n,d,q)={5(d+1)2/n+4d(1−q)/(nq),+∞,q>0,q=0.
The attaining estimator uses this envelope to choose its branch:
Tn,d,q⋆(O)=Tup(O)={max{−1,min{1,Tq(O)}},0,q>0, u(n,d,q)<1,otherwise,
Clipping restricts the score to [−1,1] and cannot increase squared error because the target lies there. Returning zero has squared error at most one.
informal · Theorem T-1 For admissible n,d,q, under our bounded additive model and independent assignment–retention design, Tup has worst-case squared error at most min{1,u(n,d,q)}.
Why can no use of outcomes improve this order uniformly?
Supplied-graph Benchmark
First isolate uncertainty intrinsic to the experiment.
Let Rn,dG(q) be optimal worst-case squared error when the true graph G is supplied alongside O.
CausalSmith (2026), a supplied research note, provides the quadratic degree benchmark under our response restrictions and assignment law:
Rn,dG(q)≍min{1,nd2}
This delivers a lower bound of that order. The known-graph score, clipping, and zero fallback give a matching upper bound.
Supplying G can only make estimation easier, so its lower bound also applies to the sampled-network experiment.
To establish the additional collection cost, we need schedules whose hidden source associations remain difficult to learn from outcomes.
Hard-to-distinguish Effects
Construct B groups, each with d sources feeding the same d recipients. There are m=Bd sources, with 2m≤n.
Before the experiment:
- Allocate source labels uniformly among groups.
- Draw independent group baselines Uℓ, with density f(w)=4cos2(2πw) on [−1/4,1/4], zero outside.
- Fix the resulting graph and coefficients.
For spillover sign σ∈{−1,1} and amplitude 0≤h≤1/4, recipients in group ℓ share
yℓ=Uℓ+2dσhXℓ,sum.
Here Xℓ,sum sums that group’s source-treatment signs. Each arrow has coefficient σh/d; own effects, source outcomes, and padding outcomes are zero.
Equivalently, every recipient i∈Cℓ has fixed schedule coefficients
ai=Uℓ−2σh(i∈Cℓ),ti=0,bij=dσh
Thus Uℓ is drawn before the experiment and becomes part of the fixed intercept, rather than measurement noise.
θ∈Mn,d,τ(θ)=nσmh,
The construction gives allowed schedules with opposite total effects.
Complete Outcome Likelihood
One retained outgoing arrow reveals a source’s recipient group. This happens independently across sources with probability p=1−(1−q)d.
Given the detailed graph H and every assignment Z, define:
- uℓ: remaining source slots in group ℓ; M=∑ℓuℓ.
- Aℓ: sum of revealed source signs.
- K: observed number of treated unrevealed sources.
The conditional density of the distinct group outcomes y=(y1,…,yB) is
λσ,h(y∣H,Z)=(KM)[xK]ℓ=1∏B{k=0∑uℓ(kuℓ)f(yℓ−2dσh(Aℓ+2k−uℓ))xk},
Here k counts hidden treated sources in a group; x is a polynomial indeterminate. Extracting [xK] enforces the known global count.
Each possible allocation predicts an outcome shift. The density averages these predictions; observed outcomes reweight the allocations. Copying each yℓ to its recipients reconstructs every outcome coordinate.
Baseline Smoothing
The unknown baselines prevent noiseless responses from identifying the spillover sign immediately.
Let gd(w) be one group’s response density averaged over all equally likely source-sign vectors, with w a possible response.
Expand the fixed-sign response likelihood relative to gd in products of treatment signs. Let as(w) be the coefficient for a product of s signs.
γs=∫Ras(w)2gd(w)dw(1≤s≤d),η=s=1∑d(sd)γs,η1=s=1∑ds(sd)γs.
The quantities η,η1 measure squared likelihood dependence on signs, with η1 additionally weighting product size.
0≤η≤η1≤d12π2h2.
Flipping one sign shifts the response by h/d. Smoothness of f bounds the squared likelihood change from that flip; summing over d coordinates produces the h2/d bound.
This controls products of every size, including outcome information beyond the mean.
Hidden Allocation Averaging
Condition on H. Compare the actual positive-sign law of (Z,y) with a reference QH that keeps the actual assignments and gives groups independent response densities gd.
Let L+ be their likelihood ratio and χH2=EQH[(L+−1)2], their squared likelihood discrepancy.
When 4eη<1, with e=exp(1),
EH[1{M≥m/4}χH2]≤1−4eηexp(eBpη1)−1.
The average uses the actual detailed retained-graph law.
- Averaging allocations spreads a product of k hidden signs over (kM) labeled subsets; orthogonality reduces its squared contribution by 1/(kM).
- These symmetric products remain functions of the observed count K.
- Hidden dependence contributes through 1−4eη; revealed associations accumulate through Bpη1.
The comparison retains every assignment and the full outcome likelihood. It therefore includes learning from outcomes and the global count.
Testing Scale
Since m=Bd, smoothing gives Bpη1≤12π2h2mp/d2.
The accumulating information is therefore controlled by h2mp/d2, while the cap on h keeps η small. Choose
h∘(B,d,q)=100π1⎩⎨⎧min{1,mpd},1,p>0,p=0,
This is the amplitude that keeps both parts of the likelihood bound small.
At low revelation, p<1/2, with m≥32:
- The event M<m/4 has probability at most 1/16.
- At h∘, the average squared likelihood discrepancy on its complement is at most 1/16.
- Symmetry of f and Cauchy–Schwarz bound the complete-record total variation by 1/16+1/4≤1/2.
At higher revelation or smaller m, a translation comparison gives the same conclusion even if the source partition is supplied.
Thus TV(P+1,h∘,P−1,h∘)≤1/2, where these are the opposite-sign complete-record laws and total variation is the largest probability difference over observed events.
Matching Lower Bound
An accurate effect estimate would distinguish positive from negative effects.
For two distributions over allowed schedules with constant targets +Δ and −Δ,
Rn,d(q)≥2Δ2(1−TV(Q+,Q−)),
Here Q+,Q− are their complete-record laws, and Δ is the target magnitude.
- In our construction, Δ=mh∘/n.
- When d2/n<1/16, choose enough groups that n/4≤m≤n/2.
- The testing bound gives risk at least Δ2/4; because m is comparable to n, this matches F(n,d,q) up to constants.
- When d2/n≥1/16, the supplied-graph benchmark already gives a constant lower bound, sufficient because F≤1.
The converse covers every use of sampled arrows, assignments, and noiseless outcomes.
Collection and Consistency
Retention of order 1/d or greater matches the supplied-graph precision order. Below that transition, d/(nq) determines the uncapped risk.
Uniform consistency means squared error vanishes uniformly over all allowed schedules.
informal · Theorem T-4 For admissible sequences dn,qn, under our bounded additive model and independent assignment–retention design, uniform consistency is possible exactly when dn2/n→0 and dn/(nqn)→0, assigning the second ratio +∞ at zero retention.
ndn2⟶0and⎩⎨⎧+∞,nqndn,qn=0,qn>0⟶0.
Here dn,qn are degree bounds and retention probabilities as population size grows.
Degree must grow more slowly than n, and collection must outpace dn/n. For our d=1 example, consistency requires nqn→∞: retention can vanish while precision improves.
Open Questions
- Estimated or heterogeneous retention, false-positive arrows, and dependent collection from interaction events.
- Alternative assignments, repeated experiments, and responses with treatment interactions.
- Exact minimax constants, confidence intervals, and recovery of individual arrows.
Platform applications require a justified mapping from recorded events to independently retained interference arrows.
Takeaways
- Independent treatment signs extract additive effects; weighting sampled arrows by 1/q restores their contributions on average.
- Under our bounded model and independent design, optimal squared risk combines d2/n and d/(nq), capped at constant order.
- Smooth unknown baselines and hidden source allocations limit complete-record information at scale h2mp/d2, yielding the matching lower bound even when outcomes help reveal connections.
Appendix: Observed-record Precision Frontier
This statement gives the attainable minimax scale, its endpoint comparisons, and the necessary and sufficient conditions for uniform consistency.
Let F be the risk-scale function in Definition P-10, and let the attaining rule be Tn,d,q⋆=Tup, where Tup is the total observable upper rule. There exist universal real constants c,C0>0 such that, simultaneously for all parameters satisfying
- (Population.) The population size n is an integer with n≥4.
- (Degree.) The degree bound d is an integer with 1≤d≤n−1.
- (Retention.) The known retention probability q belongs to [0,1].
the canonical independent assignment--audit design satisfies cF(n,d,q)≤Rn,d(q)≤θ∈Mn,dsupL(Tn,d,q⋆;θ,q)≤C0F(n,d,q). Here Mn,d is the fixed schedule class, L(T;θ,q) is expected squared estimation loss, and Rn,d(q) is its infimum over all measurable real-valued randomized estimators T(O,ξ), where O is the complete observed record and ξ is the independent randomization seed. For every pair of degree and retention sequences dn,qn satisfying 1≤dn≤n−1,qn∈[0,1]for every integer n≥4, there exists a sequence of measurable real-valued randomized estimators Tn(O,ξ) such that θ∈Mn,dnsupL(Tn;θ,qn)⟶0as n⟶∞ if and only if ndn2⟶0and⎩⎨⎧+∞,nqndn,qn=0,qn>0⟶0. The second convergence is in the extended nonnegative real numbers. For every integer n≥4 and 1≤d≤n−1, the endpoint scales are F(n,d,0)=1,F(n,d,1)=min{1,nd2}. Moreover, there exist universal real constants c1,C1>0 such that, simultaneously for every integer n≥4, every integer 1≤d≤n−1, and every 0<q≤1, c1min{1,nd2+nqd}≤F(n,d,q)≤C1min{1,nd2+nqd}.
Appendix: Observable Upper Risk Bound
This statement bounds the worst-case squared error of the clipped-or-zero inverse-inclusion rule.
Let V be a finite population with size n=∣V∣. Suppose that:
- (Population size.) n≥4.
- (Degree bound.) The integer degree bound d satisfies 1≤d≤n−1.
- (Retention probability.) The known edge-retention probability q belongs to [0,1].
Under the independent assignment--audit product design, the minimax risk Rn,d(q) and expected squared loss L of Definition P-2, the observable rule Tup of Definition P-6, and the upper-risk envelope u(n,d,q) of Definition P-5 satisfy Rn,d(q)≤θ∈Mn,dsupL(Tup;θ,q)≤min{1,u(n,d,q)}, where Mn,d is the fixed schedule class underlying the risk in Definition P-2. The rule Tup is real-valued and measurable on the complete observed-record space.