CausalSmith · seminar slides
Measuring Full Adoption from Partial Rollout
When an experiment stops before everyone is treated, choosing when to measure can control the uncertainty from estimating full adoption.
slides for Chebyshev Rollout Schedules for Polynomial Extrapolation under Low-Order Interference
Motivation
- With interference, a unit’s outcome can depend on other units’ treatment assignments.
- We want the mean outcome change between nobody treated and everybody treated.
- The rollout reaches only a treated fraction q<1.
- Subtracting the baseline from the final measurement estimates the partial-rollout contrast.
Cortez et al. (2022) show how bounded-order interactions can make full-adoption effects identifiable through polynomial extrapolation.
How should we measure a partial rollout to estimate full adoption precisely?
Research Question
Suppose the mean response is a polynomial of degree at most β, where β is the maximum order.
A natural approach measures at β+1 equally spaced fractions and extrapolates the fitted polynomial:
peq(β,q)j=βqj,j=0,…,β.
Here pjeq is the treated fraction at measurement j; q is the final fraction.
- Interpolation gives an unbiased estimate. That alone does not control how strongly its weights amplify noise.
- Cortez-Rodriguez et al. (2024) study clustering to reduce variance for polynomial rollout estimation.
- Choosing measurement fractions is an optimal-design problem, as in Kiefer and Wolfowitz (1959).
Which fractions control the variance cost of extrapolation?
Key Idea
Place more measurements near both endpoints of the observed interval.
These Chebyshev-Lobatto fractions control polynomial growth between measurements. Extrapolation beyond the interval still has an unavoidable cost.
- Choose weights that recover the target for every polynomial of degree at most β.
- Among those weights, minimize the sum of their absolute values.
- With more than the minimum number of measurements, Chebyshev-Lobatto placement attains the unavoidable exponential variance amplification up to constants.
This conclusion uses a static polynomial mean, correct round expectations, a common variance bound, and a budget bounded away from full adoption.
Half-rollout Example
At q=0.5, measurements cover only [0,0.5], while the target includes the response at one.
The Chebyshev-Lobatto measurement fractions are
pjCh(k,q)=2q{1−cos(kπj)}.
Here k is the number of rollout intervals, giving k+1 measurements; j=0,…,k indexes them. The superscript Ch names this schedule.
- At this budget, the schedule starts at zero, ends at 0.5, and concentrates measurements near both endpoints.
- The variance-amplification base is approximately 5.83.
- The matching bounds raise that base to 2β, up to constants.
The design controls what happens inside the observed half; it cannot eliminate extrapolation to one.
Model
For an outcome law P, let mP(u) be the expected population mean at treated fraction u.
mP(u)=ℓ=0∑βaP,ℓuℓ
The coefficients aP,ℓ describe the response curve. This restriction holds throughout [0,1], including the unobserved endpoint.
Our target is
τP=mP(1)−mP(0)=ℓ=1∑βaP,ℓ.
Thus τP adds the nonconstant coefficients; the intercept cancels.
At measurement fraction pj, we observe the population mean Yˉj. We require Eπ[Yˉj]=mP(pj), where π denotes rollout randomization.
Static consistency: outcomes depend on current assignments, including others’ assignments, with no separate dependence on earlier rollout steps.
Assumptions
Common variance envelope: every round satisfies
Varπ(Yˉj)≤nσ02.
Here n is population size, and σ02≥0 sets the common variance scale. It incorporates outcome magnitudes and dependence across units.
- Cross-round covariances are otherwise unrestricted, provided they form a valid covariance matrix.
- Admissible schedules, denoted Sk,q, start at zero, increase strictly, and end at q.
- Budget cap: 0<q≤qmax<1, keeping full adoption outside the observed interval.
- Oversampling: k≥cβ, with fixed c>1, gives more than the minimum β+1 measurements.
Let Pβ denote laws satisfying static consistency, polynomiality, correct round expectations, and the variance envelope.
For the half-rollout example, polynomiality must hold beyond 0.5, all the way to one. Bounded-order interference motivates this restriction; we impose it.
Unbiased Estimation
Estimate the full-adoption contrast with
τ^w,p=j=0∑kwjYˉj,
where wj is the weight on measurement j, and p is the schedule.
The weights must recover the contrast for every polynomial term:
Wβ(p)={w∈Rk+1:j=0∑kwjpj0=0 and j=0∑kwjpjℓ=1 for every ℓ=1,…,β}.
Here Wβ(p) is the set of polynomial-exact weights.
- The first equation removes the intercept; pj0 means one.
- Each remaining equation recovers one nonconstant coefficient’s contribution to τP.
- Distinct nodes and k≥β guarantee that these weights exist.
These equations deliver unbiasedness. What determines their variance?
Variance Cost
Large positive and negative weights can cancel in the expected estimate while magnifying noise.
informal · Theorem T-1 Under the rollout law restrictions, 1≤β≤k, σ02≥0, and an admissible schedule, polynomial-exact weights exist, are unbiased, and obey a variance bound sharp over the covariance envelope.
For every polynomial-exact weight vector,
Varπ(j=0∑kwjYˉj)≤nσ02(j=0∑k∣wj∣)2.
Estimator variance is bounded by the common round variance times the squared sum of absolute weights.
Why absolute values? The envelope permits covariance signs that align with the weight signs. A valid covariance matrix attains this bound.
Unbiasedness constrains signed sums; variance control requires small absolute sums.
Design Objective
First choose the least costly polynomial-exact weights at a fixed schedule:
Aβ(p)=w∈Wβ(p)inf(j=0∑k∣wj∣)2.
Here Aβ(p) is the smallest worst-case variance multiplier available at schedule p.
Then choose measurement fractions:
Mβ,k,q=p∈Sk,qinfAβ(p).
Here Mβ,k,q is the best multiplier across all admissible schedules with k+1 measurements and budget q.
Multiplying by σ02/n gives the optimal worst-case variance over all valid covariance matrices satisfying the round variance envelope.
Main Result
informal · Theorem T-2 For β≥1, k≥cβ, fixed c>1, and 0<q≤qmax<1, Chebyshev-Lobatto schedules attain the smallest worst-case variance amplification up to constants depending only on c,qmax.
C−(qmax)(q(1+1−q)2)2β≤Mβ,k,q≤C+(c,qmax)(q(1+1−q)2)2β.
The positive constants C− and C+ are independent of q,β,k; their arguments show what they depend on.
- Every admissible schedule faces the lower bound.
- Chebyshev-Lobatto placement attains the upper bound.
- Chebyshev-Lobatto placement attains the unavoidable exponential rate up to constants.
At q=0.5, with a fixed cap qmax≥0.5 below one, the common base is approximately 5.83.
Why does measurement placement control this cost?
Hidden Polynomial Growth
The weight problem has an equivalent polynomial interpretation:
w∈Wβ(p)infj=0∑k∣wj∣=sup{∣r(1)−r(0)∣:r∈R[x], deg(r)≤β, 0≤j≤kmax∣r(pj)∣≤1}.
Here r is a test polynomial of degree at most β; R[x] denotes real polynomials.
The right side asks: How large can the full-adoption contrast be while every measured value stays within one?
- A large hidden contrast forces large absolute weights.
- Choosing fractions therefore means controlling polynomial growth that measurements fail to constrain.
In the half-rollout example, we bound r at measurement fractions in [0,0.5], but its contrast involves r(1).
Between Measurements
Measurements must first control the polynomial throughout the observed interval.
Using the Chebyshev-Lobatto mesh inequality, oversampling with k≥cβ, c>1, gives
∣R(x)∣≤K(c)0≤j≤kmaxR(−cos(kπj)).
Here R is a polynomial of degree at most β, x∈[−1,1], and K(c) is a finite constant depending only on the oversampling ratio.
- Rescaling [0,q] to [−1,1] sends the measurement fractions to the nodes inside the maximum.
- Small values at those nodes imply small values everywhere in the observed interval, up to K(c).
- Oversampling supplies control between measurements.
For the half-rollout example, this step controls the entire interval [0,0.5]. How much growth remains outside it?
Beyond the Observed Interval
Under the same rescaling, full adoption becomes the exterior point xq=2/q−1>1.
Its growth factor is λ(q)=xq+xq2−1.
For polynomials bounded throughout the rescaled interval,
for every real polynomial R with deg(R)≤β and x∈[−1,1]sup∣R(x)∣≤1,∣R(xq)−R(−1)∣≤C(qmax)λ(q)β,
Here R(−1) corresponds to baseline and R(xq) to full adoption. The constant C(qmax) depends only on the budget cap.
- The mesh inequality controls the observed interval.
- This bound controls the remaining endpoint extrapolation.
- The dual identity converts endpoint growth into absolute-weight size; squaring gives variance amplification.
The growth factor equals the main result’s base, (1+1−q)2/q.
Unavoidable Amplification
A polynomial bounded throughout [0,q] satisfies the measurement restriction for every schedule.
The Chebyshev polynomial Tβ, of degree β, supplies such a polynomial after rescaling. Its endpoint contrast is at least Tβ(xq)−1.
Tβ(xq)−1≥c(qmax)λ(q)β.
This lower bound uses a positive constant c(qmax), distinct from the oversampling ratio c.
- Every placement inside the rollout interval admits this test polynomial.
- The dual identity forces absolute-weight size at least proportional to λ(q)β.
- Squaring gives the matching variance-amplification lower bound.
The unavoidable cost comes from extrapolation. Chebyshev-Lobatto placement prevents additional uncontrolled growth between measurements.
Rollout Variance Guarantee
The envelope solution also supplies an upper bound when covariance comes from the rollout itself.
informal · Lemma L-12 Under the rollout law restrictions, σ02≥0, β≥1, c>1, 0<q≤qmax<1, and k=⌈cβ⌉, Chebyshev-Lobatto placement supplies the following worst-case rollout variance upper bound.
w∈Wβ(pCh(k,q))infP∈PβsupVarπ(j=0∑kwjYˉj)≤nσ02C+(c,qmax)(q(1+1−q)2)2β,
This bounds the infimum worst-case rollout variance over polynomial-exact weights on the Chebyshev-Lobatto schedule. The ceiling rounds the interval count upward.
The reason is direct: rollout covariance satisfies the envelope, so the envelope upper bound applies.
Open Questions
- Covariance-specific optimality: Does Chebyshev-Lobatto placement minimize worst-case variance under the covariance restrictions of a specified nested rollout? A matching lower bound remains open.
- Clustered rollouts: How should measurement placement account for cluster size and dependence within clusters?
- Mixed designs: How should fractions be chosen jointly with saturation, encouragement, or exposure-based randomization?
Takeaways
- A static degree-β mean curve over [0,1], with correct round expectations, makes the full-adoption contrast estimable through polynomial-exact weights.
- Under the common variance envelope, the squared sum of absolute weights is the sharp worst-case variance multiplier.
- With k≥cβ, c>1, and 0<q≤qmax<1, Chebyshev-Lobatto placement controls growth between measurements and attains the unavoidable exponential amplification up to constants.
Appendix: Variance Envelope Design
Polynomial-exact weights are unbiased, and their squared absolute-weight sum gives the sharp worst-case variance over the diagonal covariance envelope.
Let n,k,β be integers, let q∈R, and let σ02∈R. Fix a finite assignment space Ω, a finite design π on Ω, rollout assignment vectors Z0,…,Zk, round means Yˉ0,…,Yˉk, a rollout mean curve mP, polynomial coefficients aP,ℓ, and a schedule p=(p0,…,pk). Suppose that
- (Order.) 1≤β≤k.
- (Envelope scale.) σ02≥0.
- (Schedule.) p∈Sk,q, in the sense of Definition P-1.
- (Law class.) The design, rollout variables, round means, mean curve, coefficients, envelope scale, and schedule satisfy the rollout law-class restrictions Pβ in Definition P-2.
Then Wβ(p), as defined in Definition P-3, is nonempty. Moreover, for every w∈Wβ(p), Eπ[j=0∑kwjYˉj]=mP(1)−mP(0) and Varπ(j=0∑kwjYˉj)≤nσ02(j=0∑k∣wj∣)2. For every such w, there also exists a positive semidefinite (k+1)×(k+1) matrix Γ such that Γjj≤nσ02for every j=0,…,k, and i=0∑kj=0∑kwiΓijwj=nσ02(j=0∑k∣wj∣)2. Consequently, with Aβ(⋅) and Mβ,k,q as in Definition P-5, inf⎩⎨⎧v: ∃w∈Wβ(p) with v=nσ02(j=0∑k∣wj∣)2⎭⎬⎫=nσ02Aβ(p), and inf{v: ∃p′∈Sk,q with v=nσ02Aβ(p′)}=nσ02Mβ,k,q. Finally, if p⋆∈Sk,q satisfies Aβ(p⋆)=Mβ,k,q, then for every p′∈Sk,q, nσ02Aβ(p⋆)≤nσ02Aβ(p′).
Appendix: Chebyshev Minimax Amplification
With oversampling and budgets bounded away from one, Chebyshev-Lobatto schedules attain matching minimax amplification bounds up to constants.
Fix a budget cap qmax∈(0,1). There exists a constant C−(qmax)>0 such that, for every oversampling ratio c>1, there exists a constant C+(c,qmax)>0 with the following property. For every pair of integers β,k, every rollout budget q, and every schedule p, suppose that
- (Order and oversampling.) β≥1 and k≥cβ.
- (Low-budget regime.) q>0 and the low-budget cap condition of Assumption A-4 holds for (q,qmax).
- (Admissible schedule.) When p is used below, p∈Sk,q as in Definition P-1.
Then, with Aβ(⋅) and Mβ,k,q as in Definition P-5 and pCh(k,q) as in Definition P-4, Aβ(p)≥C−(qmax)(q(1+1−q)2)2β, and Aβ(pCh(k,q))≤C+(c,qmax)(q(1+1−q)2)2β. Moreover, the minimax amplification satisfies the matching two-sided bound C−(qmax)(q(1+1−q)2)2β≤Mβ,k,q≤C+(c,qmax)(q(1+1−q)2)2β.
Appendix: Rollout Variance Feasibility
Under the rollout law restrictions, Chebyshev-Lobatto placement supplies the stated exponential upper bound for worst-case rollout variance.
Fix an oversampling constant c and a budget cap qmax such that c>1 and 0<qmax<1. Then there exists a constant C+(c,qmax)>0 such that, for every population size n, polynomial order β, number of rollout intervals k, finite assignment space Ω, finite design π on Ω, rollout budget q, and variance-envelope scale σ02, the following conditions imply the stated bound:
- (Order.) β≥1.
- (Budget.) q>0 and q satisfies the low-budget cap with qmax in Assumption A-4.
- (Variance scale.) σ02≥0.
- (Chebyshev size.) k=⌈cβ⌉.
- (Schedule.) p=pCh(k,q) is the shifted Chebyshev-Lobatto schedule of Definition P-4.
Under these conditions, w∈Wβ(pCh(k,q))infP∈PβsupVarπ(j=0∑kwjYˉj)≤nσ02C+(c,qmax)(q(1+1−q)2)2β, where Wβ(pCh(k,q)) is the unbiased weight set of Definition P-3, and the supremum ranges over rollout laws P∈Pβ satisfying Definition P-2 at the schedule pCh(k,q) with variance-envelope scale σ02.