CausalSmith · seminar slides
Estimating Treatment Value Across Budgets
Estimate the best population outcome achievable at every treatment capacity, even when covariate cells are rare and treatment effects tie.
slides for Minimax Estimation of Budgeted Treatment Value Curves with Discrete Covariates
Motivation
A practitioner wants to compare what treatment can achieve at different capacities.
The natural approach estimates treatment effects within covariate cells, ranks the cells, and plugs those estimates into the optimal-value calculation.
- Rare cells produce noisy effect estimates.
- Near a treatment threshold, small errors change rankings.
- Taking positive parts or maxima of noisy estimates introduces bias.
Feng et al. (2026) derive plug-in value-process asymptotics under regular decision-boundary and process-convergence conditions.
How accurately can we estimate the entire capacity curve while allowing rare cells and exact ties?
Key Idea
Replace estimated rankings with a treatment-price calculation.
At each price, estimate control value plus the positive treatment gains remaining after paying that price. Minimizing over prices recovers each capacity value.
Our construction combines three pieces:
- Local polynomial approximation reduces nonlinear bias.
- Unbiased count statistics estimate the polynomial’s powers.
- A common construction across prices controls the entire random path.
With independent sampling, consistency, conditional exchangeability, and fixed treatment overlap, minimax squared largest-error risk has order min{1,d/[nlog(ed)]}.
Here n is sample size and d is the known number of covariate cells. One estimated price process delivers this precision across all budgets.
Example
Create k pairs of cells. Pair i has population mass ri, divided equally between its two cells; pair masses sum to one.
Treatment probability is 1/2. Control outcome means are 1/4, and treatment outcome means are 1/2+θi and 1/2−θi, with θi∈[−1/8,1/8].
At half capacity, treat the better cell in each pair. Either cell can be selected when they tie.
Let Vb(P) denote the best mean outcome at capacity b under population law P.
V1/2(P)=83+21i=1∑kri∣θi∣=81+FP(41),V1(P)=21.
Half-capacity value depends on absolute contrasts, while full-capacity value is constant. The price process FP, defined below, contains this absolute-value problem at price 1/4.
Model
An observed record is O=(X,A,Y): covariate cell, binary treatment, and binary outcome. Potential outcomes are Y(0) and Y(1).
For cell j, let pj be its population mass, μaj its potential-outcome mean under arm a, and τj=μ1j−μ0j its treatment effect.
A policy treats fraction πj of cell j. The feasible class Πb(P) requires ∑jpjπj≤b.
With B(P) denoting mean outcome under universal control, the target is
Vb(P)=B(P)+π∈Πb(P)maxj=1∑dpjπjτj,V(P)=(Vb(P):b∈I).
The maximum adds the largest feasible treatment gain to control value. The curve collects these population optima over a budget interval I.
Assumptions
- Independent sampling: the n records are independent draws from the same population.
- Consistency: Y=Y(A); the recorded outcome is the potential outcome under received treatment.
- Conditional exchangeability: (Y(0),Y(1))⊥A∣X; within a cell, treatment selection does not depend on potential outcomes.
- Fixed overlap: treatment probability ej=P(A=1∣X=j) satisfies, in every occupied cell,
ϵ≤ej≤1−ϵ.
The fixed parameter ϵ∈(0,1/2) keeps both treatment arms possible. These conditions identify both cell outcome means.
Call this causal class Md,ϵ. Cell masses can be arbitrarily small, and effects can tie.
In the paired example, treatment probability 1/2 satisfies overlap; potential outcomes are generated independently of treatment within cells.
Main Result
Choose b0∈[0,1/2] and let I=[b0,1−b0].
Our loss squares the largest error over I, then takes expectation. The minimax risk Rn,d,ϵ,b0curve selects the best estimator against the hardest law in Md,ϵ.
informal · Theorem T-6 With independent sampling, consistency, conditional exchangeability, and fixed 0<ϵ<1/2, for all n≥1,d≥2,b0∈[0,1/2], minimax squared supremum risk is of order min{1,d/[nlog(ed)]}.
cϵmin{1,nlog(ed)d}≤Rn,d,ϵ,b0curve≤Cϵmin{1,nlog(ed)d}.
The positive constants cϵ,Cϵ depend only on overlap. A specified polynomial-and-factorial estimator attains the upper bound.
- b0=0: simultaneous precision from zero to full capacity.
- b0=1/2: precision at half capacity alone.
In the paired example, half capacity already supplies the matching difficulty despite constant full-capacity value.
Treatment Prices
A shadow price λ∈[0,1] charges λ per treatment.
Define FP(λ)=B(P)+∑jpj(τj−λ)+, where (x)+=max{x,0}. This retains only treatment gains exceeding the charge.
Vb(P)=0≤λ≤1inf{bλ+FP(λ)}.
The term bλ adds back the price of available capacity.
Every feasible allocation’s gain is bounded by its treatment charges plus the positive gains remaining after those charges.
A threshold allocation attains that bound: treat above the price, split treatment within ties, and use price zero when all positive-effect cells fit.
In the paired example, price 1/4 separates effects 1/4+∣θi∣ and 1/4−∣θi∣.
The remaining statistical problem is estimating FP uniformly over prices.
Observed Cell Contributions
For cell j, qj contains the four observed masses qay,j=P(X=j,A=a,Y=y).
For a generic four-vector u, sa(u) is its arm-a mass and s(u) its total mass.
ga(u)=max{sa(u),ϵs(u)}s(u)ua1,fλ(u)=g0(u)+[g1(u)−g0(u)−λs(u)]+,FP(λ)=j=1∑dfλ(qj).
Under our assumptions, ga(qj)=pjμaj. Thus fλ(qj) is the cell’s control contribution plus its positive gain after charging.
The denominator stabilizes arm-mean calculations on noisy mass vectors.
Substituting empirical masses still applies a nonlinear function to noise. In the paired example, this is the difficulty of estimating ∣θi∣ near zero.
Pilot Localization
For d≥16 and n≥d/L, use the polynomial construction, with L=log(ed).
Separate counts choose the approximation region and estimate the polynomial there.
In the ideal count experiment, pilot counts Nζj′ and evaluation counts Nζj are mutually independent Poisson variables with means mqζj.
Here ζ=(a,y) indexes the four treatment-outcome categories Z={0,1}2, and m=n/8.
δ=mL,cζj=mNζj′,hζj=H0{cζjδ+δ},
The pilot location cζj estimates the mass; hζj is its uncertainty width; H0 is a fixed multiplier.
Extend each location by its width, truncating the lower endpoint at zero. These intervals form a rectangle with center cj0 and coordinate radii Rζj.
The approximation region adapts to uncertainty even when a cell is barely observed.
Endpoint-sensitive Approximation
On the pilot rectangle, approximate fλ by a polynomial Pλ of order K, a small multiple of L=log(ed).
Write aζ=cζ0−Rζ and bζ=cζ0+Rζ for the coordinate interval’s endpoints. Here bζ is an endpoint, distinct from the treatment budget b.
For a mass vector y inside the rectangle, the approximation bound is
Pλ(y)−fλ(y)≤Cϵ∑ζ∈Z{(yζ−aζ)(bζ−yζ)/K+Rζ/K2}.
The first term uses distances to both endpoints. The second is a residual smoothing error.
When aζ=0, the first term becomes yζ(bζ−yζ)/K.
A broad interval therefore need not imply a large error at a tiny true mass. At mass zero, the endpoint-distance term vanishes.
Rare-cell Bias
A radius-only approximation bound would assign the same error throughout a pilot interval. Endpoint sensitivity recognizes a rare mass’s position near zero.
On successful localization, the endpoint-distance product is controlled by the true coordinate mass times L/m.
Dividing its square root by K, with K proportional to L, produces a mass-sensitive error.
After polynomial estimation and clipping, the absolute cell bias at every price is at most
Cϵ{nLpj+nL1}.
Here pj is the cell’s total mass; Cϵ depends only on overlap.
The first term shrinks with cell mass. The second remains even at zero mass.
In a rare pair, the approximation recognizes small population weight rather than charging the entire pilot width as bias.
Unbiased Polynomial Powers
For an evaluation count N∼Pois(mq), center z, and integer power h≥0, define
Uh(N;z)=t=0∑h(th)(−z)h−tmt(N)t,(N)t=N(N−1)⋯(N−t+1),(N)0=1.
The falling factorial (N)t/mt has expectation qt. Consequently, E[Uh(N;z)]=(q−z)h.
Replace each centered polynomial power by this unbiased statistic.
Conditional on the pilot, centers and polynomial coefficients are fixed. Independent evaluation coordinates make products of these replacements unbiased too.
Polynomial estimation therefore adds no nonlinear plug-in bias before clipping.
Jiao et al. (2015) develop polynomial approximation with unbiased count statistics for discrete functionals.
Cell Estimator
Expand the local polynomial in normalized centered powers, then replace those powers with their unbiased statistics:
Zj(λ)=fλ(cj0)+α∈{0,…,D}4∑βj,α(λ)ζ∈Z∏RζjαζUαζ(Nζj;cζj0),
The construction has three pieces:
- fλ(cj0): the contribution at the pilot center.
- βj,α(λ): coefficients of the polynomial correction.
- The product: unbiased estimates of normalized centered powers.
The four-component index α specifies the powers; D=2(K−1) bounds the degree in each coordinate.
Conditional on the pilot, E[Zj(λ)∣N′]=Pj,λ(qj), where N′ denotes all pilot counts.
The random powers stay fixed across prices. How do we also keep their coefficients from moving too much?
Common Smoothing Across Prices
Use the same positive averaging operator at every price:
Pj,λ(cj0+Rj⊙cosϑ)=∫[−π,π]4fλ(cj0+Rj⊙cos(ϑ+t))ζ∈Z∏JK(tζ)dt,
This smooths the four mass coordinates, expressed through angles ϑ; t shifts those angles, and ⊙ means coordinatewise multiplication. The Jackson weights JK are nonnegative and integrate to one. Price λ is not smoothed.
Total variation is a path’s accumulated movement over prices. Its bounded-variation norm adds that movement to its magnitude at price zero.
The cell paths obey ∥f⋅(u)−f⋅(v)∥BV([0,1])≤Cϵ∥u−v∥1, where ∥u−v∥1 sums coordinate differences.
Every smoothed mass vector lies in the same rectangle. Positive averaging cannot exceed the average bound on initial magnitude and accumulated movement.
Thus the polynomial paths retain this control; converting them to coefficients gives a controlled envelope proportional to the sum Sj=∑ζRζj of pilot radii.
Noise Control
Normalization by pilot radii controls the growing polynomial powers.
On successful localization, qζj/(mRζj2)≤1/L. The conditional second moment of a normalized power of degree h is at most eh2/L.
Choosing K=max{2,⌊L/512⌋} balances approximation improvement against coefficient and power growth.
Clip each correction Zj−f⋅(cj0) at magnitude d1/4Sj, producing Tj; clipping cannot increase its total variation.
Let Gj be successful localization: ∣cζj−qζj∣≤hζj/4 in every coordinate. Define the uncentered restricted error path by Wjgood(λ)=1Gj{Tj(λ)−fλ(qj)}.
E∥Wjgood∥BV([0,1])2≤cd1/16vj2.
Here vj=pjL/m+L/m measures pilot uncertainty, and c depends only on overlap.
This bounds the whole cell path’s magnitude and movement, not merely its variance at one price.
Uniform Aggregation
Write Wj=Wjgood. Center it by subtracting its pointwise mean path EWj.
For these independent continuous cell paths, the uniform inequality is
Ej=1∑d(Wj−EWj)∞2≤16384j=1∑dE[(∥Wj∥∞+TV[0,1](Wj))2].
The left side takes the largest centered error over all prices before squaring and averaging. The symbol TV[0,1] denotes total variation.
The right side charges each cell for its height and all its movement along the price interval. That movement budget controls peaks wherever they occur.
Independence makes these squared path budgets add in the maximal inequality. Fixed-price variance addition alone would not deliver this conclusion.
Since ∑jpj=1, ∑jvj2≤2L/m+2d(L/m)2. In the branch n≥d/L, inserting the cell bounds yields at most a constant times d/(nL).
From Counts to Records
The uniform centered bound combines with two remaining terms:
- Summed bias has squared order at most d/(nL), using ∑jpj≤d.
- Failed localizations have exponentially small weighted envelopes; clipping controls their contribution.
Together they bound the ideal price-process risk by Cϵd/(nL).
To implement the count construction, draw M∼Pois(n/4), randomly permute the n records, retain M when M≤n, and independently mark them pilot or evaluation with equal probability. Use the zero process when M>n.
Before the cap, Poisson marking gives the independent counts at scale m=n/8.
F(λ)=E{Fcap(λ)∣O(n)}.
Here Fcap sums the clipped cell estimates. Averaging over auxiliary randomness conditional on the actual sample cannot increase expected squared supremum error; the cap adds a controlled tail term.
Recovering the Curve
The Jackson–factorial estimator reports
VbJF=Π[0,1](0≤λ≤1min{bλ+F(λ)}),b∈I.
The superscript names the polynomial-and-count construction; Π[0,1] truncates the value to [0,1].
b∈[0,1]sup0≤λ≤1inf{bλ+F(λ)}−Vb(P)≤λ∈[0,1]supF(λ)−FP(λ).
A uniform perturbation of price values changes every minimum by at most that perturbation. Truncation cannot increase error.
Thus one accurate price process controls every budget, including one selected after viewing the curve.
For d<16, empirical masses suffice. For d≥16 and n<d/L, report the constant curve 1/2. These branches complete the all-sample upper bound.
Distance Inside Treatment Value
Return to the paired example. Let R,S be probability distributions on k categories.
Choose ri=(Ri+Si)/2 and θi=(Ri−Si)/[8(Ri+Si)], with contrast zero when the denominator vanishes.
V1/2(PR,S)=83+321∥R−S∥1,V1(PR,S)=21,
Here PR,S is the resulting causal law; ∥R−S∥1 sums absolute category-probability differences.
There is an exact conversion from n draws from each source to n causal records. Select either source equally, retain its category, and draw cell sign and treatment independently with equal probabilities. Control mean is 1/4; treated means use opposite sign shifts for the two sources.
Mixing sources within a category produces exactly the paired treatment means.
A half-capacity estimator would therefore estimate distributional distance: subtract 3/8 and multiply by 32.
Moment Matching
The lower bound uses the same absolute-value difficulty that polynomial approximation addresses in the estimator.
Let ℓ be a positive moment order. The lemma used in the converse constructs two contrast distributions ν0,ν1 on [−1,1] whose moments agree through degree ℓ, but whose mean absolute contrasts differ.
Let Eℓ denote the smallest uniform error when approximating ∣x∣ on [−1,1] by a polynomial of degree at most ℓ.
∫∣x∣dν1(x)−∫∣x∣dν0(x)=2Eℓ≥50ℓ1.
The integral averages absolute contrast under each distribution.
Matched moments imply agreement on every polynomial expectation through degree ℓ. Absolute value retains a discrepancy that those polynomials cannot resolve.
The construction uses signed weights that cancel low-degree polynomials, then splits their positive and negative parts into probability distributions.
The upper bound approximates the nonsmooth target by polynomials. The converse exploits the error that low-degree polynomials must leave behind.
Sharpness
Jiao et al. (2018) supply the distance lower bound for 1≤n≤k2. For n>k2, use small contrasts around a uniform distribution.
With h=⌊k/2⌋, moment order ℓ proportional to logk, and ξ=hℓ/(200n),
Ri,±=2h1,Si,±(z)=2h1±ξzi,∥R−S(z)∥1=hξi=1∑h∣zi∣.
Here zi∈[−1,1] is a normalized contrast. The target averages absolute contrasts, just as half-capacity value does in the example.
Moment matching cancels low-order terms in the count-likelihood comparison. The remaining tail is small, so the two sample laws are hard to distinguish.
Independent contrasts concentrate the targets; their squared mean separation has order k/[nlog(ek)]. Accurate estimation would distinguish the sample laws, contradicting the testing bound.
informal · Theorem T-4 Under independent sampling and fixed 0<ϵ<1/2, every half-capacity estimator has worst-case risk at least cϵmin{1,d/[nlog(ed)]} for all n≥1,d≥2, even with positive effects, binding capacity, and V1(P)=1/2.
Every symmetric budget interval contains half capacity, so this coordinate supplies the curve lower bound.
Open Questions
- How does risk behave at budgets that shrink with sample size?
- Can we construct adaptive simultaneous confidence bands and control welfare regret of estimated allocations?
- How many Monte Carlo draws suffice to approximate the exact conditional average while preserving its guarantee?
- What changes when covariate cells are learned from data or treatment has multiple arms?
Takeaways
- Under independent sampling, consistency, conditional exchangeability, and fixed overlap, the entire capacity curve has minimax squared largest-error risk of order min{1,d/[nlog(ed)]}, allowing rare cells and exact ties.
- Endpoint-sensitive approximation reduces bias; factorial powers estimate polynomials without plug-in bias. Common positive smoothing controls price-path movement, and the maximal inequality aggregates independent cell paths uniformly.
- Price minima transfer process accuracy to every budget. Half capacity carries the matching difficulty through absolute contrasts, even when full-capacity value is constant.
Appendix: Matched Curve Minimax Frontier
The complete result matches upper and lower risk bounds on every symmetric budget interval.
Fix an overlap parameter ϵ∈(0,1/2). There exist constants 0<cϵ≤Cϵ<∞ such that, for every n≥1, d≥2, and b0∈[0,1/2], the curve minimax risk of Definition P-5 satisfies cϵmin{1,nlog(ed)d}≤Rn,d,ϵ,b0curve≤Cϵmin{1,nlog(ed)d}. For every measurable scalar estimator V1/2 based on the n observed records, there is a full-data law P with the following properties:
- (Causal model.) P∈Md,ϵ, and each occupied cell has pj>0, τj∈[1/8,3/8], and τj>0.
- (Values and binding capacity.) V1(P)=1/2, and there is a policy π∈[0,1]d such that j=1∑dpjπj=21,V1/2(P)=B(P)+j=1∑dpjπjτj.
- (Scalar risk.) Under n independent observations from the observed margin of P, EP[(V1/2−V1/2(P))2]≥cϵmin{1,nlog(ed)d}.
When b0=0, every P∈Md,ϵ also satisfies the full-budget identity V1(P)=B(P)+j=1∑dpjmax{τj,0}, where Vb(P) is the budget value of Definition P-3.
Appendix: Uniform Budget-curve Upper Bound
The specified Jackson–factorial estimator attains the simultaneous curve-risk upper bound.
Fix the overlap parameter ϵ. Suppose:
- (Overlap.) 0<ϵ<1/2.
- (Sample and alphabet.) n≥1 and d≥2.
- (Budget interval.) b0∈[0,1/2], and I=[b0,1−b0].
- (Sampling.) For each causal law P∈Md,ϵ, the n observed records follow Assumption A-1 for the observed margin of P.
There is a constant Cϵ>0, depending only on ϵ, such that the estimator in Definition P-6 and the budget value in Definition P-3 satisfy P∈Md,ϵsupEP[b∈IsupVbJF−Vb(P)2]≤Cϵmin{1,nlog(ed)d}.
Appendix: Capacity-active Risk Lower Bound
Every half-capacity estimator faces the lower bound even with positive effects and fixed full-capacity value.
Fix an overlap parameter 0<ϵ<1/2. There exists cϵ>0 such that, for every n≥1, d≥2, every collection of observed-data laws satisfying Assumption A-1 for each full-data law, and every measurable scalar estimator T based on the n observed records, there is a full-data law P satisfying:
- (Model class.) P∈Md,ϵ.
- (Full-budget value.) V1(P)=1/2, with Vb(P) as in Definition P-3.
- (Effects in occupied cells.) For every cell j, pj>0 implies 1/8≤τj≤3/8.
- (Binding capacity.) The half-budget constraint is binding for P.
For this law, EP[(T−V1/2(P))2]≥cϵmin{1,nlog(ed)d}.
Appendix: Open Questions
- Risk at budgets that shrink with sample size.
- Adaptive simultaneous confidence bands and welfare regret of estimated allocations.
- Computational guarantees for approximating the exact conditional average, including Monte Carlo draw counts and approximation error.
- Covariate alphabets learned from data and allocation across multiple treatment arms.