CausalSmith · seminar slides

Estimating the Value of Optimal Treatment

We establish how accurately we can estimate the outcome from choosing the better treatment in each covariate group, even when some treatments are rarely observed.

Research Question

A practitioner wants the population value of choosing the better treatment separately in each covariate cell.

Ψ(P)=∑x∈[d]pxmax⁡a∈{0,1}μax. \Psi(\mathbb P) =\sum_{x\in[d]}p_x\max_{a\in\{0,1\}}\mu_{ax}.

Here P\mathbb P is the population law, dd is the number of cells, pxp_x is cell xx’s population share, and μax\mu_{ax} is its outcome mean under treatment aa.

  • Plug-in estimation replaces shares and outcome means by sample averages.
  • Rare treatments make those averages unstable.
  • Taking their maximum selects upward noise near treatment ties.

Archive (2026), Theorem 3, establishes the fixed-overlap risk order min⁡{1,d/[nlog⁡(ed)]}\min\{1,d/[n\log(ed)]\}, with constants depending on overlap.

With nn observations and known minimum treatment probability ϵ\epsilon, how does attainable precision deteriorate as ϵ\epsilon shrinks?

Key Idea

Estimate a polynomial approximation to the maximum, rather than taking the maximum of noisy estimates.

  • Pilot counts locate each cell’s probabilities.
  • A polynomial approximates its value across treatment ties.
  • Independent counts estimate polynomial terms without power-estimation bias.
  • Each arm’s denominator sensitivity is paired with that arm’s count fluctuations.

informal · Theorem T-4 With n≥1n\ge1 independent categorical observations, d≥2d\ge2, binary treatment and outcome, and known 0<ϵ≤1/20<\epsilon\le1/2, minimax squared risk is between universal multiples of min⁡{1,d/[nϵlog⁡(ed)]}\min\{1,d/[n\epsilon\log(ed)]\}.

A deterministic estimator attains this scale uniformly over unknown shares, propensities, and treatment ties.

Example

Consider equal-sized cells with treatment means around a tie:

px=1d,πx=ϵ,μ0x=12,μ1x=12+aTxde. p_x=\frac1d, \qquad \pi_x=\epsilon, \qquad \mu_{0x}=\frac12, \qquad \mu_{1x}=\frac12+\mathfrak a T_x^{\mathrm{de}}.

The treatment-one probability πx\pi_x equals the overlap floor. The perturbation TxdeT_x^{\mathrm{de}} lies in [−1,1][-1,1]; amplitude 0<a≤1/20<\mathfrak a\le1/2 keeps outcome means in [0,1][0,1].

Ψde(Tde)=12+a2d∑x∈[d](∣Txde∣+Txde), \Psi_{\mathrm{de}}(\mathbf T^{\mathrm{de}}) =\frac12+\frac{\mathfrak a}{2d} \sum_{x\in[d]}(|T_x^{\mathrm{de}}|+T_x^{\mathrm{de}}),

This computes the family’s value; Tde\mathbf T^{\mathrm{de}} collects its cell perturbations.

Negative perturbations give no gain over control. Positive perturbations give linear gain. At zero, the preferred treatment changes: the value has a corner.

How can we estimate that gain without interpreting noise as improvement?

Model

Observe n≥1n\ge1 independent units Oi=(Xi,Ai,Yi)O_i=(X_i,A_i,Y_i) with common law P\mathbb P.

Covariate XiX_i has d≥2d\ge2 categories; treatment AiA_i and outcome YiY_i are binary.

qay,x:=P(X=x,A=a,Y=y),px:=∑a∈{0,1}∑y∈{0,1}qay,x, q_{ay,x}:=\mathbb P(X=x,A=a,Y=y), \qquad p_x:=\sum_{a\in\{0,1\}}\sum_{y\in\{0,1\}}q_{ay,x},

An atom probability qay,xq_{ay,x} records one cell, treatment, and outcome combination. Summing its four atoms gives the cell share.

The propensity is πx=(q10,x+q11,x)/px\pi_x=(q_{10,x}+q_{11,x})/p_x, and the arm mean is μax=qa1,x/(qa0,x+qa1,x)\mu_{ax}=q_{a1,x}/(q_{a0,x}+q_{a1,x}).

For every occupied cell, require

ϵ≤πx≤1−ϵ. \epsilon\le\pi_x\le1-\epsilon.

The known floor 0<ϵ≤1/20<\epsilon\le1/2 guarantees observations from both arms. Write Dd,ϵobs\mathcal D_{d,\epsilon}^{\mathrm{obs}} for these laws.

Our example places treatment one exactly at the floor.

Causal Interpretation

Let Y(a)Y(a) be the potential outcome under treatment aa, and PP the full-data law.

  • Consistency: Y=Y(A)Y=Y(A); the observed outcome belongs to the treatment received.
  • Conditional exchangeability: Y(a)⊥A∣XY(a)\perp A\mid X; within a recorded cell, treatment carries no further information about either potential outcome.
  • Overlap: both treatments occur in every occupied cell.

V⋆(P)=∑x∈[d]P(X=x)max⁡a∈{0,1}EP[Y(a)∣X=x]=Ψ{Obs⁡(P)}, V^\star(P) = \sum_{x\in[d]} P(X=x) \max_{a\in\{0,1\}} \mathbb E_P[Y(a)\mid X=x] = \Psi\{\operatorname{Obs}(P)\},

The causal optimal value V⋆(P)V^\star(P) averages the causally better treatment’s mean. The observed marginal of (X,A,Y)(X,A,Y) is Obs⁡(P)\operatorname{Obs}(P).

These conditions identify the causal value from the observed target. Every admissible observed law has such a causal completion, so the same risk characterization applies.

Main Result

Minimax risk Rn,d,ϵ\mathfrak R_{n,d,\epsilon} is the smallest worst-case mean squared error over all estimators. Write Ld=log⁡(ed)L_d=\log(ed).

Under independent sampling and the overlap restriction, for every n≥1n\ge1, d≥2d\ge2, and 0<ϵ≤1/20<\epsilon\le1/2,

c⋆min⁡{1,dnϵLd}≤Rn,d,ϵ≤sup⁡P∈Dd,ϵobsEP ⁣[(V^n,d,ϵAF−Ψ(P))2]≤C⋆min⁡{1,dnϵLd}. c_\star\min\left\{1,\frac{d}{n\epsilon L_d}\right\} \le \mathfrak R_{n,d,\epsilon} \le \sup_{\mathbb P\in\mathcal D_{d,\epsilon}^{\mathrm{obs}}} E_{\mathbb P}\!\left[ \bigl(\widehat V_{n,d,\epsilon}^{\mathrm{AF}}-\Psi(\mathbb P)\bigr)^2 \right] \le C_\star\min\left\{1,\frac{d}{n\epsilon L_d}\right\}.

The deterministic estimator V^n,d,ϵAF\widehat V_{n,d,\epsilon}^{\mathrm{AF}} attains the scale. Positive constants c⋆,C⋆c_\star,C_\star are universal.

  • nϵn\epsilon is the expected rare-arm count when its propensity equals the floor throughout the population.
  • Risk has constant order when nϵ≤d/Ldn\epsilon\le d/L_d; above that threshold, its scale is d/(nϵLd)d/(n\epsilon L_d).
  • In our example, the guarantee holds for every perturbation vector, including ties in every cell.

Cell Contribution

Collect the four atom probabilities as qx=(q00,x,q01,x,q10,x,q11,x)q_x=(q_{00,x},q_{01,x},q_{10,x},q_{11,x}).

For a nonnegative vector uu, let sa(u)=ua0+ua1s_a(u)=u_{a0}+u_{a1} be arm mass, s(u)=s0(u)+s1(u)s(u)=s_0(u)+s_1(u) total mass, and Da(u)=max⁡{sa(u),ϵs(u)}D_a(u)=\max\{s_a(u),\epsilon s(u)\} a protected denominator.

Fϵ(u)={max⁡a∈{0,1}s(u)ua1Da(u),u≠0,0,u=0,u∈R+4, F_\epsilon(u) = \begin{cases} \displaystyle \max_{a\in\{0,1\}}\frac{s(u)u_{a1}}{D_a(u)},&u\ne0,\\[6pt] 0,&u=0, \end{cases} \qquad u\in\mathbb R_+^4,

This computes a weighted maximum while protecting nearly empty arm denominators.

At true probabilities, overlap makes protection inactive:

Fϵ(qx)=pxmax⁡a∈{0,1}μax. F_\epsilon(q_x)=p_x\max_{a\in\{0,1\}}\mu_{ax}.

Summing these cell contributions gives Ψ(P)\Psi(\mathbb P). Protection also permits approximation at nearby vectors that need not satisfy overlap.

The sensitivity to changes within arm aa is weighted by 1+px/sa(qx)1+p_x/s_a(q_x): smaller arms have more sensitive ratios.

Pilot Localization

Sample splitting uses pilot observations to choose an approximation region and independent evaluation observations to estimate its polynomial.

In an auxiliary Poisson experiment, all pilot and evaluation atom counts are independent, each with mean mqay,xmq_{ay,x}. Set m=n/8m=n/8 and L=LdL=L_d.

cay,x=Nay,x′m,hay,x=H0{cay,xLm+Lm}, c_{ay,x}=\frac{N'_{ay,x}}m,\qquad h_{ay,x} = H_0\left\{\sqrt{\frac{c_{ay,x}L}{m}}+\frac Lm\right\},

Pilot count Nay,x′N'_{ay,x} gives estimated mass cay,xc_{ay,x} and uncertainty radius hay,xh_{ay,x}. The constant H0H_0 is universal.

  • The square-root term follows that atom’s count fluctuations.
  • The additive term retains uncertainty when the count is zero.

Intersect each interval with the nonnegative line. Their product is rectangle QxQ_x, with lower endpoints ℓay,x\ell_{ay,x}, upper endpoints uay,xu_{ay,x}, midpoint bxb_x, and half-widths rxr_x.

Successful localization means Gx={qx∈Qx}\mathcal G_x=\{q_x\in Q_x\}.

In our example, treatment-one atoms have total mass ϵ/d\epsilon/d: their smaller fluctuations enter their own localization widths.

Polynomial Smoothing

Jiao et al. (2015) supply the strategy of polynomial approximation followed by unbiased polynomial estimation.

Within QxQ_x, express each coordinate using a cosine. Average nearby angles with nonnegative, normalized Jackson weights JKnJ_{K_n}:

Px,Kn(bx+rx⊙cos⁡θ)=∫[−π,π]4Fϵ ⁣(bx+rx⊙cos⁡(θ+τ))∏a,y∈{0,1}JKn(τay) dτ,θ∈R4. P_{x,K_n}(b_x+r_x\odot\cos\theta) = \int_{[-\pi,\pi]^4} F_\epsilon\!\left(b_x+r_x\odot\cos(\theta+\tau)\right) \prod_{a,y\in\{0,1\}}J_{K_n}(\tau_{ay})\,d\tau, \qquad \theta\in\mathbb R^4.

Here θ\theta locates a point, τ\tau shifts its angles, and ⊙\odot means coordinatewise multiplication.

The weights contain only finitely many oscillation frequencies. After averaging, the function is a polynomial Px,KnP_{x,K_n}, with maximum coordinate degree D=2(Kn−1)D=2(K_n-1).

Their average angular displacement is at most C/KnC/K_n; their average squared displacement is at most C/Kn2C/K_n^2.

In our example, restricting this polynomial to the cell’s perturbation path smooths the gain across zero.

How do angular resolution and the pilot rectangle determine approximation error?

Approximation Balance

Let Ra,x=ra0,x+ra1,xR_{a,x}=r_{a0,x}+r_{a1,x} be the total half-width within arm aa. On successful localization in an occupied cell,

∣Px,Kn(qx)−Fϵ(qx)∣≤64∑a=01(1+pxsa(qx)){∑y(qay,x−ℓay,x)(uay,x−qay,x)Kn+Ra,xKn2}. \begin{aligned} |P_{x,K_n}(q_x)-F_\epsilon(q_x)| \le64\sum_{a=0}^1 \left(1+\frac{p_x}{s_a(q_x)}\right) \left\{ \frac{\sum_y\sqrt{(q_{ay,x}-\ell_{ay,x})(u_{ay,x}-q_{ay,x})}}{K_n} +\frac{R_{a,x}}{K_n^2} \right\}. \end{aligned}

This bounds the cell approximation error.

  • Sensitivity: 1+px/sa(qx)1+p_x/s_a(q_x) weights each arm separately.
  • Pilot uncertainty: the square-root product measures distances to the interval’s two ends. It vanishes at an endpoint.
  • Resolution: the first term receives 1/Kn1/K_n; the remaining boundary error receives 1/Kn21/K_n^2.

The square-root product is at most a constant times qay,xL/m\sqrt{q_{ay,x}L/m}. Pairing these fluctuations with their own arm sensitivities costs px/ϵ\sqrt{p_x/\epsilon}.

Choose Kn=max⁡{2,⌊κL⌋}K_n=\max\{2,\lfloor\kappa L\rfloor\}, with small universal κ>0\kappa>0. Then

ηx=pxmϵL+1mϵL, \eta_x= \sqrt{\frac{p_x}{m\epsilon L}}+\frac1{m\epsilon L},

and approximation error is at most CηxC\eta_x. The first term comes from fluctuations; the second comes from boundary error.

Polynomial Estimation

Define D=2(Kn−1)D=2(K_n-1), the maximum degree in each coordinate.

Expand the polynomial around midpoint bxb_x, using half-widths rxr_x to normalize coordinates:

Px,Kn(v)−Fϵ(bx)=∑α∈{0,…,D}4βx,α∏a,y∈{0,1}(vay−bay,xray,x)αay,v∈Qx. P_{x,K_n}(v)-F_\epsilon(b_x) = \sum_{\boldsymbol\alpha\in\{0,\ldots,D\}^4} \beta_{x,\boldsymbol\alpha} \prod_{a,y\in\{0,1\}} \left(\frac{v_{ay}-b_{ay,x}}{r_{ay,x}}\right)^{\alpha_{ay}}, \qquad v\in Q_x.

The four exponents α\boldsymbol\alpha specify a term, and βx,α\beta_{x,\boldsymbol\alpha} is its coefficient.

Replace every centered power by a centered factorial statistic UkU_k:

Zx=Fϵ(bx)+∑α∈{0,…,D}4βx,α∏a,y∈{0,1}Uαay(Nay,x;bay,x)ray,xαay. Z_x = F_\epsilon(b_x) + \sum_{\boldsymbol\alpha\in\{0,\ldots,D\}^4} \beta_{x,\boldsymbol\alpha} \prod_{a,y\in\{0,1\}} \frac{U_{\alpha_{ay}}(N_{ay,x};b_{ay,x})} {r_{ay,x}^{\alpha_{ay}}}.

Here Nay,xN_{ay,x} are independent evaluation counts. The pilot chooses the coefficients and centers.

Conditional on the complete pilot array N′N',

Eaux[Zx∣N′]=Px,Kn(qx), \mathbb E_{\mathrm{aux}}[Z_x\mid N'] =P_{x,K_n}(q_x),

where Eaux\mathbb E_{\mathrm{aux}} averages the auxiliary experiment.

The remaining bias is approximation error. Why does replacing powers by factorials work?

One Cell Through the Estimator

For one cell in our example, the true atoms are

q00,x=q01,x=1−ϵ2d,q10,x=ϵd(12−aTxde),q11,x=ϵd(12+aTxde). q_{00,x}=q_{01,x}=\frac{1-\epsilon}{2d}, \qquad q_{10,x}=\frac{\epsilon}{d}\left(\frac12-\mathfrak a T_x^{\mathrm{de}}\right), \qquad q_{11,x}=\frac{\epsilon}{d}\left(\frac12+\mathfrak a T_x^{\mathrm{de}}\right).

These describe a line through the treatment tie.

Within the pilot rectangle, its true contribution is 1/(2d)+a(∣Txde∣+Txde)/(2d)1/(2d)+\mathfrak a(|T_x^{\mathrm{de}}|+T_x^{\mathrm{de}})/(2d). The restriction of Px,KnP_{x,K_n} approximates this localized gain curve across zero.

For count NN, center ζ\zeta, and degree kk,

Uk(N;ζ)=∑t=0k(kt)(−ζ)k−t(N)tmt, U_k(N;\zeta) = \sum_{t=0}^{k}\binom kt(-\zeta)^{k-t}\frac{(N)_t}{m^t},

where (N)t=N(N−1)⋯(N−t+1)(N)_t=N(N-1)\cdots(N-t+1) counts ordered selections of distinct records.

A squared treated-success factor ((q11,x−b11,x)/r11,x)2((q_{11,x}-b_{11,x})/r_{11,x})^2 is estimated by U2(N11,x;b11,x)/r11,x2U_2(N_{11,x};b_{11,x})/r_{11,x}^2.

Here U2(N;b)=N(N−1)/m2−2bN/m+b2U_2(N;b)=N(N-1)/m^2-2bN/m+b^2. Its expectation is (q−b)2(q-b)^2; using N2N^2 would add count noise.

Applying this replacement to every term estimates the polynomial even at the exact tie, without first selecting a winning arm.

Cell Noise

Higher-degree terms reduce approximation bias but increase estimation noise.

Conditional on a successful pilot,

Eaux[(Zx−Fϵ(bx))2∣N′]≤(∑α∣βx,α∣)2e32D2/Lon Gx. \mathbb E_{\mathrm{aux}} [(Z_x-F_\epsilon(b_x))^2\mid N'] \le \left(\sum_{\boldsymbol\alpha}|\beta_{x,\boldsymbol\alpha}|\right)^2 e^{32D^2/L} \quad\text{on }\mathcal G_x.

The coefficient sum measures how much the polynomial can amplify count noise. The exponential factor bounds the second moments of factorial terms.

Measure cell variation using arm widths and sensitivities:

Ra,x=ra0,x+ra1,x,wa,x=1+s(bx)Da(bx),Sxaw=2∑a=01wa,xRa,x, R_{a,x}=r_{a0,x}+r_{a1,x},\qquad w_{a,x}=1+\frac{s(b_x)}{D_a(b_x)},\qquad S_x^{\mathrm{aw}}=2\sum_{a=0}^{1}w_{a,x}R_{a,x},

Here wa,xw_{a,x} is arm sensitivity at the midpoint, and SxawS_x^{\mathrm{aw}} bounds variation across the rectangle.

Small logarithmic degree bounds the preceding second moment by Cfacd1/16(Sxaw)2C_{\mathrm{fac}}d^{1/16}(S_x^{\mathrm{aw}})^2, with universal CfacC_{\mathrm{fac}}.

Clip ZxZ_x around Fϵ(bx)F_\epsilon(b_x) with radius d1/4Sxawd^{1/4}S_x^{\mathrm{aw}}, obtaining TxT_x. Clipping controls excursions from bad pilots.

Can summing over dd cells absorb the factor d1/16d^{1/16}?

Summed Variance

The squared clipping scale retains the cell’s population mass. Define ax=pxL/(mϵ)+L2/(m2ϵ2)\mathfrak a_x=p_xL/(m\epsilon)+L^2/(m^2\epsilon^2). Then

Eaux(Sxaw)2≤Csax. \mathbb E_{\mathrm{aux}}(S_x^{\mathrm{aw}})^2 \le C_{\mathrm s}\mathfrak a_x.

The constant CsC_{\mathrm s} is universal. Thus the quantity being summed is a bound on expected squared cell variation.

raux=dmϵL,msum=∑xax=Lmϵ+dL2m2ϵ2. \mathfrak r_{\mathrm{aux}}=\frac{d}{m\epsilon L}, \qquad \mathfrak m_{\mathrm{sum}} =\sum_x\mathfrak a_x =\frac L{m\epsilon}+\frac{dL^2}{m^2\epsilon^2}.

Here raux\mathfrak r_{\mathrm{aux}} is the target auxiliary risk scale.

Population mass enters here: ∑xpx=1\sum_xp_x=1 makes the first term independent of dd.

The active regime enters next: nϵ≥d/Ln\epsilon\ge d/L, or d≤8mϵLd\le8m\epsilon L, gives msum≤(L2+8L4)/(mϵL)\mathfrak m_{\mathrm{sum}}\le(L^2+8L^4)/(m\epsilon L).

Consequently, d1/16msum/raux≤d−15/16(L2+8L4)d^{1/16}\mathfrak m_{\mathrm{sum}}/\mathfrak r_{\mathrm{aux}}\le d^{-15/16}(L^2+8L^4), which is uniformly bounded because L=log⁡(ed)L=\log(ed).

d1/16∑xEaux(Sxaw)2≤CsCvarraux. d^{1/16}\sum_x\mathbb E_{\mathrm{aux}}(S_x^{\mathrm{aw}})^2 \le C_{\mathrm s}C_{\mathrm{var}}\mathfrak r_{\mathrm{aux}}.

The universal constant CvarC_{\mathrm{var}} absorbs that bounded ratio. This is the connection from cell noise to aggregate variance.

Aggregate Error

Independent cell statistics make mean squared error equal summed variances plus squared summed bias.

The variance calculation already absorbs polynomial growth. Three bias contributions remain:

  • Approximation: total population mass gives ∑xpx≤d\sum_x\sqrt{p_x}\le\sqrt d.
  • Clipping: cell bias is at most a constant times d−3/16EauxSxawd^{-3/16}\mathbb E_{\mathrm{aux}}S_x^{\mathrm{aw}}; squaring the sum uses the same mass calculation.
  • Failed pilots: their error moments decay rapidly with LL, retaining the cell scales ax\mathfrak a_x.

For the approximation scales,

∑xηx≤raux+raux,∑xηx2≤(∑xηx)2≤18raux. \sum_x\eta_x\le\sqrt{\mathfrak r_{\mathrm{aux}}}+\mathfrak r_{\mathrm{aux}}, \qquad \sum_x\eta_x^2\le\left(\sum_x\eta_x\right)^2 \le18\mathfrak r_{\mathrm{aux}}.

This bounds summed approximation bias and its squared cell contributions; the active regime gives raux≤8\mathfrak r_{\mathrm{aux}}\le8.

Together,

Eaux(∑xTx−Ψ(P))2≤CPdmϵL. \mathbb E_{\mathrm{aux}} \left(\sum_xT_x-\Psi(\mathbb P)\right)^2 \le C_{\mathrm P}\frac{d}{m\epsilon L}.

The universal constant CPC_{\mathrm P} collects the error terms. Since m=n/8m=n/8, this is the required upper-bound scale.

Deterministic Estimator

Turn the auxiliary construction into a statistic using exactly nn observations.

Draw M∼Pois⁡(n/4)\mathsf M\sim\operatorname{Pois}(n/4). When M≤n\mathsf M\le n, use the first M\mathsf M records and fair pilot/evaluation allocations.

V~={Π[0,1](∑x∈[d]Tx),M≤n,0,M>n,V^n,d,ϵAF=E[V~∣O1,…,On]. \widetilde V = \begin{cases} \displaystyle\Pi_{[0,1]}\left(\sum_{x\in[d]}T_x\right), &\mathsf M\le n,\\[4pt] 0,&\mathsf M>n, \end{cases} \qquad \widehat V_{n,d,\epsilon}^{\mathrm{AF}} = E[\widetilde V\mid O_1,\ldots,O_n].

Projection Π[0,1]\Pi_{[0,1]} keeps the estimate in the value range. Conditional averaging integrates the auxiliary count and allocations, producing a deterministic function of the observations.

Projection and averaging cannot increase squared-error risk. The exponentially unlikely overflow contributes at most the required scale.

Under our calibration, use this construction when nϵ≥d/Ln\epsilon\ge d/L. Otherwise return 1/21/2, whose squared error is at most 1/41/4.

Why can no estimator uniformly improve the risk order?

Hard Alternatives Near Ties

Return to the equal-share example. Draw cell perturbations independently from either of two symmetric distributions η0,η1\eta_0,\eta_1 on [−1,1][-1,1].

Choose them to match moments through degree KdeK_{\mathrm{de}}, while their expected absolute perturbations differ by at least 1/(50Kde)1/(50K_{\mathrm{de}}).

Here KdeK_{\mathrm{de}} is the tie family’s matched degree—the degree denoted KabsK_{\mathrm{abs}} in the scalar approximation argument.

Under z=sin⁡2ωz=\sin2\omega, degree-KdeK_{\mathrm{de}} polynomials use only low angular frequencies. A signed angular average cancels these frequencies, while the corner retains higher ones:

∣sin⁡2ω∣=2π−4π∑ℓ=1∞cos⁡(4ℓω)4ℓ2−1. |\sin2\omega| =\frac2\pi-\frac4\pi \sum_{\ell=1}^\infty\frac{\cos(4\ell\omega)}{4\ell^2-1}.

This expands the absolute-value gain. Its nonconstant coefficients share one sign; the surviving block contains KdeK_{\mathrm{de}} terms of size proportional to Kde−2K_{\mathrm{de}}^{-2}.

Approximation–moment duality, as in Wu and Yang (2019), converts this inverse-degree separation into symmetric moment-matched distributions.

Symmetry removes the signed perturbation from average value. Their value centers differ by at least a/(100Kde)\mathfrak a/(100K_{\mathrm{de}}).

Sparse Intensity Family

Tie perturbations have bounded amplitude. A second family allows a wider range of cell intensities zx∈[0,M]z_x\in[0,M], with M≥2M\ge2.

Before normalization, set

q~11,x=ϵ(1−ϵ)zxd,q~10,x=ϵ(1−ϵ)d,q~00,x=q~01,x=(1−ϵ)2+ϵ2zx2d. \widetilde q_{11,x}=\frac{\epsilon(1-\epsilon)z_x}{d}, \qquad \widetilde q_{10,x}=\frac{\epsilon(1-\epsilon)}{d}, \qquad \widetilde q_{00,x}=\widetilde q_{01,x} =\frac{(1-\epsilon)^2+\epsilon^2z_x}{2d}.

These are cell–arm–outcome masses. Divide by their total S(z)=1−ϵ+(ϵ/d)∑xzxS(\mathbf z)=1-\epsilon+(\epsilon/d)\sum_xz_x to obtain law Pzsp\mathbb P_{\mathbf z}^{\mathrm{sp}}.

Control mean is 1/21/2, treatment mean is zx/(1+zx)z_x/(1+z_x), and overlap holds. Treatments tie at intensity one.

Define weighted gain ϕϵ(z)=(1−ϵ+ϵz)max⁡{z−1,0}/(1+z)\phi_\epsilon(z)=(1-\epsilon+\epsilon z)\max\{z-1,0\}/(1+z). Then

Ψ(Pzsp)=12+12dS(z)∑x∈[d]ϕϵ(zx). \Psi(\mathbb P_{\mathbf z}^{\mathrm{sp}}) =\frac12+\frac{1}{2dS(\mathbf z)} \sum_{x\in[d]}\phi_\epsilon(z_x).

This computes baseline plus normalized average gain.

We need two intensity distributions with matching moments, different gains, and common mean one so that the normalizer centers at one.

Moment Cancellation

Map angle to intensity by zM(ω)=M(1+cos⁡ω)/2z_M(\omega)=M(1+\cos\omega)/2. The angles ±ϑM\pm\vartheta_M, where ϑM=arccos⁡(2/M−1)\vartheta_M=\arccos(2/M-1), map to the treatment tie z=1z=1.

Use a nonnegative periodic Jackson weight JN\mathcal J_N, normalized to integrate to one against du/(2π)du/(2\pi).

  • Its frequencies satisfy ∣j∣≤2N−2|j|\le2N-2.
  • Its angular spread is at most a constant times 1/N1/N.
  • Multiplying by cos⁡(4Nu)\cos(4Nu) shifts its frequencies to absolute values between 2N+22N+2 and 6N−26N-2.

Set N=A0KN=A_0K, with sufficiently large universal integer A0A_0, and kN(u)=JN(u)cos⁡(4Nu)k_N(u)=\mathcal J_N(u)\cos(4Nu).

HK,M(ω)=kN(ω−ϑM)+kN(ω+ϑM),WK,M=∫−ππ{1+zM(ω)}∣HK,M(ω)∣ dω2π. H_{K,M}(\omega) =k_N(\omega-\vartheta_M)+k_N(\omega+\vartheta_M), \qquad W_{K,M} =\int_{-\pi}^{\pi} \{1+z_M(\omega)\}|H_{K,M}(\omega)|\,\frac{d\omega}{2\pi}.

The signed weight HK,MH_{K,M} places oscillations at both ties. WK,MW_{K,M} is its absolute mass weighted by 1+z1+z.

A degree-KK polynomial in zM(ω)z_M(\omega) has frequencies at most KK. The shifted weights have none there, so every polynomial moment through KK cancels.

Why does the gain survive this cancellation?

Gain at the Corner

Near a tie angle, the intensity map has slope magnitude M−1\sqrt{M-1}.

Angular width 1/N1/N therefore becomes intensity width proportional to M/K\sqrt M/K. Across that width, the gain changes slope by 1/21/2.

To see why signed oscillations retain this response, let GNG_N be the twice-integrated weight: GN′′=kNG_N''=k_N.

  • At its center, ∣GN(0)∣|G_N(0)| is between universal multiples of 1/N1/N.
  • Its absolute integral is at most C/N2C/N^2.
  • Integration by parts pairs the gain’s slope change with GN(0)G_N(0); smooth curvature is paired with the smaller integral.

The corner contribution has scale M/N\sqrt M/N; the smooth remainder is at most CM/N2CM/N^2. For 2≤M≤K22\le M\le K^2, large A0A_0 makes the corner dominate.

Localization also bounds WK,MW_{K,M} above by a universal constant. Hence

∣∫−ππϕϵ{zM(ω)}HK,M(ω)WK,M dω2π∣≥cpMK. \left| \int_{-\pi}^{\pi} \phi_\epsilon\{z_M(\omega)\} \frac{H_{K,M}(\omega)}{W_{K,M}}\, \frac{d\omega}{2\pi} \right| \ge c_{\mathrm p}\frac{\sqrt M}{K}.

This is the gain contrast retained after normalization; cp>0c_{\mathrm p}>0 is universal.

Mean-one Alternatives

Map the positive and negative parts of HK,M/WK,MH_{K,M}/W_{K,M} into intensity space, obtaining nonnegative measures σ+,σ−\sigma_+,\sigma_-.

Moment cancellation gives them equal mass tt and equal first moment uu.

The definition of WK,MW_{K,M} gives

∫(1+z) d(σ++σ−)=1. \int(1+z)\,d(\sigma_++\sigma_-)=1.

This computes their combined weighted mass. Equal masses and first moments imply 2t+2u=12t+2u=1, hence t+u=1/2t+u=1/2.

Add the same atom at z0=(1−u)/(1−t)z_0=(1-u)/(1-t):

ν0=σ−+(1−t)δz0,ν1=σ++(1−t)δz0. \nu_0=\sigma_-+(1-t)\delta_{z_0}, \qquad \nu_1=\sigma_++(1-t)\delta_{z_0}.

Here δz0\delta_{z_0} is a unit point mass. Both distributions now have total mass one and mean one. The completion point satisfies 1/2≤z0≤2≤M1/2\le z_0\le2\le M.

The common atom changes neither moment differences nor the gain contrast.

informal · Theorem T-6 For integer K≥2K\ge2, 2≤M≤K22\le M\le K^2, and 0≤ϵ≤1/20\le\epsilon\le1/2, two probability laws on [0,M][0,M] can share mean one and moments through KK, yet differ in expected weighted gain by at least cM/Kc\sqrt M/K, with universal c>0c>0.

Full Likelihood Comparison

A gain gap implies statistical difficulty only if the observations cannot reliably distinguish the alternatives.

Fix an inflation factor B>2B>2. In the intensity family, observe all four independent Poisson counts with means Bnq~ay,x(z)Bn\widetilde q_{ay,x}(z), including controls.

Let LzL_z be their likelihood ratio relative to z⋆=M/2z_\star=M/2, and Ez⋆E_{z_\star} reference expectation. Then

Ez⋆[LzLw]=exp⁡ ⁣{α(z−z⋆)(w−z⋆)}, E_{z_\star}[L_zL_w] =\exp\!\left\{\alpha(z-z_\star)(w-z_\star)\right\},

where ww is another intensity and α≤2Bnϵ/(dM)\alpha\le2Bn\epsilon/(dM) measures the full likelihood’s sensitivity.

Matching moments through KspK_{\mathrm{sp}}, the intensity family’s degree, cancels the exponential expansion through that degree. Its remaining terms are small when BnϵM/(2d)Bn\epsilon M/(2d) is at most a small multiple of KspK_{\mathrm{sp}}.

The tie family has the parallel identity

E0[Lde,zLde,w]=exp⁡{4λtra2zw},z,w∈[−1,1]. E_0[L_{\mathrm{de},z}L_{\mathrm{de},w}] =\exp\{4\lambda_{\mathrm{tr}}\mathfrak a^2zw\}, \qquad z,w\in[-1,1].

Here E0E_0 is expectation at the tie and λtr=Bnϵ/d\lambda_{\mathrm{tr}}=Bn\epsilon/d is treated count intensity per cell.

Degrees proportional to LdL_d make both complete count mixtures close after combining all cells. Randomly ordering the Poisson records transfers this difficulty to their first nn observations; large fixed BB controls shortage.

Lower-bound Coverage

Choose logarithmic matched degrees Ksp≍Kde≍LdK_{\mathrm{sp}}\asymp K_{\mathrm{de}}\asymp L_d. Write xsplice=d/(Bnϵ)x_{\mathrm{splice}}=d/(Bn\epsilon).

Choose the tie amplitude and intensity support by

ade2=min⁡{14,ηdedKdeBnϵ}. \mathfrak a_{\mathrm{de}}^2 =\min\left\{\frac14, \frac{\eta_{\mathrm{de}}dK_{\mathrm{de}}}{Bn\epsilon}\right\}.

Msp=min⁡{Ksp2,ηspdKspBnϵ}. M_{\mathrm{sp}} =\min\left\{ K_{\mathrm{sp}}^2, \frac{\eta_{\mathrm{sp}}dK_{\mathrm{sp}}}{Bn\epsilon} \right\}.

The small universal constants ηde,ηsp>0\eta_{\mathrm{de}},\eta_{\mathrm{sp}}>0 keep the likelihood mixtures close.

| Family | Range supplying coverage | Squared value separation: at least a universal multiple of | |---|---|---| | Perturbations around ties | ηspxspliceKsp<2\eta_{\mathrm{sp}}x_{\mathrm{splice}}K_{\mathrm{sp}}<2 | min⁡{1/(4Kde2),ηdexsplice/Kde}\min\{1/(4K_{\mathrm{de}}^2),\eta_{\mathrm{de}}x_{\mathrm{splice}}/K_{\mathrm{de}}\} | | Cell intensities | ηspxspliceKsp≥2\eta_{\mathrm{sp}}x_{\mathrm{splice}}K_{\mathrm{sp}}\ge2, so Msp≥2M_{\mathrm{sp}}\ge2 | min⁡{1,ηspxsplice/Ksp}\min\{1,\eta_{\mathrm{sp}}x_{\mathrm{splice}}/K_{\mathrm{sp}}\} | | Two rare-arm laws | Bounded dd | min⁡{1,1/(nϵ)}\min\{1,1/(n\epsilon)\} |

For sufficiently many cells, independent draws concentrate values around separated centers. Common mean one centers the intensity normalizer at one.

An estimator accurate below these gaps would distinguish close observation mixtures. Degree comparison makes the first two rows cover min⁡{1,d/(nϵLd)}\min\{1,d/(n\epsilon L_d)\}; the last supplies bounded alphabets.

Takeaways

  • Precision: optimal worst-case squared risk has order min⁡{1,d/[nϵlog⁡(ed)]}\min\{1,d/[n\epsilon\log(ed)]\}, uniformly over unknown shares, propensities, and treatment ties.
  • Estimation: local polynomials handle the maximum’s corner; factorial statistics estimate their terms without bias. Summing mass-sensitive cell scales absorbs polynomial noise.
  • Necessity: matching moments hides changes in gains. Localized oscillations cancel polynomial information while retaining the gain’s change in slope.

informal · Theorem T-5 For independent observations of a common law, dn≥2d_n\ge2, and known 0<ϵn≤1/20<\epsilon_n\le1/2, uniform mean-square consistency is possible exactly when dnnϵnlog⁡(edn)⟶0\frac{d_n}{n\epsilon_n\log(e d_n)}\longrightarrow0.

Here dnd_n and ϵn\epsilon_n are cell counts and overlap floors along the sample-size sequence. Under outcome consistency and conditional exchangeability, the same criterion governs causal optimal value.

Appendix: Matched Risk Frontier

The deterministic estimator attains the universal minimax squared-error scale for observed and causally identified values.

Theorem T-4 (Universal matched risk frontier)

There exist universal real constants c⋆,C⋆,H0,κc_\star,C_\star,H_0,\kappa and an integer D0D_0 satisfying 0<c⋆≤C⋆,H0>0,κ>0,D0≥2, 0<c_\star\le C_\star,\qquad H_0>0,\qquad \kappa>0,\qquad D_0\ge2, such that the following bounds hold for every:

  • (Sample size.) Integer n≥1n\ge1.
  • (Alphabet size.) Integer d≥2d\ge2.
  • (Overlap.) Real overlap parameter 0<ϵ≤1/20<\epsilon\le1/2.

Write Ld=log⁡(ed)L_d=\log(ed) for the logarithmic alphabet scale, and let V^n,d,ϵAF\widehat V_{n,d,\epsilon}^{\mathrm{AF}} be the prescribed deterministic armwise estimator with calibration constants H0,κ,D0H_0,\kappa,D_0. The observed minimax squared-error risk, Rn,d,ϵ=inf⁡V^sup⁡P∈Dd,ϵobsEP ⁣[(V^−Ψ(P))2], \mathfrak R_{n,d,\epsilon} = \inf_{\widehat V} \sup_{\mathbb P\in\mathcal D_{d,\epsilon}^{\mathrm{obs}}} E_{\mathbb P}\!\left[ \bigl(\widehat V-\Psi(\mathbb P)\bigr)^2 \right], where the infimum ranges over measurable real-valued estimators based on nn observed units, satisfies c⋆min⁡{1,dnϵLd}≤Rn,d,ϵ≤sup⁡P∈Dd,ϵobsEP ⁣[(V^n,d,ϵAF−Ψ(P))2]≤C⋆min⁡{1,dnϵLd}. c_\star\min\left\{1,\frac{d}{n\epsilon L_d}\right\} \le \mathfrak R_{n,d,\epsilon} \le \sup_{\mathbb P\in\mathcal D_{d,\epsilon}^{\mathrm{obs}}} E_{\mathbb P}\!\left[ \bigl(\widehat V_{n,d,\epsilon}^{\mathrm{AF}}-\Psi(\mathbb P)\bigr)^2 \right] \le C_\star\min\left\{1,\frac{d}{n\epsilon L_d}\right\}. For the causal class, the same estimator and constants satisfy c⋆min⁡{1,dnϵLd}≤inf⁡V^sup⁡P∈Pd,ϵEObs⁡(P) ⁣[(V^−V⋆(P))2]≤sup⁡P∈Pd,ϵEObs⁡(P) ⁣[(V^n,d,ϵAF−V⋆(P))2]≤C⋆min⁡{1,dnϵLd}, \begin{aligned} c_\star\min\left\{1,\frac{d}{n\epsilon L_d}\right\} &\le \inf_{\widehat V} \sup_{P\in\mathcal P_{d,\epsilon}} E_{\operatorname{Obs}(P)}\!\left[ \bigl(\widehat V-V^\star(P)\bigr)^2 \right] \\ &\le \sup_{P\in\mathcal P_{d,\epsilon}} E_{\operatorname{Obs}(P)}\!\left[ \bigl(\widehat V_{n,d,\epsilon}^{\mathrm{AF}}-V^\star(P)\bigr)^2 \right] \\ &\le C_\star\min\left\{1,\frac{d}{n\epsilon L_d}\right\}, \end{aligned} where the infimum again ranges over measurable real-valued estimators based on nn observed units, V⋆(P)V^\star(P) is the causal oracle value, and the expectation is under the observed marginal law Obs⁡(P)\operatorname{Obs}(P).

Appendix: Observable Upper Bound

The prescribed observed-data estimator achieves the uniform squared-error upper bound.

Theorem T-2 (Uniform observable risk bound)

There exist universal constants H0>0H_0>0, κ>0\kappa>0, 0<C⋆<∞0<C_\star<\infty, and an integer D0≥2D_0\ge2 such that, for every choice of:

  • (Sample size.) An integer n≥1n\ge1.
  • (Alphabet size.) An integer d≥2d\ge2.
  • (Overlap.) A public overlap parameter 0<ϵ≤1/20<\epsilon\le1/2.

the estimator V^n,d,ϵAF\widehat V_{n,d,\epsilon}^{\mathrm{AF}} specified in Definition P-7, with these tuning constants, is a measurable, deterministic function of the observed sample. For every family of sampling laws satisfying Assumption A-1 for each P∈Dd,ϵobs\mathbb P\in\mathcal D_{d,\epsilon}^{\mathrm{obs}}, the class of admissible observed laws with public overlap floor ϵ\epsilon, its squared-error risk for the observed value Ψ(P)\Psi(\mathbb P) defined in Definition P-3 satisfies sup⁡P∈Dd,ϵobsEP ⁣[{V^n,d,ϵAF−Ψ(P)}2]≤C⋆min⁡{1,dnϵLd},Ld=log⁡(ed). \sup_{\mathbb P\in\mathcal D_{d,\epsilon}^{\mathrm{obs}}} E_{\mathbb P}\!\left[ \left\{\widehat V_{n,d,\epsilon}^{\mathrm{AF}}-\Psi(\mathbb P)\right\}^{2} \right] \le C_\star\min\left\{1,\frac{d}{n\epsilon L_d}\right\}, \qquad L_d=\log(ed).

Appendix: Minimax Lower Bound

Every estimator faces the same worst-case squared-error order over the observed class.

Theorem T-3 (Universal minimax risk lower bound)

There exists a universal constant c⋆>0c_\star>0 such that, for every sample size n∈Nn\in\mathbb N, alphabet size d∈Nd\in\mathbb N, and overlap parameter ϵ∈R\epsilon\in\mathbb R satisfying

  • (Sample size.) n≥1n\ge1.
  • (Alphabet size.) d≥2d\ge2.
  • (Overlap.) 0<ϵ≤1/20<\epsilon\le1/2.

the minimax squared-error risk Rn,d,ϵ\mathfrak R_{n,d,\epsilon} satisfies Rn,d,ϵ≥c⋆min⁡{1,dnϵLd},Ld=log⁡(ed). \mathfrak R_{n,d,\epsilon} \ge c_\star\min\left\{1,\frac{d}{n\epsilon L_d}\right\}, \qquad L_d=\log(ed).

Appendix: Consistency Threshold

The joint cell-count and overlap criterion exactly characterizes uniform mean-square consistency, with fixed-parameter specializations.

Theorem T-5 (Consistency threshold and fixed-parameter rates)

Let Rn,d,ϵ\mathfrak R_{n,d,\epsilon} be the minimax squared-error risk in Definition P-4. Consider sequences (dn)n∈N(d_n)_{n\in\mathbb N} of alphabet sizes and (ϵn)n∈N(\epsilon_n)_{n\in\mathbb N} of overlap floors satisfying:

  • (Integer alphabet.) dn∈Nd_n\in\mathbb N for every nn.
  • (Alphabet size.) dn≥2d_n\ge2 for every nn.
  • (Positive overlap.) ϵn>0\epsilon_n>0 for every nn.
  • (Overlap range.) ϵn≤1/2\epsilon_n\le1/2 for every nn.

There exists a sequence of measurable real-valued estimators V^n\widehat V_n, each based on nn independent observed units, such that sup⁡P∈Ddn,ϵnobsEP[(V^n−Ψ(P))2]⟶0 \sup_{\mathbb P\in\mathcal D_{d_n,\epsilon_n}^{\mathrm{obs}}} \mathbb E_{\mathbb P} \bigl[(\widehat V_n-\Psi(\mathbb P))^2\bigr] \longrightarrow0 if and only if dnnϵnlog⁡(edn)⟶0(n→∞). \frac{d_n}{n\epsilon_n\log(e d_n)} \longrightarrow0 \qquad (n\to\infty). For each fixed integer d≥2d\ge2, there exist real constants c,Cc,C, depending on dd, with 0<c≤C0<c\le C, such that for every integer n≥1n\ge1 and every overlap floor 0<ϵ≤1/20<\epsilon\le1/2, cmin⁡{1,1nϵ}≤Rn,d,ϵ≤Cmin⁡{1,1nϵ}. c\min\left\{1,\frac{1}{n\epsilon}\right\} \le \mathfrak R_{n,d,\epsilon} \le C\min\left\{1,\frac{1}{n\epsilon}\right\}. For each fixed overlap floor 0<ϵ≤1/20<\epsilon\le1/2, there exist real constants c,Cc,C, depending on ϵ\epsilon, with 0<c≤C0<c\le C, such that for every pair of integers n≥1n\ge1 and d≥2d\ge2, cmin⁡{1,dnlog⁡(ed)}≤Rn,d,ϵ≤Cmin⁡{1,dnlog⁡(ed)}. c\min\left\{1,\frac{d}{n\log(e d)}\right\} \le \mathfrak R_{n,d,\epsilon} \le C\min\left\{1,\frac{d}{n\log(e d)}\right\}.