Treatment Effect Estimation with Auxiliary Records and Diminishing Overlap
The verified overlap-uniform frontier offers a credible theoretical contribution, but the manuscript needs substantial reorganization and several concrete presentation corrections to communicate it effectively.
- Minimax precision with two information budgets; An attaining estimator; appendices The presentation hierarchy obscures the central contribution. A lengthy six-step estimator construction precedes the main risk theorem, the following estimator section repeatedly describes that same construction, and extensive presentations of standard tools occupy substantial space before the distinctive lower-bound argument. Repeated definitions, condition lists, and post-result paraphrases make the paper considerably harder to navigate.
5 findings — 1 major · 3 minor · 1 nit Read the entire review →
- Submitted
- 3 Oct 2026 (v1) · last revised 3 Oct 2026 (v9)
- Cite as
-
CSWP-2026-037· https://causalsmith.org/papers/stat_annotation_rarearm_frontier_v1/
@techreport{causalsmith_stat_annotation_rarearm_frontier_v1,
title = {Treatment effect estimation with auxiliary records and diminishing overlap},
author = {{CausalSmith}},
year = {2026},
month = oct,
institution = {CausalSmith Working Papers},
number = {CSWP-2026-037},
url = {https://causalsmith.org/papers/stat_annotation_rarearm_frontier_v1/},
note = {Version 9, 3 Oct 2026. Machine-generated; formal statements verified in Lean 4 at commit 70df51f}
} https://causalsmith.org/papers/stat_annotation_rarearm_frontier_v1/ Cites version 9 of 3 Oct 2026. Abstract
We characterize minimax squared-error precision for a population-weighted treatment contrast with binary treatment and outcomes and finite discrete covariates. The experiment supplies independent samples from a common population: complete records containing outcomes, treatment, and covariates, and auxiliary treatment–covariate records. Covariates have categories, and treatment propensities in occupied cells lie in , where is a public overlap floor. Over arbitrary covariate probabilities and cellwise outcome means, the minimax risk is with numerical comparison constants independent of all four indices. A deterministic estimator on the original records attains this order with proof-oriented tuning and numerical constants, and a matching lower bound applies to all Borel randomized rules on those records. The comparison yields exact sequence criteria for consistency, for joint consistency and rare-label benchmark attainment, and for a vanishing risk ratio relative to complete records alone. At fixed complete-record size, alphabet size, and overlap floor, increasing auxiliary information converges to the exact-marginal minimax benchmark. Under potential-outcome consistency and conditional treatment exchangeability, the contrast equals the population average treatment effect.
Introduction
This paper establishes a uniform minimax precision frontier for estimating a population-weighted treatment contrast when outcome information and treatment–covariate information arrive through separate sampling channels. The model has binary treatment and outcomes and a finite covariate alphabet. Its unknown population law permits arbitrary covariate probabilities and unrestricted cellwise outcome means, subject to a public treatment-overlap restriction in every occupied covariate cell. The resulting risk characterization describes jointly how the complete-record budget, the auxiliary-record budget, the alphabet size, and a possibly diminishing overlap floor determine attainable precision.
The experiment contains , the number of complete outcome–treatment–covariate records, and , the number of independent auxiliary treatment–covariate records, sampled from the same population. The covariate alphabet has size , and , the public overlap floor, bounds occupied-cell treatment propensities away from zero and one. Thus all records carry information about population treatment–covariate frequencies, while the complete sample also carries outcomes. Conditional overlap accommodates arbitrarily small population covariate cells, making the distinction between these information budgets consequential when many cells are sparsely represented.
For this experiment, Theorem 1 establishes that , the minimax squared-error risk, satisfies The comparison constants are numerical and independent of every public index throughout the stated domain. The target is the population-covariate-weighted difference between the two conditional outcome means, defined in Definition 5. Every observable model law admits a compatible potential-outcome extension satisfying consistency and conditional treatment exchangeability, and the target equals the population average treatment effect under every such extension, by Lemma 1.
The two terms identify distinct sources of statistical difficulty. The inverse scale reflects information about rare-arm outcomes in the complete sample. The many-cell term reflects learning the unknown treatment–covariate distribution using both channels. A common-marginal testing construction in Theorem 2 establishes a capped inverse- risk floor for every auxiliary budget, including the experiment supplied with the exact population marginal. The deterministic construction in Algorithm 1 attains the full frontier through independent observation pools, pilot localization, reciprocal-polynomial correction, clipping, and finite averaging over ordered prefixes. Its proof-oriented tuning establishes the statistical order uniformly over the model and public indices with comparison constants that absorb the zero-output threshold; Section 5 explains the mechanism.
The frontier also gives exact resource characterizations for arbitrary experiment sequences. Writing for rare-arm outcome information, for the total marginal-information budget, and for the regularized logarithmic scale, Theorem 4 shows that consistency is equivalent to Joint consistency and attainment of rare-label benchmark order are equivalent to The same result characterizes a vanishing risk ratio relative to complete records alone, accounting for both supervised saturation and supervised risks that already vanish. These criteria quantify the marginal expansion needed to reach a precision order governed by complete-record outcomes. At fixed , Proposition 1 further establishes convergence of the minimax risk itself to the exact-marginal risk as , with an explicit finite-sample comparison.
The closest supervised analysis is Zeng et al. (2026), and the matching fixed-interior supervised characterization is credited to CausalSmith (2026). The fixed-overlap two-channel frontier is established by CausalSmith (2026). Relative to these comparisons, the present result characterizes the joint dependence on unequal information budgets and a possibly diminishing public overlap floor through constants uniform over all four indices. Reciprocal approximation in off-policy evaluation provides a methodological antecedent (Ma et al., 2022). Semi-supervised treatment-effect inference supplies complementary efficiency results under nuisance-estimation conditions (Chakrabortty et al., 2024), while the allocation results of Nwankwo et al. (2025) address annotation design under their adaptive sampling regime. Here the precision comparison concerns passive independent acquisition from a common population.
The results hold under the stated model and sampling assumptions.
The paper proceeds from related work to the experiment, target, and causal interpretation, followed by the uniform minimax comparison and benchmark recovery. It then explains the attaining estimator and develops the consistency and auxiliary-information resource characterizations before discussing their interpretation and limitations. The appendices present the causal and benchmark arguments, estimator risk bounds, testing and approximation lower bounds, resource derivations and verification note, and proofs of the main results.
Related work
The closest supervised comparison is the unrestricted discrete model of Zeng et al. (2026). For a fixed overlap floor, their conventional estimators have squared-error scale , while their converse has scale in its stated many-cell range, with floor-dependent constants. The public CausalSmith working paper CausalSmith (2026) closes that gap: for each fixed , there are and such that, whenever and , the supervised minimax risk is bounded above and below by floor-dependent multiples of Our comparison in Theorem 1 treats the complete-record budget, auxiliary-record budget, alphabet size, and public overlap floor jointly, with numerical comparison constants independent of all four indices over their stated domains. This uniformity makes the dependence on diminishing overlap part of the risk characterization itself.
The nearest two-channel result is Theorem 4 of CausalSmith working paper CSWP-2026-022 (CausalSmith, 2026). At each fixed overlap floor it gives, with constants allowed to depend on that floor, as the risk order for the complete-plus-auxiliary experiment. The present passive two-channel experiment likewise combines complete records with independent records containing treatment and covariate information, under Assumption 2. Within the overlap class in Definition 4, the two budgets may be unequal: complete records supply outcome information, while both channels supply information about the treatment–covariate distribution. The overlap-uniform comparison in Theorem 1, together with the rare-label benchmark in Theorem 2, gives these information sources separate roles with numerical constants uniform in the possibly diminishing floor. The benchmark specializations are collected in Proposition 1. Their sequence implications in Theorem 4 characterize minimax consistency, attainment of the rare-label benchmark order, and strict relative improvement from auxiliary records as the budgets, alphabet size, and overlap floor vary together.
Reciprocal-polynomial approximation has an important antecedent in Ma et al. (2022). They study off-policy evaluation with supplied target-policy weights and partial knowledge of the behavior policy through a global lower bound on action probabilities. Their Chebyshev construction and approximation-based lower bound provide methodological precedents for estimating weighted outcome functionals with uncertain denominators. The upper-bound result uses a Poisson sampling model and a delocalization condition on the target policy, while the lower bound imposes its stated exploration-probability regime. Here the target uses unknown population covariate weights, and the overlap restriction controls treatment probabilities conditional on an occupied covariate cell. Consequently, small population cells remain admissible under fixed conditional overlap. The estimator in Algorithm 1 adapts reciprocal approximation to these unknown weights and to the distinct outcome and marginal-information budgets.
The passive experiment also belongs alongside semi-supervised treatment-effect inference. Chakrabortty et al. (2024) study labeled and outcome-unlabeled samples and obtain robustness and efficiency results under their nuisance-estimation conditions. Zhang et al. (2023) analyze missing-at-random labeling with decaying labeling probabilities, making the observation mechanism central to the available information. A complementary design question is addressed by Nwankwo et al. (2025): their annotation-allocation result optimizes asymptotic variance, and their feasible procedure uses batch adaptation and cross-fitting. Those conclusions operate under their proportional budget and batch regime, causal identification and missing-at-random conditions, treatment and annotation positivity, and the stipulated moment, nuisance-consistency, marginal and product convergence-rate, function-class, and cross-batch dependence conditions. In our experiment, independent sampling from a common population fixes how records enter each channel. The squared-error comparison therefore characterizes the value of auxiliary records under passive acquisition, with treatment overlap and the two sample sizes specified as public experiment indices.
More broadly, limited-overlap precision and inference motivate attention to the information carried by rare treatment observations (Rothe, 2017; Armstrong et al., 2021; Ma et al., 2020). Discrete functional estimation supplies complementary tools for aggregate targets when many cells have small counts, particularly polynomial approximation and moment matching (Jiao et al., 2015; Wu et al., 2016). These strands meet in the paper’s minimax squared-error question: how treatment overlap and the separate budgets for outcome and treatment–covariate information jointly determine the precision of a population-weighted treatment contrast.
Experiment, target, and causal interpretation
Throughout, logarithms are natural, norms of finite vectors are Euclidean, and numerical comparison constants are independent of the public experiment indices unless stated otherwise. The relations and denote inequalities and two-sided comparisons up to such constants. The public indices are the complete-record sample size , the auxiliary sample size , the covariate alphabet size , and the overlap floor . The covariate index ranges from to , and the treatment index ranges over .
The two information budgets concern different parts of the same population distribution. A complete record contains the covariate coordinate , binary treatment , and binary observed outcome ; its probability law is . We use the covariate probabilities , treatment–covariate probabilities , success-marked probabilities , treatment propensities , outcome regressions , and treatment–covariate marginal .
Explicitly, for and , Thus , while the zero convention makes every outcome regression total and leaves the target unchanged on null arm–cells.
These quantities distinguish conditional treatment overlap from population cell size. The propensity and marginal definitions used throughout are recorded explicitly below.
For a probability law of on , let . Define the treatment propensity in cell by
For every with ,
⊢ LeanWe impose a public restriction on treatment assignment within every occupied covariate cell.
The treatment–covariate marginal is the probability law obtained from , the probability law of complete records , by the projection . Here takes values in a finite alphabet of size , for a nonnegative integer , and . Its cell-probability table is for each covariate value and treatment value .
⊢ LeanThe standard strong conditional overlap condition gives each treatment arm positive conditional probability in every occupied cell (Zeng et al., 2026); propensity adjustment traces to inverse-probability weighting (Horvitz et al., 1952; Hirano et al., 2003). Its public floor may vary across experiments, allowing treatment overlap to diminish along an experiment sequence. Covariate probabilities may be arbitrarily small, so the restriction accommodates populations with many sparsely represented cells. The null-cell convention in Definition 1 supplies a value for the propensity wherever the cell has zero population weight.
Sampling supplies complete records and auxiliary records independently from this population. Write for the ordered complete sample, for the ordered auxiliary sample, and for their observed pair.
An independent seed permits randomized estimation rules on these original records.
The observed data have distribution
⊢ LeanThe sampling restriction can now be stated as a product experiment.
For a measurable space , let denote the class of probability measures on .
Independent complete and outcome-unlabeled samples from the same population are a standard sampling condition in semisupervised treatment-effect estimation (Chakrabortty et al., 2024). Here the auxiliary records directly inform the same treatment–covariate table that governs the complete records. Consequently, records carry marginal information, while records also carry outcomes.
To specify the observable model, let probability laws have the following notation.
The observable law class is This is model (3) of Zeng et al., restricted to the stated range of the public overlap floor .
⊢ LeanThe observable law class combines the finite record space with the public overlap restriction.
The estimand is with summands for null covariate cells defined to equal zero.
⊢ LeanThe correspondence with the discrete model in Zeng et al. (2026) fixes the population class for the two-channel experiment. Within that class, the target averages the conditional outcome contrast using population covariate weights.
Let denote the probability law on assigning each Borel set its Lebesgue measure. The estimator randomization seed has this law and is independent of the observed data , where and are the ordered complete-record and auxiliary samples, respectively.
Because the outcome regressions lie in , the target lies in . This range motivates the following convention for admissible estimation rules .
Clipping weakly reduces squared error for every target value in . The minimax risk therefore evaluates precision over all original-record rules with this bounded range.
The minimax squared-error risk is The infimum ranges over all Borel estimation rules on the original observed records, including rules randomized through the independent seed . Clipping under squared-error loss permits restriction to rules taking values in .
⊢ LeanThe observable target also admits a potential-outcome interpretation. A compatible potential-outcome extension has law and carries a binary potential outcome for each treatment value .
The causal interpretation rests on consistency and conditional treatment exchangeability under such an extension.
Under the potential-outcome extension , holds -almost surely.
⊢ LeanThe standard consistency condition for binary treatment connects the observed outcome to the potential outcome under the received treatment (Spława-Neyman, 1990; Rubin, 1974). It supplies the link between the observed outcome regressions and the corresponding potential outcomes within each treatment arm. Conditional treatment exchangeability then connects those arm-specific observations to the potential-outcome distribution within the covariate cell.
Under the potential-outcome extension ,
⊢ LeanThis standard conditional treatment exchangeability condition requires treatment assignment to be independent of the pair of potential outcomes given the recorded covariate (Rosenbaum et al., 1983; Imbens et al., 2015). Together with consistency and overlap, it identifies the two conditional potential-outcome means from the observable outcome regressions.
Lemma 1 establishes both existence and identification: every law in Definition 4 admits a compatible extension satisfying Assumptions 3 and 4, and every compatible extension satisfying these conditions obeys Thus the observable functional in Definition 5 is the average treatment effect throughout this class of compatible causal extensions. The observable minimax criterion consequently measures precision for that common causal target under the stated interpretation.
For comparison, the exact-marginal benchmark experiment supplies the population treatment–covariate table directly, paralleling the role of known propensity weights in inverse-probability constructions (Horvitz et al., 1952; Hirano et al., 2003). Its estimation rule receives this table jointly with the complete records and the seed.
The corresponding exact-marginal risk evaluates estimation with this population information available.
Define the minimax squared-error risk with the exact treatment–covariate marginal supplied by Here is the complete-record component of , and the infimum ranges over Borel estimation rules receiving , the exact marginal table , and the independent seed .
⊢ LeanSupplying the exact table makes the population covariate weights and treatment propensities available to the rule, while the complete sample supplies outcome information. The main comparisons use the capped rare-label benchmark and the fixed-overlap annotation benchmark ; their formulas and comparison properties are given in Proposition 1.
The first function records the capped inverse scale of complete-record information under the public overlap floor. The second combines an inverse complete-sample term with a many-cell term governed by the total marginal-information budget. These numerical benchmarks provide a common scale for the exact-marginal and fixed-overlap comparisons in Proposition 1.
Minimax precision with two information budgets
The complete records supply outcome information, while both complete and auxiliary records supply treatment–covariate information. The frontier proved in this section is , where is the numerical risk rate defined next, with comparison constants uniform in all four public indices. Its two components have distinct origins: complete records estimate the rare-arm success masses, while all records estimate the treatment–covariate masses needed to convert those successes into population-weighted arm means. Sparse arm masses require a reciprocal correction; its usable polynomial degree is limited by rare-arm outcome information , even when auxiliary records make the marginal sample much larger. We first define the resulting rate, then give the complete attaining rule required by the frozen verification layer, followed by the formal comparison and its benchmark consequences.
Define All denominators are strictly positive on the public index range, and is a positive numerical function.
⊢ LeanFor every , define
The estimator takes the ordered complete and auxiliary records , the independent seed , and the public parameters as inputs.
Set If , output For , proceed through the remaining steps.
Define the pool lengths and tuning parameters by Use the first complete records as the outcome pool. Form the pilot pool by concatenating the treatment–covariate projections of the next complete records with the first auxiliary records. Form the factorial pool by concatenating the remaining complete-record projections with the remaining auxiliary records. Preserve the stated order within each pool.
Define the Chebyshev polynomials and the reciprocal-approximation coefficients by Use the removable extensions at zero in the definitions of and .
For each prefix triple satisfying write the ordered outcome-pool observations as , the pilot-pool observations as , and the factorial-pool observations as . For and , define Define the falling factorials of an integer count by
For each prefix triple, define
Output the deterministic finite average Poisson prefix combinations exceeding a pool length have output zero. The estimator is independent of . Every denominator is a strictly positive public quantity or an integer count plus one, including for empty observed cells; all quantities in the construction are determined by the observed data and public parameters.
The zero-output branch for is a proof device: bounded loss on that branch is absorbed into the universal comparison constant because the numerical rate is at least . Thus the construction certifies the uniform minimax order with proof-oriented constants; the threshold should not be read as calibrated moderate-sample tuning.
The rare-arm outcome scale combines the complete-record sample size with the overlap floor. The total marginal-information budget counts all records carrying treatment and covariate observations, and the regularized logarithm depends on the outcome scale. Thus records the outcome-information component, while records the many-cell component. The cap at one accommodates experiments with bounded information.
The rate separates the precision associated with observing rare-arm outcomes from the precision associated with learning the treatment–covariate distribution across many cells. Increasing the auxiliary sample enlarges , reducing the many-cell term, while the complete-record outcome scale remains . A smaller overlap floor raises both terms and also reduces the logarithmic factor. The following theorem compares this rate with the minimax risk in Definition 7; its upper bound is attained by the deterministic prefix-average estimator specified in Algorithm 1. The causal clause connects the observable target to Lemma 1.
There exist numerical constants , independent of all public indices, such that the following holds for every experiment with:
(Sample sizes.) Integers and .
(Covariate alphabet.) An integer .
(Overlap floor.) A real parameter .
The deterministic estimator constructed in Algorithm 1 is Borel measurable, ignores the randomization seed , and takes values in for every data realization. With the minimax squared-error risk from Definition 7 and the rate from Definition 9, Here is the observable model class in Definition 4, is the observable target in Definition 5, and the expectation uses the experiment specified in Definition 7.
Moreover, for every integer , every , and every observable law , there exists a joint law of the observed coordinates and binary potential outcomes whose observed marginal is and which satisfies Assumptions 3 and 4. Every such law satisfies
⊢ LeanThe outcome-information component has a direct lower benchmark that applies both to the two-channel risk and to the exact-marginal risk in Definition 8. The next theorem establishes it using two laws with a common treatment–covariate marginal, so auxiliary records cannot distinguish them.
There is a numerical constant , independent of all public indices, such that, for every satisfying
(Complete-record sample size.) .
(Covariate alphabet.) .
(Overlap parameter.) .
the minimax risks in Definitions 7 and 8 satisfy The first bound applies to the infimum over all clipped Borel randomized original-record rules specified in Definition 7.
Moreover, for every , overlap parameter , and separation satisfying
(Covariate alphabet.) .
(Overlap parameter.) .
(Separation.) .
the two complete-record laws and specified by belong to of Definition 4. Their targets, defined in Definition 5, and treatment–covariate marginals satisfy At , their one-record Kullback–Leibler divergence is exactly where ranges over complete-record atoms and is the natural logarithm.
⊢ LeanThe target separation is carried entirely by treated outcomes at the public overlap floor. The auxiliary observations and the supplied exact marginal have the same distribution under the two laws, so the floor persists for every auxiliary budget. We next compare the uniform rate with the rare-label benchmark, the fixed-overlap benchmark, and the exact-marginal experiment.
Let , , and be as in Definitions 9, 7, and 8. Define the rare-label and fixed-overlap benchmark functions by The following statements hold.
For every fixed , there exist constants , depending only on , such that for all integers , , and ,
There exist numerical constants such that for all integers , , and , and every ,
For all integers , , and , and every ,
For every fixed integer , integer , and , the limit along integer auxiliary sample sizes satisfies
For every real , there exists , depending only on , such that for all integers , , and , and every satisfying ,
At fixed overlap, the first clause recovers the benchmark combining inverse complete-sample precision with a many-cell term governed by the total sample size and a squared logarithmic factor; only these comparison constants may depend on the chosen floor. With two covariate cells, the risk has rare-label order for every auxiliary budget, and supplying the exact marginal gives that order for every allowed alphabet size. At fixed , the third and fourth clauses additionally give an explicit comparison and convergence of the minimax risk to the exact-marginal risk as . Section 5 explains the construction in Algorithm 1 and compares its guarantee with an inverse-count baseline. The technical many-cell lower-bound construction and its testing comparison are presented through Algorithm 3 and Lemma 11.
An attaining estimator
The estimator corrects a mismatch between the quantities observed with outcomes and the arm means entering the target. In arm and cell , complete records identify the success mass , whereas the target contribution is . Since , this requires estimating a reciprocal arm mass. The pilot pool localizes each arm–cell: populated cells use an inverse count, while sparse cells use a polynomial reciprocal whose monomials are estimated from factorial counts in an independent pool.
The degree calibration is tied to , rather than to , because only the complete records carry the success marks , and the least-favored arm supplies them at the overlap scale . Auxiliary records reduce marginal-count noise but cannot create outcome marks. The choice balances the sparse-cell approximation bias with the coefficient and outcome noise controlled by the complete sample. The formal clipping rule and complete prefix-average estimator appear in Definition 10 and Algorithm 1; this section explains their mechanism and compares their guarantee with a simpler inverse-count baseline.
A simpler comparison isolates the role of the polynomial correction. The inverse-count baseline uses an outcome pool and a single marginal pool, applying the same count-plus-one correction throughout. It retains the clipping and finite-averaging construction, as specified next.
The baseline takes the ordered complete and auxiliary records and the public parameters as inputs.
If , output For , proceed through the remaining steps.
Define the pool lengths and Poisson prefix means by Use the first complete records as the outcome pool. Form the marginal pool by concatenating the treatment–covariate projections of the remaining complete records with all auxiliary records, preserving their order.
Write the outcome-pool observations as and the marginal-pool observations as . For each prefix pair satisfying and for , , define
Output the deterministic finite average The weights are the probabilities of independent Poisson prefix lengths with means and ; prefix pairs exceeding either pool length have output zero.
The denominator regularizes the marginal correction even when an observed arm–cell is empty. Outcome information enters through the success counts, while auxiliary records enlarge the pool estimating the treatment–covariate distribution. The following guarantee quantifies these two contributions uniformly over the observable model.
There exists a universal numerical constant , independent of , such that, for every experiment satisfying
(Sample sizes.) are nonnegative integers with .
(Alphabet size.) is an integer with .
(Overlap parameter.) is real and .
the baseline of Algorithm 2 is measurable and satisfies for every data realization . For every observable law , its squared-error risk satisfies The expectation is over the two-channel data under ; the rule ignores the independent uniform randomization seed.
⊢ LeanThe bound reflects the different roles of the two pools. Rare-arm outcome information determines the term , while the marginal pool controls the many-cell term through the total number of treatment–covariate observations. Increasing the auxiliary budget therefore sharpens the baseline guarantee through the second term. Comparing the two displayed worst-case upper guarantees, the attaining estimator replaces the baseline guarantee’s many-cell term by one smaller by the squared regularized logarithmic factor , up to numerical constants, while preserving the inverse rare-arm information term. This comparison motivates the polynomial correction in sparse arm–cells and provides a transparent uniform benchmark for the three-pool construction.
The supporting moment bounds appear in Lemmas 2 and 3. The polynomial certificate and the localized arm-risk bound are given in Lemmas 5 and 6. Finally, Lemma 4 supplies the transfer argument connecting the Poisson calculations to the finite prefix averages on the original records.
Consistency and the value of auxiliary records
The risk comparison in Theorem 1 answers three resource questions: which budgets support consistency, how much marginal information attains rare-label oracle order, and when auxiliary records yield a vanishing risk ratio relative to complete records alone. These questions allow the sample sizes, alphabet size, and overlap floor to vary jointly. We first specify the domain of experiment sequences.
An experiment sequence is an arbitrary sequence of public experiment indices, indexed by the nonnegative integers: For every , the complete-record size , auxiliary size , and alphabet size are integers satisfying and the public overlap floor is a real number satisfying
⊢ LeanAn experiment sequence permits arbitrary joint variation within these public ranges, including diminishing overlap and an expanding alphabet. The three resource criteria concern vanishing minimax risk, bounded risk relative to the rare-label benchmark, and vanishing risk relative to the supervised experiment. The benchmark retains its cap: The following definition makes these comparisons precise and introduces the sequence-specific information scales.
Define Each set ranges over all allowed sequences of public experiment indices For each such sequence, the rare-arm information scale and total marginal-information sample size are Write for the regularized logarithm evaluated at the -th experiment.
⊢ LeanExplicitly, the regularized logarithm is . Sequences are indexed by as in Definition 11; the display in Definition 12 denotes the same asymptotic tail and discards only the initial coordinate. The consistency phase concerns absolute precision. The oracle phase combines a diverging rare-arm information scale with attainment of the rare-label benchmark up to a constant factor. The improvement phase measures a strict relative gain from auxiliary records. The next result characterizes all three criteria and supplies finite-experiment conditions for saturation and rare-label order.
Let be any sequence of allowed public experiment indices, and put For the phases defined in Definition 12, the following equivalences hold as : If for every , then Whenever , oracle membership also has the equivalent budget characterization
Write for the minimax risk in Definition 7. For every , there exist constants such that, for all sufficiently large , Moreover, there exists such that, for all sufficiently large and every ,
For a single experiment, let and satisfy
(Complete-record budget.) .
(Alphabet size.) .
(Overlap range.) .
Put There exists a universal constant such that, for every such experiment, There also exist universal constants such that, for every such experiment,
⊢ LeanThe theorem separates the two resources directly. Complete records determine , so no auxiliary budget can overcome bounded rare-arm outcome information. Both channels determine , so auxiliary records can reduce the many-cell term once . For a single experiment, the two useful endpoints are with universal comparison constants. The first is marginal-information saturation; the second is the rare-label plateau.
Three illustrative sequences
Let , so every displayed public index is legal and .
Supervised rare-label order. Take Then and . The supervised experiment is already in , and .
Improvement between two consistent risks. Take Without auxiliary records the many-cell term gives while the added marginal budget reduces the risk to . Both risks vanish, but their ratio is of order , so the sequence lies in .
Expansion from saturation to consistency. Take The supervised scale satisfies , so its risk stays of constant order. With auxiliary records, , making ; the two-channel risk is then of order and is consistent.
These examples are illustrations of the order characterizations, rather than finite-budget calibrations. They also show why strict improvement can compare two vanishing risks or move an experiment out of saturation, while the rare-label plateau remains controlled by complete-record outcomes.
Discussion and limitations
The results provide a population benchmark for passive outcome annotation from a common distribution. Under the independent sampling condition in Assumption 2, complete records supply outcomes together with treatment and covariates, while auxiliary records supply treatment and covariates. The minimax comparison in Theorem 1 characterizes the precision of the population contrast in Definition 5 as both budgets, the covariate alphabet, and the public overlap floor vary. Under Assumptions 3 and 4, this contrast is the population average treatment effect.
The marginal-budget plateau gives these information sources a distinct economic interpretation. Additional auxiliary records improve knowledge of treatment–covariate frequencies and reduce the many-cell component of the risk. Once that component is at or below the rare-label benchmark, the minimax risk has order , by Theorems 1 and 2. Thus auxiliary expansion can bring estimation to a precision scale governed by rare-arm outcomes in the complete sample. On the oracle sequences characterized in Theorem 4, this scale is eventually . The plateau concerns risk order: it identifies the information budget governing precision once treatment–covariate information is sufficiently abundant.
The exact-marginal experiment sharpens this interpretation. Supplying the entire treatment–covariate probability table yields rare-label risk order for every allowed alphabet size, as established in Proposition 1. Moreover, for each fixed complete-record sample size , fixed alphabet size , and fixed overlap floor , the minimax risk converges to the exact-marginal risk as the integer auxiliary budget tends to infinity. This fixed-parameter limit describes what increasingly precise frequency information can deliver with a given outcome sample. The common-marginal alternatives in Theorem 2 explain the remaining statistical difficulty: identical treatment–covariate frequencies accompany different rare-arm outcome distributions and different target values.
For annotation planning, these comparisons distinguish investment in population frequency information from investment in outcome information. They provide a benchmark for the precision attainable when acquisition follows the common-distribution experiment. Allocation procedures that choose which records receive outcomes introduce a further design problem. The asymptotic-variance allocation and feasible batch-adaptive procedure of Nwankwo et al. (2025) provide complementary context for that problem under their stated budget, identification, positivity, and regularity conditions.
Limitations and future work
The attaining estimator in Algorithm 1 outputs zero whenever . Its uniform result therefore certifies minimax order with proof-oriented constants rather than providing calibrated finite-budget tuning: the comparison constant absorbs this threshold over all realistic values below it. The resource conditions in Theorem 4 should accordingly be read as order-based planning benchmarks, not as calibrated recommendations for a particular annotation budget. Computationally practical tuning, stable evaluation, and implementation at moderate sample sizes require further analysis. Adaptive allocation would also change the observation mechanism in Assumption 2; extending the benchmark to allocation rules would require accounting for the dependence and selection induced by those rules.
The paper’s loss is squared error for a population treatment contrast. Interval estimation requires additional distributional and coverage guarantees, while policy objectives require specifying the decision class and the welfare criterion. These questions have different statistical requirements from the minimax point-estimation comparison.
Finally, the overlap floor is a public restriction on population propensities in occupied cells. Empirical overlap assessments introduce uncertainty about that restriction, particularly when observed cell counts are small. Extensions to continuous covariates, multiple treatments, or outcomes beyond the binary case would require corresponding model and information-budget characterizations. The binary finite-alphabet experiment provides a reference point for studying these extensions.
Appendices
Causal interpretation and benchmark proofs
The causal interpretation and the benchmark comparisons concern the same observable class in Definition 4, defined by the public overlap restriction. The potential-outcome statement describes compatible extensions of each law in that class. The benchmark comparisons concern the information supplied to estimation rules under the sampling experiment in Assumption 2.
Compatible extensions and identification
The existence statement uses a conditional construction with independent binary treatment and potential outcomes. We first specify the probability law used in that construction.
For , is the probability law on assigning probability to and probability to .
This law expresses binary conditional distributions directly in terms of their success probabilities. In the following construction, the observed propensity and outcome regressions determine those probabilities within each occupied covariate cell.
Let be a natural number, a real number, and a probability law of the complete observation . Suppose:
(Covariate alphabet.) .
(Overlap range.) .
(Model membership.) , as defined in Definition 4.
Then admits a joint probability law of , with binary potential outcomes , whose marginal equals and which satisfies Assumptions 3 and 4. Call precisely these extensions compatible.
One compatible extension is given by and, for every occupied cell , by the conditional law For every compatible extension , the causal contrast equals the target defined in Definition 5:
⊢ LeanThroughout, , and all treatment and outcome indices range over . Recall the cell quantities The propensity convention in Definition 1 is Since these quantities are obtained by summing probabilities, Thus : on an occupied cell this follows from , and on a null cell it follows from the value . Similarly, division by , together with the stipulated value on a null arm, gives
Define the treatment and potential-outcome Bernoulli masses by These definitions apply to every cell and arm, including those with zero mass. By Definition 13, they are nonnegative and satisfy For a binary pair , write Construct through its atom masses: Every entry is nonnegative. Summing the factual-outcome indicator first and then the remaining binary coordinates yields Hence the displayed table defines a probability law; normalization preserves its atom masses.
Summing out both potential outcomes gives Indeed, for the indicator selects and the -sum equals one; for it selects and the -sum equals one.
The propensity weights reconstruct the treatment–covariate masses: For , nonnegativity and give both arm masses zero. For , the two identities are Likewise, If , both observed outcome atoms vanish. If , the identities for success and failure are Combining these calculations proves Equality at every atom proves equality of the observed marginal with , and in particular
The defining indicator gives Consequently, which is Assumption 3.
Summing over the factual outcome, and then using the unit sums of the Bernoulli factors, gives Therefore, for every cell, On an occupied cell, division by proves conditional independence of and . More explicitly, This is the stated product of three Bernoulli laws. Null cells have zero probability, so the calculation establishes Assumption 4. Together with the preceding steps, is a compatible extension.
Now fix any compatible extension . Define its potential-outcome atom masses and its cellwise potential-success masses by These definitions apply to every cell and both arms. Expanding the finite expectation, summing out , and distributing the difference gives We identify the two success masses in each summand.
Since the observed marginal of equals , summing its atom masses gives By Assumption 3, Thus summing the factual-success atoms selects precisely those potential-outcome pairs with , yielding Conditional exchangeability in Assumption 4 supplies the atom identity For , this follows by multiplying the conditional factorization by . For , all the corresponding atom masses are zero, so the same identity holds.
Multiplying this identity by and summing over the potential outcomes proves
Fix and . First suppose . Nonnegativity of the atom masses and give Hence
Next suppose . Model membership in Definition 4 supplies Assumption 1, so Dividing the preceding success identity by the positive arm mass therefore gives The two cases establish this identity for every cell and both arms.
Substituting first the treatment success mass and then the control success mass into the contrast expansion yields where the last equality is Definition 5. Since was arbitrary, this identifies the contrast for every compatible extension.
The product construction supplies an existence witness for every observable law in the stated class. It chooses conditional independence between the two potential outcomes as well as between treatment and the potential-outcome pair. Compatibility itself requires the observed marginal, consistency, and conditional treatment exchangeability; the identifying equality applies to every extension satisfying those requirements. Thus the causal contrast is invariant across compatible choices of the joint potential-outcome distribution.
The public overlap restriction gives both treatment arms positive probability in every occupied covariate cell. Under a compatible extension, consistency and conditional exchangeability identify each conditional potential-outcome mean with its corresponding observed outcome regression. The target in Definition 5 aggregates their contrast using the population covariate weights. Null covariate cells have zero weight under both the observable law and its extensions. These roles keep the observable restriction in Assumption 1 distinct from the identification conditions imposed on the extension in Assumptions 3 and 4.
Two-cell and exact-marginal comparisons
The benchmark functions and are defined in Proposition 1: the former is the capped inverse rare-arm outcome scale, and the latter combines inverse complete-sample precision with a many-cell term at fixed overlap. The numerical rate is defined in Definition 9. These definitions distinguish the numerical comparisons from the minimax risks in Definitions 7 and 8.
For a two-cell covariate alphabet, Proposition 1 gives rare-label order uniformly over the auxiliary budget and the allowed overlap range. The uniform risk comparison in Theorem 1 supplies the connection between the numerical rate and attainable precision. The matching lower bound in Theorem 2 locates the persistent difficulty in the treated outcomes of the complete records.
The exact-marginal comparison has the same rare-label order for every allowed alphabet size. In this experiment, the population covariate weights and treatment propensities are supplied through the marginal table, as specified in Definition 8. The common-marginal alternatives in Theorem 2 retain their target separation when this table is supplied. Together, the two comparisons in Proposition 1 characterize experiments whose minimax precision is governed by complete-record outcome information, with numerical comparison constants uniform over their stated public indices.
At each fixed positive overlap floor, the comparison with in Proposition 1 expresses the rate in the conventional complete-sample and total-sample scales. Its constants may depend on that fixed floor. The two-cell and exact-marginal comparisons retain uniform constants as the floor varies within the stated range.
The fixed-parameter experiment limit
The exact-marginal risk provides the limiting benchmark for increasing auxiliary information. For , , , and , Proposition 1 bounds the nonnegative difference between the two-channel and exact-marginal risks by This comparison concerns the minimax risk itself. At fixed , its dependence on the auxiliary sample size quantifies convergence to the exact-marginal experiment.
The same proposition establishes that bounded rare-arm outcome information gives a uniformly positive risk floor over all auxiliary budgets and allowed alphabet sizes. The experiment limit and this floor therefore describe complementary aspects of auxiliary information: increasing auxiliary records approaches the precision available with the population marginal supplied, while the rare-label benchmark characterizes the outcome information carried by the fixed complete sample.
Estimator risk bounds
The upper risk comparisons combine three ingredients: moment bounds for smoothed inverse counts, polynomial estimation within a localized range of arm-cell probabilities, and finite averaging over ordered prefixes. The auxiliary Poisson experiments separate the relevant counts, while the prefix transfer returns their risk bounds to the original fixed-size experiment.
Poisson counts and inverse-count contributions
We first collect the probability laws, count variables, and arm-level quantities used in the inverse-count calculations.
Adding one to the denominator makes the contribution well defined at an empty arm count. The following moment bounds quantify the resulting smoothing and its dispersion over the full range of Poisson intensities.
Let , let have the Poisson law with mean , and define Then
⊢ LeanFor , write with . For any real sequence, define its forward increment by Then Thus , , and are square-integrable.
We first establish the forward-increment variance inequality for a sequence of finite support. Expanding the square and using gives For , telescoping and Cauchy–Schwarz yield
The Poisson mass recurrence is Consequently, for every , Here and below the sum over is empty when . These identities imply All these identities include . Interchanging the nonnegative path sums now gives The last sum is finite because has finite support.
To extend this inequality, suppose that and are square-integrable. For , define and the errors The value error satisfies For the increment error, the identity implies Thus the shifted sequence is square-integrable. The truncation definition also gives For each fixed , this error is zero once . Dominated convergence therefore yields
Cauchy–Schwarz and expansion of the squares give and Hence both the variance and the expected squared increment of the truncations converge to those of . Passing to the limit in the finite-support inequality proves Applying this to , with the square-integrability established above, gives
We next bound the second moment of . Since , for , For , the pointwise comparison follows from . Applying the Poisson recurrence twice gives The reciprocal-weighted series is summable because its terms lie between zero and . Summing the identity therefore yields It follows that Since for , we obtain Together, the two cases establish this bound for every .
For the squared reciprocal pair, define The calculation shows that Also . Thus, for ,
For , four applications of the Poisson recurrence give The reciprocal-weighted series is again dominated by the Poisson mass series, so summation gives Consequently, Using now yields This bound therefore holds for every .
To evaluate the first moment, first take . The Poisson masses then satisfy and hence For , the recurrence gives Because , this identity can be summed: Dividing by proves the asserted positive-rate formula.
Finally, and , so Multiplying the variance inequality by the positive quantity , and then using the reciprocal-pair bound and , gives Division by proves including .
The expectation identity records the smoothing error, while the second-moment and variance bounds control its contribution to sampling error. Applied to the independent outcome-success and marginal counts in Lemma 3, these controls give an arm-level bound that is uniform over the overlap class.
There exists a universal numerical constant such that the following holds.
(Parameters.) Let be an integer, , , and .
(Population.) Let , as defined in Definition 4. For and , write and define the outcome-success conditional mean by
(Poisson counts.) On a common probability space, let be measurable counts satisfying where denotes the Poisson law with mean . The entire collection of counts is mutually independent.
Define the cell contributions and the covariate-weighted arm mean by Then
⊢ LeanTake , and fix the parameters, law, and counts in the statement. Throughout, suppress the argument in the population quantities. For every cell, Indeed, the arm probabilities partition the covariate-cell probability, and the outcome-success event is contained in the corresponding arm-cell event. Dividing by gives the conditional-mean bounds; when , both and are zero.
Exact expectation. Define the nonnegative Poisson means The Poisson first moments give By Lemma 2, Mutual independence permits factorization of the product expectation: The count factors are integrable, the reciprocal factor is bounded by one, and independence makes their products integrable. Thus finite-sum linearity yields
Bias bound. First suppose . Then , so If , then , and the preceding expectation simplifies to Consequently, in all cells,
For , Assumption 1 gives and : multiply its lower propensity bound and its upper propensity bound by , respectively. For , the same inequalities follow from nonnegativity. Hence, for every , Since every summand in the bias expression is nonnegative, The last sum is at most one, because The elementary exponential bound gives Summing this second bound proves
Weight moments. Use the reciprocal function and numerical constant from Lemma 2, and define the nonnegative real random variables The cited result supplies The usual Poisson moments are Independence of and therefore gives In particular, and are square integrable. Since , by , Expanding variance and factoring the independent expectations yields These calculations also cover and .
Cell variance. The Poisson moments of the outcome-success count give Moreover, is independent of , because is independent of the pair . Their product is square integrable: its second moment factors into the two finite second moments. Thus Define the deterministic cell envelope by Multiplying the weight bounds by the nonnegative coefficients and gives
Variance of the sum. For , the count blocks use disjoint members of the mutually independent collection, so The second assertion follows by applying the measurable function defining each contribution to its block. Pairwise independence and square integrability now give
Deterministic cell envelope. If , then , and forces . Thus and .
Suppose henceforth that . Overlap implies It also gives , whence
The rational factors satisfy Consequently,
Using in the first two bounds yields Similarly, and the last two bounds give Substitution into the cell envelope proves The last inequality adds the nonnegative quantity . Together with the zero-mass case, this establishes the envelope for every cell.
Summation and constant calibration. Summing the cell envelopes and using gives Finally, Since the reciprocal-intensity sum is nonnegative, this proves as required.
The bias bound captures the accumulation of smoothing error across cells. The variance bound separates the outcome-success intensity from the marginal-count intensity, with the overlap floor controlling both contributions. These are the armwise risk inputs for the inverse-count baseline in Algorithm 2; finite averaging supplies the corresponding rule on the observed records.
Transfer to finite ordered pools
The transfer argument applies to any bounded statistic of independent ordered prefixes. Its notation is local: the risk-bound symbol below is distinct from the treatment coordinate.
A finite pool supports every prefix up to its observed length. Averaging over those prefixes, with zero output on overflow, yields the deterministic transfer rule in the next result.
Let be a finite index set. Suppose the following conditions hold.
(Pools.) For each , let be a probability law on an arbitrary measurable observation space, and let be an integer pool length. Observations within pool are iid with law , and the pools are mutually independent.
(Statistic.) Let be a measurable real-valued statistic on families of finite ordered prefixes, including empty prefixes, such that for every prefix family .
(Target and risk.) Let be the target and the risk bound. Let be mutually independent prefix lengths, independent of all observations. For independent infinite iid observation sequences with respective laws , suppose
For finite ordered pools , define the prefix-averaged statistic by This is the conditional average over the prefix lengths with output zero whenever some . It defines a total deterministic measurable rule, takes values in for every finite pool family, and satisfies where the expectation is under the independent finite iid pools. For observation spaces equipped with their Borel sigma-algebras, the rule is Borel measurable.
⊢ LeanFor a length vector , define Here ranges over the finite ordered pool families in the statement. Define, for every such and every , On , the assumed range of gives ; on , this follows from its zero value. Thus Writing for expectation over the independent prefix lengths, we have Every prefix projection in the last sum is measurable, and the sum is finite. Consequently is a total deterministic measurable rule, with For Borel observation spaces, these compositions and their finite sum are Borel measurable.
Write for expectation under the independent finite iid pools and The bounds on and imply so all the following losses are integrable. For each fixed , Jensen’s inequality for the square function gives Integrating over the finite pools yields
Let denote the untruncated random prefix family from the hypothesis. Its conditional law is where the point mass on the empty ordered prefix. For every admissible , independence and iid sampling give the same conditional prefix law for the finite pools: Indeed, projection onto the first coordinates sends to , and the coordinatewise laws multiply across the independent pools. Summing these equalities over the admissible lengths therefore gives In the integral, ranges over prefix families with respective lengths .
Splitting the capped loss between the two events, and using its zero output on overflow, now yields The first inequality discards a nonnegative complementary loss and uses . The last follows by writing the overflow event as and applying the finite union bound.
Fix . The Poisson exponential moment follows directly from its probability masses and the exponential series: Since , exponential Markov gives The elementary numerical lower bound implies As , we obtain Cancelling the strictly positive factor proves
Combining the preceding bounds with the assumed Poisson-prefix risk gives These calculations include : empty products equal , empty sums equal , the pool and prefix families are the unique empty families, and the overflow event is empty.
The transfer preserves the prefix risk bound up to an explicit exponentially small remainder determined by the finite pool lengths. It also provides measurability and boundedness on every observed pool family. For the baseline, Lemmas 3 and 4 supply the count-risk and finite-experiment ingredients of Theorem 3.
A localized polynomial certificate
The attaining construction in Algorithm 1 uses a polynomial correction on the branch selected by a small pilot count. The scalar certificate below collects its approximation and moment controls. We introduce the certificate notation before stating those bounds.
The residual bound controls reciprocal approximation on the unit interval. The same certificate gives unbiased factorial estimation of the polynomial and a second-moment bound for every nonnegative argument.
Let be an integer with . Let be the Chebyshev polynomial specified by and define Define the polynomials and by the identities with their removable values at zero. Then Moreover, where is the coefficient of in .
For real parameters , define and suppose that
(Positive scales.) and .
(Nonnegative argument.) .
(Degree calibration.) .
Let , the Poisson law with mean , and define Then
⊢ LeanThe Chebyshev recurrence gives Indeed, the initial values and the cosine addition formula establish the last identity by induction. Consequently, Applying Lemma 8 with polynomial , degree bound , and uniform bound , we obtain For , the points and both belong to this interval. The derivative bound therefore gives Combining this with the range bound and yields
The numerator has zero constant coefficient. Polynomial division by thus gives the identity For , this implies When , the denominator is positive. Dividing the three numerator bounds by it gives and hence the required minimum bound.
Differentiating the polynomial identity from the preceding step and evaluating at zero gives The endpoint derivative identity is It follows directly by differentiating the Chebyshev recurrence: the initial derivatives are and, using , Induction gives . Since , division by is valid, and therefore Thus also has zero constant coefficient. Its polynomial division by gives For every , the two polynomial identities consequently yield These identities specify the polynomial continuations at zero as well.
Composition with the affine polynomial gives Scalar multiplication preserves this degree bound, and polynomial division by lowers it by one. Applying the same argument to gives The inequalities also hold for a zero polynomial, with the usual degree convention. Therefore the coefficient expansion is
For any real polynomial , use coefficient notation and define its coefficient norm by Both sums have finite support. The coefficient triangle inequality and convolution formula give, for real polynomials and , Multiplication by preserves this norm: For the zero polynomial both sides are zero; otherwise this follows by shifting the coefficients, since
Define the shifted family Its initial coefficient norms and recurrence are Since the norm inequalities imply Starting from and , two-step induction gives because
Applying the norm identities to , we obtain The last inequality uses and . Applying them next to yields Here the first equality uses the degree bound, and follows from .
Fix , , and , and define the Poisson mean The law of is We use and the empty-product value .
For every integer , the terms with have , while for . Shifting the Poisson series therefore gives The exponential series converges, so these factorial moments are finite. This computation includes and .
Since , each summand of the estimator satisfies Integrating the finite sum term by term and using the polynomial expansion gives
To obtain the mixed moments, define the falling-factorial polynomials For an integer , they satisfy
Let . First suppose . The binomial addition identity for falling-factorial polynomials, applied to , gives The product definition supplies Moreover, Multiplying the addition identity by and removing its zero terms thus gives If fails, exchange the two orders; the product and the coefficients are symmetric. Evaluating the resulting identity at any integer yields
Define, for , The product expansion and the finite factorial moments justify termwise expectation. They give All terms are nonnegative, so .
Now suppose . Since , the overlap coefficient satisfies The falling-factorial bound follows by bounding each factor by ; when the order exceeds , the falling factorial is zero. The order-zero case has value .
Also, for every overlap index in the displayed sum, because , , and . These inequalities include under the stated power convention. Hence The second inequality adds nonnegative terms, and the equality is the binomial theorem.
Expanding the square and integrating the finite sum gives Every product is integrable by its finite factorial expansion. For each pair of indices, where the moment bound applies because . Consequently, The coefficient sum is nonnegative, so its bound may be squared. All index ranges remain valid at , when the estimator sum consists of its order-zero term.
The certificate links polynomial approximation to a statistic built from observed counts. Its second-moment bound depends explicitly on both the degree and the argument, making localization part of the risk calculation. The independent pilot count supplies the branch selection, while the inverse-count moment bounds control the contribution on the complementary branch. The following result assembles these ingredients at the calibration used by the attaining estimator.
There exists a numerical constant such that the following holds for every , overlap parameter , observable law , arm , and pool intensities .
(Experiment.) The indices satisfy
(Model.) The law satisfies , as defined in Definition 4.
(Intensities.) The pool intensities satisfy
(Calibration.) Set
(Poisson pools.) On any probability space, let be jointly independent measurable counts with Here is the Poisson law with mean , and the population quantities are
Using the monomial coefficients of the reciprocal-approximation polynomial in the estimator construction, form and Then The same constant applies to every choice of indices, law, arm, intensities, and probability space satisfying these conditions.
⊢ LeanFix parameters and counts satisfying the hypotheses. Write for their probability measure on the given sample space .
Identify the joint count law. Define the count space and the selected count vector by For , define probability measures with coordinates ordered as in .
The selected counts form a subfamily of the stipulated independent family: their indices are distinct, including the two factorial-pool indices because . Thus, for every independence gives Indeed, the event on the left is the intersection of these singleton-coordinate events. Equality on singletons determines measures on the countable space , so
Establish the population inputs. For the fixed law and arm, set The probability definitions imply If , the bound gives ; if , the defining quotient for gives the same identity By Definition 4, the law satisfies Assumption 1. On occupied cells, each arm proportion lies in , hence On a null covariate cell, both arm masses vanish and this inequality also holds. In particular, The corresponding outcome count has mean zero, so both branch contributions vanish almost surely.
The public parameters satisfy Consequently are strictly positive.
On , define the coordinate counts by Define real-valued functions on this entire space by Under , the four coordinate counts in cell have independent Poisson laws with means respectively. We write and for expectation and variance under .
Calibrate the degree and localization scale. Introduce Since , the definition of gives Using and , Therefore Moreover, , and the minimum in its definition yields
Define the light and heavy index sets, their light mass, and their light count by For every light cell, overlap gives Summing this inequality and using total mass one proves These formulas also apply when either index set is empty, with its sum equal to zero.
Bound the inverse-branch variance. Use the reciprocal function and numerical constant supplied by Lemma 2: For each cell define the inverse multiplier Independence, the Poisson first and second moments, and Lemma 2 give where the first inequality uses . The variance of the independent product is Also, Factoring its independent first and second moments therefore gives
For , overlap implies Indeed, , and multiplying by proves the first bound. The elementary inequalities give the four rational bounds For example, the first, third, and fourth left-hand sides equal their respective right-hand sides multiplied by , , and . Hence gives Substitution into the variance identity proves For , both sides vanish by the null-cell identities already established. Summing over all cells gives
Bound the light polynomial variances. Define, for every cell, The hypotheses of Lemma 5 hold because , , , and . For a light cell it supplies Independence of the two factorial counts and then imply The outcome count is independent of this multiplier, so
For , the following bounds retain each mixed monomial: When , the first follows from . The second follows from , since . The next two use and . When , all these inequalities follow from .
Expanding the product and using gives Here uses . Thus Summation yields
Assemble the light mixture variances. Define The factorial unbiasedness in Lemma 5 gives For , independence and the reciprocal expectation from Lemma 2 therefore give The polynomial identity used here is as specified in Algorithm 1. The two branch-mean formulas also hold when , because .
The pilot is independent of both branches. Consequently, Subtracting the square of the first identity from the second gives
For , the residual bound in Lemma 5 yields The last inequality follows from . Using the branch means and , we obtain For , the branch means vanish and the same bound applies.
Overlap and the elementary bound for give Thus Combining this with the polynomial variance bound and proves
Control the heavy mixture variances. For a heavy cell define its pilot mean by The cutoff satisfies . The Poisson lower-tail Bernstein inequality states Since the event is contained in the displayed deviation event with . Hence
For every , Lemma 5 supplies The multiplier calculation used for light cells now gives For , one has . Applying the mixed-monomial calculation with localization scale , while retaining the squared cell mass, gives Also, Factoring the independent outcome second moment therefore proves
The pilot tail absorbs this growth. Indeed, , , , and . Thus Consequently, Since and ,
The inverse branch mean lies in , by its explicit formula. Moreover, . Hence and summing gives Using the mixture variance identity and , we conclude Adding the light and heavy bounds proves
Bound the selected bias. Define the exponential pilot parameter by The Poisson exponential moment and exponential Markov inequality give This calculation applies to every . The ratio condition and for imply The floor inequality , together with , gives It follows that
The branch means yield, for , For , the light residual estimate therefore gives
For heavy cells, the coefficient bound in Lemma 5 implies The defining polynomial identity gives Here each of the two terms in the preceding sum is bounded by . Using and the heavy pilot absorption proves Together with the opposite pilot bound, this gives For , the bias is zero. Applying the triangle inequality cell by cell and summing proves Since , one has , and hence
Form the canonical mean-squared-error envelope. Poisson counts have moments of every order, and the inverse denominators are at least one, so all the branch and hybrid statistics have finite second moments. Under the product measure , distinct cells are independent. Therefore the variance and squared-bias decomposition is Substituting the variance and squared-bias bounds gives
Normalize the retained terms. Define the nonnegative deterministic envelope The intensity bounds, , and imply the first three bounds below; the experiment hypothesis gives the fourth: Using , each term of the preceding mean-squared-error envelope satisfies For the polynomial term, the first reciprocal bound multiplies by , and the other two nonnegative summands are also bounded by times their counterparts in . For the pilot term, the parentheses are at most . Adding the seven inequalities, with , yields
Absorb the deterministic envelope. Define Since , Substituting this bound into the light mass and bandwidth terms gives where the last comparison uses .
The calibration and imply Together with , the preceding bandwidth bounds give Consequently, The nonnegative square gives Also implies . Define the numerical constants All the retained terms are therefore bounded as We have proved the canonical estimate The displayed construction makes a fixed numerical constant.
Transfer the canonical estimate to the given counts. Define the squared-error function on the count space by The definitions of the branches give, for every , The count map is measurable, and every real-valued function on the countable count space is measurable. Using the joint law established at the outset, change of variables therefore gives Finally, . The same numerical thus applies to every admissible choice in the statement.
The arm-risk bound separates the rare-arm outcome scale from the many-cell approximation term. Under the stated logarithmic degree calibration, the polynomial correction improves the dependence of the latter term on total marginal information. Pilot localization and the count-moment controls keep the combined contribution within the displayed squared-error bound, uniformly over the observable laws and balanced pool intensities in the statement.
For the large-information branch of Algorithm 1, Lemma 6 supplies the risk bound for each arm. Their clipped contrast has the same risk order for the target in Definition 5. The prescribed pool allocation satisfies the intensity and balance conditions, and Lemma 4 carries this bound to the deterministic finite prefix average on the original complete and auxiliary records. The exponentially small transfer remainder is absorbed by the inverse rare-arm information term, while the degree is comparable to the regularized logarithm in Definition 9. Together with the bounded-target control for the zero-output branch, these ingredients give the attaining-estimator upper comparison in Theorem 1.
Testing and approximation lower bounds
The lower comparison in Theorem 1 combines rare-label testing with a many-cell construction based on polynomial approximation. The first component isolates the information supplied by complete records about rare-arm outcomes. The second connects a reciprocal approximation gap to priors on complete-record tables, with a common distribution of treatment–covariate marginals. We first fix the testing distances and signed-measure norm used in these arguments.
The probability distance measures separation between observation laws, whereas the signed-measure norm fixes the normalization of an approximation certificate. The next three results supply, respectively, the finite-alphabet Pinsker inequality (Tsybakov, 2009), Markov’s polynomial inequality (Pierzchała, 2016), and the finite alternation representation used in polynomial moment matching (Wu et al., 2016). These are standard tools; the new statistical construction begins with their overlap-scaled specialization below.
Let be probability measures on a finite set. Define their total variation distance and natural-logarithm Kullback–Leibler divergence by Each summand with is defined to be zero. Then, with the inequality interpreted in the extended nonnegative reals,
⊢ LeanLet denote the finite alphabet. If some satisfies and , then which proves the inequality in this case. Henceforth assume
Equip the alphabet with its full power-set sigma-algebra and construct the discrete probability measures In particular, If , nonnegativity forces for every . The support condition then gives Thus .
Define the density and log-likelihood functions on the whole alphabet by The singleton density identity is so is a density of with respect to . At every positive -mass, both masses in the ratio are positive. Consequently, the log-likelihood is integrable on this finite space, and the measure divergence is finite. Writing its real value as evaluation on singletons gives Here, as in the statement, every zero--mass summand is zero.
Define the event-supremum distance and the positive-gap event by Normalization yields Splitting this sum and its absolute-value counterpart over and its complement gives The signs defining the event justify the second line. Finite additivity on the disjoint singletons also gives Every event gap is bounded by the defining supremum; its terms lie in . Therefore
We next bound the absolute density deviation. Define, for , with . The density identity and normalization imply Indeed, the density identity converts the logarithmic term into , and the remaining integral is .
For , differentiation gives The last inequality follows from Hence is increasing. Since its derivative is nonpositive on and nonnegative on . Thus decreases toward zero on and increases from zero on . At the endpoint, . Dividing its nonnegativity by the positive denominator yields
Define the following functions on : All these functions are integrable, together with their squares, on the finite space. The scalar bound gives Moreover, and therefore Cauchy–Schwarz now yields
To relate the event supremum to this integral, define Then The first identity follows from normalization; the second follows by integrating the density and subtracting the integral of . Splitting the zero integral gives On each of and , integration of and implies Adding these inequalities proves Taking the supremum over events and using the preceding bound, we obtain The final equality follows by squaring the two nonnegative quantities.
Combining the finite-alphabet comparison with this bound and the divergence identity gives In the present case, the divergence is finite and nonnegative, so the real inequality carries directly to the extended nonnegative reals, where the square root is the power . Together with the infinite-divergence case, this proves the claim.
Lemma 7 expresses testing separation in terms of the natural-logarithm divergence. For the approximation component, the relevant control instead concerns how rapidly a bounded polynomial can vary over its interval.
Let be a nonnegative integer, a real polynomial of degree at most , and . Suppose that Then
⊢ LeanFor a continuous real function on , define The set in this definition is nonempty and bounded, by compactness and continuity. Consequently, for every , Indeed, each value is bounded by the supremum, and any common upper bound bounds the supremum. We will establish and then apply this equivalence to the hypothesis and conclusion.
If , the polynomial is constant, so Suppose henceforth that . Define the Chebyshev polynomials, viewed over either or , by and define their extrema and root angles by The extrema are distinct and decreasing, and In particular, For , define the cardinal polynomials Lagrange interpolation and differentiation give, for every real , Thus, for , It remains to bound the final sum by .
Fix , and define These definitions include the case . Interpolation gives We first establish its derivative bound at the roots of .
Define The following polynomial identities will be used: For the first identity, both sides have degree , leading coefficient , and vanish at every : the endpoints annul , and the interior extrema annul . The second is the Chebyshev differential identity, obtained by differentiating .
Let satisfy . The explicit roots give Hence , and the nodal identity implies . At this root, the differential identity yields Differentiating at , and using the preceding identity, gives Since the extrema decrease, Also , because and . Therefore Interpolation of gives If , all summands on the right are positive; if , all are negative. In either case, Consequently,
At the fixed point , differentiation of the signed interpolant gives Indeed, a negative weight is multiplied by , and a nonnegative weight by . We next propagate the root bounds from the preceding step to this derivative value.
Define the cardinal polynomials at the roots and a reflected-root polynomial by Empty products equal , so these definitions also apply when . Since we have The derivative has degree at most . Interpolating it at the roots and using the root bounds therefore gives The last equality follows by differentiating the product defining ; all its derivative summands at zero are nonnegative. Moreover, for every ,
We now establish the vertical comparison Define the squared chord function and the list of paired chord squares by where successive pairs are concatenated into a list of length . For an even list of nonnegative entries, define with value for the empty list.
Sorting a list in decreasing order and pairing adjacent entries maximizes . To see this, for , the two exchanges satisfy Thus the two largest entries can be paired together without decreasing the product. Removing that pair and inducting proves the assertion; the other factors are nonnegative.
For the fixed , define Choose nearest to , and put The two lists and have the same multiset of entries: their angles run through the odd multiples of , shifted by the respective angle, and adding an integer multiple of permutes these angles modulo .
Define All the arguments lie in . Since increases on this interval and consecutive root angles differ by , Hence reversing the root blocks and placing before gives a decreasing list. Replacing by merely exchanges the two entries within a block, and reversing blocks preserves their paired product. The sorting inequality therefore implies The elementary chord identity turns this into The products are nonnegative, so Also Thus each factor on the right is bounded by its endpoint counterpart: Multiplying these bounds and then multiplying by proves the required vertical comparison.
Define Its degree and derivative at zero are and its roots are . The preceding steps give On the closed right half-plane, define The denominator has no zero there. This quotient is holomorphic in the open right half-plane, continuous on its closure, and, since , In particular it has the growth bound required by the Phragmén–Lindelöf principle and is bounded along the positive real axis. Its boundary values satisfy The right-half-plane Phragmén–Lindelöf principle therefore gives
Suppose, for a contradiction, that , and define Then For , the equality would imply , contradicting the quotient bound. Thus every root of lies in the open left half-plane.
If is nonconstant, the Gauss–Lucas theorem places every root of its derivative in the convex hull of its roots, hence in the open left half-plane. This contradicts . If is constant, define Then because . The boundary bound implies , again a contradiction. We conclude that
Combining the signed-interpolation identity, root reflection, and derivative comparison yields Returning to the interpolation bound for , we obtain and hence The hypothesis and the supremum characterization in the first step give Since , multiplication and transitivity give Finally, each derivative value is bounded by its supremum, so
The degree-squared derivative bound identifies the interval scale relevant to the reciprocal function below. A complementary duality result represents its approximation error by a signed measure that annihilates all moments through the prescribed degree.
Let , let be continuous, and let be an integer. There exist nodes and real weights such that and where the infimum ranges over real polynomials of degree at most . Equivalently, the finite signed measure has support on at most points and satisfies Here is the unit point mass at , and is the total mass of the variation measure of .
⊢ LeanFor a continuous function , write The restrictions of the polynomials in form a finite-dimensional normed space. Hence the ball is compact, and the continuous function attains its minimum there. Choose a minimizer . Since the zero polynomial belongs to this ball, For every , the triangle inequality gives Thus is a global minimizer. Define the approximation error and residual by In particular, is continuous and
If , define The denominator is positive for every , so these nodes are strictly increasing and belong to . Moreover, the residual bound implies throughout the interval. Consequently, We next obtain the same identity when .
Suppose , and assume for contradiction that there are no strictly increasing interval points at which alternates between its two extreme values. Define These sets are compact; is nonempty because attains its maximum, and and are disjoint.
We construct a polynomial satisfying If , take ; then the product equals on . If and , take , with the same conclusion.
It remains to consider the case in which both sign sets are nonempty. Their compactness and disjointness provide a number such that Set Choose a finite subcover of by open balls of radius centered in , and list the distinct centers in increasing order: Define their signs and the number of adjacent sign changes by If , selecting one center from each of the first successive constant-sign runs gives increasing alternating extrema, contrary to the supposition. Therefore
Define polynomials backwards along the list of centers: Each sign change contributes one linear factor, so To check its sign, descending induction gives and Indeed, the terminal polynomial is the constant . At an equal-sign pair the induction carries over unchanged. At an opposite-sign pair, The new linear factor is negative for and positive within of every later center. These signs, together with , establish the induction.
For any , choose a covering center . Opposite signs at and would imply contradicting . Hence This completes the sign-polynomial construction.
We now turn that strict sign agreement into a uniform improvement. Define This set is compact and contains no point of . Define In the first case the maximum is strictly below , since otherwise a maximizing point would belong to . Thus in either case Define The set is compact and contains . Therefore . Also , because is nonzero at every extremum. Set For , Consequently, For , The perturbed residual is continuous on the compact interval, so these pointwise strict inequalities imply But the polynomial has degree at most , and hence a contradiction.
Thus, when , there exist increasing interval nodes with alternating residual values. Define their orientation by Together with the zero-error construction, we have in both cases
Define the nodal weights, their normalizing sum, and the normalized weights by Distinctness of the nodes makes every factor nonzero, so . Hence There are exactly negative factors in . Therefore
For every real polynomial of degree at most , Lagrange interpolation at these nodes gives The coefficient of on the left is zero, whereas on the right it is . Dividing by yields In particular,
Define the weighted target value by Polynomial cancellation and the alternating residual identity give Since and , this proves
Finally, choose the orientation of the weights by If , the preceding identities directly give If , negating every weight preserves its absolute value and reverses every weighted sum: and Thus both cases establish the required weights, including the case of zero approximation error.
For the signed-measure formulation, define Because the nodes are distinct, for every real-valued function on the interval, Applying the integral identity to and to gives the asserted moments and target value.
The finite support in Lemma 9 makes the certificate suitable for a finite latent distribution. The following specialization retains a fixed reciprocal gap while placing its scale at the interval length divided by the squared degree.
Let the parameters satisfy:
(Degree.) is an integer with .
(Interval.) .
(Overlap.) .
Set There exist strictly increasing nodes and real weights defining the finite signed measure where is the unit point mass at , such that and Here denotes the total mass of the variation measure of .
⊢ LeanDefine the reciprocal target and its slope parameter by The hypotheses give Thus is continuous on .
We first select a polynomial attaining the best uniform approximation error. For a continuous real function on a nonempty compact interval, write Define The space is finite dimensional, being spanned by the restrictions of . Hence is compact and contains zero. The continuous error functional therefore attains its minimum there at the restriction of a polynomial of degree at most . Comparison with zero gives For , minimality gives For , the reverse triangle inequality gives Consequently, defining the best approximation error by we have
Suppose, for contradiction, that Then, for every , The triangle inequality therefore yields Define the comparison point by Since and , Direct evaluation gives The approximation bounds at these two points imply By the mean value theorem, there exists such that and hence
To bound this derivative, define the polynomial pulled back to the unit interval by It has degree at most , and the affine map sends onto . Thus Applying Lemma 8 with bound gives For every , the inverse coordinate belongs to . Substituting it and dividing by yields
In particular, This contradicts the chain Therefore
Apply Lemma 9 to the continuous function on the nondegenerate interval . Indexing its nodes from zero, it supplies with Define Because the nodes are distinct, its total variation and moments satisfy Finally, which establishes the certificate.
The certificate separates two mathematical roles: its vanishing moments support the observation comparison, and its reciprocal integral supplies the target separation. Both properties hold on the same finite support under the degree, interval, and overlap conditions in Lemma 10.
The testing priors use a two-cell construction for the rare-label component and a certificate-based construction for the many-cell component. We first specify the two-cell tables and the variation measure needed to turn signed certificate weights into latent probabilities.
For , , and , define and on by For both tables, set and assign zero probability to every record with . Thus is the positive-sign law and the negative-sign law of Theorem 2. In the rare-label branch of Algorithm 3, use these tables with where denotes the Dirac probability measure at the table .
These tables have the same treatment–covariate marginal , while their treated outcome means carry opposite perturbations. They supply the rare-label comparison in Theorem 2, including the benchmark with the exact marginal table supplied. For the many-cell construction, the variation measure assigns nonnegative mass to the certificate’s atoms and leaves their signs available for the outcome assignment.
For the selected finite signed measure , let denote its total-variation measure. For every measurable set , where the supremum ranges over all finite measurable partitions of . In particular, if with distinct atoms , then
The construction below chooses its branch using the public information scales. In the affine branch, a common latent distribution determines the arm masses, a core branch carries the signed outcome assignment, and a reservoir supplies the remaining raw mass before normalization.
by 8ptby 8pt
The testing priors are measures on complete-record probability tables, defined for public parameters and satisfying
(Complete-record budget.) .
(Alphabet size.) .
(Overlap range.) .
Their construction is as follows.
Put If or , set For , define the two-cell table by Output Otherwise continue with the following steps.
Set
Fix a witness supplied by Lemma 10, represented as with defining properties At each atom of positive variation mass, define the polar sign
Define the raw covariate and arm masses by For each rare cell , independently draw a latent coordinate and a branch flag , with denoting the core branch, according to The filler and core branches remain distinct when the core measure has an atom at zero. For , set Both priors use raw arm masses .
Let have the common latent-coordinate marginal just defined, and put Append a reservoir cell with raw covariate mass , propensity , and both outcome means zero. Set the remaining cells null.
For , define the normalized complete-record table by Output the pushforward priors of the common finite product latent distribution under the respective table maps.
The testing priors in Algorithm 3 are distributions over normalized probability tables. In the affine branch, the reservoir mass complements the expected total rare-cell mass, while is the realized total raw mass. Normalizing by therefore retains the variation in rare-cell masses across latent draws. The core and filler flags specify distinct outcome assignments even when they share a latent coordinate at zero.
The reciprocal certificate supplies the separation ingredient for the covariate-weighted target in Definition 5. Its moment conditions supply the approximation ingredient for comparing observations under the two hypotheses. The next result assembles these roles under the large-information and affine-regime conditions, including the overlap validity of every normalized table.
There exists a numerical constant such that the following holds for every and . Put where is the rare-arm information scale, is the total marginal-information sample size, is the regularized logarithmic scale, and is the normalized many-cell difficulty. Suppose that:
(Public indices.) and .
(Overlap parameter.) .
(Information scale.) .
(Affine regime.) .
For every signed certificate satisfying the certificate conditions at the affine tuning parameters in Algorithm 3, and every latent configuration in that construction, the normalized laws under both hypotheses belong to of Definition 4, and their treatment–covariate marginal tables agree. For each such , the two product priors obtained by pushing the common product latent distribution through the normalized-law construction also induce exactly the same distribution of .
The selected priors and in Algorithm 3 induce exactly the same distribution of , and Here is the minimax squared-error risk in Definition 7, with the infimum over all clipped Borel randomized rules in the original fixed-size two-channel experiment.
⊢ LeanSet and fix public parameters satisfying the hypotheses. Throughout the proof, the quantities have exactly the values in the affine branch of Algorithm 3.
We first establish support and the common marginal for an arbitrary admissible certificate . The tuning formulas give Indeed, and . Also , so The last bound follows by multiplying by . In particular, , and .
Write the certificate and its variation measure as For configurations involving a zero-weight node, extend the polar sign by Thus , including when .
The one-coordinate latent space and its probability law are The branch flag distinguishes the filler state from a core state at the node zero. Since , so these masses are nonnegative and sum to one.
For a coordinate with this law, because . Consequently, where and . Hence, for every latent configuration, These assertions also cover an empty rare-cell set, in which case .
For every , the raw arm masses satisfy Both raw arms are positive. The assigned conditional means belong to , and summing the raw complete-record table over all atoms gives Division by therefore produces probability tables. Their occupied rare cells satisfy the overlap inequalities above; the reservoir has propensity ; and the remaining cells have mass zero. Thus by Definition 4.
Summing out the outcome coordinate gives, under either hypothesis, In particular, Define the common product latent law and its pushforward priors by Pushing the pointwise equality through this common latent law yields
The assumed inequalities select the affine branch of Algorithm 3. The preceding equality applies to its selected certificate, and hence For the risk bound, fix an admissible certificate. Such a certificate exists because , , and : Lemma 10 supplies the strictly ordered nodes, variation mass one, vanishing moments through degree , and reciprocal gap
Define the raw targets, their means, their gap, and the normalized targets by The last identity follows from Definition 5: the control means and the reservoir outcome means are zero. Pointwise,
The difference of the one-cell target means is Here the filler contributes zero, while multiplying the core probability by the polar sign restores the signed weight. The identity and the zero-th moment of give since . Additivity of expectation now gives
We next calibrate this gap in terms of . The tuning formulas imply As , we have and , so . Thus The defining floor inequality then gives Together with , this yields If the alphabet cap determines , this is the required mass bound. If the floor cap determines , the bound applies. Therefore In particular, in the present regime.
Consider the following raw Poisson experiment. Conditional on and hypothesis , the complete-record atom counts and auxiliary atom counts are mutually independent, with respective means We use the Poisson convention with .
In one rare cell, combine the two control-channel counts. The resulting four-count mixture is The first two coordinates count treated complete outcomes equal to one and zero, respectively.
When both complete treated counts are zero, the two mixture probabilities agree. When both are positive, both mixture probabilities vanish. For , define the signed discrepancy Expanding the conditional Poisson probabilities and the core mixture gives Indeed, the filler has treated mean zero under both hypotheses. On the core branch, the difference between the two deterministic outcome assignments is the polar sign, and . These are all the possible nonzero discrepancies.
We bound the sum of these discrepancies by moment cancellation. Define Here denotes the coefficient of . Factoring one treated intensity gives Every coefficient of is nonnegative.
For , the matched moments imply Bounding the exponential remainder on , and using , gives For , the full absolute exponential series gives the same inequality, with every included. Expanding the polynomial therefore yields
To sum over the counts, use . Coefficientwise, the nonnegative count series obey where means that each coefficient on the left is at most the corresponding coefficient on the right. Thus This calculation cancels the common baseline using . The dominating series is finite: Consequently the nonnegative coefficient sums can be interchanged, and the signed discrepancies are absolutely summable. We obtain The last equality uses
For probability measures, use the total variation convention On a countable space this equals one half of the sum of absolute singleton discrepancies. The two disjoint patterns in the preceding calculation therefore give
The tuning gives . For an integer , The middle inequality follows by retaining the -th term of the positive series for . For the last inequality, gives . Since , Moreover, and Here , , , and . Hence
We now restore the full observation channels. Given a combined control count , its complete-channel count has conditional distribution This follows directly from The splitting law is independent of the latent coordinate and hypothesis. Applying it cannot increase total variation. Independence of the latent coordinates makes the rare-cell mixtures a product, whose distance is bounded by the sum of the cell distances; this follows by telescoping the difference of the product mass functions. The reservoir counts form a common independent factor, and the remaining cells have zero counts. Consequently the full two-channel histogram mixtures have distance below .
Uniformly ordering each channel’s histogram is another common probability kernel. Its conditional law is the ordered Poisson experiment from the normalized table. To see this, for a probability mass function on a finite alphabet , put The independent-count probabilities factor as Thus, conditional on the latent table, the ordered channels have the following law: Both channels are independent conditional on the latent table. Their domains are with the empty tuple at length zero.
Append the independent seed , and define where the latent table is mixed according to . Common kernels and a common independent seed preserve the distance bound, so
We next bound the normalized target’s deviation from its raw mean. Since , For either hypothesis, Independence and the inequality consequently give For the last two identities, use and .
The normalization identity is Since , squaring and integrating yields Markov’s inequality at the positive radius , together with , gives The middle estimate uses the tuning identity
To calibrate this tail bound, define the ordinary logarithmic scale The information-scale assumption implies For the second inequality, gives ; the third follows from .
The floor-mass bound already established implies Also and give Thus the two caps defining satisfy and hence
The required exponential comparison follows from The first uses and ; the second follows from . Multiplying gives Since , Finally, so Substituting into the preceding tail bound proves, for both hypotheses,
Let be any Borel rule on the ordered raw channels and seed. Define its two Bayes squared risks by Threshold the rule at and define the test errors The definition of total variation gives On a test error with , the estimation error is at least . The two target-tail bounds therefore imply Consequently, If either Bayes risk is infinite, this conclusion holds directly. The common seed is already part of the experiment, so this argument includes randomized rules.
We transfer this bound to an arbitrary clipped Borel rule in the original experiment. First we control prefix failures. If and , exponential Markov gives using . The event is empty.
Since , the conditional means satisfy For the retention event the complete-channel tail is bounded at , while . Hence, uniformly in the latent configuration and hypothesis, When , the auxiliary failure event is empty.
We calibrate this last quantity against the target gap. Since , . For , Also , so If , the affine-regime inequality gives . If , then . The calibrated mean gap consequently satisfies It follows that
Define the original rule’s risk and its worst-case risk by Clipping and give Thus this supremum is finite, and every constructed table’s risk is at most .
The transferred rule is The brackets denote the first indicated number of ordered records, with the empty prefix when that number is zero. This is a Borel rule.
Conditional on the latent table and the channel totals, the records are independent draws from the normalized laws. Thus, on retention, their prefixes have exactly the original two-channel product law, independently of the seed. In particular, On failure, the output is zero and , so Averaging under either latent prior gives Combining this with the raw testing lower bound yields
For , the two cases and give Therefore every original clipped Borel randomized rule satisfies The constant zero rule belongs to the rule class. Taking the infimum over that class, as specified in Definition 7, proves Together with the support and marginal equalities already established, this proves the assertion with the stated numerical constant .
For a common latent configuration, the two hypotheses have identical normalized marginal tables because their arm masses and normalization agree. Pushing the common latent distribution through the two table maps consequently gives the same distribution of under both priors. Across latent configurations, the marginal table itself can vary. Thus the prior property concerns equality of distributions over marginal tables, together with equality under the specified common-latent coupling.
The risk conclusion in Lemma 11 concerns the joint observation law of complete and auxiliary records in Definition 7. Its observation comparison incorporates the complete-record outcomes and their association with the latent marginal table. The common marginal distribution describes the auxiliary channel’s unconditional law under the priors; the stated lower bound accounts for both channels together. The resulting many-cell scale depends on total marginal information through , while the logarithmic degree calibration depends on rare-arm information through .
Finally, Theorem 2 supplies the capped inverse- lower bound throughout the public parameter range. It controls the branch and, with the fixed numerical threshold absorbed into the comparison constant, the bounded-information branch . In the remaining branch, Lemma 11 supplies the capped lower bound. Together these comparisons give the lower order specified by Definition 9. Combined with the attaining-estimator upper comparison in Theorem 1, they establish the uniform minimax comparison for the original two-channel experiment.
Resource characterizations and verification note
The uniform comparison in Theorem 1 supplies the common basis for the resource conclusions in Theorem 4. For every allowed experiment sequence in Definition 11, the rate definition in Definition 9 gives Here the sequence-specific scales are those introduced in Definition 12. The comparison constants are independent of the public indices. Consequently, the resource characterizations apply to arbitrary allowed sequences, including sequences with oscillating budgets, expanding alphabets, and diminishing overlap.
Consistency and oracle order
The consistency characterization in Theorem 4 assigns a separate requirement to each component of the rate: The first condition concerns the information supplied by rare-arm outcomes in the complete records. The second concerns marginal information relative to the alphabet size. Auxiliary records contribute through the second denominator, while the complete-record budget and overlap floor determine the first scale. These two requirements characterize vanishing minimax risk throughout the sequence domain.
Oracle order compares precision with the rare-label benchmark in Proposition 1. Under , that benchmark eventually equals . The oracle characterization therefore places the many-cell component at or below this inverse-information order: Equivalently, the total marginal-information budget satisfies As stated in Theorem 4, this budget characterization is conditional on divergence of the rare-arm information scale. Its order constant may depend on the sequence, whereas the underlying risk comparison is uniform over public indices.
For the supervised specialization , the identity gives the consistency threshold and the oracle threshold , together with . These specializations identify the marginal-information requirements supplied entirely by complete records.
Strict relative improvement
The improvement phase in Definition 12 compares the auxiliary-record experiment with the supervised experiment at the same complete-record budget, alphabet size, and overlap floor. Applying the uniform risk comparison to both experiments gives Both caps enter this comparison, accommodating supervised risks ranging from vanishing precision to saturation.
The exact characterization in Theorem 4 combines three requirements: The first supports increasing outcome precision. The second places the supervised experiment above rare-label oracle order by a diverging factor. The third measures the marginal expansion relative to the larger of a constant and the supervised many-cell scale. Together they characterize a vanishing relative risk, including for sequences that move between different supervised resource regions. Within the supervised specialization, the relative risk ratio equals one.
Saturation and the precision plateau
The finite-experiment conclusions in Theorem 4 retain the cap in the rate. When the many-cell component reaches the cap, and the minimax risk is bounded above and below by positive universal constants. This saturation condition identifies a region of constant-order risk.
At the larger marginal budget the same result establishes The cap preserves the comparison for small rare-arm information scales. Along every oracle sequence, , so the risk eventually has order .
The plateau conclusion also preserves the quantification over auxiliary budgets. By Theorem 4, on every oracle sequence there is a positive lower comparison constant such that, for all sufficiently large indices and every replacement budget , The rare-label floor in Theorem 2 supplies this bound uniformly over the auxiliary channel. Thus oracle attainment identifies a precision order governed by complete-record outcome information, with further marginal information operating within that order.
Verification note
The mathematical scope includes the canonical randomized minimax risks, the explicit estimator and its risk guarantee, the testing and approximation bounds, the benchmark comparisons, the resource characterizations, and causal realization and identification. The statistical results use the finite observable model in Definition 4, the overlap and product-sampling conditions in Assumptions 1 and 2, and the rule domains in Definitions 7 and 8. Causal identification concerns compatible potential-outcome extensions satisfying Assumptions 3 and 4, as specified in Lemma 1. Auxiliary results retain their displayed independence, calibration, and approximation hypotheses. These conditions are assumed mathematical inputs to the stated implications.
Proofs of the main results
Choose numerical constants and from Theorem 2 and Lemma 11, respectively. For any public indices in the stated range, write Then , , and . By Definition 9, The two cited results supply throughout the public index range, and Both constants are independent of the public indices. We next establish a uniform upper constant for the specified estimator.
First suppose , and use the pool lengths and tuning parameters from Algorithm 1. Since , The integer splits satisfy Indeed, , and splitting the remaining records into two parts gives the last two inequalities. Consequently, where the last inequality uses and . Moreover, Thus For the prescribed intensities this yields These bounds include .
Under Assumption 2, the three disjoint pools are independent. Their observation laws are , , and , respectively: projecting a complete record gives the same treatment–covariate law as an auxiliary record. Extend each pool by an independent iid continuation and introduce independent prefix lengths independent of the observations.
Here is the count calculation for each pool. Let its finite alphabet be , its atom probabilities be , and its prefix intensity be , so that For counts , define Conditioning on the prefix length and using the multinomial count formula gives We use ; an atom of zero probability has count zero almost surely. This factorization, together with independence of the pools, shows that the prefix counts from Algorithm 1 are jointly independent and satisfy Thus Lemma 6 applies with precisely the prescribed .
Define, for , on these ideal prefixes. The cited result supplies a numerical constant such that The binary conditional means and the covariate probabilities satisfy including the zero convention for null cells. Hence Define the clipped ideal-prefix contrast by Clipping toward an interval containing the target decreases squared loss, and The second inequality is pointwise, so it applies with the shared counts used by the two arm statistics.
We calibrate the last bound to the numerical rate and bound the prefix overflow cost. From and the definition of , Also and , which imply All denominators below are positive, so
For every positive pool length , the inequality gives Applying this to the three pool lengths and using the bounds already established, where the last inequality uses . Define the numerical constant Combining the ideal-prefix risk, degree comparison, and overflow bound yields
Apply Lemma 4 to the three positive pool lengths , the clipped prefix statistic, and the target . Its finite average is exactly the estimator in Algorithm 1, since The zero output on overflow agrees with the construction. Independence and the stated pool laws therefore give This proves the uncapped upper bound for every model law when .
Define For fixed public indices, the observed-data space is finite, so the deterministic estimator is Borel measurable. Its definition is independent of . In the averaging branch, every prefix statistic lies in , the displayed prefix probabilities are nonnegative, and Thus, with the remaining probability assigned output zero, The zero branch has the same range. Since , this also gives the universal bound
We now follow the three upper-bound regimes. If , the estimator is zero, and Moreover, so If and , then Finally, if and , the preceding uncapped bound gives Taking the supremum over the model class proves
Choose the final numerical constants by They satisfy and the calibrations needed below are All these constants were chosen independently of the public indices.
The lifted rule is Borel measurable by composition with the data projection and takes values in . It is therefore admissible in Definition 7. Squared-error risks are nonnegative, and the defining minimax infimum yields where the last inequality uses .
For the lower bound, first suppose . Positivity of and gives Using , the constant calibration, and the rare-label bound,
Now suppose . Then , and hence If , the rate satisfies It follows that
If , all hypotheses of Lemma 11 hold, and it supplies To compare this quantity with the rate, split according to whether . In that case, When , Thus in both cases, Together with the preceding branches, this proves the lower bound throughout the public index range.
Finally, fix , , and . Choose the independent conditional extension specified in Lemma 1: is a joint law of , with binary potential outcomes, satisfying The cited result supplies both this extension and, for every extension with the same observed marginal satisfying Assumptions 3 and 4, the identity This establishes the causal realization and identification assertions.
Choice of the two laws. Fix satisfying the hypotheses of the risk bounds, and set Since , we have Write For , define the law on by and Also set Every atom in the first two covariate cells is positive. Summing within each such cell gives Thus the total mass is one. Summing over outcomes and taking the conditional ratios gives The remaining covariate masses are zero. Because the occupied cells satisfy Assumption 1, so Definition 4 gives By Definition 5, Define their common treatment–covariate marginal by The outcome sums above show that When , all statements concerning have an empty index set.
Closeness of the complete-record experiments. Use the natural-logarithm divergence and finite total variation distance of Lemma 7. The two laws have common positive support, namely , so their divergence is finite. For either occupied cell, cancellation of the common control terms gives where the last equality uses . The null cells contribute zero. Hence The ratio is positive, and yields Indeed, . Multiplication by therefore gives
Define the complete-record array laws by They too have common support. For an array in that support, Taking expectations, each coordinate has law , and thus Consequently the product divergence is finite and satisfies Squaring the chosen amplitude gives Applying Lemma 7 to these finite array laws now gives since the squared expression under the final comparison is at most .
Calibration to the benchmark. The square identity gives If , positivity of gives , and therefore If , then , and In both cases,
Adjoining the auxiliary observations and randomization. For probability measures on a general measurable space, use the extension which agrees with the finite formula in Lemma 7.
We first establish the common-factor identity needed here. Let be probability laws on a finite set , and let be a probability law on a measurable space . For any measurable , define its sections by The signed masses sum to zero, so Since , it follows that Conversely, for every subset , and the same identity holds for . Taking suprema in the two directions proves
By Assumption 2, the augmented observation laws for the original-record experiment are First removing the common seed factor and then the common auxiliary factor gives For , the auxiliary array space consists of the empty array and its law is a point mass, so the same argument applies.
Bounded risks and the testing reduction. For any observable law , the conditional outcome means satisfy The numerator lies between zero and the denominator, so Since and , Definition 5 yields Consequently, every clipped rule obeys and hence its risk is at most four under every model law. The same pointwise bound applies to clipped exact-marginal rules. The constant zero rule belongs to both rule classes.
To establish the testing inequality, let where is any measurable space. Define The targets are separated by If , the triangle inequality gives Thus , and the defining event bound for total variation implies Therefore For each sign, the pointwise loss bound on the corresponding error region is The losses are integrable because the rule is bounded. Integrating and taking the maximum yields
The original-record minimax bound. Fix any clipped Borel randomized rule admitted by Definition 7. Apply the testing inequality with Using the two target identities, we obtain Both laws belong to , so The supremum is finite by the bound of four, and the rule class is nonempty. Taking the infimum over all such , as specified in Definition 7, proves
The exact-marginal minimax bound. Define the complete-record laws augmented by the seed by The common-factor identity gives Fix a clipped Borel rule admitted by Definition 8, and freeze its marginal input at the common table: This is a measurable clipped rule on the complete-record arrays and the seed. Applying the testing inequality to this rule gives Because , these are precisely the two risks of at and . Consequently, Again the supremum is bounded by four and the rule class contains the constant zero rule. The squared-error clipping reduction in Definition 7 also applies when the exact marginal is supplied as an input: projecting the rule’s output onto preserves Borel measurability and weakly decreases squared loss, since . Thus the infimum over all Borel exact-marginal rules equals the infimum over clipped Borel exact-marginal rules. Taking the infimum in Definition 8 proves The chosen is independent of all public indices.
The pair at an arbitrary admissible separation. Now fix , , and . Define the asserted pair by and All occupied-cell entries are positive, and their sums are Thus each table is a probability law. Its occupied-cell quantities are Every other covariate mass is zero. Since , Definition 4 gives The two occupied contributions in Definition 5 give Finally, summing over outcomes gives which proves . The null-cell assertions are vacuous when .
Exact divergence at separation . At , the treated success and failure masses in each occupied cell under are and , respectively; under they are exchanged. The control terms have likelihood ratio one, and the null cells have zero contribution. Therefore, for each , using . Summing the two occupied-cell contributions proves
We first establish the quantitative experiment comparison, then prove the remaining assertions in their stated order. Throughout, the public indices satisfy the ranges in the statement. We use the cell quantities Since the conditional means belong to , Definition 5 gives The laws supplied by Theorem 2 make the model class nonempty. Both rule classes contain the zero rule, and every clipped rule has squared loss between zero and four. Thus the suprema and infima used below are finite.
Comparison of experiments. Fix an original-record rule . For every real table and auxiliary array , define and, for every complete-record array and every , define Here clipping is as in Definition 10. The sum is finite, its weights are polynomials in the supplied entries, and clipping makes this a Borel rule with values in on the entire real table space.
At the true table , product sampling gives Consequently the average already lies in , and convexity of squared loss yields Integrating over and the independent seed gives For , the auxiliary-array space contains the single empty array, whose weight is the empty product ; the same argument applies. Taking suprema over and infima over proves The zero rule and nonnegativity of squared loss also give and hence
For the reverse quantitative bound, assume . Define the empirical and adjusted auxiliary tables by Because , the two clipping endpoints are ordered. Thus In an empty empirical cell, all four empirical and adjusted arm entries are zero. The adjustment is a Borel function of the auxiliary array.
Fix any clipped Borel supplied-table rule , and define This is an admissible original-record rule, so For later use, define its supplied-table counterpart’s maximal risk by
We next bound the risk at a fixed supplied table. For real tables define Fix and any table satisfying Define a replacement law by the atoms These atoms are nonnegative and sum to one. Its marginal and cell masses are On every occupied replacement cell, division of the displayed legality inequalities by its cell mass proves the overlap restriction. Thus Moreover, both replacement arm masses are positive in an occupied cell, so In a null replacement cell the cell-weighted means vanish. Originally null arms have inherited mean zero by the stated convention.
The original atoms factor in the same way: For a null original arm, both atoms are zero, which verifies these identities there as well. It follows that For finite probability laws, use where the sum ranges over their common finite atom space. Therefore The replacement target is and the contrast bound gives
The product-distance bound is Indeed, the empty products have distance zero, and the triangle inequality, inserting , gives Here a common independent probability factor preserves total variation: integration over its sections proves the upper inequality, and cylinder events prove the reverse inequality. In particular,
Squared loss is in . After integrating over the common seed, summing the loss against the positive and negative atom-mass differences bounds its change in expectation by four times total variation. Hence For every realization, the rule and both targets lie in , so Integrating this inequality under the replacement law, whose true marginal is , and combining the two bounds proves
It remains to control the expected adjusted-table error. Define The population overlap restriction gives If , the treated entry moves to the lower endpoint and Otherwise, if , it moves to the upper endpoint and In the remaining case the entry is unchanged. The control entry moves by the opposite amount, and the triangle inequality consequently gives Summing over cells proves
Under , expanding the empirical-coordinate square into its diagonal and off-diagonal terms gives Cauchy–Schwarz for the coordinates yields Using the coordinate identity and , we obtain Nonnegative variance then gives and therefore
Product sampling expresses the plug-in risk as the auxiliary average of its fixed-table risk. Applying the fixed-table bound at gives This holds uniformly in . Consequently, for every admissible , Taking the infimum over all supplied-table rules, as in Definition 8, proves Combining this with the earlier difference bounds establishes
Fixed-overlap benchmark. Fix , and define These are positive, with . We first compare the logarithms. Since and , The elementary inequality implies . Hence so Also, Since and , this gives
The upper logarithmic bound and imply Together with , positivity of the denominators yields The chosen constant satisfies where the middle inequality uses . Define the uncapped quantities The preceding bounds give Finally, because , Thus the first assertion holds with and the displayed , which depends only on .
Rare-label benchmarks. Let be the numerical constant supplied by Theorem 2, and let be the numerical constant supplied by Theorem 3. Choose The rare-label bounds give The baseline is an admissible clipped Borel rule by Theorem 3. Taking its worst-case risk and then the minimax infimum gives
Set Since , if , then If , then , and the capped baseline quantity is at most . Thus in both cases
For the supplied-table upper bound, define, for every real table and every observation , Every quotient with zero denominator in this construction is assigned zero. Define the total rule The totalized quotients are Borel functions, and clipping makes the rule admissible on every ambient table.
At the true table, finite summation gives For each arm, the second-moment contribution obeys Indeed, when , the left side is zero. Otherwise, and overlap gives , so Summing both arms and all cells therefore yields
Define the un-clipped sample mean by Independence of the complete records gives Clipping satisfies For , moving it to decreases its distance to the target; for , moving it to does the same; and on clipping is the identity. Consequently, when , the supplied-table rule has risk at most . When , its zero branch has risk Taking suprema and the supplied-table rule infimum proves The chosen are positive numerical constants common to both benchmark comparisons.
Limit along auxiliary sample sizes. Fix in the stated range. Along integer , where the last implication uses continuity of the square root at zero. For every , the comparison already established gives The squeeze theorem therefore yields Adding the fixed value proves the asserted limit.
Bounded rare-label scale. Fix , and use the numerical constant from Theorem 2. Define If , then and Taking the minimum of the two right sides gives The rare-label risk floor now implies This constant depends only on , as required.
For admissible and , define The conditional outcome means belong to , while the covariate masses are nonnegative and sum to one. Thus Definition 5 gives We first establish an uncapped risk bound for .
Set, as in Algorithm 2, Both pool lengths and both prefix means are positive. By Assumption 2, the outcome pool and the marginal pool are independent, with respective laws Indeed, the marginal pool uses projections of complete records disjoint from the outcome pool, followed by the independent auxiliary records.
Extend these pools by independent iid continuations, and write Independently of these sequences, take independent prefix lengths where is the Poisson probability law with mean . Define the complete-atom and marginal-atom counts by for and ; empty sums equal zero.
For a nonnegative integer array , put Conditioning on the outcome-prefix length gives its Poisson probability multiplied by the multinomial probability: Here . The same calculation for a nonnegative integer array gives Consequently, the atom counts within each pool are independent Poisson variables, and independence of the pools gives independence across the two collections.
In particular, define Then For each fixed arm , the collection is mutually independent. These conclusions include zero-mass cells, whose counts equal zero almost surely.
Define the arm totals, their population targets, and the clipped Poisson-prefix contrast by The count laws and independence just established discharge the hypotheses of Lemma 3. Let be its universal variance constant. For each , it supplies The finite arm sums are square-integrable, using Poisson moments and the positive denominators. Expanding squared loss around the mean therefore yields By Definition 5, Projection onto decreases squared distance to . Moreover, where the second inequality follows by expanding the square and using the nonnegativity of Set Taking expectations gives
Define the Poisson risk allowance and the exponential overflow allowance by Both are nonnegative. The clipped prefix statistic is measurable and takes values in , including on empty prefixes. The target also belongs to this interval. Thus the two positive, independent iid pools satisfy the hypotheses of Lemma 4.
More explicitly, writing for the first records of a sequence, define Expanding this conditional expectation over the independent Poisson lengths gives exactly the finite average in Algorithm 2, with zero output on overflow. Hence, after forming the pools from the original records, Integration over the independent seed leaves this risk unchanged.
The transfer bound in Lemma 4, with its nonnegative overflow allowance enlarged by a factor of four, now gives
The integer pool sizes satisfy because and . Consequently, and therefore Also, and , so
For the overflow allowance, both pool sizes are at least , giving The elementary bound , obtained by maximizing , together with , yields Since , this proves Combining these estimates gives
Define Using , the preceding bounds imply, for every , The constants used here are universal.
Choose the final constant For all admissible sample sizes, the rule in Algorithm 2 is measurable: the small-sample branch is constant, and the remaining branch is a finite sum of measurable count functions with positive denominators.
To check its range directly, for define These weights are nonnegative and satisfy Every clipped prefix value belongs to . Thus For , the rule equals zero, so the same range conclusion holds.
Suppose . The zero rule has risk Moreover, It follows that using and the nonnegativity of the capped rate.
Finally, suppose . If , the estimator and target both belong to , so for every realization. Hence If , the uncapped bound established above gives These cases cover every admissible experiment and every , with the same positive universal constant .
Uniform risk comparison. By Theorem 1, there are numerical constants such that, throughout the allowed public index range, where is defined in Definition 9.
Fix an allowed sequence , and write The public restrictions give , , and . Consequently, The same comparison and positivity apply at every auxiliary budget, including zero.
Consistency. The comparison gives so if and only if . If , then eventually , and hence Both summands are nonnegative, so Taking reciprocals in the first limit and nonnegative square roots in the second yields and . Conversely, these two limits imply Since , Together with Definition 12, this proves the consistency characterization.
Oracle membership. Suppose . Then eventually , and By Definition 12, the remaining oracle condition is eventual boundedness above of .
First suppose that, for some real constant , eventually. Define The lower comparison then gives, eventually, Eventually , so and its cap is inactive. Thus All factors are nonnegative, and therefore eventually. This is the required big- condition.
Conversely, that big- condition supplies a constant such that eventually Multiplication by the positive factor gives Consequently, eventually. This proves the oracle equivalence.
Necessary conditions for improvement. Define the supervised risk, supervised rate, and rate ratio by Their denominators are positive. Applying the uniform comparison at both auxiliary budgets gives Indeed, the left inequality follows by dividing by ; the right inequality follows from the opposite two bounds. Squeezing therefore yields
Assume . Since , The consistency calculation gives .
Introduce, for every , The identity gives
Eventually and . For such , Hence the cap in is inactive: In particular, It follows that Using , we obtain the first inverse-square bound:
For the second bound, the cap satisfies, for every , The lower bound follows by increasing the second argument of the minimum. For the upper bound, if , then if , then
For the eventual indices under consideration, and , so Thus The exact budget identity is If , the first two expressions both equal ; if , they both equal . Therefore,
Both inverse squares tend to zero. Taking positive square roots and then reciprocals gives Finally, which proves all three necessary limits.
Sufficient conditions for improvement. Suppose the three limits in the claimed improvement characterization hold. In the notation just defined, they are For every , positivity and give The first quotient satisfies Combining this with the budget identity yields The risk-ratio comparison then proves .
The supervised slice. If for every , then where the final equality uses and . Substitution into the consistency and oracle characterizations gives the two stated supervised conditions.
Moreover, , so Its limit is , and hence .
The equivalent oracle budget. For every and every constant , multiplication or division by the positive quantities and gives Thus the two eventual inequalities use the same comparison constant, and Under , the oracle characterization proves the asserted budget equivalence.
Risk order and the uniform auxiliary-budget floor. For any allowed experiment, increasing the second argument of the minimum gives Hence, for every and every ,
Now let . Choose a real constant giving an eventual upper bound for , and define Since , eventually . On that same tail, The lower comparison also gives, on a tail independent of , This proves both oracle risk assertions with a positive lower constant independent of the auxiliary budget.
Single-experiment saturation. Fix an experiment satisfying the stated public restrictions, and use All three denominator factors are positive. If , then The uniform comparison therefore yields
For the upper bound, the laws in Theorem 2 ensure that the model class is nonempty. For each law in that class, the binary outcome conditional means lie in . The target formula in Definition 5 thus gives Define the constant original-record rule by for every data realization and seed. This rule is Borel measurable and takes values in . Its squared error is the constant , so Definition 7 gives This proves the saturation bounds with the universal constant .
Single-experiment oracle plateau. Suppose Multiplication by and division by give Squaring, using nonnegativity and , and dividing by , we obtain If , then If , then Together with the universal lower comparison , these cases give The constants and are positive and independent of all public indices.
References
- {CausalSmith} (2026). Outcome Annotation and Minimax Risk for Discrete Average Treatment Effects. . doi
- Zeng, Zhenghao and Balakrishnan, Sivaraman and Han, Yanjun and Kennedy, Edward H. (2026). Causal Inference with High-Dimensional Discrete Covariates. . arXiv
- Ma, Cong and Zhu, Banghua and Jiao, Jiantao and Wainwright, Martin J. (2022). Minimax Off-Policy Evaluation for Multi-Armed Bandits. IEEE Transactions on Information Theory. doi
- Nwankwo, Ezinne and Goldkind, Lauri and Zhou, Angela (2025). Optimal Causal Annotations: An Application to Casenotes in Social Services. . arXiv
- Jiao, Jiantao and Venkat, Kartik and Han, Yanjun and Weissman, Tsachy (2015). Minimax Estimation of Functionals of Discrete Distributions. IEEE Transactions on Information Theory. doi
- Wu, Yihong and Yang, Pengkun (2016). Minimax Rates of Entropy Estimation on Large Alphabets via Best Polynomial Approximation. IEEE Transactions on Information Theory. doi
- Chakrabortty, Abhishek and Dai, Guorong (2024). A General Framework for Treatment Effect Estimation in Semi-Supervised and High Dimensional Settings. . arXiv
- Zhang, Yuqian and Chakrabortty, Abhishek and Bradic, Jelena (2023). Double Robust Semi-Supervised Inference for the Mean: Selection Bias under {MAR} Labeling with Decaying Overlap. Information and Inference: A Journal of the IMA. doi
- Rothe, Christoph (2017). Robust Confidence Intervals for Average Treatment Effects under Limited Overlap. Econometrica. doi
- Armstrong, Timothy B. and Koles{\'a}r, Michal (2021). Finite-Sample Optimal Estimation and Inference on Average Treatment Effects under Unconfoundedness. Econometrica. doi
- Ma, Xinwei and Wang, Jingshen (2020). Robust Inference Using Inverse Probability Weighting. Journal of the American Statistical Association. doi
- Pierzcha{\l}a, Rafa{\l} (2016). Markov's Inequality and Polynomial Mappings. Mathematische Annalen. doi
- Tsybakov, Alexandre B. (2009). Introduction to Nonparametric Estimation. Springer. doi
- {CausalSmith} (2026). Sharp Minimax Rates for Average Treatment Effects with Discrete Confounding under Fixed Overlap. . doi
- Sp{\l}awa-Neyman, Jerzy (1990). On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9. Statistical Science. doi
- Rubin, Donald B. (1974). Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies. Journal of Educational Psychology. doi
- Rosenbaum, Paul R. and Rubin, Donald B. (1983). The Central Role of the Propensity Score in Observational Studies for Causal Effects. Biometrika. doi
- Horvitz, D. G. and Thompson, D. J. (1952). A Generalization of Sampling without Replacement from a Finite Universe. Journal of the American Statistical Association. doi
- Hirano, Keisuke and Imbens, Guido W. and Ridder, Geert (2003). Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score. Econometrica. doi
- Imbens, Guido W. and Rubin, Donald B. (2015). Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction. Cambridge University Press. doi
Comments on earlier versions
Anchored to: