Random Group Formation and the Equal-group CR2 Variance in Finite Populations
Abstract
This paper studies design-based variance estimation for random group-formation experiments in finite populations. Units are assigned to disjoint groups of a fixed common size , the group-size parameter, and treatment is randomized across realized groups. The target is the finite-population partition-average marginal effect, defined by averaging composition-indexed potential outcomes over the uniform -slice of possible groups. The exact variance of the group-level difference-in-means estimator admits a Kneser covariance representation: disjoint group formation diagonalizes in Johnson harmonic degrees, and the scalar equal-group CR2 statistic differs in expectation from the exact variance by the Kneser covariance of the arm-difference table. In triangular arrays with growing group count , the number of realized groups, stable treatment fraction, bounded potential outcomes, and grouped-unit sampling fraction converging to , the limiting grouped-unit fraction, the exact design variance of the difference-in-means estimator satisfies, after scaling by , where is the independent-group leading variance scale and is the degree-one Johnson energy of the arm contrast. Consequently, the equal-group CR2 statistic estimates , is asymptotically conservative for the exact variance in the stated one-sided probability sense, and is ratio-consistent exactly when the dense correction is negligible relative to the corrected variance scale. At zero sampling density, ratio consistency holds under , including regimes with . The paper also identifies the scalar statistic returned by a versioned clubSandwich CR2 calculation, gives an eight-unit witness with exact variance and expected CR2 value , and proves a positive-density lower bound: for a fixed group size , a strictly positive limiting grouped-unit fraction , an outcome envelope , and a variance floor below the separated independent-arm limit , every measurable one-realization variance statistic has nonvanishing worst-case relative error over the bounded schedule class with those parameters.
Introduction
Random group formation is common in experiments where outcomes depend on who interacts with whom. Classrooms, teams, peer groups, neighborhoods, and online clusters can all be randomized objects rather than fixed sampling units. In such designs, the realized groups are typically disjoint: once a unit is placed in one group, it is removed from the pool available to the others. This finite-population dependence changes the variance target for a group-level treatment contrast, even when treatment is randomized across groups after the partition is formed.
This paper gives a design-based account of that variance target for homogeneous random partitions. The finite population has size , the common group size is fixed at , and disjoint groups are drawn uniformly before a balanced treatment assignment is applied across groups. Potential outcomes are deterministic functions of the treatment arm and the realized group. The estimand is the partition-average marginal effect, obtained by averaging the contrast of group-level potential-outcome tables over the uniform -slice of possible groups. This places random group formation inside the finite-population potential-outcome tradition of Splawa-Neyman et al. (1990), Fisher (1935), Cox (1958), Rubin (1974), and Holland (1986).
The central object is the covariance induced by drawing disjoint groups. On the uniform -slice, the normalized Kneser disjointness operator averages a group table over all groups disjoint from a given group. The Johnson association scheme diagonalizes this operator degree by degree. Theorem 1 uses that diagonalization to express the covariance of two centered group tables as a sum of Johnson harmonic inner products multiplied by finite- Kneser eigenvalues. Applied to the arm-difference table, this identity identifies the exact finite-population covariance term generated by group formation.
The exact design variance follows from combining this Kneser covariance with balanced treatment assignment. Theorem 2 establishes that the group-level difference in means is unbiased for the partition-average marginal effect and that its exact variance decomposes into an independent-group component plus ordered-disjoint covariance terms. The same theorem shows that the expected scalar equal-group CR2 statistic differs from the exact variance by exactly the negative of the Kneser covariance contrast. Thus the discrepancy between the usual cluster calculation and the finite-population randomization variance is determined by the geometry of the full potential group tables.
The asymptotic analysis studies triangular arrays with fixed , growing group count, stable treated-group fraction , bounded potential outcomes, nondegenerate scaled exact variance, and grouped-unit sampling fraction . Under these conditions, Theorem 3 gives the expansion where is the independent-group leading variance scale and is the degree-one Johnson energy of the arm-difference table. The degree-one term has a direct finite-population interpretation: it is the component of the treatment-control group-table contrast carried by marginal unit participation, and disjoint sampling makes that component contribute at first order whenever the limiting grouped-unit fraction is positive.
This expansion yields the CR2 phase frontier. Theorem 4 shows that the scalar equal-group CR2 statistic estimates in probability, while the exact variance uses the corrected scale . The theorem gives a one-sided asymptotic conservativeness statement and characterizes ratio consistency by the relative-energy condition At zero sampling density, Theorem 5 gives ratio consistency under , including the benchmark , for which . This connects the dense calculation to the sparse intuition in Fu et al. (2026) while identifying the sampling fraction that governs the scalar variance ratio in the present fixed- random-partition setting.
The paper also relates the population calculation to applied regression software. In the equal-group design, Proposition 1 identifies the treatment-coordinate entry returned by clubSandwich::vcovCR with type CR2, for the stated unweighted intercept-plus-treatment regression and versioned sandwich bread convention, with the scalar statistic analyzed in the design theory. Proposition 2 then gives a finite eight-unit, four-pair, two-treated-group schedule in which the exact variance is and the expected CR2 statistic is . The witness makes the dense correction visible in a small balanced design.
Finally, the one-realization result gives an identification-theoretic interpretation of the dense correction. Proposition 3 constructs same-sign and independent-arm Rademacher schedule priors whose one-realization observed-data mixtures agree while their scaled exact variances converge to separated limits at positive density. Theorem 6 converts this comparison into a uniform lower bound over the dense bounded schedule class: for some positive , every measurable statistic of the realized partition, assignment, and observed outcomes has worst-case relative error probability at least one half asymptotically. The obstruction is the degree-one cross-arm component of the potential group tables, which enters the exact variance but is not uniformly recoverable from a single realized grouping and assignment.
The formal statements and internal algebraic derivations are machine-checked in Lean 4; the verification appendix records the precise scope. The paper proceeds as follows. Section 2 places the results in the design-based, survey-sampling, cluster-robust, and interference literatures. Section 3 defines the random group-formation design, the partition-average marginal effect, the Johnson decomposition, and the scalar CR2 statistic. Section 4 proves the Kneser covariance identity and the finite-sample PAME variance formula. Section 5 derives the projection limit, the CR2 phase frontier, and the zero-density ratio result. Section 6 connects the scalar statistic to the versioned clubSandwich calculation and evaluates the eight-unit witness. Section 7 proves the one-realization obstruction, Section 8 summarizes the scope and extensions, and Section A collects the proofs and the verification note.
Related work
The paper belongs to the design-based tradition in causal inference, where treatment assignment is the source of randomness and potential outcomes are fixed features of a finite population (Splawa-Neyman et al., 1990; Fisher, 1935; Cox, 1958; Rubin, 1974; Holland, 1986). Its population target is a group-composition estimand: for a population of size and common group size , the analysis averages potential outcomes over the uniform -slice of possible groups. This places random group formation inside the same finite-population logic that underlies classical randomization inference, while making the composition of a treated or control group part of the assignment mechanism.
The asymptotic perspective is closest to survey-sampling triangular arrays, where the population may grow, the realized sample may occupy a nonvanishing fraction of it, and finite-population corrections can survive in the limit (Hájek, 1960; Cochran, 1977; Ohlsson, 1989; Fuller, 2009). The grouped-unit sampling fraction / plays that role here. Under the dense design studied in Definition 4, the number of realized groups diverges while is fixed, the treated-group fraction converges to an interior limit, and converges to a limit in the unit interval. The resulting variance formula retains the finite-population geometry induced by drawing disjoint groups, so the large-sample object is governed by both the usual independent-group variance scale and a correction determined by overlap in potential group tables.
The closest theorem-level comparison is Fu et al. (2026). For group interaction experiments with fixed or randomly formed groups, their Section 3 and Theorems 1–2 establish both asymptotic normality of the group-level contrast and ratio consistency of the CR2 variance estimator, under boundedness, their Assumption 1, and the sparse whole-tuple condition . That condition makes accidental reuse of population units across independently sampled tuples asymptotically negligible, so the finite-population disjointness geometry disappears from the limit and a single sparsity rate carries both conclusions. The present paper differs on three counts. It works in the homogeneous fixed- random group-formation subcase and keeps the exact disjointness geometry visible rather than assuming it away. Its subject is the variance object itself: the results characterize the exact design variance and the probability limit of the equal-group CR2 statistic, and Section 8 records what a complete inference theory would still require. And it replaces the whole-tuple rate by the grouped-unit sampling fraction: Theorem 4 shows that what governs the CR2 variance ratio in this subcase is , through the degree-one Johnson correction, and Theorem 5 delivers ratio consistency under alone, in particular on schedules with that their condition excludes. Theorem 1 expresses that geometry through the Johnson-scheme decomposition of slice functions and the normalized Kneser disjointness operator, while Theorem 2 converts it into the exact variance of the group-level difference-in-means estimator. In the dense regime, Theorem 3 yields the expansion , where is the independent-group leading variance scale and is the degree-one Johnson energy of the arm-difference table. At zero sampling density, Theorem 4 gives the corresponding convergence of the scalar CR2 ratio, aligning the dense calculation with the sparse intuition when .
The algebra behind these comparisons draws on the Johnson association scheme and Kneser graph spectrum (Delsarte, 1973; Brouwer et al., 1989; Filmus, 2016; Brouwer et al., 2018). Those tools are used here as finite-population variance geometry. The group table records, for each treatment arm and possible group, the group-average potential outcome; its centered version and Johnson projections separate additive unit-level variation from higher-order composition variation. This decomposition is what makes the dense correction interpretable: the term involving is attached to the first Johnson component of the arm contrast, the part of the table most directly affected by removing units from the remaining pool after a group has been drawn.
The variance-estimation part of the paper connects to the cluster-robust covariance literature initiated by White (1980) and Liang et al. (1986), and to finite-sample and leverage adjustments for clustered least squares (Bell et al., 2002; Cameron et al., 2015; Abadie et al., 2023). The scalar statistic in Definition 12 is the equal-group analogue of the CR2 adjustment used in applied software. Two design-based points of contact deserve emphasis. Pustejovsky et al. (2018) develop bias-reduced linearization and Satterthwaite-type testing for fixed-effects models, and the CR2 adjustment they analyze is derived under an independent-cluster working covariance model; that working model is exactly what random group formation violates here, since drawing disjoint groups from a finite population correlates the realized group tables. The present results quantify the resulting gap rather than repairing the adjustment: Theorem 2 shows that the expected scalar CR2 statistic differs from the exact design variance by precisely the Kneser covariance contrast, which is the term the independent-cluster working model sets to zero. Su et al. (2021) give a design-based comparison of individual-level, cluster-average, and cluster-total regression analyses of cluster-randomized experiments, showing how the estimand and the robust standard error depend on cluster-size weighting and on the model-assisted structure imposed. Their clusters are fixed by the design; the object studied here is the additional variance geometry contributed by making the clusters themselves random and disjoint, at a common size that removes the cluster-size weighting question from the comparison. Proposition 1 gives a software-facing identity for the unweighted intercept-plus-treatment regression and the clubSandwich CR2 covariance calculation, tying the population calculation to the implementation line in Pustejovsky et al. (2018), Zeileis (2004), Zeileis (2006), Zeileis et al. (2020), Pustejovsky (2026), and Zeileis et al. (2026). This identity is useful because it pins down the scalar object consumed by standard regression software before the asymptotic comparison is made.
The design also sits near the literature on interference, exposure mappings, and group-formation experiments (Sobel, 2006; Hudgens et al., 2008; Tchetgen et al., 2012; Manski, 2013; Liu et al., 2014; Aronow et al., 2017; Ugander et al., 2013; Eckles et al., 2017; Athey et al., 2018; Li et al., 2019; Xu et al., 2021; Wang et al., 2025; Samii et al., 2023; Gao et al., 2025). That work clarifies how causal estimands change when a unit’s outcome can depend on peers, assignments in a neighborhood, or a realized exposure condition. Here the exposure condition is the realized group itself: the potential outcome , first introduced formally in Assumption 4, depends on the arm and the group . The random-partition design then supplies a tractable law over group compositions, making the population average marginal effect and its estimator design-based quantities.
Finally, the one-realization lower bound is related to finite-population variance nonidentification and conservative variance-estimation results (Aronow et al., 2014; Basse et al., 2018; Harshaw et al., 2026; Park et al., 2026) and sits alongside design-based randomization and permutation inference for interference settings (Basse et al., 2024; Puelz et al., 2022). Proposition 3 constructs two randomized schedule priors with identical one-realization observables and separated scaled variances, and Theorem 6 turns that separation into a lower bound for arbitrary one-realization variance statistics. Together with the exact variance and CR2 results, this positions the paper as a finite-population account of what random group formation contributes to variance geometry, what the standard scalar software statistic targets in the equal-group design, and what information a single realized partition contains about the design variance.
Setup and assumptions
Throughout, indexes the finite population size and is the fixed common group size. Row-dependent quantities carry an subscript, all limits are along the triangular array, and generic finite constants may change from line to line. Expectations, inner products, and norms below are finite-population objects taken over the uniform slice of possible groups.
Three row-level quantities recur in the conditions below and are fixed once here. The realized group count is ; the number of grouped units is the total number of population units that end up inside a realized group; and is the exact design variance of the group-level difference-in-means estimator of Definition 7, taken over the joint law of the realized groups and the treatment assignment. The asymptotic analysis rests on the number of realized groups and on the treatment, sampling, boundedness, and variance-scale restrictions imposed on the triangular array.
The number of realized groups diverges:
⊢ LeanAssumption 1 is the growing number of randomized groups condition, a standard route for design-based asymptotics with many randomized clusters (Fu et al., 2026). It is the dimension along which the random partition supplies repeated group-level observations.
For a triangular schedule array with row group count and treated-group count , where , the row treatment fraction is
⊢ LeanThe number of treated groups determines the row treatment fraction in Definition 1; the number of control groups is the complementary count used in the difference-in-means estimator below.
The treated-group fraction converges to an interior limit:
⊢ LeanAssumption 2 is the stable complete-randomization arm fractions condition (Li et al., 2017). The interior limiting treated-group fraction keeps both treatment arms asymptotically represented in the randomized group assignment.
The grouped-unit fraction converges:
⊢ LeanAssumption 3 is the finite-population sampling-fraction limit condition (Ohlsson, 1989). It records the limiting density of grouped units in the population, allowing the same notation to cover sparse and dense grouping regimes.
There is a finite uniform outcome envelope such that
⊢ LeanAssumption 4 is the uniformly bounded composition potential outcomes condition (Fu et al., 2026). The deterministic potential outcome may depend on the unit, arm, and realized group, while the uniform envelope supplies a common finite bound across rows.
For a feasible triangular schedule array with common group size , positive group counts , treated-group counts satisfying , grouped size , and deterministic potential-outcome schedules, there is a scaled-variance lower-bound constant such that and
⊢ LeanAssumption 5 is the nondegenerate scaled design variance condition (Li et al., 2017). The scaled-variance lower-bound constant fixes the normalization used by the asymptotic variance comparisons.
We next define the finite-population design and the function spaces on which its variance geometry is expressed.
The treatment-arm set is the two-point set
⊢ LeanThe treatment-arm set is used throughout for the two arms of the group-level potential-outcome tables.
A feasible triangular schedule array with common group size consists of the following data:
(Group size.) A natural number satisfying .
(Row sizes.) For each row , a population size , a number of groups , and a number of treated groups .
(Feasibility.) For every row ,
(Potential-outcome schedule.) For every row , a deterministic potential-outcome schedule where is the realized group argument of .
Definition 3 collects the rowwise feasibility restrictions used in the design: the group size is common, each row has positive groups and a nontrivial treated count, and the potential-outcome schedule is deterministic.
Let be the finite population of labeled units, and let The group tuple is drawn uniformly from all ordered -tuples of pairwise-disjoint elements of . Independently, the assignment vector is drawn uniformly from all binary vectors with exactly treated groups.
⊢ LeanDefinition 4 defines the homogeneous random group-formation design. The ordered group tuple carves pairwise-disjoint groups of common size out of the finite population , and the balanced group-treatment assignment vector is drawn independently conditional on the realized groups. The feasibility condition allows the grouped units to occupy any fraction of the population. The realized groups therefore form a disjoint packing of : they are pairwise disjoint and each has size , and they cover the whole population exactly when . The general case, in which units lie outside every realized group and contribute no observation, is what gives the sampling fraction its range and is where the sparse and intermediate-density regimes studied below live. The design’s name, random partition, refers throughout to this packing mechanism; the saturated case is the special case in which it is literally a partition.
For each treatment arm and each group , define the group-level arm table by
⊢ LeanThe group-level arm table converts unit-level composition potential outcomes into the group mean observed when group receives arm .
For integers , let The -slice design is the complete-randomization design on , equivalently the uniform distribution over all -element subsets of the -unit population. For any real-valued table , write
⊢ LeanThe uniform -slice is the population of possible groups, and the averaging operator turns any group table into its finite-population slice mean.
Define the finite-population partition-average marginal effect by The difference-in-means estimator across treated and control groups is
⊢ LeanDefinition 7 defines the finite-population partition-average marginal effect and its realized group-level difference-in-means estimator. The estimand averages the contrast of the two arm tables over the full slice, while the estimator uses the treatment labels and realized groups produced by Definition 4.
For integers and with , let and be the uniform -slice. The space is the real vector space of functions , equipped with uniform-slice expectation inner product and induced norm .
The inner product and induced norm in Definition 8 provide the Hilbert-space notation used to decompose group tables by Johnson degree.
For integers with , let be the uniform -slice, let denote uniform averaging on , and let be the uniform-slice inner product. For each , let be the canonical degree- Johnson harmonic subspace and let be the orthogonal projection onto : is linear, has range , fixes every element of , and satisfies For every , define its Johnson components by These components satisfy the centered decomposition and distinct degrees are orthogonal:
⊢ LeanThe Johnson harmonic subspace and projection organize a centered group table into orthogonal degrees. This is the representation-theoretic coordinate system for the exact variance identities below, following the Johnson and Kneser association-scheme perspective (Filmus, 2016; Brouwer et al., 2018).
Two derived slice quantities enter the next two definitions. For each arm , the centered arm table is the group-level arm table of Definition 5 with its slice mean removed, as recorded in Definition 15; and the uniform-slice arm variance is its energy, the variance of the arm- group table under a single uniform draw from the slice. These are the only two objects needed to read the covariance and correction definitions that follow.
For a function on , define the normalized Kneser disjointness operator by For arm tables and , define the ordered-disjoint covariance by
⊢ LeanDefinition 10 records the covariance generated by sampling disjoint groups. The normalized disjointness operator averages over groups disjoint from a given group, while the centered arm table and ordered-disjoint covariance isolate the finite-population dependence induced by the partition.
Define the degree-one Johnson energy of the arm-difference table by Define the independent-group leading variance scale by
⊢ LeanThe degree-one energy is the part of the arm-difference table carried by the linear Johnson component. The uniform-slice arm variance enters Definition 11 through the independent-group leading variance scale.
For each arm , let be the within-arm sample variance of the observed group means, computed with denominator . Define the scalar equal-group CR2 variance statistic by
⊢ LeanThe within-arm sample variance in Definition 12 is computed from observed group means within each assigned arm. The scalar CR2 statistic is therefore the equal-group cluster-robust variance quantity analyzed in the later software identity and asymptotic results.
The class defined next is named for the dense regime that motivates it, and its parameter ranges over the whole unit interval: arrays with belong to it, and the results below treat and as the two phases of one statement.
The class consists of triangular arrays , with fixed common group size , for which:
(Feasible rows.) The common group size satisfies . In each row, , , , and . The potential-outcome schedule assigns a real value for every group , every unit , and every arm .
(Dense growth.) The group count satisfies Assumption 1, so .
(Treatment fraction.) The treated-group fraction satisfies Assumption 2: for an interior limiting treated-group fraction , and .
(Sampling fraction.) The grouped-unit sampling fraction satisfies Assumption 3: for a limiting grouped-unit sampling fraction , and .
(Uniform envelope.) The potential outcomes satisfy Assumption 4: for a uniform envelope ,
(Scaled variance.) The exact design variance satisfies Assumption 5: for a scaled-variance lower-bound constant ,
Equivalently, with the row feasibility, interiority, closed-interval, envelope, and variance-floor conditions listed above.
⊢ LeanThe dense schedule class packages the conditions in Assumptions 1, 2, 3, 4, and 5. It is the common domain for the dense asymptotic statements, combining feasible rows, a stable treatment split, a limiting grouped-unit fraction, bounded potential outcomes, and a positive scaled design-variance floor.
Exact variance geometry
The setup in Definitions 4, 5, and 7 makes the realized groups a sample of disjoint -subsets. The variance calculation therefore depends on two finite-population operations: centering each arm table on the uniform -slice and averaging a table over groups disjoint from a given group. This section records the exact algebra for those operations and then applies it to the design variance of , the group-level difference-in-means estimator.
We first fix the realized arm counts and the centered table notation used in the covariance formulas.
For , let be the number of realized groups assigned to arm at row . Under the complete group-treatment assignment with exactly treated groups and control groups, this notation gives and .
Definition 14 aligns the random-assignment notation with the fixed arm counts from Definition 4. In the balanced complete group assignment used throughout the paper, the realized counts equal the design counts, so later variance expressions may use and directly.
For integers and with , let Given a deterministic potential-outcome schedule for units , arms , and groups , define the centered arm- group table by for each , where
⊢ LeanThe centered table in Definition 15 isolates the part of an arm-specific group mean that can covary across disjoint realized groups. The centering is with respect to the uniform slice, matching the estimand in Definition 7 and the ordered-disjoint covariance in Definition 10.
For integers , let For any real-valued function , define its squared uniform-slice norm by where denotes averaging over the uniform law on .
⊢ LeanDefinition 16 supplies the norm in which Johnson harmonic components are measured. Because the inner product averages over all candidate groups of size , these energies describe finite-population variation before the random partition selects the realized disjoint groups.
The next result gives the spectral identity that turns disjointness dependence into degree-by-degree covariance terms. Its constants are the normalized Kneser eigenvalues, obtained from the classical Johnson association-scheme spectrum (Delsarte, 1973; Brouwer et al., 1989; Brouwer et al., 2018); the harmonic decomposition follows the standard slice analysis of Boolean functions (Filmus, 2016).
Let satisfy and . Let be a deterministic potential-outcome schedule for units , arms , and groups , with group-level arm tables as in Definition 5. Suppose the following conditions hold.
(Johnson projections.) For each , is a linear projection on functions whose range is the degree- Johnson harmonic subspace , which fixes every element of , and whose residual is orthogonal to under the uniform-slice inner product .
(Centered orthogonal decomposition.) For every and , and the projected components are mutually orthogonal: if , then for all .
(Kneser spectrum.) For every and every , the unnormalized Kneser adjacency operator has eigenvalue
Then the normalized Kneser disjointness operator acts on each projected component by for every , every , and every . Moreover, if are centered under the uniform -slice, then for a uniform ordered disjoint pair , Finally, the ordered-disjoint covariance of the arm-difference table satisfies
⊢ LeanTheorem 1 shows that disjoint group formation has an exact finite-sample diagonalization in Johnson degrees. Each degree contributes its harmonic inner product multiplied by the signed finite- factor , so the covariance retained by sampling groups without replacement is completely summarized by the slice energies of the projected arm tables. Applied to the arm-difference table, the same identity gives , the ordered-disjoint covariance contrast that enters the variance comparison below.
The exact variance formula combines this disjointness covariance with the complete-randomization variation across treatment labels. The definitions in Definitions 15 and 14 make the statement entirely finite-sample: the arm variances , the ordered-disjoint covariances , and the independent-group scale are all computed from the deterministic row schedule.
Let be natural numbers and let . Suppose that:
(Feasible partition.) The two-stage random partition design in Definition 4 is feasible: .
(Group sizes.) , , and .
(Potential outcomes.) is a deterministic potential-outcome schedule, defined for every , every , and every .
Set and For the difference-in-means estimator , the finite-population PAME , the exact design variance , and the scalar equal-group CR2 statistic in Definition 12, and
⊢ LeanTheorem 2 establishes three finite-sample facts for the two-stage design. First, the group difference in means is unbiased for the finite-population PAME. Second, the exact design variance separates an independent-group component, , from the ordered-disjoint covariance terms induced by the random partition. Third, the scalar equal-group CR2 expectation differs from the exact variance by exactly . Thus the sign and magnitude of the CR2 discrepancy are governed by the same Kneser covariance contrast characterized in Theorem 1.
Dense and sparse variance behavior
The exact identities in Theorems 1 and 2 reduce the large-population question to the behavior of Johnson energies under random grouping. In dense arrays, where a positive fraction of the finite population may be grouped, the first Johnson degree carries the leading correction to the independent-group variance scale. The higher degrees remain present in the finite-sample identity, but their aggregate contribution is uniformly of smaller order under the bounded-outcome and fixed-group-size conditions.
A word on how to read the statements below. Each theorem carries its Johnson-projection, orthogonal-decomposition, and Kneser-spectrum clauses explicitly, because the verified statements quantify over the projections rather than fixing them. Those three clauses are not extra economic assumptions: they hold automatically for the canonical Johnson projections on the uniform -slice whenever , by Lemmas 3 and 2, which are proved in Section A. The substantive conditions are only the four array conditions of Section 3: growing group count, stable treatment fraction, converging sampling fraction, and bounded potential outcomes. A reader may take the projection clauses as given and read each theorem as a statement about arrays satisfying those four conditions alone.
Fix a common group size and real numbers , , and . There is a constant such that, for every feasible triangular schedule array with common group size and every rowwise choice of Johnson projections on , the following conditions imply the displayed limits below:
(Group growth.) The array satisfies Assumption 1.
(Treatment fractions.) The array satisfies Assumption 2 with limiting treated-group fraction .
(Sampling fractions.) The array satisfies Assumption 3 with limiting grouped-unit fraction .
(Bounded outcomes.) The array satisfies Assumption 4 with uniform outcome envelope .
(Johnson decomposition.) In every row with , the projections give the centered orthogonal Johnson decomposition for every and every , and distinct Johnson degrees are orthogonal under .
(Kneser spectrum.) In every row with , every is an eigenfunction of the unnormalized Kneser adjacency operator with eigenvalue
Then and Moreover, for every row , the pooled contribution of Johnson degrees , has absolute value at most .
⊢ LeanThe theorem identifies the dense correction as the product of the grouped-unit sampling limit and the degree-one contrast energy . Intuitively, degree one records the part of the arm-difference table that is visible through the marginal participation of individual population members in sampled groups. Sampling without replacement induces competition for those members across groups, and the limit in Theorem 3 converts that competition into the correction to the scaled exact variance. The final bound gives the corresponding uniform remainder statement for Johnson degrees at least two, so the first-order dense comparison is governed by the degree-one projection.
This projection expansion feeds directly into the behavior of the equal-group CR2 statistic. The statistic is the usual scalar cluster-robust variance estimator for the difference in group means in this balanced design, matching the equal-group CR2 form used in finite-sample cluster-robust inference (Pustejovsky et al., 2018). The next result states its probability limit and the exact criterion under which the conservative dense correction vanishes relative to the target variance.
Let , and let be a triangular array of feasible random-group experiment rows with population sizes , group counts , treated-group counts , grouped-unit counts , and deterministic potential-outcome schedules. Fix constants . Suppose that:
(Dense array.) The array belongs to the dense bounded schedule class in Definition 13, with parameters .
(Johnson projections.) For every row , the spaces are equipped with linear projections , , whose ranges are the degree- Johnson harmonic subspaces , which fix functions in their ranges and have residuals orthogonal to under .
(Orthogonal decomposition.) For every row with , every , and every , and distinct Johnson components are orthogonal:
(Kneser spectrum.) For every row with , every , and every , the unnormalized Kneser adjacency operator satisfies
Then, as , and Moreover, for every , and the ratio converges in probability to if and only if
⊢ LeanTheorem 4 says that CR2 estimates the independent-group scale in probability, while the exact design variance subtracts the dense projection correction. Consequently, the statistic is asymptotically conservative for the exact variance in the one-sided probability sense stated in the theorem. Its ratio consistency is characterized by a single relative-energy condition: the dense correction must be negligible compared with the corrected scaled variance . This gives a diagnostic interpretation to the Johnson decomposition in Definition 9: degree-one heterogeneity in the arm contrast is precisely the component that determines whether the usual CR2 standard error is sharp in dense random-group designs.
The sparse case follows by setting the grouped-unit sampling fraction to zero. In that regime, the same theorem conditions allow many realized groups while making the first-order finite-pool correction vanish at the scale relevant for the variance ratio. The final result records this implication and isolates the benchmark count sequence in which even though .
Fix an integer . Then the following statements hold.
(Sparse dense arrays.) For every feasible triangular schedule array with common group size , if the array belongs to in Definition 13 with limiting grouped-unit fraction , then
(Birthday counts.) With the benchmark counts satisfy for all sufficiently large ,
(Birthday-aligned arrays.) For every feasible triangular schedule array with common group size , if its grouped-unit count satisfies row by row and the array satisfies Assumptions 1, 2, 4, and 5 for some , , and , then
The sparse result separates the variance question from whole-design collision heuristics. What matters for the scalar PAME variance is the grouped-unit fraction , and Theorem 5 establishes ratio consistency whenever that fraction converges to zero within the stated dense schedule class. The explicit sequence gives a concrete regime with vanishing sampling fraction and diverging . Thus CR2 remains ratio-consistent for the exact design variance in a range where the experiment still uses many overlapping opportunities in the underlying finite population.
Software identity and finite witness
The preceding results analyze the scalar equal-group CR2 statistic in Definition 12. This section records how that scalar statistic is obtained from a standard software call in the equal-group design, then gives a fully finite calculation that fixes the sign and magnitude of the dense correction. The software statement is deliberately versioned: the relevant covariance entry is the treatment-coordinate entry returned by clubSandwich for an unweighted intercept-plus-treatment regression using the sandwich bread convention (Pustejovsky, 2026; Zeileis et al., 2026; Zeileis, 2004; Zeileis, 2006; Zeileis et al., 2020; Pustejovsky et al., 2018).
The eight-unit witness fixes and uses the balanced sign vector For every group and every unit , the potential outcomes are
⊢ LeanProposition 1 identifies the population-design statistic with the coefficient variance delivered by the stated vcovCR call. The row-identification and outcome clauses align the regression rows with the realized groups in Definition 4; the design-matrix and unweighted-fit clauses make the treatment coefficient equal to the group-level treated-control contrast in Definition 7. The block-algebra and bread-scaling clauses then pin down the CR2 adjustment and the normalization used by the versioned software implementation.
The sign vector in Definition 17 is balanced in the sense that half of its entries equal and half equal ; the verified witness takes the canonical representative so that . The numbers reported below are computed for this representative. The finite calculation below specializes the design to eight units, four pairs, and two treated groups. It provides a small balanced schedule in which the exact variance components and the expected CR2 statistic can be evaluated without asymptotics.
Suppose , , and . Fix a deterministic potential-outcome schedule , an ordered tuple of pairwise-disjoint realized groups of common size , and a balanced group-treatment assignment vector with treated groups and control groups. Assume the software regression data satisfy the following conditions.
(Row identification.) For each realized group, the regression rows are in bijection with the units in that group.
(Design matrix.) The fitted model matrix has exactly two columns, an intercept and the numeric binary group-treatment regressor:
(Observed outcomes.) The regression outcome in row of group is the realized potential outcome , and its within-group average equals the observed group mean.
(Unweighted fit.) The fit is an unweighted full-column-rank least-squares fit, with residuals , and the average residual in each group equals the observed group mean minus the observed mean in that group’s treatment arm.
(Block algebra.) The stacked cross-product satisfies , the group hat matrices are each is positive definite, and each CR2 adjustment is symmetric positive definite with
(Bread scaling.) The matrix used by the CR2 covariance calculation is , where is the unweighted matrix.
Let be the covariance matrix returned by in version , with , , and omitted, applied to this unweighted intercept-plus-treatment fit using version for the bread. Then the treatment-coordinate entry equals the scalar equal-group CR2 statistic in Definition 12:
⊢ LeanThe witness in Definition 17 makes treatment outcomes depend only on the average sign within the realized pair, while control outcomes are identically zero. Balance of gives a concrete degree-one component in the treated arm table, so the exact finite-pool correction in Theorem 2 has a visible numerical effect.
For the balanced eight-unit witness schedule with , , , and , suppose that:
(Johnson projections.) There is a system of orthogonal projections onto the canonical Johnson harmonic spaces in .
(Centered decomposition.) These projections decompose every after removal of its uniform-slice mean, with different harmonic degrees orthogonal under .
(Kneser spectrum.) The unnormalized Kneser adjacency operator acts on each by the eigenvalue
Then the witness satisfies and, for the random partition design in Definition 4 and the scalar equal-group CR2 statistic in Definition 12,
⊢ LeanProposition 2 shows that the finite design variance is , while the expected equal-group CR2 statistic is . The same calculation reports and , matching the geometry in Theorem 1: the treated table’s degree-one energy generates a negative ordered-disjoint covariance, and that covariance enters the exact variance through the dense correction. Thus the witness supplies a concrete numerical check on both the Kneser covariance normalization and the software-facing CR2 statistic before the one-realization lower bound studied next.
One-realization lower bound
The finite witness in Proposition 2 shows how the dense correction can move the exact variance away from the equal-group CR2 target in a small design. This section turns that calculation into a positive-density impossibility statement for one-realization variance recovery. The construction compares two randomized schedule priors whose induced observed-data mixtures agree for every statistic of the realized groups, assignments, and observed outcomes, while their scaled exact variances concentrate at separated limits.
We first record the observed object and the two sign priors used in the comparison.
A one-realization observation at population size , common group size , realized group count , and treated-group count is a triple with the following components:
(Partition.) is an ordered tuple with for every , and whenever .
(Treatment allocation.) selects a subset of the realized groups with exactly elements.
(Observed outcomes.) For every realized group and every unit , assigns a real observed outcome .
Definition 18 fixes the sigma-field available to a one-realization procedure: the sampled partition, the group treatment allocation, and the observed unit outcomes within sampled groups. It matches the information used by the design estimator in Definition 7 and by the equal-group CR2 statistic in Definition 12, but it treats the variance statistic itself as an arbitrary measurable function of the realized data.
For a population size , is the product finite design on arrays under which every unit-arm coordinate is drawn independently from the fair two-point law:
⊢ LeanFor each , is the finite product design on Boolean schedules whose coordinate design at every is the fair coin design:
⊢ LeanBoth priors are stated on Boolean coordinates, and a Boolean draw becomes a potential-outcome schedule through the sign map Given a common-sign draw from , the induced schedule is additive and arm-free, so the same unit sign is carried into both arms. Given an arm-specific draw from , the induced schedule is with the two arms drawn independently. Both induced schedules take values in and are additive: the potential outcome of unit does not depend on the composition of the group it lands in. Consequently every group table is an average of independent signs, which is what produces the arm variances quoted in the proposition. The independent prior in Definition 19 randomizes unit signs separately by treatment arm; the same-sign prior in Definition 20 uses a common unit sign across arms. Both priors generate bounded Boolean schedules, but they place different mass on the degree-one arm-difference energy in Definition 11. That difference is invisible after observing only the assigned arm in a single realization.
Fix a common group size . Let be a feasible triangular array with row population sizes , group counts , treated-group counts , , , and deterministic schedules. Let and let , the limiting grouped-unit fraction, satisfy . Suppose:
(Group growth.) The array satisfies Assumption 1.
(Treatment fractions.) The treated-group fractions satisfy Assumption 2 with limit .
(Sampling fractions.) The grouped-unit fractions satisfy Assumption 3 with limit .
(Johnson projections.) For every row , the canonical Johnson projections on are linear orthogonal projections onto , fix , and have residuals orthogonal to .
(Johnson decomposition.) For every row with , every , and every , and distinct Johnson degrees are orthogonal under .
(Kneser spectrum.) For every row with , every , and every , the unnormalized Kneser adjacency operator satisfies
Then, for every row and every statistic of the one-realization observation , Moreover, under , Under , The two scaled-variance limits are separated by a positive gap: Consequently, for every fixed satisfying the lower-tail probabilities satisfy
⊢ LeanProposition 3 isolates the information loss created by one realized treatment assignment. Every statistic of the one-realization observation has the same mixture expectation under and , yet the exact-variance limit changes by . The equal observed-data mixture reflects the fact that each observed unit contributes only its assigned-arm sign; the variance separation comes from the unobserved cross-arm alignment, which enters Theorem 2 through the degree-one term . In positive-density designs, the grouped-unit fraction keeps that term on the same scale as the leading variance.
The next result converts the mixture separation into a uniform lower bound over the dense schedule class. It conditions the two priors on high-probability deterministic supports, so the comparison is stated directly over arrays in from Definition 13.
Fix a common group size with , and let be a triangular schedule array with population sizes , group counts , treated-group counts , , and deterministic potential-outcome rows. Let . Suppose:
(Envelope and fractions.) , , and the array satisfies Assumptions 1, 2, and 3 with limiting treated-group fraction and limiting grouped-unit fraction .
(Johnson decomposition input.) For every row , there are orthogonal projections onto the degree- Johnson harmonic spaces , , whose positive-degree components give the centered orthogonal decomposition of every :
(Kneser spectrum input.) For every row with , the Kneser adjacency operator acts on by the eigenvalue
(Variance lower bound.) With the constant satisfies
Then there exist support sets for the common-arm Rademacher prior and for the independent-arm Rademacher prior such that both prior probabilities tend to one, every diagonal selection from either support induces an array in with parameters , the conditioned one-realization laws satisfy and the scaled exact variances converge uniformly on the respective supports: Moreover, there is an such that every measurable one-realization variance statistic satisfies
⊢ LeanTheorem 6 establishes the one-realization lower bound in the positive-density class. The high-probability supports place both constructions inside with the same envelope, fraction, and scaled-variance parameters, while total variation convergence makes the conditioned observed laws asymptotically indistinguishable. Uniform convergence of the scaled exact variances to and supplies the separated targets, and the final display gives a single for which every measurable statistic has worst-case relative error probability bounded below by one half.
The intuition is the same as in a two-point Le Cam comparison, adapted to deterministic triangular arrays. If the observed laws are asymptotically the same, a statistic based only on cannot reliably determine which variance target generated the data. Because the targets remain separated by the positive-density correction , any one-realization variance statistic must make a nonvanishing relative error on at least one member of the dense class. This identifies the degree-one cross-arm component in Definition 11 as the obstruction to uniform exact-variance ratio consistency from a single realized grouping and assignment.
Discussion, scope, and extensions
The results above characterize a variance-estimation problem created by random group formation in dense finite populations. The exact identities in Theorems 1 and 2 express the design variance through the Johnson decomposition and the Kneser disjointness geometry of the group table. Those identities separate the independent-group leading scale from the Kneser finite-population correction, whose dense-limit leading term is the degree-one arm-difference component in Definition 11. In dense designs, Theorem 3 turns that exact decomposition into an interpretable limit: the scaled variance expansion contains the degree-one Johnson correction alongside the independent-group leading scale.
This characterization motivates the phase-frontier statement for the scalar CR2 statistic. The scalar CR2 statistic in Definition 12 estimates the independent-group scale under the balanced equal-group design, and Theorem 4 identifies the dense correction governing its scaled difference from the exact variance and the condition for ratio consistency. In sparse regimes, Theorem 5 shows that overlap from group formation is asymptotically negligible at the variance scale considered there. Together, the dense and sparse statements give a single design-based account of when the usual cluster calculation tracks the exact randomization variance and when the finite-population group-formation term contributes to the target.
The software comparison in Propositions 1 and 2 anchors this population geometry in the regression workflow used by applied researchers. The proposition identifies the equal-group scalar CR2 statistic with the corresponding clubSandwich calculation for the intercept-plus-treatment regression, in the setting of Pustejovsky et al. (2018). The eight-unit construction then gives a finite instance in which that statistic and the exact design variance differ. This finite witness complements the asymptotic analysis: the same degree-one structure that appears in Theorem 3 is already visible in a small balanced design.
The lower bound in Theorem 6 gives the identification-theoretic interpretation of the correction. For the dense schedule class in Definition 13, the observed realization contains the realized groups, assignments, and member outcomes, while the exact variance also depends on how the unobserved counterfactual group tables co-vary across disjoint groups. Proposition 3 supplies two dense constructions with asymptotically indistinguishable observed laws and separated exact variances, and Theorem 6 converts that comparison into a uniform lower bound for every one-realization variance statistic. The result therefore locates the obstruction precisely: the observed data can support the usual cluster scale, but the dense finite-population correction includes a cross-arm component that is not uniformly recoverable from one realized grouping and assignment.
These conclusions also clarify the positive scope of the paper. The analysis is design-based and finite-population: potential outcomes are deterministic, randomness comes from group formation and balanced assignment, and the target is the exact variance of the group-level difference-in-means estimator. The asymptotic statements are triangular-array statements over the schedule class in Definition 13, with bounded outcomes, stable treatment and sampling fractions, growing group counts, and nondegenerate scaled exact variance. Within that scope, the paper gives exact variance identities, dense and sparse asymptotic comparisons, a software identity for the scalar CR2 calculation, a finite witness, and a one-realization lower bound.
Limitations and future work
The results leave Gaussian approximation, studentized testing, Wald coverage, and finite-sample CR2 conservativeness as separate inferential questions. The variance identities and ratio limits characterize the target variance and the behavior of the scalar CR2 statistic, while a distributional theory for tests would require additional approximation arguments for the studentized estimator. Such arguments would naturally interact with the many-cluster refinements developed for CR2 procedures (Pustejovsky et al., 2018) and with recent work on random group formation and cluster-robust inference (Fu et al., 2026).
Variable group sizes are another extension. The present analysis uses a common group size throughout, which makes the random partition a uniform slice design and brings the Johnson association scheme directly into the variance calculation. Allowing heterogeneous group sizes would require the corresponding finite-population covariance operator and an analogue of the degree-one correction for the resulting design. That extension would preserve the same substantive question–how random group formation changes the variance target–while changing the combinatorial geometry used to express it.
Appendices
Proofs and auxiliary lemmas
This appendix collects the auxiliary spectral statements used by the variance geometry and records how the formal arguments fit together. The starting point is the Johnson association scheme on the uniform slice, whose orthogonal decomposition supplies the coordinates used in Definition 9 and whose Kneser disjointness operator supplies the covariance operator in Definition 10. Classical accounts of these schemes appear in Delsarte (1973), Brouwer et al. (1989), and Brouwer et al. (2018); the harmonic-analysis notation follows the slice presentation in Filmus (2016).
For , let be the degree- Johnson harmonic subspace, and let be the -orthogonal projection onto . For , the centered Johnson decomposition is For , the unnormalized Kneser adjacency operator is The normalized Kneser disjointness operator is Its eigenvalue on is denoted by . For , define the ordered-disjoint covariance and the arm-difference covariance by The degree-one arm-difference energy is
The objects in Definition 21 restate, in one place, the spectral apparatus used throughout the exact and asymptotic variance arguments. The decomposition separates centered group tables into orthogonal Johnson degrees, and the Kneser operator averages over disjoint groups, matching the dependence induced by random partitioning. With this notation fixed, two Kneser statements follow, and they are deliberately distinct. Lemma 1 is the combinatorial fact: the unnormalized disjointness adjacency operator , which sums a table over all groups disjoint from a given one, acts on the degree- harmonic space by the integer eigenvalue . Lemma 2 is the form the variance algebra consumes: it divides by the number of disjoint groups to obtain the averaging operator of Definition 10, whose eigenvalues are the falling-factorial ratios that carry the -dependence of the variance expansion. The second is obtained from the first by that normalization, which is why its proof is short; keeping them apart isolates the one combinatorial input of the paper from the bookkeeping that turns it into a covariance statement.
Using the uniform -slice , the slice function space , and the Johnson harmonic subspaces from Definition 9, suppose that:
(Population and group size.) and are nonnegative integers, with the population size and the common group size, and .
(Harmonic degree.) .
(Function.) .
Let be the linear operator on defined by Then is an eigenfunction of with eigenvalue Equivalently, as an identity in .
⊢ LeanWrite for finite and . Also write The Johnson harmonic construction used in Definition 9 has where orthogonality is with respect to the uniform-slice inner product. The hypothesis gives , so is nonempty.
First take . Since is spanned by , membership gives a scalar such that For every , Indeed, after is fixed, the admissible ’s are precisely the -subsets of the points outside . Thus which is the asserted formula in degree zero.
Now suppose . Define the scalar and the residual We first show It is enough to check this on the spanning monomials with . If , then , and the adjacency operator preserves this lower filtration level: Hence .
It remains to consider . For every , When , no disjoint can contain . When , such ’s are obtained by adjoining further points from the complement of , which has size . Inclusion-exclusion gives Therefore because every proper subset has . By linearity over the span , the same conclusion holds for every , in particular for the present .
Since , for every , The adjacency operator preserves , so . It is also self-adjoint for the uniform-slice inner product: which follows by interchanging the two finite sums and using symmetry of disjointness. Hence, for every , Thus is orthogonal to .
Combining the previous two steps, and . Taking gives Since , with , so the uniform-slice inner product is positive definite. Therefore , i.e. This is the desired identity for , and together with the degree-zero case proves the lemma.
For any population size and common group size , suppose:
(Overlap.) .
(Harmonic degree.) is an integer with .
(Harmonic function.) belongs to the degree- Johnson harmonic subspace .
Then the unnormalized Kneser adjacency operator, which sums over -subsets disjoint from the argument, acts on by for every .
⊢ LeanFix with , fix , and let . Write .
For a slice function , use the unnormalized Kneser adjacency operator The hypotheses , , and are exactly the hypotheses needed to apply Lemma 1 to this operator. It gives as an identity in the slice function space .
The preceding function identity says that, for every , The left-hand side is exactly , so which is the asserted formula.
Together, Lemmas 1 and 2 give the spectral multiplier for disjointness averaging on each Johnson degree. After normalization by the number of disjoint -subsets, these multipliers become the eigenvalues used in the covariance contrast of Theorem 1. The alternating sign in degree is the algebraic source of the projection correction that later appears in Theorem 3.
The remaining classical input is the orthogonal expansion of functions on the slice. It ensures that the covariance calculation can be expressed degree by degree rather than as a direct summation over all ordered disjoint pairs.
Let and be nonnegative integers with . For the canonical Johnson harmonic projections on , whenever , every function and every satisfy Moreover, the projections are pairwise orthogonal: for all , all functions , and ,
⊢ LeanAssume . Then , so is the finite uniform slice with For a slice function , write
For , let be the span of the inclusion monomials The Johnson harmonic layers are constructed by Since , finite-dimensional orthogonal decomposition gives Iterating from to , Moreover : for every fixed , because . Thus point masses belong to , and they span all slice functions.
Therefore the orthogonal projections onto the layers satisfy, for every , The degree-zero space is the space of constant functions. Its orthogonal projection is the constant function with value , since for every real scalar , Hence Evaluating the full decomposition at and subtracting the degree-zero component gives Applied to , this is the centered projection identity with the algebraic uniform mean.
The averaging operator is the uniform-slice expectation, so for every , Substituting this equality into the preceding display yields When , the same formula reads , because the slice has one point and the degree-zero projection is .
It remains to check distinct-degree orthogonality. For any and any slice function , because is the orthogonal projection onto . If , then and therefore every element of is orthogonal to every element of . The case is symmetric. Thus, whenever , This proves the pairwise orthogonality assertion.
Lemma 3 is the bookkeeping device behind the exact variance formula. Applying the decomposition to the centered arm tables in Definition 5 lets the Kneser covariance in Definition 10 act separately on each harmonic component. This is what turns the two-stage random partition design in Definition 4 into the exact identity in Theorem 2.
The subsequent verified arguments use these ingredients in a fixed order. First, the finite-sample variance algebra combines the PAME estimator in Definition 7 with the Kneser covariance identity to obtain Theorem 2. Next, the dense schedule class in Definition 13 specializes that identity to the projection limit in Theorem 3 and to the CR2 comparison in Theorem 4; the sparse construction gives the complementary behavior in Theorem 5. The software calculation in Proposition 1 identifies the scalar CR2 statistic with the stated clubSandwich call, and Proposition 2 evaluates the finite eight-unit witness from Definition 17. Finally, the randomized schedule construction in Proposition 3 feeds the one-realization lower bound in Theorem 6.
The finite-sample and software statements are algebraic consequences of the displayed definitions and of the versioned software conventions cited in Pustejovsky (2026) and Zeileis et al. (2026). The surrounding econometric motivation connects these calculations to random group formation and cluster-robust variance practice as in Fu et al. (2026).
Verification note.
Every theorem, proposition, and assumption displayed in this paper, and every internal algebraic derivation supporting them, is machine-checked in Lean 4, with no unproved hypotheses and no remaining proof obligations. The displayed definitions divide into two kinds. Those carrying a Lean declaration – the schedule array, the arm set, slice averaging, the slice norm, the centered arm table, the two Rademacher priors, the one-realization observation, the row treatment fraction, and all numbered def: objects – are the objects the verified statements quantify over. Three are presentation-level definitions written for the reader and carry no Lean declaration of their own: the uniform-slice space in Definition 8, the realized arm group counts in Definition 14, and the unnormalized adjacency operator in Definition 21. They name notation that the verified statements express directly in terms of the slice and its inner product, and nothing in the verified development depends on them. The trust boundary is narrower than is usual for results of this kind: the classical Johnson decomposition and Kneser spectrum recorded in Lemmas 3, 2, and 1 are not imported as cited facts but are themselves proved in the verified development, so the citations to Delsarte (1973), Brouwer et al. (1989), Filmus (2016), and Brouwer et al. (2018) attribute these classical results rather than assume them. What remains outside the machine-checked scope is the bibliographic attribution itself and the versioned software conventions of Pustejovsky (2026) and Zeileis et al. (2026), which enter Proposition 1 as stated implementation conventions.
Proofs of the main results
Let be the unnormalized Kneser adjacency operator on functions . For and , the projection assumption gives , so the Kneser spectrum assumption gives By Definition 10, Since and , using the falling-factorial convention . Hence
Now let satisfy , and put The centered decomposition in Definition 9 gives, for every , For a uniform ordered disjoint pair , each coordinate has the uniform -slice marginal, and the product expectation equals the Kneser inner product: and Therefore Substituting the positive-degree decompositions and using linearity of and of , because distinct Johnson degrees are orthogonal. This proves the covariance identity.
For each arm , define the centered arm table Then . By Definition 10 and the preceding ordered-pair identity, for under a uniform ordered disjoint pair . Applying the covariance identity from the previous step to , , and , and using gives
It remains to identify the summand with the squared norm of the projected arm contrast. For every positive degree and constant , Indeed, the centered decomposition applied to the constant function gives Taking the slice inner product with and using degree orthogonality leaves hence by definiteness of the slice inner product. Therefore, by linearity of , Again by linearity, Thus Substitution into the preceding display yields which is the asserted contrast identity.
By the group-size hypotheses, , , , and . The feasibility condition and also give . Write the treated-group fraction as For a realized ordered partition of pairwise-disjoint elements of , define and, for any vector , Set These quantities are well defined because .
Let Since , we have Using the bilinearity of the uniform-slice inner product in Definition 10 and the symmetry of the uniform ordered-disjoint-pair law under swapping the two groups,
We next record the two partition-moment identities used below. For any , let and let Then Each coordinate of is uniform on , and each distinct ordered coordinate pair is a uniform ordered-disjoint pair. Therefore Applying this with , , and gives and
The same exchangeability calculation gives the variance of the partition average. Indeed, Thus, for , Also, since each coordinate is uniform on ,
Condition on . Under the balanced assignment in Definition 4, and the usual complete-randomization second moments for distinct are Expanding the difference-in-means estimator from Definition 7 with these moments gives and The same complete-randomization calculation for the denominator- within-arm sample variances in Definition 12 yields
Taking expectations in the conditional mean identity and using the partition-average identity above, where the last equality is Definition 7.
By the finite tower variance identity for the two-stage design, Substituting the identities already proved gives Since this is exactly
Taking expectations in the conditional CR2 identity gives
Subtracting the variance identity from the CR2 expectation identity, the common terms cancel and therefore
∎Set Then . Fix a feasible triangular array satisfying the four displayed assumptions, fix the rowwise Johnson projections, and bring into scope the two rowwise hypotheses that these projections give the centered orthogonal Johnson decomposition and that the corresponding Kneser spectrum formula holds. Index rows by , and write for the row population size, for the group count, and for the arm counts, , and . Since , . The feasibility condition gives Together with Assumption 1, this implies . Hence
Define Because and , every row has , and therefore , so the denominator is positive. Also By Assumption 3 and the preceding display, .
For , Definition 5 and Assumption 4 give, for each arm , Put Then More generally, if on , then every Johnson projection satisfies Indeed, writing , orthogonal projection gives so . Applying this with , , and yields Consequently
Let and where is the normalized Kneser eigenvalue from Theorem 1. We claim that, for every row, First suppose . Put , so . For any function on , any finite degree set , any integer threshold such that for all , and any envelope satisfying for all , the spectral-sum estimate is Indeed, from each numerator factor is at most , while each denominator factor is at least ; hence The projection-energy bound proved above gives and the triangle inequality therefore gives the displayed spectral-sum estimate.
Applying this estimate with , , , and gives Using , Now suppose . Since , the same eigenvalue formula gives because . Together with , this yields Using and , Since , .
By Theorem 1, applied to , The degree-one eigenvalue is Splitting off degree one and multiplying by gives Therefore This proves the second displayed limit.
Next fix an arm . Let The preceding bound on implies For all sufficiently large , . Applying Theorem 1 to the centered table and using the degree- spectral bound gives Thus Since Assumption 2 gives , also . Hence This proves the third displayed limit.
It remains to identify the variance limit. The same stable-fraction assumption implies that, eventually, Together with , this yields for all sufficiently large . On those rows, Theorem 2 gives Multiplying by , and using and , gives the eventual identity Both terms on the right tend to zero by the preceding two steps. Therefore which is the first displayed limit.
Finally, the rowwise bound already proved gives because and . Translating the row index back to the theorem’s notation gives the asserted bound for every row and completes the proof.
∎For , set The dense schedule condition in Definition 13 gives , , and hence Consequently and for all sufficiently large . Also, since and , the population size tends to infinity, so eventually.
Let be any deterministic table with for all , where . For in the support of the design in Definition 4, define the arm- selected mean by The selected mean has expectation . Indeed, condition on any realized arm-position set of cardinality . Under Definition 4, each selected group is uniform on , and averaging over the independently chosen arm positions preserves this marginal law.
For the variance, define the centered table and the normalized disjointness operator by for . For all sufficiently large rows, and . Conditional on the arm positions, two distinct selected groups form a uniform ordered disjoint pair, so Expanding the square of the selected average gives
It remains to bound the covariance term. Since , uniform averaging gives , hence and . Applying Theorem 1 to the centered table gives For rows with , the falling-factorial expression for satisfies, for , The first inequality follows by bounding the numerator falling factorial by and the denominator falling factorial by ; the second uses . Because each is an orthogonal projection, Therefore, for all sufficiently large , Since , , and , the displayed variance tends to zero. Chebyshev’s inequality therefore gives
Apply the preceding conclusion first to , using , and then to , using . With we have The sample-variance identity gives, eventually, Because , and the selected means are bounded by , the square map preserves convergence in probability here. Thus
By Definition 12 and Definition 11, eventually. Since , both reciprocal factors are bounded deterministic sequences. Combining this boundedness with the two armwise convergences in the preceding step yields
Define, for every , The first conclusion of Theorem 3 supplies Subtracting this deterministic convergence from the stochastic expansion just proved gives
The scaled-variance nondegeneracy condition in Definition 13 gives eventually. Since , for all sufficiently large , Thus is eventually positive and bounded away from zero.
Set From the first expansion and the eventual lower bound on , Similarly, The deterministic target is eventually bounded. To see this, bounded potential outcomes give , while gives eventually. Hence, eventually, Let The preceding displays give and . Since is eventually bounded away from zero and is eventually bounded, Because on the same eventual rows, this gives
Define For all sufficiently large , , and hence Moreover by the sampling-fraction condition, and because it is a squared norm. Since eventually, eventually.
Fix . On every row for which , The right-hand probability tends to zero because . Therefore
It remains to prove the equivalence. Suppose first that Together with uniqueness of deterministic probability limits gives : indeed, if , the triangle inequality forces at least one of to occur. Since eventually, this yields , namely
Conversely, assume That is, . Since eventually, . Retargeting the already proved convergence to the deterministic limit gives This proves the asserted if and only if.
Since , in particular . We prove the three asserted conclusions in the order in which they are stated.
Sparse dense arrays. Let be a feasible triangular schedule array with common group size , and suppose that in Definition 13 with limiting grouped-unit fraction . Equip each row with the canonical Johnson projections. The canonical decomposition and Kneser-spectrum hypotheses required by Theorem 4 are supplied by Lemmas 3 and 2. Applying Theorem 4 with , its ratio criterion becomes so the criterion converges to . Hence
Birthday counts. Define For , so eventually. For , Since , the floor ratio tends to , while . Therefore For divergence of the squared count, the elementary floor bound gives Eventually , and hence Consequently, for all sufficiently large ,
Birthday-aligned arrays. Let be a feasible triangular schedule array satisfying the rowwise birthday alignment, Assumptions 1, 2, 4, and 5. For row , write for the group count, for the population size, and for the grouped-unit count. From Assumption 1, , and feasibility gives Thus . The alignment condition says and the birthday-count limit from the previous step therefore yields Together with , this is exactly Assumption 3 with limiting grouped-unit fraction . The assumed group-count growth, stable treatment fraction, bounded potential outcomes, and scaled-variance nondegeneracy then place in with by Definition 13. The first step applies and gives
Write for the realized treated-group set, so , and write , so . For a group , define The assumptions and imply , , , , and the real denominators and are nonzero. The two versioned source identities give for the unweighted full-rank least-squares fit (Zeileis et al., 2026), and for the CR2 call with omitted , , and (Pustejovsky, 2026). The stated bread scaling therefore yields
The fitted design has group block where is the -vector of ones. Summing the block cross-products gives Since the determinant is , inversion gives the entries used below:
For every group , the leverage block is Using the preceding inverse entries and the two possible values of , Thus Let . Since , the symmetric positive-definite matrix satisfying is determined by its action on the span of and on its orthogonal complement. For one has The identity , together with positive definiteness, therefore gives Combining these two relations column by column,
Summing the displayed entries down any column gives Consequently The residual-mean condition in the statement says where and on , on . Hence
Define the treatment-coordinate adjusted cluster score by Using , the inverse entries in Step 2, and the residual sum from Step 4 gives the two cases
Because is symmetric, each summand in the CR2 sandwich is a rank-one outer product after premultiplication and postmultiplication by . Indeed, with Therefore and its treatment-coordinate entry is
Squaring the two cases in Step 5 and using gives Equivalently, By Definition 12, the two displayed fractions are and , respectively, and hence
Let By Definitions 17 and 5, The vector has four entries and four entries, so its population mean is zero and its population variance is one. The usual fixed-size sample-mean identity for a uniform two-subset gives Since is identically zero, its centered table is zero, hence
For the treated ordered-disjoint covariance, write the eight-unit population and its two-subset slice as Use ordered pairs There are such ordered pairs. For fixed , each unit in the six-point complement of appears in five two-subsets of that complement, and . Therefore Also , because the six same-positive pairs and six same-negative pairs contribute each and the sixteen mixed pairs contribute . Thus Using , this gives Consequently
Define the arm-difference table Since , , so Set The centered Johnson decomposition assumed in the proposition gives and the two summands are orthogonal. Hence By Theorem 1, instantiated with and , The Kneser eigenvalues are Using , Together with , this linear system gives By Definition 11, , so
It remains to evaluate the design variance and the CR2 expectation. Here By Definition 11, Applying Theorem 2 to the feasible eight-unit design gives Substituting the displayed values, The same result in Theorem 2, now for the statistic in Definition 12, gives Therefore
∎Fix a row and a realized design . Under the independent-sign prior, define the selected sign field Because the realized groups are pairwise disjoint, every observed unit has equal to its realized treatment arm. Hence the observation produced from the independent schedule is exactly the observation produced from the common-sign schedule with signs . For fixed , the vector has the same product Rademacher law as the common-sign vector. Finite Fubini then gives, for every statistic ,
For any deterministic vector , write for . Sampling without replacement gives If , then Under the common-sign prior, and so in probability. Since Assumption 1 implies , and therefore, for each arm ,
The same calculation applies arm by arm under . For each fixed arm , so in probability and
Under , the two arm tables coincide pointwise: By linearity of the Johnson projection, Thus under .
Under , put The arm-difference table is the slice sample mean This function is a linear combination of degree-one inclusion indicators; after subtracting its slice mean, it is orthogonal to constants and lies in . Hence the degree-one projection equals the centered sample mean, and Since while , , and in probability, we get
By Assumption 2, and hence Consequently, for either prior,
Since , every row has , and therefore . The degree-one Kneser eigenvalue in Theorem 1 is Thus . Writing for the grouped-unit count and using Assumption 3,
The exact rowwise variance identity is used on the eventual rows where both treatment arms contain at least two realized groups. These rows are eventual because and : eventually and , forcing , and eventually and , forcing .
On those rows, Theorems 2 and 1 give Combining the convergence statements above yields and
The separation is positive because and : Also Assumption 3 gives , and follows from . Since ,
Finally, if in probability and , then Apply this with . The same-sign limit exceeds the independent-sign limit by , so every lies below both limits. Therefore
Define By Proposition 3, the unconditioned same-sign and independent-arm one-realization mixtures have identical bounded-test expectations, and the scaled exact variances satisfy under their respective Rademacher schedule priors. The same result also gives , hence The hypothesis on gives , and therefore also .
We extract deterministic high-probability supports from these two convergence-in-probability statements. For , let denote the corresponding limit and let for a schedule-prior sign configuration . Since in probability, for each integer choose such that, whenever , Let be the largest with , using when the set is empty, and set Then , so , and These are the supports and .
Every full diagonal selection from either support belongs to . Indeed, for the same-sign prior a selected row has the additive form and for the independent-arm prior it has the additive form Thus . The original design skeleton supplies the group-count, treated-fraction, and sampling-fraction conditions in Definition 13. For any diagonal selection with for every , because the support error is bounded by . Since , this convergence gives Hence all defining conditions of hold for each such diagonal selection.
Since for , both conditioning masses are positive for all sufficiently large . On those rows, let denote expectation under the one-realization mixture obtained by first conditioning on and then applying the random partition and treatment design, and define For the finitely many remaining rows, take ; this totalization convention has no effect on the limiting assertion. For any bounded test , conditioning a finite prior on a set of positive prior probability changes its expectation by at most twice the complement probability: Indeed, writing , the conditioned expectation is and hence This derivation also covers the case , where the unnormalized complement contribution is zero. Applying this bound to the two schedule priors on the eventual-positive rows and using the exact unconditioned equality from Proposition 3 yields The right-hand side tends to , while because the zero test is admissible on the eventual-positive rows and by convention on the remaining rows. Therefore Together with the previous steps, this proves the support, dense-class, conditioned-total-variation, and uniform scaled-variance parts of the diagonal certificate.
It remains to prove the all-statistic lower bound. Put Because , both and are positive. Fix an arbitrary one-realization variance statistic , and define the threshold For all sufficiently large , the supports are nonempty, have positive conditioning probability, and satisfy and . On such rows define the two wrong-decision tests If and then the support bound gives and hence Thus implies relative error greater than . Similarly, if and the relative error is at most , then so implies relative error greater than . The two strict algebraic margins are exactly the displayed choices of and .
Let For each , the preceding implication bounds the same-sign row probability of by the corresponding relative-error probability. That row can be embedded into a full triangular array in : keep the row at index , choose arbitrary support rows for all sufficiently large , and choose arbitrary bounded sign rows at the finitely many remaining indices. The convergence and class argument from Step 3 applies because membership in the supports is eventual. Therefore The identical construction for gives Averaging over the conditioned finite supports uses only positivity of the conditioning masses.
Since pointwise under the independent-arm observation channel, The definition of , applied to , gives Combining the last two displays yields Using Step 6 on both terms, for all sufficiently large .
Finally, , so the left-hand side in the last display converges to . Also : if the set of dense-class risks is nonempty, this is the supremum of probabilities bounded by one, and if it is empty the supremum convention used here gives . Hence Since was arbitrary, the asserted lower bound holds for every measurable one-realization variance statistic.
References
- Jiawei Fu and Cyrus Samii and Ye Wang (2026). Inference for Group Interaction Experiments. . arXiv
- Yuval Filmus (2016). An Orthogonal Basis for Functions over a Slice of the Boolean Hypercube. Electronic Journal of Combinatorics. doi
- Andries E. Brouwer and Sebastian M. Cioab{\u a} and Ferdinand Ihringer and Matt McGinnis (2018). The Smallest Eigenvalues of Hamming Graphs, Johnson Graphs and Other Distance-Regular Graphs with Classical Parameters. Journal of Combinatorial Theory, Series B. arXiv
- Xinran Li and Peng Ding (2017). General Forms of Finite Population Central Limit Theorems with Applications to Causal Inference. Journal of the American Statistical Association. doi
- Esbj{\"o}rn Ohlsson (1989). Asymptotic Normality for Two-Stage Sampling from a Finite Population. Probability Theory and Related Fields. doi
- James E. Pustejovsky and Elizabeth Tipton (2018). Small-Sample Methods for Cluster-Robust Variance Estimation and Hypothesis Testing in Fixed Effects Models. Journal of Business \& Economic Statistics. doi
- Fangzhou Su and Peng Ding (2021). Model-Assisted Analyses of Cluster-Randomized Experiments. Journal of the Royal Statistical Society: Series B. doi
- Christopher Harshaw and Joel A. Middleton and Fredrik S{\"a}vje (2026). Optimized Variance Estimation under Interference and Complex Experimental Designs. Journal of the American Statistical Association. doi
- Guillaume W. Basse and Edoardo M. Airoldi (2018). Limitations of Design-Based Causal Inference and {A/B} Testing under Arbitrary and Network Interference. Sociological Methodology. doi
- Peter M. Aronow and Donald P. Green and Donald K. K. Lee (2014). Sharp Bounds on the Variance in Randomized Experiments. Annals of Statistics. doi
- Guillaume Basse and Peng Ding and Avi Feller and Panos Toulis (2024). Randomization Tests for Peer Effects in Group Formation Experiments. Econometrica. doi
- David Puelz and Guillaume Basse and Avi Feller and Panos Toulis (2022). A Graph-Theoretic Approach to Randomization Tests of Causal Effects under General Interference. Journal of the Royal Statistical Society: Series B. doi
- James E. Pustejovsky (2026). {clubSandwich}: Cluster-Robust (Sandwich) Variance Estimators with Small-Sample Corrections. .
- Achim Zeileis and Thomas Lumley (2026). {sandwich}: Robust Covariance Matrix Estimators. .
- Jerzy Splawa-Neyman and Dorota M. Dabrowska and Terence P. Speed (1990). On the Application of Probability Theory to Agricultural Experiments. Essay on Principles. Section 9. Statistical Science. doi
- Ronald A. Fisher (1935). The Design of Experiments. Oliver and Boyd.
- David R. Cox (1958). Planning of Experiments. John Wiley \& Sons.
- Donald B. Rubin (1974). Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies. Journal of Educational Psychology. doi
- Paul W. Holland (1986). Statistics and Causal Inference. Journal of the American Statistical Association. doi
- William G. Cochran (1977). Sampling Techniques. John Wiley \& Sons.
- Jaroslav H{\'a}jek (1960). Limiting Distributions in Simple Random Sampling from a Finite Population. Publications of the Mathematical Institute of the Hungarian Academy of Sciences.
- Wayne A. Fuller (2009). Sampling Statistics. John Wiley \& Sons. doi
- Philippe Delsarte (1973). An Algebraic Approach to the Association Schemes of Coding Theory. .
- Andries E. Brouwer and Arjeh M. Cohen and Arnold Neumaier (1989). Distance-Regular Graphs. Springer. doi
- Halbert White (1980). A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity. Econometrica. doi
- Kung-Yee Liang and Scott L. Zeger (1986). Longitudinal Data Analysis Using Generalized Linear Models. Biometrika. doi
- Robert M. Bell and Daniel F. McCaffrey (2002). Bias Reduction in Standard Errors for Linear Regression with Multi-Stage Samples. Survey Methodology.
- A. Colin Cameron and Douglas L. Miller (2015). A Practitioner's Guide to Cluster-Robust Inference. Journal of Human Resources. doi
- Alberto Abadie and Susan Athey and Guido W. Imbens and Jeffrey M. Wooldridge (2023). When Should You Adjust Standard Errors for Clustering?. Quarterly Journal of Economics. doi
- Achim Zeileis (2004). Econometric Computing with {HC} and {HAC} Covariance Matrix Estimators. Journal of Statistical Software. doi
- Achim Zeileis (2006). Object-Oriented Computation of Sandwich Estimators. Journal of Statistical Software. doi
- Achim Zeileis and Susanne K{\"o}ll and Nathaniel Graham (2020). Various Versatile Variances: An Object-Oriented Implementation of Clustered Covariances in {R}. Journal of Statistical Software. doi
- Michael E. Sobel (2006). What Do Randomized Studies of Housing Mobility Demonstrate?: Causal Inference in the Face of Interference. Journal of the American Statistical Association. doi
- Michael G. Hudgens and M. Elizabeth Halloran (2008). Toward Causal Inference with Interference. Journal of the American Statistical Association. doi
- Eric J. Tchetgen Tchetgen and Tyler J. VanderWeele (2012). On Causal Inference in the Presence of Interference. Statistical Methods in Medical Research. doi
- Charles F. Manski (2013). Identification of Treatment Response with Social Interactions. Econometrics Journal. doi
- Lan Liu and Michael G. Hudgens (2014). Large Sample Randomization Inference of Causal Effects in the Presence of Interference. Journal of the American Statistical Association. doi
- Peter M. Aronow and Cyrus Samii (2017). Estimating Average Causal Effects under General Interference, with Application to a Social Network Experiment. Annals of Applied Statistics. doi
- Susan Athey and Dean Eckles and Guido W. Imbens (2018). Exact {p}-Values for Network Interference. Journal of the American Statistical Association. doi
- Johan Ugander and Brian Karrer and Lars Backstrom and Jon Kleinberg (2013). Graph Cluster Randomization: Network Exposure to Multiple Universes. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. arXiv
- Dean Eckles and Brian Karrer and Johan Ugander (2017). Design and Analysis of Experiments in Networks: Reducing Bias from Interference. Journal of Causal Inference. doi
- Xinran Li and Peng Ding and Qian Lin and Dawei Yang and Jun S. Liu (2019). Randomization Inference for Peer Effects. Journal of the American Statistical Association. doi
- Hui Xu and Guillaume W. Basse (2021). Randomization Inference for Composite Experiments with Spillovers and Peer Effects. . arXiv
- Ye Wang and Cyrus Samii and Haoge Chang and Peter M. Aronow (2025). Design-Based Inference for Spatial Experiments under Unknown Interference. Annals of Applied Statistics. doi
- Cyrus Samii and Ye Wang and Jonathan Sullivan and Peter M. Aronow (2023). Inference in Spatial Experiments with Interference Using the {SpatialEffect} Package. Journal of Agricultural, Biological and Environmental Statistics. doi
- Mengsi Gao and Peng Ding (2025). Causal Inference in Network Experiments: Regression-Based Analysis and Design-Based Properties. Journal of Econometrics. doi
- Bryan Park and Stefan Wager (2026). Neyman Jackknife: Design-Based Variance Estimation for Causal Inference under Interference. . arXiv
Comments on earlier versions
Anchored to: