CausalSmith — CSWP-2026-017 · ← back to the paper · arXiv · GitHub

AI referee report

on “Random Group Formation and the Equal-group CR2 Variance in Finite Populations”

Overall score 6.8/10 10 findings — 4 major · 5 minor · 1 nit

The paper delivers a potentially important and formally verified variance characterization, phase frontier, software identity, and impossibility result, but central notation and theorem presentation require substantial repair before the contribution is journal-ready.

The paper may have been revised since this report. One automated referee’s estimate — not peer review. Produced by a single automated referee in the pipeline's review stage. It can be wrong, and it is not peer review.

Summary

The submission characterizes exact and asymptotic variance under homogeneous random group formation using Johnson–Kneser geometry, identifies the probability target of equal-group CR2, and establishes a positive-density one-realization lower bound. The verified results are strong and the manuscript generally represents their scope faithfully. Publication nevertheless requires clearer reader-facing corollaries, consistent population indexing, an explicit probability space for the lower bound, and a more precise verification-scope statement.

Strengths

Findings

major Dense and sparse variance behavior

The principal asymptotic theorems repeatedly present the Johnson decomposition and Kneser spectrum as long theorem hypotheses even though the manuscript later proves that the canonical projections satisfy them automatically. This obscures the substantive assumptions and makes the main contribution appear conditional on reader-supplied spectral structure.

Suggested fix

Retain the gate-form verified results in the appendix, but add machine-checked corollaries for the canonical Johnson projections whose hypotheses contain only feasibility, group growth, stable treatment fraction, sampling fraction, boundedness, and—where needed—the scaled-variance floor. Use those corollaries as the main-text phase-frontier and sparse results.

major Setup and assumptions

The population labeling is internally inconsistent. The feasible schedule definition uses units in {0,…,n_r−1}, while the random-partition, slice, and Johnson definitions use {1,…,n}. As written, the schedule domain and the groups in Ω_{n,M} are not literally the same finite set.

Suggested fix

Choose one labeling convention globally and rewrite every occurrence of the unit universe, membership subtype, and Ω_{n,M} accordingly. A brief statement that all finite populations are identified with [n] would eliminate the mismatch.

major One-realization lower bound

The central mixture display writes E_{H_n}E_{Z_n}{φ(O_n)} even though O_n also contains the random group tuple A_n. The lower-bound theorem then writes a supremum over Y in C_dense while its construction begins from a fixed design skeleton A; the domain of the statistic and the quantities held fixed in this supremum are therefore unclear to the reader.

Suggested fix

Define one joint design expectation that explicitly integrates over both the random group tuple and treatment allocation, and use it throughout the mixture argument. State whether the minimax supremum ranges over schedules compatible with the fixed population/group-count skeleton or over complete arrays with varying skeletons, and define the statistic family on that exact observation space.

major Proofs and auxiliary lemmas

The verification note states, “Every theorem, proposition, and assumption displayed in this paper … is machine-checked … with no unproved hypotheses.” Assumptions are formalized conditions rather than established facts, and the software proposition depends on two externally sourced implementation contracts. The later qualifications improve the account but leave the opening sentence materially overbroad.

Suggested fix

State that the internal Lean declarations and derivations are sorry-free, that displayed assumptions are formally encoded, and that the software identity is verified conditional on the two versioned source contracts identified in its formalization-scope footnote.

minor global

The manuscript repeatedly calls a fixed-count complete assignment “balanced,” including designs with p converging to any interior value rather than one half. This can be read as equal allocation, which is imposed only in the eight-unit witness.

Suggested fix

Use “complete fixed-count group assignment” or “fixed-arm-count assignment” in the general theory, reserving “balanced” for G_{1n}=G_{0n}.

minor Software identity and finite witness

The displayed definition of the eight-unit witness introduces only a “balanced sign vector” and supplies its actual coordinates several paragraphs later, after discussion of the software proposition. The formal object is therefore incomplete at its point of definition for a reader.

Suggested fix

Put a_i=+1 for i≤4 and a_i=−1 for i≥5 directly inside the witness definition, and place the definition immediately before the witness proposition.

minor Related work

The sentence “its subject is the variance object itself … and Section … records what a complete inference theory would still require” frames the comparison partly through an absent inferential deliverable outside the designated limitations subsection. The later phrase “quantify the resulting gap rather than repairing the adjustment” uses the same contrastive framing.

Suggested fix

Describe the delivered scope affirmatively—for example, exact variance characterization, CR2 probability limits, and the variance-ratio frontier—and keep discussion of Gaussian approximation and studentized inference in the existing Limitations and future work subsection.

minor abstract

The lower-bound formula first uses p in 1/[Mp(1−p)]−2ρ/M without identifying it in plain words, contrary to the first-use gloss rule. The sentence also makes the fixed treatment-fraction parameter less visible than M, ρ, B, and c_σ.

Suggested fix

Introduce p as the limiting treated-group fraction when it first appears and list it among the fixed lower-bound parameters.

minor Related work

The closest-comparator discussion gives the locator as prose—“their Section 3 and Theorems 1–2”—rather than attaching it to the citation command, weakening precise source attribution.

Suggested fix

Use a locator-bearing citation such as FuSamiiWang2026 (Section 3, Theorems 1–2) and apply the same convention to other theorem-level external comparisons.

nit Proofs and auxiliary lemmas

The appendix begins with an unnumbered “Appendices” heading immediately followed by the numbered section “Proofs and auxiliary lemmas,” and it repeats the slice, norm, and Johnson–Kneser apparatus already defined in the setup.

Suggested fix

Remove the redundant heading and consolidate repeated definitions into a short notation recap that points back to the setup.

Questions for the authors

Review history

Round Date Score Findings
1 — 6.5 12
2 — 6.8 11
3 · current — 6.8 10

Every referee draw is kept: scores are noisy, so the history is shown rather than only the last or the best pass.