CausalSmith — CSWP-2026-019 · ← back to the paper · arXiv · GitHub

AI referee report

on “Sharp Ordinal Benefit Bounds for Survivor Compliers under Selection and Noncompliance”

Overall score 6.3/10 13 findings — 5 major · 7 minor · 1 nit

The paper contains a strong verified identification and computation result, but its publication case requires a more self-contained model presentation, reproducible algorithm description, sharper competitor comparison, and clearer positioning of the highly conservative inference result.

The paper may have been revised since this report. One automated referee’s estimate — not peer review. Produced by a single automated referee in the pipeline's review stage. It can be wrong, and it is not peer review.

Summary

The paper characterizes sharp bounds for an ordinal strict-benefit probability among survivor compliers by reducing the observed IV-selection model to cellwise exact-mass partial transport. It supplies closed-form threshold cuts, endpoint-attaining latent laws, a linear-time sparse coupling routine, a fixed-law directional limit, and a finite-sample uniform guard. The mathematical core is substantial and coherent, while the current manuscript remains too formalization-driven and underspecified at several central operational points for publication in its present form.

Strengths

Findings

major Setup and assumptions

The central observable object is not defined operationally in the main text. The definition says that ell_i(x) and h_j(x) are "obtained from the corresponding conditional instrument contrasts," but the actual four conditional probabilities and their signs appear only deep in the proof. A reader therefore cannot reconstruct the capacity vector, check its observable implications, or implement the estimator from the definition that every subsequent theorem invokes.

Suggested fix

Insert the explicit formulas for both contrasts directly into the observable-capacities definition, including the zero-denominator convention, and immediately explain which observed cells enter each term. State there that nonnegativity is an implication of the maintained model rather than part of an unrestricted observed law.

major Related work

The dedicated literature section identifies the relevant strands but gives the closest competing IV ordinal-benefit result, Gabriel–Sachs–Jensen, only a brief descriptive mention. It likewise summarizes Dong–Heiler without comparing their identified objects, observable inputs, sharpness arguments, and inferential conditions theorem by theorem. Because existing work already supplies response-function IV bounds for finite ordinal outcomes and selected-complier distributional bounds, the current prose leaves the incremental novelty insufficiently adjudicated.

Suggested fix

Add a precise comparison—preferably a compact table or focused subsection—covering the target stratum, outcome scale, selection mechanism, instrument assumptions, marginal information, sharpness notion, computational form, and inference delivered by this paper versus Gabriel–Sachs–Jensen, Dong–Heiler, Kennedy–Harris–Keele, Possebom–Riva, and de Aguas et al. Explain whether any existing model nests the present model or vice versa, and identify exactly which unequal-mass transport result is new.

major global

The manuscript is organized around a large inventory of theorem-interface objects rather than the economic argument. Separate definitions of each potential variable are followed by a second system definition; threshold aggregates are defined after their first complete definition; cost objects repeat the algorithm; and the guard-event prose is followed by a formal definition saying only "all guard-event indices." This repetition obscures the short conceptual chain from observed IV contrasts to capacities, transport, sharp bounds, and inference.

Suggested fix

Rebuild the main text around that conceptual chain. Consolidate the potential variables and identifying assumptions into one setup subsection, retain only the economically central definitions and theorems in the body, and move presentation-level restatements, operation-accounting objects, multiplier bookkeeping, and verification-interface material to a technical appendix.

major Computation and witness

The claimed linear-time algorithm is supported by the verified theorem, but the displayed construction is not reproducible as an algorithmic specification. Phrases such as "construct a maximum subflow" and "allocate the residual mass" omit the ordering, tie rules, pointer updates, stopping conditions, and residual invariants that later carry the complexity and optimality argument.

Suggested fix

Provide explicit pseudocode for the lower and upper passes, including initialization, scan direction, eligibility tests, tie handling, pointer advancement, residual completion, and emitted trace format. Work the three-level example through both extremal allocation traces and connect every charged operation class to a pseudocode line.

major Estimation and guarded inference

The finite-sample guard is mathematically valid, but its headline placement gives it similar prominence to the sharp identification theorem even though the paper's own calculation shows that the reported set remains [0,1] at remotely realistic sample sizes in the smallest model configuration. The practically informative inferential result presently delivered is the fixed-law directional limit, while the face-aware multiplier object is diagnostic and the uniform guard is best interpreted as an existence or fallback guarantee.

Suggested fix

Align the abstract, introduction, and inference-section opening with this evidentiary hierarchy: foreground the fixed-law limit, describe the deterministic guard explicitly as a conservative finite-sample fallback, and reserve practical confidence-set language for a calibrated procedure supported by additional theory and numerical evidence.

minor abstract

The sentence "The same construction gives sparse endpoint witnesses computable in O(|X|K) operations" is ambiguous after the preceding claim about endpoint-attaining full latent laws. The verified sparsity bound applies to the cellwise coupling traces, while the full latent-law witnesses have no stated global sparsity bound.

Suggested fix

Replace "sparse endpoint witnesses" with "sparse endpoint-attaining coupling traces" or "sparse cellwise coupling certificates," while keeping the separate full-law attainment claim intact.

minor Limitations and future work

The displayed Direction margin assumption states only |Delta q(x)| >= kappa_sigma; strict positivity of kappa_sigma appears afterward in prose. As the manuscript itself observes, the displayed condition becomes vacuous for a nonpositive margin, so the formal environment does not contain the condition attributed to it.

Suggested fix

State "Fix kappa_sigma > 0" inside or immediately before the assumption environment and define the direction-margin condition under that domain. Keep clear that this condition belongs solely to the proposed future calibration problem.

minor Setup and assumptions

The slate-benefit system definition writes the observed element as O=(X,Z,D,S,SY), whereas the earlier observed-law definition and the formal observed-data type use a missing-value outcome tilde Y. Multiplication by S ordinarily zero-codes an unselected outcome and is not equivalent to an explicit missing marker when zero is an outcome level.

Suggested fix

Use O=(X,Z,D,S,tilde Y) consistently throughout and reserve SY only if a separately defined zero-coded representation is genuinely needed.

minor Limitations and future work

The sentence describing C_{1-alpha,n} as "the guarded interval constructed from the finite face diagnostic" conflicts with the earlier and verified construction: the interval is determined by the plug-in endpoints and deterministic padding, while the multiplier face envelope is reported separately and has no role in coverage.

Suggested fix

Write that the guarded interval is reported alongside the finite face diagnostic. Make the same distinction wherever xi or the multiplier process is described as being "used by" the guarded interval.

minor Estimation and guarded inference

The projection step is presented mainly as estimator construction, while its model-diagnostic meaning receives little attention. At the population law, capacity nonnegativity is an observable implication of the maintained IV and monotonicity restrictions; in samples, coordinatewise projection can conceal sizable raw violations.

Suggested fix

Explain the distinction between sampling-induced negative contrasts and evidence against the maintained model. Recommend reporting raw contrasts and projection distances, and state explicitly that the consistency and coverage results are indexed by correctly specified structural laws.

minor Sharp benefit bounds

The partial-transport characterization is cited chiefly to a general optimal-transport reference, although the available literature includes work specifically on partial transport and mass-constrained couplings. The current citation support is broader than the precise mathematical device being invoked.

Suggested fix

Add and discuss an appropriate partial-transport reference, such as Caffarelli–McCann, and distinguish the paper's finite capacity-constrained formulation from classical complete-mass optimal transport.

minor Estimation and guarded inference

Sample indexing alternates between O_1,...,O_n and sums over r=0,...,n-1. The empirical-cell and empirical-frequency definitions therefore use a convention different from the sampling assumption, multiplier process, and surrounding prose.

Suggested fix

Adopt one indexing convention throughout the manuscript and update every empirical sum, multiplier sum, and sample declaration consistently.

nit Sharp benefit bounds

The title "No-selection reduction" carries an unexplained asterisk even though the theorem-local formalization-scope footnote already records the published input.

Suggested fix

Remove the asterisk or define its meaning consistently in a general notation note.

Questions for the authors

Review history

Round Date Score Findings
1 — 6.2 12
2 — 6.2 10
3 — 6.3 11
4 · current — 6.3 13

Every referee draw is kept: scores are noisy, so the history is shown rather than only the last or the best pass.