Paradigm Journal All articles
Research Methodology

The Unpaid Ledger: When Reviewing Manuscripts Costs More Than It Earns

Paradigm Journal
The Unpaid Ledger: When Reviewing Manuscripts Costs More Than It Earns

Photo: Ciências_sociais.png: *Nuvola_apps_edu_miscellaneous.svg: David Vignoni, traced User:Stannered Nuvola_apps_edu_languages.svg: Traced by User:Stannered, original by David Vignoni Nuvola_apps_kuser.svg: David Vignoni, User:Stannered derivative work:

A Contribution Science Cannot See

Every published paper in an American journal rests on hours of unpaid, unrecorded labor. A mid-career reviewer at a research university may spend sixty to eighty hours a year evaluating manuscripts — reading methods sections line by line, checking statistical claims, drafting constructive critiques. None of it appears on a CV in any form a hiring committee can weigh. It is, in effect, a shadow economy of expertise: essential to the system, worthless on paper.

The paradox deserves a name. Call it the reviewer's discount — the widening gap between what peer review contributes to science and what it contributes to the person performing it.

What Hiring Committees Actually Count

Surveys of tenure and promotion criteria across US research universities reveal a consistent pattern. Teaching hours are logged. Grants are tallied to the dollar. Publication counts are parsed by journal impact factor. Reviewer service, when it appears at all, is relegated to a single line under "service to the profession" — the least weighted category in virtually every evaluation rubric.

The consequences compound early. An assistant professor deciding how to spend a finite Saturday faces a rational calculus: one more manuscript review or one more section of a grant proposal? The proposal determines renewal. The review determines nothing measurable. Early-career scientists interviewed for this piece described declining review invitations from top journals precisely because the time cost could not be justified against promotion timelines — a quiet form of triage that siphons review labor away from the venues that need it most.

The Incentive Gap in Numbers

The arithmetic is stark. A typical review for a major society journal takes four to eight hours. At the median postdoctoral salary in the United States, that represents several hundred dollars of institutional time donated, per manuscript, per reviewer. Multiply across the hundreds of thousands of manuscripts processed annually by American journals and the donated labor reaches into the hundreds of millions of dollars — a subsidy the research enterprise extends to itself, invisibly.

Meanwhile, the reviewer receives, at best, a thank-you email and a line in an annual acknowledgments list that almost no evaluation committee reads.

Could Reviewing Be Quantified?

A growing chorus argues the fix is procedural rather than cultural: make review contributions countable. Proposals circulate around several mechanisms.

First, verified review records. Platforms such as Publons (now folded into Web of Science) demonstrated that reviewers can accumulate documented credits. Adoption remains voluntary and, crucially, disconnected from promotion rubrics.

Second, institutional weighting. A handful of US medical schools have begun allowing documented peer review service to count toward promotion dossiers under community service or scholarship categories. The practice is rare, inconsistent, and largely unknown to junior faculty.

Third, funder recognition. Federal agencies could, in principle, treat sustained reviewer service as a proxy for scientific judgment — a signal of standing in a field that no self-citation can manufacture.

The Objections

Skeptics raise legitimate concerns. Quantify review volume, they warn, and you invite the same metric-chasing that has distorted publication counts: rapid, shallow reviews produced in bulk to pad a dossier. Quality of critique is notoriously difficult to assess without reproducing the very gatekeeping problem peer review exists to solve.

There is also a fairness question in reverse. If review service becomes a currency, those with heavier teaching loads or caregiving responsibilities may fall further behind — trading one inequity for another.

Yet the status quo carries its own inequity. Review labor currently flows disproportionately from those who can least afford it: early-career scientists and faculty at teaching-intensive institutions, who accept invitations to build professional standing that the system never pays out.

A Modest Proposal

The most defensible reform is not a full accounting regime but a minimum standard of visibility. Journals should issue verifiable review records as a default. Departments should require — and weigh — those records in promotion dossiers, even at modest weight. Funding agencies should ask applicants to disclose reviewer service, not as a scored criterion but as context for scientific judgment.

None of this requires new money. It requires the research community to admit that a system it describes as foundational has been treating its foundation as free. Science already trusts peer review with its most important decisions. It is time to trust the record of that work with a place on the résumé.

All Articles

Related Articles

Behind the Desk: What Editorial Decision Files Reveal About Who Gets Published

Behind the Desk: What Editorial Decision Files Reveal About Who Gets Published

Authorship by Position: Mapping the Unwritten Hierarchy Behind Bylines

Authorship by Position: Mapping the Unwritten Hierarchy Behind Bylines

Friction as a Filter: The Journals Asking Scientists to Pick Up a Pen Again

Friction as a Filter: The Journals Asking Scientists to Pick Up a Pen Again