Dominique de Roo of De Gruyter Brill on Truth in the Age of AI. Listen to Episode 2 of Upstream by Integra.

Listen Now
Blog Sep 18, 2026 | Peer Review

Peer Review Capacity Is More Than a Reviewer Problem

13

Integra Editorial Author

Peer review is often discussed as if the challenge were simple: there aren’t enough reviewers. Manuscript volumes are rising, research is growing more specialized, and researchers already carry heavy reviewing loads. The pressure on journals is real. But framing this purely as a shortage leads publishers toward solutions that grow the pool without addressing how much of it is actually usable.

A more useful question is how much usable reviewer capacity a journal can reliably bring to a manuscript when expertise is needed. A large database of potential reviewers doesn’t guarantee completed, high-quality reviews. Relevance, independence, availability, willingness to accept an invitation, and the likelihood of finishing the review all determine whether potential capacity becomes usable capacity. This is the central premise of Integra’s Peer Review Capacity Playbook, developed for Peer Review Week 2026 as a practical framework for publishers and editorial teams.

From Reviewer Headcount to Usable Capacity

The distinction becomes clear when you follow a reviewer from discovery to completed review. A candidate may have strong expertise but little relevance to a particular manuscript. Another may be highly relevant but unavailable in the required timeframe. A third may pass initial screening, then decline the invitation. Even after accepting, a reviewer may withdraw or miss the deadline.

These aren’t isolated events — they’re compounding losses. The playbook treats reviewer capacity as a multiplication problem rather than a headcount problem, modeling a path from the potential reviewer pool through relevance, independence, availability, willingness, and completion probability to arrive at usable capacity. It’s a conceptual model, not a forecasting formula, unless the underlying variables are consistently defined and measured.

This reframes the operational question. If most candidates are lost to poor manuscript matching, adding names to a database won’t help much. If nonresponse or late withdrawal is the real bottleneck, improving discovery alone won’t solve it either. Capacity management means identifying where candidates are lost and fixing the cause at that stage.

The Reviewer Funnel Shows Where Capacity Is Lost

The playbook’s reviewer funnel makes this visible. Its illustrative example starts with identified candidates, then narrows through relevance screening, independence and conflict-of-interest checks, availability, invitation acceptance, and on-time completion. In this hypothetical, only 3% of the initial pool results in a completed review. The figure is illustrative, not an industry benchmark — but it shows how fast potential capacity can narrow across a workflow.

The implication: the right intervention isn’t always “find more reviewers.” Editorial teams can instead ask where the biggest losses occur and why. Better manuscript-reviewer matching reduces unsuitable invitations. Earlier conflict-of-interest screening prevents wasted ones. Better timing cuts declines; clearer workflows cut late withdrawals and incomplete reviews. Improving one stage often reduces losses downstream.

Expertise Is Necessary — Fit Determines Usability

Reviewer discovery and reviewer suitability are different problems. Technology makes it easier to find researchers whose profiles look relevant to a manuscript, but finding a name isn’t the same as finding a suitable reviewer.

The playbook names five core factors for assessing a candidate: expertise (can they evaluate the work), relevance (fit with the manuscript), availability (can they deliver within the timeframe), independence (can they assess it impartially), and reliability (a track record of completing reviews on time, to a consistent standard). Methodological fit can be added when relevant.

This matters because a reviewer’s most visible trait isn’t always the most useful one. A highly cited researcher may have limited topical or methodological fit. A well-matched specialist may be unavailable. A reviewer who accepts quickly may still turn in a review that needs heavy editorial rework.

The goal is reviewer suitability — not availability, prestige, or database size.

Reviewer Churn Has a Measurable Cost

Scarcity also carries a less visible operational cost. A decline triggers another search. A nonresponse means another invitation round. A late withdrawal means more screening and outreach. An incomplete review may require editorial intervention or a replacement reviewer. Each event eats into time that could go toward manuscript assessment and decision-making.

This is why turnaround time alone doesn’t tell the full story. A journal that only tracks time-to-acceptance can miss the cost of finding a replacement or securing a usable review. The playbook recommends tracking a broader set of indicators:

Time to completed, usable reviewWhether apparent speed translates into usable editorial input
Reviewer-manuscript fitWhether selected reviewers are appropriate for the work
Rework rateHow often reviews need additional review or editorial intervention
Replacement rateHow often selected reviewers are lost mid-process
Reviewer-pool healthWhether the operation is becoming dependent on a narrow group

These shift the focus from individual transaction speed to the performance of the reviewer operation as a whole.

Speed and Quality Aren’t Opposing Objectives

This distinction also reshapes how journals should think about speed. Pressure to shorten time-to-first-decision can make reviewer response speed an attractive metric — but optimizing for speed alone creates a false economy. A reviewer who responds fast but fits poorly may deliver a review that arrives promptly yet needs heavy interpretation, extra review, or replacement.

A better approach is improving the conditions that support speed and quality together. Better matching reduces unsuitable invitations, improves acceptance rates, and increases the odds that a completed review is actually useful. The goal isn’t choosing between speed and quality — it’s designing a process where both improve in tandem.

Technology Can Expand Capacity Without Replacing Judgment

Technology has a real role here, but it needs clear boundaries. The playbook separates what can be automated or technology-assisted from what requires contextual editorial judgment.

Technology can support candidate discovery, profile enrichment, signal detection, workflow coordination, analytics, and reporting. It can flag potential conflicts of interest, shared institutional affiliations, or prior coauthorship — improving the efficiency of reviewer selection. But it can’t determine on its own whether a relationship is disqualifying. That stays an editorial judgment.

Automation’s value isn’t removing editorial responsibility — it’s reducing operational overhead so editors can focus on decisions that require context, interpretation, and accountability. The playbook draws a clear line: automation expands the pool and surfaces relevant signals; final suitability and conflict-of-interest calls remain with editors.

This principle extends beyond reviewer selection. Publishers should judge technology not just by what it can do, but by whether it improves the overall decision process while preserving human accountability.

A Resilient Reviewer Pool Isn’t Necessarily a Large One

Capacity also needs to be assessed at the pool level. A journal can have plenty of reviewers and still be vulnerable if too much of its workload concentrates in a small number of individuals, institutions, or regions.

The playbook’s Reviewer Pool Resilience Matrix maps two dimensions: pool breadth and workload concentration. A broad pool with low concentration is the resilient state; other combinations create vulnerability or bottlenecks. Notably, the matrix treats resilience separately from fit — relevance and availability should be tracked alongside it, not folded into its two dimensions.

That has strategic implications. Publishers need to know where their reviewer base is concentrated, where expertise runs thin, and where dependence on a small group of highly active reviewers creates a point of failure. Building a broader, better-matched reviewer base is a capacity strategy — not just a recruitment exercise.

Different Journals Need Different Operating Models

Journals organize reviewer operations differently. Some manage discovery and invitations directly through editors; others use technology-assisted workflows, hybrid arrangements, or managed operational support. The playbook describes four models and is clear that they aren’t stages every journal must progress through — the right approach depends on submission volume, specialization, and available editorial resources.

What matters isn’t whether a journal uses operational support, but how responsibilities are divided. A managed model, for instance, can handle discovery, assessment, and invitation logistics while leaving final decision authority with the editorial team. The goal is removing operational bottlenecks without transferring editorial accountability.

For publishers weighing changes to reviewer operations, the relevant question isn’t which model is universally best — it’s which model delivers the capacity the journal needs while preserving the quality, independence, and accountability scholarly assessment requires.

Diagnose Before Redesigning

Before investing in a major overhaul of reviewer operations, editorial teams should pin down where capacity is actually being lost. The answer differs across journals, disciplines, manuscript types, and volume levels.

The playbook offers two diagnostic tools. The Reviewer Selection Scorecard gives a structured way to assess a candidate across expertise, manuscript relevance, methodological fit, availability, independence, and reliability. The Reviewer Pool Health Check takes a broader operational view — asking whether teams can catch conflicts before invitation, distinguish unavailability from poor fit, monitor concentration, measure time to a completed usable review, and scale discovery during high-volume periods. Both are self-assessment frameworks, not industry benchmarks.

That distinction matters: no universal score determines whether a reviewer suits every manuscript, just as no single metric determines whether a reviewer operation is healthy. These tools are diagnostic — they help teams surface assumptions, bottlenecks, and dependencies so they know where to intervene.

From Reviewer Shortage to Capacity Strategy

The playbook’s five principles sum up the approach: measure usable capacity, not pool size; optimize the entire reviewer journey; treat relevance and independence as capacity factors in their own right; use technology to remove friction without removing accountability; and build breadth before capacity becomes a crisis.

This reframing moves the conversation past the familiar “reviewer crisis” narrative. It treats peer review as an operational system in which expertise must be identified, matched, assessed, invited, activated, and sustained — giving publishers a more precise basis for deciding where process redesign, technology, or added capacity will make the biggest difference.

The Peer Review Capacity Playbook goes deeper into the frameworks covered here, including the Reviewer Capacity Equation, Reviewer Funnel, Reviewer Selection Framework, Reviewer Friction Map, Reviewer Pool Resilience Matrix, operating models, and self-assessment tools. We built it as a practical resource for publishers and editorial teams who want to examine their own reviewer operations, pinpoint where capacity is being lost, and decide what to do about it.

For editorial teams facing rising submissions, increasingly specialized research, and constant pressure for timely decisions, the more useful question may not be how to find more reviewers — but how to make the capacity they already have usable, reliable, and sustainable.


Recent Blogs

Where AI Ends and Editorial Judgment Begins: A Practical Map for the Journal Workflow
Artificial intelligence

Where AI Ends and Editorial Judgment Begins: A Practical Map for the Journal Workflow

AI Readiness in Education Cleared One Bar. Agentic AI Has Raised Another. 
AI in Education

AI Readiness in Education Cleared One Bar. Agentic AI Has Raised Another. 

Safeguarding Research Integrity in the Age of AI: Why Technology, Editorial Expertise, and Governance Must Work Together
Research Integrity

Safeguarding Research Integrity in the Age of AI: Why Technology, Editorial Expertise, and Governance Must Work Together

Want to
Know More?