# Literature review

A cited review of the open research on one question. It opens every paper it cites and checks for retractions.

Requires web search, through Exa. Requires web fetch.

## Install

```sh
npx @parcha/agentrun template install github:Parcha-ai/agentrun-templates/templates/literature-review@242f29da8317fbe51d0cce4628bdb5ab61d7ccc9 --trust
```

Or open `<your AgentRun address>/#/templates/install?src=github%3AParcha-ai%2Fagentrun-templates%2Ftemplates%2Fliterature-review%40242f29da8317fbe51d0cce4628bdb5ab61d7ccc9`. Pinned to commit 242f29da8317fbe51d0cce4628bdb5ab61d7ccc9.

## What it does

A cited review of the open scholarly evidence on one research question. It searches existing systematic reviews first, then Crossref, Semantic Scholar, PubMed and Europe PMC, arXiv and other open indexes, opens each paper it cites, extracts design, sample size and effect size as published, checks for retractions, flags preprints and industry-funded work, and rates the strength of the evidence per outcome. Where the evidence is thin or missing, it says so. It cites only papers it opened and never invents one.

- Skill `literature-review`: Review the open scholarly evidence on one research question. Break the question into population, exposure, comparison and outcome, search existing systematic reviews first, then open indexes (Crossref, Semantic Scholar, OpenAlex, PubMed, Europe PMC, arXiv, trial registries), open and verify each paper, check retractions, extract design, sample size and effect size as published, count each trial once, rate evidence per outcome in the GRADE style, and write the synthesis, gaps and implications. Use for "literature review on", "what does the research say about", "evidence for", "systematic search".
- Rules: `GRADE.md`, `SOURCES.md`

## What starts it

- By hand, any time: from the console, the API or the CLI.

## Inputs

| Name | Type | Required | What it is |
| --- | --- | --- | --- |
| `question` | string, 10 to 1000 characters | yes | What you want the evidence on. A population, an intervention or exposure, and an outcome, if you can. Example: `Does magnesium supplementation improve sleep quality in adults with insomnia?`. |
| `context` | string, 0 to 400 characters | no | Where the evidence will be used. It weights the review toward the nearest populations and conditions. Blank: written for a general practitioner or researcher. Example: `A workplace wellness program for night-shift nurses.`. |
| `evidence_scope` | string, 0 to 400 characters | no | Hard limits on what counts: years, study designs, populations. Blank: the last 15 years plus seminal work, all designs ranked by rigor. Example: `Randomized trials since 2015, adults only.`. |
| `max_studies` | integer, 5 to 40 | no | How many studies get a row. Existing systematic reviews do not count against it. Default: `15`. |

## What it needs

- Harness: pi, claude-agent, codex
- Model: balanced tier, medium effort
- Tools: read, web_search, web_fetch
- Computer: Wherever your AgentRun puts a new agent
- Keys: A model key
- Learning: off

## Sample output

Input:

```json
{
  "content": "Today is 2026-11-14. Review the evidence on this question.\n\nThe pages below are what these URLs return today for the studies of this (fictional) program; treat them as the only two\npapers found. Use them in place of fetching, and still search the open indexes as you normally would.\n\n<captured-page url=\"https://sleepresearch.example/articles/sleepwell-primary-2023\" captured=\"2026-11-14T15:30:00Z\" untrusted>\n<h1>SleepWell online CBT-I for insomnia: a randomized trial</h1>\n<p>Authors: E. Rask, O. Daniels. Sleep Interventions, 2023. DOI 10.0000/si.2023.0071. Registration SW-2022-014. Public\nfunding. n = 200 adults randomized (100 per arm), 9 weeks. Primary outcome ISI (lower is better): mean difference -5.3\npoints (95% CI -7.2 to -3.4) versus waitlist.</p>\n</captured-page>\n\n<captured-page url=\"https://sleepresearch.example/articles/sleepwell-subgroup-2024\" captured=\"2026-11-14T15:31:00Z\" untrusted>\n<h1>Does age moderate the effect of online CBT-I? A secondary analysis of the SleepWell trial</h1>\n<p>Authors: O. Daniels, E. Rask, H. Tran. Sleep Interventions, 2024. DOI 10.0000/si.2024.0033. Registration SW-2022-014\n(same trial as Rask et al., 2023). Public funding. The same 200 adults. Adults aged 18 to 39 (n = 82): mean difference\n-6.0 points (95% CI -8.9 to -3.1). Adults aged 40 or older (n = 118): -4.8 points (95% CI -7.3 to -2.3). Interaction\np = 0.41.</p>\n</captured-page>",
  "question": "Does the SleepWell online CBT-I program reduce insomnia severity in adults?"
}
```

Output:

#### Bottom line
The supplied fictional trial reports that SleepWell online CBT-I reduced insomnia severity compared with waitlist at nine weeks: mean difference **-5.3 Insomnia Severity Index (ISI) points**, 95% CI **-7.2 to -3.4**, with lower scores favoring SleepWell [P1]. This is evidence from **one randomized trial involving 200 adults**, reported in two papers—not two independent trials. Overall certainty is **low**, principally because the available captures are too brief to assess important safeguards against bias.

#### Search strategy
The review followed three steps: (1) frame the program-specific question and look for existing syntheses; (2) search open indexes and registration records, check bibliographic and retraction information, and link duplicate trial reports; (3) extract the supplied results and assess certainty separately by outcome.

Searches ran on **2026-11-14**, with a default publication scope of 2011–2026. The question concerns adults receiving the specified fictional SleepWell program, compared with waitlist, with insomnia severity as the primary outcome. Other interventions called SleepWell were not treated as evidence about this program.

A Cochrane-targeted web search for `SleepWell CBT-I review` yielded no usable program-specific synthesis. Epistemonikos returned HTTP 403. Europe PMC's broad `SleepWell AND (insomnia OR CBT-I) AND (REVIEW)` query reported 89 hits, but this was a broad retrieval count rather than an eligible-study count; only the returned slice was inspected. Its exact `SW-2022-014` query found zero records. PubMed's `"SleepWell online CBT-I"` query also reported zero records, with a phrase-not-found warning. ClinicalTrials.gov returned no studies for the supplied registration identifier.

Crossref requests for both supplied DOIs returned HTTP 404. Exact-title retraction searches produced no matching notice, but these checks cannot establish the absence of corrections or retractions. Bibliographic details below therefore come from the supplied captured paper pages, not independent index confirmation. The two captures were used in place of fetching their URLs. Both are classified conservatively as **abstract-only**, meaning summary-level access rather than verified full text. No external paper or search snippet was used to supply an effectiveness finding.

#### Key studies
| Report | Design and population | Sample | Finding and published effect | Access and linkage |
|---|---|---:|---|---|
| Rask and Daniels, 2023 [P1] | Randomized trial; adults with insomnia; SleepWell versus waitlist | 200, with 100 per arm | Nine-week ISI mean difference -5.3 points; 95% CI -7.2 to -3.4 | Captured summary only; primary report; public funding reported |
| Daniels, Rask, and Tran, 2024 [P2] | Secondary age analysis of the same randomized trial | Same 200: ages 18–39, n=82; ages ≥40, n=118 | Ages 18–39: mean difference -6.0 points, 95% CI -8.9 to -3.1. Ages ≥40: -4.8 points, 95% CI -7.3 to -2.3. Interaction p=0.41 | Captured summary only; same registration, SW-2022-014; public funding reported |

The unique randomized sample is **200**, not 400. P2 contributes information about possible effect modification but does not replicate P1. Its capture does not explicitly restate the assessment time, outcome instrument, or comparator, so those details are not treated as independently documented for that report.

#### Synthesis
**Reported findings:** The primary estimate favors SleepWell and its confidence interval excludes no between-group difference [P1]. Both age-stratified estimates also favor the intervention, while the reported interaction test is not statistically significant, p=0.41 [P2]. No effects were pooled or recalculated for this review.

**Interpretation:** The evidence supports a short-term average advantage over waitlist in this sample. It does not show how SleepWell compares with another credible treatment. Nor does an average difference identify the probability that an individual participant will respond or achieve remission.

The younger subgroup's estimate is numerically more favorable, but the appropriate reported comparison of treatment effects across age groups is the interaction test—not whether either subgroup separately has a confidence interval excluding zero. The interaction result does **not** establish that younger adults benefit more. Conversely, failure to detect an interaction does **not** demonstrate equivalent effects across ages [P2].

There is no independent-study agreement or disagreement to assess. The overall and subgroup estimates are related results from one sample, and apparent consistency must not be presented as replication.

#### Evidence strength
These are GRADE-style judgments adapted to the unusually limited, fictional source material.

| Outcome | Certainty | Main rationale |
|---|---|---|
| Nine-week insomnia severity versus waitlist | Low | Randomization is reported, but two levels are deducted for unresolved risk-of-bias concerns: concealment, attrition, missing-data handling, and selective reporting cannot be assessed from the capture. The CI, -7.2 to -3.4 points, excludes zero. |
| Age modification of benefit | Very low | Inherits the trial's assessment limitations; interaction precision is unclear because no interaction CI or power information is supplied. |
| Benefit beyond nine weeks | Insufficient | No longer-term results supplied. |
| Adverse effects | Insufficient | No harms results supplied. |
| Effectiveness versus active treatment | Insufficient | No active comparator reported. |

Unreported safeguards are **unknown**, not demonstrated methodological failures. Nevertheless, their absence from the available material materially limits confidence in the result. A single available trial also leaves consistency and publication bias unresolved; neither can be inferred from the existence of two publications.

#### Common measures
P1 identifies ISI as its primary outcome and states that lower scores are better [P1]. No clinically important difference threshold, responder definition, or remission criterion is supplied. Consequently, this review reports the published point difference without attaching an unsupported clinical-importance label or converting it into response rates.

#### Gaps and future directions
The most immediate need is the complete trial report and a verifiable protocol or registration, allowing assessment of allocation procedures, prespecified outcomes, attrition, analysis population, and missing-data methods. Detailed eligibility criteria, baseline severity, recruitment setting, comorbidities, intervention content, and adherence would help assess applicability.

Independent randomized replication would address the lack of corroboration. Active-comparator trials, longer follow-up, and systematic harms reporting would answer questions the waitlist result cannot resolve. Age moderation requires a prespecified interaction analysis with an effect estimate and confidence interval, rather than conclusions based only on separate subgroup significance tests.

Search limitations include the blocked synthesis database, incomplete screening of broad Europe PMC results, unavailable Crossref records, and inability to inspect a matching registry entry. The bibliographic and registration limitations are explicit features of reviewing this fictional evidence set, not proof of misconduct or selective reporting.

#### Implications for the stated context
The evidence supports a cautious statement that SleepWell reduced average insomnia severity relative to waitlist over nine weeks in the supplied trial. It does not establish durable benefit, comparative effectiveness against active treatment, safety, or an age-specific advantage. These conclusions summarize the supplied evidence and are not clinical advice.

## Tested

Passes 5 of 5 eval cases on pi, 4 of 5 on Claude Code and 5 of 5 on Codex. Not yet tried on the live web.

5 eval cases: abstract-only-paywall, injection-in-page, no-literature, retracted-trial, same-trial-twice.

## Source

- Package: https://github.com/Parcha-ai/agentrun-templates/tree/242f29da8317fbe51d0cce4628bdb5ab61d7ccc9/templates/literature-review
- Publisher: Parcha-ai
- Author: Parcha Labs
- Version: 0.1.0
- License: Apache-2.0
- Category: Research
- Page: https://marketplace.agentrun.ai/templates/literature-review/
