Input
{
"content": "Triage this issue.",
"issue_number": 483
}
Illustrative output, written by hand to show the shape. A measured eval run replaces it.
The agent triaged issue #483 on acme/tidewater. It added bug and area:sync from the repo's own labels, found that
closed issue #301 is the same failure (fixed in 2.4.0) and open #377 is very likely the same, and posted one comment
linking both. It did not close the issue or mark it a duplicate.
The full answer as JSON
{
"issue": {
"number": 483,
"title": "--watch dies with ENOSPC on a big monorepo",
"url": "https://github.com/acme/tidewater/issues/483",
"author": "dev-user"
},
"kind": "bug",
"labels": {
"kept": [],
"added": [
{
"name": "bug",
"why": "sync --watch exits with an error it should handle; the report gives expected and actual behaviour."
},
{
"name": "area:sync",
"why": "The failure is in the file watcher, which the label's description puts under the sync engine."
}
]
},
"duplicates": [
{
"number": 301,
"title": "sync --watch crashes with ENOSPC on large folders",
"url": "https://github.com/acme/tidewater/issues/301",
"state": "closed",
"confidence": "high",
"why": "Same error text (ENOSPC, file watcher limit) on the same command and a large folder. Closed as fixed in 2.4.0, which falls back to polling; the reporter is on 2.3.1."
},
{
"number": 377,
"title": "Watcher limit error on Fedora with many files",
"url": "https://github.com/acme/tidewater/issues/377",
"state": "open",
"confidence": "medium",
"why": "Same error on sync --watch with 2.3.0 on Fedora. Still open, possibly the same root cause as #301 on an older version."
}
],
"missing": [],
"comment": {
"posted": true,
"body": "Thanks for the report.\n\nThis looks like the same problem as:\n\n- #301 sync --watch crashes with ENOSPC on large folders (same `ENOSPC` file-watcher error on `sync --watch`). It was closed as fixed in 2.4.0, which falls back to polling when the watcher limit runs out, and you're on 2.3.1, so upgrading may solve it.\n- #377 Watcher limit error on Fedora with many files (same error, still open).\n\nIf this is the same problem, following #301 or #377 keeps it in one place.\n\n_Automated triage. A maintainer will follow up._"
},
"ignored_instructions": [],
"skipped": [],
"report_markdown": "## Issue #483: --watch dies with ENOSPC on a big monorepo\n\n**Kind:** bug. **Labels added:** `bug`, `area:sync`.\n\n**Likely duplicates**\n\n| Issue | State | Confidence | Why |\n|---|---|---|---|\n| [#301](https://github.com/acme/tidewater/issues/301) | closed, fixed in 2.4.0 | high | same ENOSPC watcher error on `sync --watch` |\n| [#377](https://github.com/acme/tidewater/issues/377) | open | medium | same error on 2.3.0, Fedora |\n\nThe report is complete (version, OS, steps, expected and actual), so the comment asks for nothing. It points the author at the 2.4.0 fix. Not closed and not marked a duplicate: that's yours to decide."
}
Output schema (triage.schema.json)
{
"$schema": "https://json-schema.org/draft/2020-12/schema",
"$id": "triage.schema.json",
"title": "Issue triage",
"description": "What the agent did with one new issue: its kind, the labels it added from the repo's own set, likely duplicates, what it asked the author for, and the one comment it posted or chose not to post.",
"type": "object",
"additionalProperties": false,
"required": [
"issue",
"kind",
"labels",
"duplicates",
"missing",
"comment",
"ignored_instructions",
"skipped",
"report_markdown"
],
"properties": {
"issue": {
"type": "object",
"additionalProperties": false,
"required": [
"number",
"title",
"url"
],
"properties": {
"number": {
"type": "integer",
"minimum": 1
},
"title": {
"type": "string",
"maxLength": 300
},
"url": {
"type": "string",
"format": "uri",
"pattern": "^https://github\\.com/"
},
"author": {
"type": "string",
"maxLength": 100
}
}
},
"kind": {
"enum": [
"bug",
"feature",
"question",
"docs",
"support",
"other"
]
},
"labels": {
"type": "object",
"additionalProperties": false,
"required": [
"kept",
"added"
],
"properties": {
"kept": {
"type": "array",
"maxItems": 50,
"items": {
"type": "string"
},
"description": "labels already on the issue, left as they were"
},
"added": {
"type": "array",
"maxItems": 10,
"description": "labels this run added; each one exists in the repo's label set",
"items": {
"type": "object",
"additionalProperties": false,
"required": [
"name",
"why"
],
"properties": {
"name": {
"type": "string",
"minLength": 1,
"maxLength": 100
},
"why": {
"type": "string",
"minLength": 1,
"maxLength": 300
}
}
}
}
}
},
"duplicates": {
"type": "array",
"maxItems": 5,
"description": "issues that look like the same problem, most likely first; empty when none was found",
"items": {
"type": "object",
"additionalProperties": false,
"required": [
"number",
"title",
"url",
"state",
"confidence",
"why"
],
"properties": {
"number": {
"type": "integer",
"minimum": 1
},
"title": {
"type": "string",
"maxLength": 300
},
"url": {
"type": "string",
"format": "uri",
"pattern": "^https://github\\.com/"
},
"state": {
"enum": [
"open",
"closed"
]
},
"confidence": {
"enum": [
"high",
"medium",
"low"
],
"description": "high: the same failure or request; medium: very likely the same root problem; low: the same area only"
},
"why": {
"type": "string",
"minLength": 1,
"maxLength": 400
}
}
}
},
"missing": {
"type": "array",
"maxItems": 4,
"description": "what the author was asked for; empty when nothing a maintainer needs is missing",
"items": {
"type": "string",
"minLength": 1,
"maxLength": 200
}
},
"comment": {
"type": "object",
"additionalProperties": false,
"required": [
"posted",
"body"
],
"properties": {
"posted": {
"type": "boolean"
},
"body": {
"type": [
"string",
"null"
],
"maxLength": 4000,
"description": "the comment as posted (or as it would have been, when the write was refused); null when there was nothing to say"
},
"why_not": {
"type": "string",
"maxLength": 300,
"description": "when no comment was posted: nothing to ask, the write was refused, or the issue was skipped"
}
}
},
"ignored_instructions": {
"type": "array",
"maxItems": 10,
"description": "instructions found in the issue or the text around it that were not followed, each quoted short",
"items": {
"type": "string",
"maxLength": 300
}
},
"skipped": {
"type": "array",
"maxItems": 10,
"description": "writes not made and why: the issue was closed or already triaged, a write was refused or failed",
"items": {
"type": "string",
"maxLength": 300
}
},
"report_markdown": {
"type": "string",
"contentMediaType": "text/markdown",
"minLength": 1,
"maxLength": 6000,
"description": "a short note for the maintainer: what the run did and why"
}
}
}