← Back to list
name: evidence-auditor
description: |
Audit the evidence supporting each claim and write gaps/concerns into

evidence-auditor
by WILLOSCAR
Research pipelines as semantic execution units: each skill declares inputs/outputs, acceptance criteria, and guardrails. Evidence-first methodology prevents hollow writing through structured intermediate artifacts.
⭐ 83🍴 10📅 Jan 24, 2026
SKILL.md
name: evidence-auditor
description: |
Audit the evidence supporting each claim and write gaps/concerns into output/MISSING_EVIDENCE.md.
Trigger: evidence audit, missing evidence, unsupported claims, 审稿证据审计, 证据缺口.
Use when: peer review 流程中,需要逐条检查 claim 的证据链、缺 baseline、评测薄弱点。
Skip if: 缺少 claims 输入(例如还没有 output/CLAIMS.md)。
Network: none.
Guardrail: 只写“缺口/风险/下一步验证”,不要替作者补写论述或引入新主张。
Evidence Auditor (peer review)
Goal: for each claim, either (a) point to the supporting evidence in the manuscript, or (b) write a concrete gap with an actionable fix.
Inputs
output/CLAIMS.md
Outputs
output/MISSING_EVIDENCE.md
Output format (recommended)
For each claim:
Claim: copy the claim textEvidence present: what the paper provides (experiments/theory/citations)Gap / concern: what is missing or weakMinimal fix: the smallest additional evidence that would address the gapSeverity:major|minor(optional)
Workflow
- Iterate claims in
output/CLAIMS.md. - For empirical claims, check:
- dataset/task definition is clear
- baselines are appropriate
- evaluation protocol is valid
- ablations/sensitivity analyses exist where needed
- For conceptual claims, check:
- definitions are unambiguous
- assumptions are stated
- claims do not exceed what is argued
- Write
output/MISSING_EVIDENCE.mdas a list of claim-by-claim entries.
Definition of Done
- Every claim from
output/CLAIMS.mdhas an evidence note or a gap item. - “Fix” items are actionable (what to add, not “more experiments”).
Troubleshooting
Issue: you cannot locate the evidence in the paper
Fix:
- Mark the claim as “evidence not locatable” and ask for a clearer source pointer (or re-extract claims with better pointers).
Issue: the audit starts proposing new claims
Fix:
- Stop; only critique what exists in
output/CLAIMS.mdand the manuscript.
Score
Total Score
70/100
Based on repository quality metrics
✓SKILL.md
SKILL.mdファイルが含まれている
+20
○LICENSE
ライセンスが設定されている
0/10
✓説明文
100文字以上の説明がある
+10
○人気
GitHub Stars 100以上
0/15
✓最近の活動
1ヶ月以内に更新
+10
✓フォーク
10回以上フォークされている
+5
✓Issue管理
オープンIssueが50未満
+5
✓言語
プログラミング言語が設定されている
+5
✓タグ
1つ以上のタグが設定されている
+5
Reviews
💬
Reviews coming soon

