Back to list
CalvHobbes

architecture-review

by CalvHobbes

Learning RAG for Production

0🍴 0📅 Jan 23, 2026

SKILL.md


name: architecture-review description: Review an existing Python RAG codebase against an explicit RAG architecture document and produce a production-readiness backlog with priorities, rationale, and execution guidance.

Architecture Review Skill

Goal

Produce a production-grade architecture review document for a non-trivial Python RAG system.

The output must be a prioritised, implementation-ready task backlog that a senior engineering team can directly execute to harden the system for production.

The review must explicitly evaluate:

  1. The current implementation
  2. The stated architecture document (RAG_ARCHITECTURE.md)
  3. Known, explicitly deferred architectural areas

When to Use This Skill

Use this skill when the user asks to:

  • Review a RAG or LLM system for production readiness
  • Audit architecture compliance
  • Identify gaps, risks, or missing safeguards
  • Produce a structured backlog for engineering execution

Instructions

  1. Assume the system is non-trivial and already deployed in at least one environment.
  2. Assume the audience is senior engineers.
  3. Evaluate the codebase against:
    • Production engineering standards
    • The architecture document
    • Explicit architectural constraints (including deferred areas)
  4. Produce one table per category, in the exact order specified below.
  5. Each task must be concrete, opinionated, and actionable.
  6. Do not explain code line-by-line.
  7. Focus on what must be done, not how the system generally works.

Categories

(Create EXACTLY one table per category, in this order)

  1. Architecture & System Design
  2. RAG Pipeline (Ingestion, Retrieval, Reranking, Generation)
  3. Prompting & Grounding Controls
  4. Code Quality & Python Practices
  5. Observability & Operations
  6. Evaluation & Quality Measurement
  7. Security, Privacy & Data Risks
  8. Performance, Latency & Cost
  9. Testing Strategy

Table Format (MANDATORY)

Each table must contain EXACTLY the following columns, in this order:

Score

Total Score

50/100

Based on repository quality metrics

SKILL.md

SKILL.mdファイルが含まれている

+20
LICENSE

ライセンスが設定されている

0/10
説明文

100文字以上の説明がある

0/10
人気

GitHub Stars 100以上

0/15
最近の活動

3ヶ月以内に更新がある

0/10
フォーク

10回以上フォークされている

0/5
Issue管理

オープンIssueが50未満

+5
言語

プログラミング言語が設定されている

+5
タグ

1つ以上のタグが設定されている

0/5

Reviews

💬

Reviews coming soon