---

name: evaluate description: FABER Phase 4 - Tests and reviews implementation, looping back to build phase if issues found model: claude-opus-4-5

Evaluate Skill

You receive full workflow context including Frame, Architect, and Build results.

<CRITICAL_RULES>

1. Comprehensive Testing - ALWAYS run all available tests
2. GO/NO-GO Decision - ALWAYS return clear decision with reasoning
3. Failure Details - ALWAYS document specific failure reasons for retries
4. Context Awareness - ALWAYS consider retry count and previous attempts
5. Quality Standards - NEVER approve code that fails tests or has critical issues </CRITICAL_RULES>

Context Provided:

Copy{
  "work_id": "abc12345",
  "retry_count": 0,
  "frame": {"work_item_title": "...", "branch_name": "..."},
  "architect": {"spec_file": "...", "key_decisions": [...]},
  "build": {"commits": [...], "files_changed": [...], "attempts": 1}
}

See workflow/basic.md for detailed steps.

See: plugins/faber/docs/RESPONSE-FORMAT.md for complete specification.

GO Decision (Success):

Copy{
  "status": "success",
  "message": "Evaluate phase completed - all tests pass, ready for release",
  "details": {
    "phase": "evaluate",
    "decision": "go",
    "test_results": {"total": 42, "passed": 42, "failed": 0},
    "review_results": {"issues": 0, "warnings": 0}
  }
}

NO-GO Decision (Warning - triggers retry):

Copy{
  "status": "warning",
  "message": "Evaluate phase completed - issues found, returning to build",
  "details": {
    "phase": "evaluate",
    "decision": "no-go",
    "test_results": {"total": 42, "passed": 40, "failed": 2},
    "review_results": {"issues": 3, "warnings": 5}
  },
  "warnings": [
    "test_auth_login: AssertionError on line 45",
    "test_export_csv: TimeoutError after 30s",
    "Linting: unused variable in utils.py"
  ],
  "warning_analysis": "Two tests are failing due to authentication changes, and there are code quality issues to address",
  "suggested_fixes": [
    "Update test_auth_login to use new auth flow",
    "Increase timeout for test_export_csv",
    "Remove unused variable in utils.py:23"
  ]
}

Failure Response (evaluation itself failed):

Copy{
  "status": "failure",
  "message": "Evaluate phase failed - could not run tests",
  "details": {
    "phase": "evaluate"
  },
  "errors": [
    "Test framework not found: pytest",
    "Database connection failed during test setup"
  ],
  "error_analysis": "The test suite could not be executed due to missing dependencies and infrastructure issues",
  "suggested_fixes": [
    "Run 'pip install pytest' to install test framework",
    "Check database connection string in test config"
  ]
}

This Evaluate skill tests implementations and makes GO/NO-GO decisions that control workflow progression.