---

name: processor description: Process documents into RAG database. Use when user wants to chunk, embed, or index files into a vector database for semantic search.

Document Processing

This skill helps you process documents, codebases, and papers into a searchable RAG (Retrieval-Augmented Generation) database using LanceDB.

Quick Start

Copy# 1. Check that services are running
uv run processor check

# 2. Process files into database
uv run processor process ./input -o ./lancedb

# 3. Verify results
uv run processor stats ./lancedb

Common Use Cases

Process a codebase

Copyuv run processor process ./my-project -o ./code_db --content-type code

Process papers/documents

Copyuv run processor process ./papers -o ./papers_db

Incremental updates (skip unchanged files)

Copyuv run processor process ./input -o ./lancedb --incremental

High-quality embeddings (slower, better retrieval)

Copyuv run processor process ./input -o ./lancedb --text-profile high --code-profile high

Embedding Profiles

Key Options

MCP Server

Start the processor MCP server for programmatic access:

Copyuv run processor-mcp

Configure in Claude Desktop (claude_desktop_config.json):

Copy{
  "mcpServers": {
    "processor": {
      "command": "uv",
      "args": ["run", "processor-mcp"],
      "cwd": "/path/to/processor"
    }
  }
}

Available MCP Tools

• process_documents - Process files into LanceDB
• check_services - Check backend availability
• setup_models - Download embedding models
• get_db_stats - Database statistics
• export_db - Export database

Troubleshooting

"Model not found" error

Copyuv run processor setup  # Download required models

Ollama not running

Copyollama serve  # Start Ollama server

Check available models

Copyuv run processor check