---

name: "spark-sql-optimizer" description: | Optimize spark sql optimizer operations. Auto-activating skill for Data Pipelines. Triggers on: spark sql optimizer, spark sql optimizer Part of the Data Pipelines skill category. Use when working with spark sql optimizer functionality. Trigger with phrases like "spark sql optimizer", "spark optimizer", "spark". allowed-tools: "Read, Write, Edit, Bash(cmd:*), Grep" version: 1.0.0 license: MIT author: "Jeremy Longshore jeremy@intentsolutions.io"

Spark Sql Optimizer

Overview

This skill provides automated assistance for spark sql optimizer tasks within the Data Pipelines domain.

When to Use

This skill activates automatically when you:

• Mention "spark sql optimizer" in your request
• Ask about spark sql optimizer patterns or best practices
• Need help with data pipeline skills covering etl, data transformation, workflow orchestration, and streaming data processing.

Instructions

1. Provides step-by-step guidance for spark sql optimizer
2. Follows industry best practices and patterns
3. Generates production-ready code and configurations
4. Validates outputs against common standards

Examples

Example: Basic Usage Request: "Help me with spark sql optimizer" Result: Provides step-by-step guidance and generates appropriate configurations

Prerequisites

• Relevant development environment configured
• Access to necessary tools and services
• Basic understanding of data pipelines concepts

Output

• Generated configurations and code
• Best practice recommendations
• Validation results

Error Handling

Resources

• Official documentation for related tools
• Best practices guides
• Community examples and tutorials

Related Skills

Part of the Data Pipelines skill category. Tags: etl, airflow, spark, streaming, data-engineering