---

name: "pyspark-transformer" description: | Transform pyspark transformer operations. Auto-activating skill for Data Pipelines. Triggers on: pyspark transformer, pyspark transformer Part of the Data Pipelines skill category. Use when working with pyspark transformer functionality. Trigger with phrases like "pyspark transformer", "pyspark transformer", "pyspark". allowed-tools: "Read, Write, Edit, Bash(cmd:*), Grep" version: 1.0.0 license: MIT author: "Jeremy Longshore jeremy@intentsolutions.io"

Pyspark Transformer

Overview

This skill provides automated assistance for pyspark transformer tasks within the Data Pipelines domain.

When to Use

This skill activates automatically when you:

• Mention "pyspark transformer" in your request
• Ask about pyspark transformer patterns or best practices
• Need help with data pipeline skills covering etl, data transformation, workflow orchestration, and streaming data processing.

Instructions

1. Provides step-by-step guidance for pyspark transformer
2. Follows industry best practices and patterns
3. Generates production-ready code and configurations
4. Validates outputs against common standards

Examples

Example: Basic Usage Request: "Help me with pyspark transformer" Result: Provides step-by-step guidance and generates appropriate configurations

Prerequisites

• Relevant development environment configured
• Access to necessary tools and services
• Basic understanding of data pipelines concepts

Output

• Generated configurations and code
• Best practice recommendations
• Validation results

Error Handling

Resources

• Official documentation for related tools
• Best practices guides
• Community examples and tutorials

Related Skills

Part of the Data Pipelines skill category. Tags: etl, airflow, spark, streaming, data-engineering