name: spark-builder
display_name: Spark Builder
description: Write PySpark and Spark SQL jobs — RDDs, DataFrames, streaming, MLlib, and cluster configuration.
category: Data & Analytics
platforms: [claude-code, api]
version: 1.0.0
author: Claude Code
tags: [spark-builder]
Spark Builder
Overview
Write PySpark and Spark SQL jobs — RDDs, DataFrames, streaming, MLlib, and cluster configuration.
When to Use This Skill
Use Spark Builder when you need to:
- Work with spark builder tasks in your project or workflow
- Automate spark builder operations at scale
- Generate production-quality spark builder output quickly
Instructions
When this skill is active, Claude will:
- Understand the full context of your spark builder request
- Apply best practices and conventions for Data & Analytics
- Produce clean, well-structured, production-ready output
- Explain key decisions and offer alternatives where relevant
Examples
Example 1 — Basic Usage
User: Help me get started with spark builder.
Claude: I'll walk you through the essential steps for spark builder in your context...
Example 2 — Advanced Usage
User: I need a production-ready spark builder setup with full error handling.
Claude: Here's a complete, production-hardened spark builder implementation...
Guidelines
- Always validate inputs before processing
- Follow the conventions of the target platform or language
- Prefer explicit over implicit — clarity beats cleverness
- Include comments for non-obvious logic
- Suggest tests or validation steps where appropriate
Dependencies
Required: python, pyspark
Platforms
Available on: claude-code, api
Part of the claude-skills collection — 183+ skills for Claude.