The interface is localized. Original skills retain their author's language; some long-form pages are provided in English.
Explore skills
Design & creative · SKILL.md

data-batch-processing

data-batch-processing

Use this skill when designing batch processing with Hive, Spark SQL, Pig, or HQL. This skill enforces: Hive metastore management, Spark SQL Catalyst optimization, file format selection (Parquet, ORC, Avro), partitioning and bucketing strategies, query tuning with statistics and dynamic partition pruning. Do NOT use for: real-time streaming, CDC pipelines, d…

Independent GitHub snapshot · Automated classification · Original documentation governs

Skill documentation

GitHub
Loading documentation from the source…
Saved skills