界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

syn-spark-skew

syn-spark-skew

【效率与协作】Operate, configure, troubleshoot, and manage Apache Spark. Use for Apache Spark engineering tasks, day-to-day operations, and production support.

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: syn-spark-skew description: Operate, configure, troubleshoot, and manage Apache Spark. Use for Apache Spark engineering tasks, day-to-day operations, and production support.

Apache Spark: data skew and partition tuning

When to use

Use this skill for data skew and partition tuning in Apache Spark. This skill specifically handles data skew and partition tuning and nothing else in the Apache Spark family.

Procedure

Diagnose skewed partitions from the UI, repartition/salt hot keys, and tune spark.sql.shuffle.partitions.

Notes

This is the Apache Spark skill dedicated to data skew and partition tuning. Sibling skills cover other Apache Spark capabilities; this one is the right choice only when the task is about data skew and partition tuning.

我的收藏