界面已本地化;技能介绍与说明文档按所选语言由 AI 自动翻译,代码、命令、路径和专业术语保留原文,以原作者文档为准。
探索技能
效率与协作 · SKILL.md

bio-population-genetics-linkage-disequilibrium

bio-population-genetics-linkage-disequilibrium

【效率与协作】Computes linkage disequilibrium (r2, D', composite Rogers-Huff r2), prunes correlated variants, clumps GWAS summary statistics to lead SNPs, and defines haplotype blocks with PLINK 1.9/2.0 and scikit-allel. r2 and D' answer different questions - r2 (= chi2/N) is the tagging and GWAS-power currency, D' marks observed recombination and is upward-biased…

独立 GitHub 快照 · 自动分类 · 以原作者文档为准

技能说明

GitHub

name: bio-population-genetics-linkage-disequilibrium description: Computes linkage disequilibrium (r2, D', composite Rogers-Huff r2), prunes correlated variants, clumps GWAS summary statistics to lead SNPs, and defines haplotype blocks with PLINK 1.9/2.0 and scikit-allel. r2 and D' answer different questions - r2 (= chi2/N) is the tagging and GWAS-power currency, D' marks observed recombination and is upward-biased for rare variants. PLINK 2.0 has no bare --r2 (split into --r2-phased and --r2-unphased); pruning (--indep-pairwise, genotype-blind) and clumping (--clump, p-value-aware) are distinct operations that are constantly confused. The clumping or fine-mapping LD reference must be ancestry-matched or it fails silently into false credible sets. Use when calculating LD, pruning variants for PCA or structure, clumping GWAS hits, or selecting tag SNPs. For QC see plink-basics; for PCA see population-structure; fine-mapping is causal-genomics/fine-mapping. tool_type: mixed primary_tool: plink2

Version Compatibility

Reference examples tested with: PLINK 1.9 (1.90b7+), PLINK 2.0 (alpha 6+), scikit-allel 1.3+, numpy 1.26+.

Before using code patterns, verify installed versions match. If versions differ:

  • Python: pip show <package> then help(module.function) to check signatures
  • CLI: <tool> --version then <tool> --help to confirm flags

If code throws ImportError, AttributeError, or TypeError, introspect the installed package and adapt the example to match the actual API rather than retrying.

Version traps that change results, not just syntax: PLINK 2.0 has NO bare --r2 (it was split into --r2-phased, the EM haplotype-frequency estimator, and --r2-unphased, the composite dosage estimator); PLINK 1.9 still uses bare --r2. PLINK 2.0 --indep-pairwise <window>['kb'] [step] <r2> requires the step to be 1 when the window is given in kb. allel.rogers_huff_r returns a CONDENSED upper-triangle array, not a square matrix - scipy.spatial.distance.squareform it before 2D indexing. The single source of truth for versions is this block, not headings.

Linkage Disequilibrium

"Measure LD between my variants" -> Quantify how predictably one variant's alleles co-occur with another's, choosing r2 or D' by the question being asked.

  • CLI: plink2 --r2-unphased (composite dosage r2, no phasing) or --r2-phased (EM haplotype r2)
  • Python: allel.rogers_huff_r(gn) ** 2 (composite r2, scikit-allel)

"Thin correlated variants before PCA or structure" -> Remove variants so no remaining pair is in high LD, leaving a near-independent marker set.

  • CLI: plink2 --indep-pairwise 50 5 0.1 (genotype-blind, phenotype-agnostic)
  • Python: allel.locate_unlinked(gn, size=50, step=5, threshold=0.1) (scikit-allel)

"Reduce my GWAS hits to one signal per locus" -> Group correlated associations around the most significant SNP per region.

  • CLI: plink --clump sumstats --clump-p1 5e-8 --clump-r2 0.1 --clump-kb 250

Scope: LD measures, pruning, clumping, haplotype blocks, and LD decay. QC/conversion route to plink-basics; PCA/ADMIXTURE to population-structure; --glm GWAS to association-testing; resolving independent causal variants to causal-genomics/fine-mapping; phased haplotypes to phasing-imputation/haplotype-phasing.

The Single Most Important Insight -- D' and r2 answer different questions

  1. D' measures whether recombination has been observed between two loci (a historical/structural question); r2 measures how well one variant predicts the other (a statistical/predictive question), so they are not interchangeable.
  2. r2 owns tagging, imputation, pruning, and GWAS power because r2 = chi2/N exactly (N = number of haplotypes = 2 x sampled individuals, for the 1-df allelic 2x2 table; the composite estimator targets this gametic r2 under random mating): a proxy multiplies the association test's non-centrality by r2, so 1/r2 times the sample size is needed to recover the lost power (Pritchard & Przeworski 2001).
  3. D'=1 routinely coexists with r2 ~ 0.05 because allele-frequency asymmetry caps r2: r2/r2max = D'^2 over most of frequency space (VanLiere & Rosenberg 2008), which is exactly why a common array SNP cannot tag a rare causal variant despite "complete LD".
  4. Every operation that consumes an LD matrix (clumping, fine-mapping, LD-score regression) silently assumes that matrix matches the study sample's LD; a wrong-ancestry or underpowered reference does not error, it produces confidently wrong output.

Tool Taxonomy

MethodTool / callMechanismWhen
Composite (Rogers-Huff) r2plink2 --r2-unphased; allel.rogers_huff_rcorrelation of 0/1/2 dosage vectors, no phasingrobust default when phase or HWE is doubtful
EM haplotype r2plink2 --r2-phased; vcftools --hap-r2infers haplotype frequencies under HWE, then r2large HWE-consistent samples, or truly phased input
D'plink --r2 dprime; plink2 --ld <a> <b>D normalized by its frequency-constrained maxblock boundaries, recombination history (NOT tagging)
LD pruningplink2 --indep-pairwise; allel.locate_unlinkedgenotype-blind windowed r2 thinningindependent marker set for PCA/ADMIXTURE/GRM
LD clumpingplink --clumpp-value-aware grouping around an index SNPone lead SNP per associated GWAS locus
Haplotype blocksplink --blocks no-pheno-reqGabriel confidence-interval D' methodblock maps, recombination inference
LD score regressionldsc (--l2, --h2, --rg)regress GWAS chi2 on LD scoreh2, genetic correlation, confounding from sumstats

Decision Tree by Scenario

ScenarioUseWhy
Thin variants for PCA/ADMIXTURE/GRM--indep-pairwise after excluding long-range-LD regionsphenotype-blind independence; MHC/inversions must go by coordinate first
Reduce GWAS hits to lead SNPs--clump with ancestry-matched LDp-value-aware; one index SNP per locus
Establish independent causal signalsconditional analysis or fine-mapping, NOT tighter clumpingclumping picks the top SNP, not the causal one; over-clumping deletes real secondaries
Assess a proxy/tag SNPr2 (--r2-unphased), require r2 >= 0.8r2 = fraction of effective N retained at the proxy
Define haplotype blocks / recombinationD' (--blocks, --r2 dprime)D' marks observed recombination; r2 does not
Phase or HWE doubtful, small N, missingnesscomposite r2 (--r2-unphased, Rogers-Huff)EM can manufacture haplotype-frequency artifacts
LD from genotypes in Python at scaleallel.locate_unlinked / allel.rogers_huff_rcomposite estimator, chunkable; no phased-EM in scikit-allel
h2 / confounding from summary statsLD-score regression with ancestry-matched scoresslope = h2, intercept-1 = confounding

Pairwise LD and the Phased/Unphased Choice

Goal: Compute pairwise r2 (and D' when recombination is the question) without an EM artifact under structure or missingness.

Approach: Default to the composite dosage estimator that needs no phasing; reach for EM haplotype r2 only when the sample is large and HWE-consistent, and use D' solely for block/recombination work.

# Composite dosage r2 (Rogers-Huff): robust default, no HWE assumption.
plink2 --bfile data --r2-unphased --ld-window-kb 1000 --ld-window-r2 0.2 --out ld_unphased

# EM haplotype-frequency r2: only when phase is trustworthy / sample is large and HWE-consistent.
plink2 --bfile data --r2-phased --ld-window-kb 1000 --out ld_phased

# D' for a single pair (recombination / block question), with observed haplotype frequencies.
plink2 --bfile data --ld rs123 rs456 --out pair

# PLINK 1.9 still has the bare --r2; add dprime to also report D'.
plink --bfile data --r2 dprime --ld-window-kb 500 --out ld_dprime
import allel
from scipy.spatial.distance import squareform

callset = allel.read_vcf('data.vcf.gz')
gn = allel.GenotypeArray(callset['calldata/GT']).to_n_alt()

# rogers_huff_r returns a CONDENSED upper-triangle vector; square it for r2, squareform for a matrix.
r2_matrix = squareform(allel.rogers_huff_r(gn[:200]) ** 2)

LD Pruning for Structure (genotype-blind)

Goal: Produce a near-independent marker set so PCA/ADMIXTURE/GRM are not dominated by a handful of LD blocks.

Approach: Exclude long-range-LD regions by coordinate FIRST (their internal r2 is high and real, so a threshold cannot remove them sensibly), then slide an r2 window over the survivors.

# 1. Drop long-range-LD regions by position (MHC chr6:25-35 Mb, 8p23.1, 17q21.31, LCT/2q21; coordinates are build-specific).
plink2 --bfile data --exclude range longrange_ld.txt --make-bed --out data_noLR

# 2. Windowed r2 prune (50 here is a variant count, so step 5 is fine; step MUST be 1 only with a kb window).
plink2 --bfile data_noLR --indep-pairwise 50 5 0.1 --out prune     # 50-variant window, step 5, r2 0.1
plink2 --bfile data_noLR --extract prune.prune.in --make-bed --out data_pruned
import allel

callset = allel.read_vcf('data.vcf.gz')
gn = allel.GenotypeArray(callset['calldata/GT']).to_n_alt()

loc_unlinked = allel.locate_unlinked(gn, size=50, step=5, threshold=0.1)  # boolean keep-mask
gn_pruned = gn.compress(loc_unlinked, axis=0)

Clumping GWAS Summary Statistics (p-value-aware)

Goal: Collapse a region of correlated associations to one lead SNP per independent locus.

Approach: Index on genome-wide-significant SNPs and absorb nearby LD partners, overriding PLINK's permissive defaults; use an ancestry-matched LD reference, ideally the study sample itself.

# Defaults (p1=1e-4, p2=1e-2, r2=0.5, kb=250) are neither genome-wide nor strict - set them explicitly.
plink --bfile ld_reference \
    --clump gwas_sumstats.txt \
    --clump-p1 5e-8 --clump-p2 1e-5 --clump-r2 0.1 --clump-kb 250 \
    --out clumped
# clumped.clumped lists one index SNP per locus. This is NOT conditional analysis or fine-mapping.

Haplotype Blocks and LD Decay

Goal: Map regions of little observed recombination, or characterize how LD decays with distance.

Approach: Use the Gabriel D'-CI block method for boundaries; for decay, bin composite r2 by physical distance after stratifying by population so admixture LD does not flatten the curve.

plink --bfile data --blocks no-pheno-req --out blocks   # blocks.blocks, blocks.blocks.det (Gabriel CI)
import allel, numpy as np

callset = allel.read_vcf('data.vcf.gz')
gn = allel.GenotypeArray(callset['calldata/GT']).to_n_alt()
pos = callset['variants/POS']

n = min(1000, gn.shape[0])
r2, dist = [], []
for i in range(n):
    for j in range(i + 1, min(i + 100, n)):
        r2.append(allel.rogers_huff_r(gn[[i, j]])[0] ** 2)  # condensed length-1 -> index [0]
        dist.append(pos[j] - pos[i])
r2, dist = np.array(r2), np.array(dist)

edges = np.arange(0, 100001, 1000)
decay = [np.mean(r2[(dist >= edges[k]) & (dist < edges[k + 1])]) if ((dist >= edges[k]) & (dist < edges[k + 1])).any() else np.nan for k in range(len(edges) - 1)]

Per-Method Failure Modes

Long-range-LD regions survive pruning

Trigger: --indep-pairwise run without excluding MHC/inversions by coordinate. Mechanism: their internal r2 is high and genuine, so a window prune keeps a dense cluster. Symptom: the top PCs capture the MHC (chr6:25-35Mb) or 17q21.31 inversion, not ancestry. Fix: --exclude range the long-range-LD list (MHC, 8p23.1, 17q21.31, LCT; Price 2008) before pruning, not a tighter r2.

D' read as "high LD" for tagging

Trigger: selecting tag SNPs or judging proxy adequacy from D'. Mechanism: D'=1 only says no recombinant was observed; frequency asymmetry caps r2 far below 1. Symptom: a "perfectly linked" common SNP retains almost no association power for a rare causal variant. Fix: use r2 for tagging/power and require r2 >= 0.8; reserve D' for blocks.

D' inflated at rare alleles / small N

Trigger: interpreting D' or --blocks where minor-allele count is below ~10-20. Mechanism: the fourth haplotype is unobserved by chance, pushing the D' MLE to ~1 even for independent loci. Symptom: spurious "perfect LD" blocks that vanish with more samples. Fix: do not interpret D' at low MAC; report r2, which is noisy but not systematically inflated.

EM haplotype r2 on structured/missing data

Trigger: --r2-phased or --hap-r2 under inbreeding, structure, or high missingness. Mechanism: EM converges to biased haplotype frequencies that violate the HWE assumption. Symptom: r2 disagrees with the composite estimate and shifts with missingness. Fix: use --r2-unphased (composite Rogers-Huff) when phase or HWE is doubtful.

Wrong-ancestry LD reference

Trigger: clumping, LD-score regression, or fine-mapping with a panel that does not match the GWAS ancestry. Mechanism: the LD matrix consumed differs from the sample's true LD; no error is raised. Symptom: mis-grouped clumps, biased heritability, false fine-mapping credible sets with "impossible" configurations. Fix: compute LD from the study sample itself, or use an ancestry-matched panel.

Over-clumping merges independent signals

Trigger: treating --clump as conditional or fine-mapping analysis. Mechanism: clumping keeps the single most significant SNP and discards everything in LD with it. Symptom: two truly independent causal variants in modest LD collapse to one locus. Fix: use conditional analysis (COJO) or fine-mapping (causal-genomics/fine-mapping); do not just tighten --clump-r2.

LD decay curve flattens at a spurious floor

Trigger: plotting LD decay on a pooled multi-population sample. Mechanism: admixture and background LD inflate long-range r2 independent of distance. Symptom: the decay curve plateaus at a nonzero asymptote instead of decaying toward zero. Fix: stratify by population before computing decay (LD ~ 1/(4Nec+1), Hill & Robertson 1968).

Quantitative Thresholds

OperationFlag / valueTypicalRationale
Pruning for PCA/ADMIXTURE/GRM--indep-pairwise r20.1 (range 0.05-0.2)near-independence so structure is not double-counted; strictness trades marker count for independence
Pruning window / stepwindow / step50 var / 5, or 200kb / 1window must exceed local LD extent; step is 1 for kb windows in plink2
Pruning for polygenic scores--indep-pairwise r20.1-0.5 within 250kb-1Mbretain more signal; tuned by validation
Clumping LD threshold--clump-r20.1 (default 0.5 under-clumps)r2 0.1 within 250kb defines one independent locus; set explicitly
Clumping p-values--clump-p1 / --clump-p25e-8 / 1e-5 (defaults 1e-4/1e-2)index at genome-wide significance; defaults are neither genome-wide nor strict
Tag / proxy adequacyr2>= 0.8r2 = chi2/N: retains >= 80% of association power at the proxy (Pritchard & Przeworski 2001)
Gabriel "strong LD" blockupper 95% D' CI> 0.98 (lower > 0.7)one recombinant makes D'=1 impossible yet the CI can sit just below 1 (Gabriel 2002)
MAF floor for stable D'MAF>~ 0.05D' upward bias and r2 variance both blow up at low MAC
LDSC applicabilitymean chi2 / N> ~1.02 / N > ~5000below this the slope is too noisy; exclude MHC; munge to HapMap3 SNPs (Bulik-Sullivan 2015)

Thresholds are conventions, not laws - inspect the LD distributions and verify current best practice before applying numbers blindly.

Common Errors

Error / symptomCauseSolution
plink2 --r2 "unrecognized flag"bare --r2 removed in PLINK 2.0choose --r2-phased or --r2-unphased; PLINK 1.9 keeps --r2
--indep-pairwise 50kb 5 0.1 errorsstep must be 1 for kb windowsuse --indep-pairwise 50kb 1 0.1 or a variant-count window
rogers_huff_r(gn)[0,1] index errorfunction returns a condensed vectorsquareform(rogers_huff_r(gn)) first, or index [0] for a single pair
Top PCs capture one regionlong-range-LD region left in--exclude range MHC/8p23.1/17q21.31/LCT by coordinate before pruning
Clumping reports correlated SNPs as separate locidefault --clump-r2 0.5 too looseset --clump-r2 0.1 and --clump-p1 5e-8 explicitly
Independent secondary hit disappearsover-clumping treated as fine-mappinguse conditional analysis / fine-mapping, not a tighter clump
False fine-mapping credible setswrong-ancestry LD referenceuse in-sample or ancestry-matched LD
LDSC intercept read as pure stratificationintercept also absorbs sample overlapuse the attenuation ratio (intercept-1)/(mean chi2 - 1)

References

  1. Lewontin RC. The interaction of selection and linkage. I. General considerations; heterotic models. Genetics 1964; 49(1):49-67.
  2. Hill WG, Robertson A. Linkage disequilibrium in finite populations. Theoretical and Applied Genetics 1968; 38(6):226-231. DOI:10.1007/BF01245622.
  3. Pritchard JK, Przeworski M. Linkage disequilibrium in humans: models and data. American Journal of Human Genetics 2001; 69(1):1-14. DOI:10.1086/321275.
  4. Gabriel SB, Schaffner SF, Nguyen H, et al. The structure of haplotype blocks in the human genome. Science 2002; 296(5576):2225-2229. DOI:10.1126/science.1069424.
  5. Price AL, Weale ME, Patterson N, et al. Long-range LD can confound genome scans in admixed populations. American Journal of Human Genetics 2008; 83(1):132-135. DOI:10.1016/j.ajhg.2008.06.005.
  6. VanLiere JM, Rosenberg NA. Mathematical properties of the r2 measure of linkage disequilibrium. Theoretical Population Biology 2008; 74(1):130-137. DOI:10.1016/j.tpb.2008.05.006.
  7. Rogers AR, Huff C. Linkage disequilibrium between loci with unknown phase. Genetics 2009; 182(3):839-844. DOI:10.1534/genetics.108.093153.
  8. Bulik-Sullivan BK, Loh P-R, Finucane HK, et al. LD Score regression distinguishes confounding from polygenicity in genome-wide association studies. Nature Genetics 2015; 47(3):291-295. DOI:10.1038/ng.3211.

Related Skills

  • plink-basics - format conversion and QC before any LD operation
  • population-structure - PCA and ADMIXTURE on the LD-pruned marker set
  • association-testing - GWAS whose summary statistics feed clumping
  • selection-statistics - haplotype statistics that depend on LD structure
  • causal-genomics/fine-mapping - resolving independent causal variants beyond clumping
  • phasing-imputation/haplotype-phasing - phased haplotypes for EM/haplotype-based r2
我的收藏