spider

【开发与工程】Crawl and scraping systems architecture — distributed crawler topology, URL frontier, politeness, and compliance. Architecture-only (no execution code). Don't use for single-page scraping (Navigator) or ETL pipelines (Stream).

独立 GitHub 快照 · 自动分类 · 以原作者文档为准