essential-web-taxonomy

24-trillion-token web dataset with 12-category taxonomy labels enabling efficient curation of specialized datasets through SQL filtering and small annotation models.

Independent GitHub snapshot · Automated classification · Original documentation governs