web-content-extraction

Here are 4 public repositories matching this topic...

teng-lin / agent-fetch

Full-content web fetcher for AI agents — Chrome TLS fingerprinting, browser impersonation, multi-strategy article extraction, and web scraping.

nodejs typescript html-to-markdown web-crawler web-scraping readability fetcher content-extraction ai-agents tls-fingerprint pdf-extraction anti-bot-detection browser-impersonation web-content-extraction ai-agent-skill web-fetcher httpcloak

Updated Mar 15, 2026
TypeScript

Murrough-Foley / web-content-extraction-benchmark

Star

WCXB: Web Content Extraction Benchmark — 2,008 pages, 7 page types, 1,613 domains. The largest open benchmark for web content extraction, boilerplate removal, and main content detection.

nlp benchmark text-extraction dataset web-scraping html-parsing content-extraction boilerplate-removal web-content-extraction

Updated Apr 4, 2026
Python

🌐 BeautifulSoup: Effortlessly scrape and parse web data with this powerful Python library! Perfect for developers needing quick and reliable HTML/XML data extraction. Start saving time on your projects today! [MIRROR][UNOFFICIAL]

python data-mining mirror web-crawler python3 unofficial web-scraping xpath data-extraction html-parsing css-selectors web-automation mirrored-repository unofficial-mirror dynamic-web-scraping api-scraping web-content-extraction

Updated Mar 1, 2026
Python

ONEdart / SiteMirror

Star

Python tool for advanced web scraping and site mirroring. It downloads entire websites, including HTML, CSS, JS, images, and other assets, while preserving site structure and updating links for of…

web-scraping web-archiving html-scraper python-automation website-cloning static-site-mirror web-content-extraction

Updated May 22, 2026
Python

Add this topic to your repo

To associate your repository with the web-content-extraction topic, visit your repo's landing page and select "manage topics."

Learn more

Navigation Menu