GitHub / any4ai / AnyCrawl
AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/any4ai%2FAnyCrawl
PURL: pkg:github/any4ai/AnyCrawl
Stars: 2,101
Forks: 192
Open issues: 3
License: mit
Language: TypeScript
Size: 2.01 MB
Dependencies parsed at: Pending
Created at: 5 months ago
Updated at: 3 days ago
Pushed at: 3 days ago
Last synced at: 3 days ago
Topics: ai-scraping, aitools, crawl, data, html-to-markdown, rag, scrape, scraping, serp, webscraper