GitHub / TezzLabs / TezzCrawler

Crawl any site, starting from the sitemap and convert entire website into Markdown, making it easy for the LLMs to learn

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/TezzLabs%2FTezzCrawler
PURL: pkg:github/TezzLabs/TezzCrawler

Stars: 2
Forks: 0
Open issues: 0

License: mit
Language: Python
Size: 46.9 KB
Dependencies parsed at: Pending

Created at: 10 months ago
Updated at: 9 months ago
Pushed at: 9 months ago
Last synced at: 2 months ago

Topics: crawler-python, dataset-generation, llm, python

Loading...