Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / paulpierre / markdown-crawler
A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/paulpierre%2Fmarkdown-crawler
Stars: 168
Forks: 16
Open Issues: 4
License: mit
Language: Python
Repo Size: 1.14 MB
Dependencies: pending
Created: 7 months ago
Updated: 10 days ago
Last pushed: 7 months ago
Last synced: 10 days ago
Topics: html-to-markdown, html-to-markdown-converter, html2md, llm, llmops, markdown, markdown-crawler, markdown-parser, markdown-scraper, md-crawler, rag, web-scraper