JamesN-dev/Scroll-Scribe

ScrollScribe is a Python tool designed to scrape internal URLs from targeted website, read those URLs from a text file, scrape the content of each URL using `crawl4ai`, and generate cleaned Markdown output suitable for ingestion into RAG (Retrieval-Augmented Generation) systems or other text-processing pipelines.

Language: Python - Size: 646 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0