joe-stifler/crawler

Crawler is a Python package that crawls web pages and converts their content into Markdown format, making it easy to create documentation, notes, or other text-based representations. It features domain restrictions, flexible output options, and graph visualization.

Language: Python - Size: 283 KB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 1