Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / bambeero1 / URLer

Web crawler using Playwright. It extracts URLs from a given website and saves them in either JSON or TXT format. It includes options to skip crawling or saving URLs containing specific keywords.

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bambeero1%2FURLer

Stars: 1
Forks: 0
Open Issues: 0

License: None
Language: Python
Repo Size: 22.5 KB
Dependencies: 2

Created: 4 months ago
Updated: 3 months ago
Last pushed: 3 months ago
Last synced: 3 months ago

Topics: archiving, crawler, crawling, playwright, scrape, scraper, scraping

Files
    Loading...
    Readme
    Loading...
    Dependencies
    requirements.txt pypi