Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / pavlovtech / WebReaper

Web scraper, crawler and parser in C#. Designed as simple, declarative and scalable web scraping solution.

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/pavlovtech%2FWebReaper

Stars: 93
Forks: 19
Open Issues: 4

License: gpl-3.0
Language: C#
Repo Size: 37.3 MB
Dependencies: 68

Created: about 2 years ago
Updated: 22 days ago
Last pushed: 6 months ago
Last synced: 19 days ago

Commit Stats

Commits: 525
Authors: 4
Mean commits per author: 131.25
Development Distribution Score: 0.013
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/pavlovtech/WebReaper

Topics: crawler, datamining, parser, parsing, scraper, scraping, scraping-api, scraping-data, scraping-tool, scraping-web, scraping-websites, webcrawler, webscraping

Files
    Loading...
    Readme
    Loading...
    Dependencies
    .github/workflows/CI.yml actions
    .github/workflows/WebReaperAzureFuncs.yml actions
    Examples/BrownsfashionScraper/Dockerfile docker
    Examples/BrownsfashionScraper/BrownsfashionScraper.csproj nuget
    Examples/WebReaper.AzureFuncs/WebReaper.AzureFuncs.csproj nuget
    Examples/WebReaper.ConsoleApplication/WebReaper.ConsoleApplication.csproj nuget
    Examples/WebReaper.DistributedScraperWorkerService/WebReaper.DistributedScraperWorkerService.csproj nuget
    Examples/WebReaper.ScraperWorkerService/WebReaper.ScraperWorkerService.csproj nuget
    Misc/WebReaper.ProxyProviders/WebReaper.ProxyProviders.csproj nuget
    WebReaper/WebReaper.csproj nuget
    WebReaper.Tests/WebReaper.IntegrationTests/WebReaper.IntegrationTests.csproj nuget
    WebReaper.Tests/WebReaper.UnitTests/WebReaper.UnitTests.csproj nuget