Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / kevinmarquesp / web_crawler_ex
Tool to extract all the anchor links URLs of websites, store that list of URLs inside a SQLite3 database and repeat that same process to each link recursively using multiple sub process in parallel
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/kevinmarquesp%2Fweb_crawler_ex
Stars: 0
Forks: 0
Open Issues: 0
License: mit
Language: Elixir
Repo Size: 4.53 MB
Dependencies:
3
Created: 5 months ago
Updated: 23 days ago
Last pushed: 23 days ago
Last synced: 23 days ago
Topics: async, elixir, httpoison, mix, parallelism, study-project, web-crawler