Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / NikolaiT / GoogleScraper
A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/NikolaiT%2FGoogleScraper
Stars: 2,563
Forks: 816
Open Issues: 141
License: apache-2.0
Language: HTML
Repo Size: 16.6 MB
Dependencies:
52
Created: over 10 years ago
Updated: 3 months ago
Last pushed: almost 3 years ago
Last synced: 3 months ago
Topics: crawler, python, scraping, search-engine, search-engine-optimization, search-engines
Files
Dependencies
- puppeteer ^1.7.0
- PyMySql *
- aiohttp *
- asyncio *
- cssselect *
- fake_useragent *
- lxml *
- recommonmark *
- requests *
- selenium *
- sqlalchemy *
- agent-base 4.2.1
- async-limiter 1.0.0
- balanced-match 1.0.0
- brace-expansion 1.1.11
- buffer-from 1.1.1
- concat-map 0.0.1
- concat-stream 1.6.2
- core-util-is 1.0.2
- debug 2.6.9
- debug 3.1.0
- es6-promise 4.2.4
- es6-promisify 5.0.0
- extract-zip 1.6.7
- fd-slicer 1.0.1
- fs.realpath 1.0.0
- glob 7.1.2
- https-proxy-agent 2.2.1
- inflight 1.0.6
- inherits 2.0.3
- isarray 1.0.0
- mime 2.3.1
- minimatch 3.0.4
- minimist 0.0.8
- mkdirp 0.5.1
- ms 2.0.0
- once 1.4.0
- path-is-absolute 1.0.1
- pend 1.2.0
- process-nextick-args 2.0.0
- progress 2.0.0
- proxy-from-env 1.0.0
- puppeteer 1.7.0
- readable-stream 2.3.6
- rimraf 2.6.2
- safe-buffer 5.1.2
- string_decoder 1.1.1
- typedarray 0.0.6
- util-deprecate 1.0.2
- wrappy 1.0.2
- ws 5.2.2
- yauzl 2.4.1