Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / sidravic / lost_grandma
Lost grandma is a quick and effective crawler that used to crawl Sephora for product information
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sidravic%2Flost_grandma
Stars: 0
Forks: 0
Open Issues: 19
License: None
Language: JavaScript
Repo Size: 1.56 MB
Dependencies:
678
Created: about 4 years ago
Updated: about 4 years ago
Last pushed: over 1 year ago
Last synced: about 1 year ago
Topics: crawlers, nodejs, postgresql, redis, simple-crawler, tor
Files
Loading...
Readme
Loading...
Dependencies
package.json
npm
- bull-repl ^0.18.1 development
- chai ^4.2.0 development
- mocha ^6.2.2 development
- nodemon ^2.0.2 development
- pm2 ^4.2.0 development
- sinon ^7.5.0 development
- @azure/cognitiveservices-customvision-prediction ^4.0.0
- @azure/cognitiveservices-customvision-training ^4.0.0
- @hapi/joi ^16.1.8
- aws-sdk ^2.567.0
- axios ^0.19.0
- azure-cognitiveservices-imagesearch ^2.0.0
- blocked ^1.3.0
- body-parser ^1.19.0
- bull ^3.11.0
- cheerio ^1.0.0-rc.3
- clarifai ^2.9.1
- date-fns ^2.9.0
- ejs ^3.0.1
- express ^4.17.1
- express-winston ^4.0.2
- he ^1.2.0
- http-proxy-agent ^2.1.0
- https-proxy-agent ^3.0.0
- ms-rest-azure ^3.0.0
- pg ^7.12.1
- pg-hstore ^2.3.3
- redis ^2.8.0
- sequelize ^5.19.6
- sequelize-cli ^5.5.1
- simplecrawler ^1.1.8
- socks-proxy-agent ^4.0.2
- winston ^3.2.1
- winston-logstash-transport ^2.0.0
- yargs ^14.2.0
Dockerfile
docker
- node 12.10 build
docker-compose.yml
docker
- ${LOST_GRANDMA_IMAGE_ID} latest
- ${TOR_IMAGE_ID} latest
scripts/tor/Dockerfile
docker
- node 12.10 build