Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / bunseokbot / darklight
Engine for collecting onion domains and crawling from webpage based on Tor network
JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bunseokbot%2Fdarklight
Stars: 9
Forks: 4
Open Issues: 3
License: apache-2.0
Language: Python
Repo Size: 16.1 MB
Dependencies:
48
Created: over 5 years ago
Updated: 3 months ago
Last pushed: over 1 year ago
Last synced: about 21 hours ago
Topics: celery, crawler, crawling, darkweb, engine, python, redis, tor
Files
Loading...
Readme
Loading...
Dependencies
requirements.txt
pypi
- APScheduler ==3.5.3
- Django ==2.1.10
- Pillow ==8.3.2
- PyMySQL ==0.9.3
- PySocks ==1.6.8
- SQLAlchemy ==1.2.16
- amqp ==2.3.2
- anyjson ==0.3.3
- atomicwrites ==1.2.1
- attrs ==18.2.0
- beautifulsoup4 ==4.6.3
- billiard ==3.5.0.5
- boto3 ==1.9.90
- botocore ==1.12.90
- celery ==4.2.1
- certifi ==2018.11.29
- chardet ==3.0.4
- coverage ==4.5.2
- docutils ==0.14
- elasticsearch ==6.3.1
- elasticsearch-dsl ==6.3.1
- idna ==2.8
- image ==1.5.27
- jmespath ==0.9.3
- kombu ==4.2.2.post1
- mock ==2.0.0
- more-itertools ==4.3.0
- pbr ==5.1.1
- pluggy ==0.8.0
- py ==1.7.0
- pytest ==4.0.2
- python-dateutil ==2.7.5
- pytz ==2018.7
- redis ==3.0.1
- requests ==2.21.0
- s3transfer ==0.2.0
- selenium ==3.141.0
- six ==1.12.0
- tzlocal ==1.5.1
- urllib3 ==1.24.2
- vine ==1.1.4
docker-compose.yml
docker
- bunseokbot/torproxy latest
- darklight latest
- redis latest
Dockerfile
docker
- python 3-onbuild build