zyq001/pycrawler

powerful python crawler: proxy-ip,mutiprocessing+Queue+yaml configurable crawler, readability, bs4(beautiful soup), pybloom, PooledDB, MysqlDb, selenium-webdriver-phantomjs, reids,anti-geetest, yaml, email

Language: Python - Size: 412 KB - Last synced at: about 2 years ago - Pushed at: about 8 years ago - Stars: 8 - Forks: 5