Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

Package Usage: pypi: scrapy-user-agents

Automatically pick an User-Agent for every request
2 versions
Latest release: over 5 years ago
14,912 downloads last month

View more package details: https://packages.ecosyste.ms/registries/pypi.org/packages/scrapy-user-agents

View more repository details: https://repos.ecosyste.ms/hosts/GitHub/repositories/rejoiceinhope%2Fcrawler-demo

Dependent Repos 110

Silicon-Orchard/fake_product_review_check
Detect review manipulation by leveraging reviewer historical stylometrics in Amazon, Yelp, Facebook and Google reviews
  • ==0.1.1 requirements.txt

Size: 5.13 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

martinmags/homegym
A web app that tracks websites to help you get the best deals on your home gym equipment.
  • ==0.1.1 requirements.txt

Size: 51.8 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

shankypy/amazon-scraper
  • ==0.1.1 amazon_scraper/requirements.txt

Size: 13.7 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

tlebryk/openrice
china in transition
  • ==0.1.1 requirements.txt

Size: 1.24 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

pustovalovm/SF_training
  • ==0.1.1 module_3/version_2_with_scraping/outputs/requirements.txt
  • ==0.1.1 module_3/outputs/requirements.txt

Size: 265 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

PiyushKhanna30/Scrapy_amazon.in
  • ==0.1.1 requirements.txt

Size: 21.5 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

Pradip-p/Web-Scarpy
  • ==0.1.1 requirements.txt

Size: 41 KB - Last synced: 9 months ago - Pushed: over 1 year ago

sanekua/Avtoria_scraper
Avtoria scraper using bs4,requests
  • ==0.1.1 requirements.txt

Size: 266 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

weefatboi/spider-projects
a collection of all personal web crawler projects
  • ==0.1.1 requirements.txt

Size: 290 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

navneetpathania/crunch-base-site-scrap
  • ==0.1.1 crunchbase/requirements.txt

Size: 17.6 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

kimp1er/web-scrap-rutracker
Scrapy project for rutracker.org
  • ==0.1.1 requirements.txt

Size: 36.1 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

bohdan-onsha/threeeggsaday_paginiaurii
  • ==0.1.1 requirements.txt

Size: 23.4 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

vinaykakanuru/Scrapy_Projects
Web Scraping related Projects
  • ==0.1.1 requirements.txt

Size: 27.3 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

epeenphrine/scrapy_test
learning scrapy
  • ==0.1.1 requirements.txt

Size: 259 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

shivamjagdishsingh/amazonscrapy
scrapping amazon website
  • ==0.1.1 amazonscrapy/requirements.txt

Size: 108 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

Raza046/Medical-eCommerce-Django-Python
A medical-eCommerce for purchasing medicines online.
  • ==0.1.1 requirements.txt

Size: 16.9 MB - Last synced: about 1 year ago - Pushed: about 1 year ago

SmartPracticeschool/SBSPS-Challenge-1160-Predicting-the-energy-output-of-wind-turbine-based-on-weather-condition
Predicting Energy Output of Wind Turbine
  • ==0.1.1 05 Building UI/requirements.txt

Size: 6.05 MB - Last synced: 21 days ago - Pushed: over 1 year ago

juansimon27/scrapy-walmart
Product scraping from Walmart Canada website, with further cleaning and integration of data from a different store.
  • ==0.1.1 requirements.txt

Size: 52.9 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

chandrashekarvt/Task-Manager
  • ==0.1.1 Back-end/requirements.txt

Size: 234 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

OmiGitProjects/FlaskLogin
Login Form In Flask Without Database
  • ==0.1.1 requirements.txt

Size: 18.6 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

daniel2012600/adult_comic_crawl
  • ==0.1.1 requirements.txt

Size: 62.5 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

andreyxdd/marketeye-api
API to process stock market technical indicators (NYSE/NASDAQ only)
  • ==0.1.1 requirements.txt

Size: 252 KB - Last synced: 28 days ago - Pushed: 28 days ago

jenja-pa/GeekHubHomework2022
Сховище домашніх робіт курсу GeekHub 2022 Python
  • * HT_16/requirements.txt

Size: 416 KB - Last synced: 7 months ago - Pushed: over 1 year ago

Sagyam/Nepali-News-Scraper
Nepali News Scraper Bot written using Scrapy
  • ==0.1.1 requirements.txt

Size: 779 KB - Last synced: about 1 year ago - Pushed: about 2 years ago

dunjadjordjevic/-Comparison-of-machine-learning-algorithms-for-predicting-thyroid-diseases
  • =0.1.1=pypi_0 requirements.txt

Size: 7.84 MB - Last synced: 7 months ago - Pushed: over 1 year ago

aanghelidi/MALscrapy
Web scraper of MAL website
  • * requirements.txt

Size: 68.4 KB - Last synced: 12 months ago - Pushed: 12 months ago

niuguy/myspiders
my spiders
  • ==0.1.1 requirements.txt

Size: 752 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

pyxudev/Portfolio
portfolio
  • ==0.1.1 scraping-estimation-tool/requirements.txt
  • ==0.1.1 speed_score/requirement.txt

Size: 78.4 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

mzs9540/covid19
This Project shows data of various countries affected from covid19 and also predict new death based on Previous Results using Machine Learning.
  • >=0.1.1,<=2 app/requirements.txt

Size: 7.06 MB - Last synced: about 1 year ago - Pushed: over 3 years ago

NirmalSilwal/Python
covers python basic to advance topics, practice questions, logical problems in python, web development using html, css, bootstrap, jquery, DOM, Django 🚀🚀. 💥 🌈
  • ==0.1.1 web scraping/flipcartCrawling/requirements.txt

Size: 20.4 MB - Last synced: 25 days ago - Pushed: over 1 year ago

samjain2907/Covid-Relief-Fund
A croudfunding webstie prototype aimed at digitizing fund collection for different NGO's working for people in this pandemic
  • ==0.1.1 server/requirements.txt

Size: 6.33 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

zanaaziz/pyleapo
A Python API for accessing your Leap Card balance, overview, and travel credit history.
  • >=0.1.1 setup.py

Size: 41 KB - Last synced: 5 days ago - Pushed: almost 2 years ago

MariaKhalidAlvi/Web-Scraping
  • ==0.1.1 requirements.txt

Size: 201 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

MarosPapan/TatryProject
Tatry
  • ==0.1.1 requirements.txt

Size: 18.8 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

laisbsc/Scrappix
Repo with the contents for the final submission for the Applied Tech Group Project, CCT College Dublin.
  • ==0.1.1 scrappix/requirements.txt

Size: 25.8 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

spandanpal22/Web_Scraping_Amazon
This project uses Scrapy framework to do web scraping on Amazon
  • ==0.1.1 requirements.txt

Size: 15.6 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

twimbit/twimintel-scrapper
  • ==0.1.1 requirements.txt

Size: 22.8 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago

bibinguyen/ClothingScrapy
ClothingScrapy
  • ==0.1.1 requirements.txt

Size: 9.77 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

Ahmed2200716/portfo
  • ==0.1.1 requirements.txt

Size: 1.35 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

rakibulislam01/web-scraping
web-scraping
  • ==0.1.1 requirements.txt

Size: 46.9 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

Echeverrias/IE
Django + Scrapy
  • ==0.1.1 src/requirements.txt

Size: 27.6 MB - Last synced: 10 months ago - Pushed: almost 2 years ago

EnumaHub/urulogs
  • ==0.1.1 requirements.txt

Size: 743 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

ChayanBansal/WebScraper-MiamiHotels-Scrapy-ClearTrip
  • ==0.1.1 requirements.txt

Size: 25.4 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

brandontkessler/scrapers
  • ==0.1.1 requirements.txt

Size: 639 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

brandontkessler/QuantDrivenSports
  • ==0.1.1 requirements.txt

Size: 20.5 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

jasonminsookim/scraping_ufcstats
  • ==0.1.1 requirements.txt

Size: 912 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

aiqingr/moreDjangoinVirtualEnv
  • ==0.1.1 firstVirtualEnv/requirements.txt

Size: 122 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

Anmolbansal1/GSoC-experiments
  • ==0.1.1 requirements.txt

Size: 17.6 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

kenny813x201/ETF_scrapy
crawls ETF data from www.etfwatch.com.au
  • ==0.1.1 requirements.txt

Size: 122 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

danthespal/webScraper 📦
  • ==0.1.1 requirements.txt

Size: 38.1 KB - Last synced: 10 months ago - Pushed: almost 2 years ago

sgsaikat/WebScraping_Amazon.in
This repo hosts the code to webscrape Shorts Reads section of Amazon.in
  • ==0.1.1 requirements.txt

Size: 35.2 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

SkotarenkoEvgeny/Scrapy-training-project
  • * requirements.txt

Size: 1.19 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago

netoferraz/acordaos-tcu
Base de acórdãos do Tribunal de Contas da União
  • ==0.1.1 requirements.txt

Size: 589 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

ngshiheng/food-delivery-scrapy 📦
Aggregate the data of food delivery services
  • * Pipfile
  • ==0.1.1 Pipfile.lock

Size: 358 KB - Last synced: 25 days ago - Pushed: over 2 years ago

sushiPlague/tribble-amazon-sci-fi-book-crawler
Kind of works :man_shrugging:
  • * Pipfile
  • ==0.1.1 Pipfile.lock

Size: 962 KB - Last synced: 4 months ago - Pushed: about 3 years ago

captionnemo/Datapipeline_DataEngineer_project_2022
  • ==0.1.1 Code_Scarpy/VN_ALONHADAT/requirements.txt
  • >=0.1.1 Code_Scarpy/VN_BATDONGSANCOMVN/old/requirements.txt
  • >=0.1.1 Code_Scarpy/real-estate-crawl/realestatevn/requirements.txt
  • ==0.1.1 scrapy/VN_ALONHADAT/requirements.txt
  • >=0.1.1 scrapy/VN_BATDONGSAN/requirements.txt
  • >=0.1.1 scrapy/VN_BATDONGSANCOMVN/old/requirements.txt
  • >=0.1.1 scrapy/VN_BATDONGSANCOMVN/requirements.txt
  • >=0.1.1 scrapy/VN_DIAOCONLINE/requirements.txt
  • >=0.1.1 scrapy/VN_DOTHINET/requirements.txt
  • >=0.1.1 scrapy/VN_MOGIVN/requirements.txt
  • ==0.1.1 scrapy/VN_NHADATCAFELAND/requirements.txt
  • >=0.1.1 scrapy/VN_RONGBAY/requirements.txt
  • >=0.1.1 scrapy/VN_TINBATDONGSAN/requirements.txt
  • >=0.1.1 scrapy/real-estate-crawl/realestatevn/requirements.txt

Last synced: over 1 year ago

dxghost/cs224n-project
Analysing football and basketball news articles.
  • ==0.1.1 src/requirements.txt

Size: 123 KB - Last synced: about 1 year ago - Pushed: about 3 years ago

rejoiceinhope/crawler-demo
A crawler demo to illustrate web crawling.
  • * amazon_us_demo/requirements.txt

Size: 803 KB - Last synced: about 1 month ago - Pushed: over 3 years ago

aakashv8900/kaggle_summary_card
  • ==0.1.1 requirements.txt

Size: 57.6 KB - Last synced: 15 days ago - Pushed: about 3 years ago

Sbrendon98/AnimeSpider
A web scraping app made with Python and React Native to notify you of when your favorite anime is airing its new episode.
  • ==0.1.1 requirements.txt

Size: 1.82 MB - Last synced: about 1 month ago - Pushed: over 1 year ago

geekysid/Django-Projects
Projects based on Django
  • ==0.1.1 GeekySid/requirements.txt

Size: 31.4 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

tristanlatr/Interventions-Urgence-Environnement-Quebec
This software generates and upload an Excel file (also JSON) containing all information from the Registre des interventions d'Urgence-Environnement Québec. The file is updated every day.
  • ==0.1.1 setup.py

Size: 197 MB - Last synced: about 1 year ago - Pushed: about 2 years ago

AyemunHossain/IDORD
✅ Experience the power of an automated Insecure Direct Object Reference (IDOR) vulnerability detection tool. Safeguard your applications with cutting-edge technology that identifies potential security weaknesses in an efficient and streamlined manner.
  • ==0.1.1 requirements.txt

Size: 190 KB - Last synced: 6 months ago - Pushed: 6 months ago

Kosaaaaa/xkom-scrapy 📦
  • * requirements.txt

Size: 21.5 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

AdsTable/car-aggregator
WebApp, Search engine for vehicle auctions from Copart and IAAI
  • * backend/Pipfile
  • ==0.1.1 backend/Pipfile.lock

Size: 945 KB - Last synced: 6 days ago - Pushed: almost 2 years ago

kz-inx/IMDb_Scraping
IMDb_Scraping website scrapy using Django Rest Faremwork (DRF)
  • ==0.1.1 requirements.txt

Size: 2.72 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

sayashraaj/Bookmyshow_Scraper
Built with Scrapy (framework): Obtain categorised data from Bookmyshow listing
  • ==0.1.1 bookmyshow/requirements.txt

Size: 14.3 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

crazy-djactor/python_scrapy_bot
  • ==0.1.1 asp_cuz/requirement.txt

Size: 75.6 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

dmnddvrd/pyscraper
Python project using scrapy to scrape popular romanian pages. TODO: Integration with Apache Kafka + Proper docker-compose.
  • ==0.1.1 requirements.txt

Size: 8.79 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

mateja-filipovic/psz-projekat
  • ==0.1.1 requirements.txt

Size: 11.5 MB - Last synced: 7 months ago - Pushed: 11 months ago

nwizugbesamson/Aggregator
Aggregation and summary statistics on five categories jobs listed on indeed.com, au.indeed.com, uk.indeed.com, ca.indeed.com
  • ==0.1.1 requirements.txt

Size: 13.7 MB - Last synced: about 1 month ago - Pushed: over 1 year ago

yongler/Project-HouseMates-Orbital-2021
https://housematesorbital.herokuapp.com/
  • ==0.1.1 Pipfile
  • ==0.1.1 Pipfile.lock
  • ==0.1.1 requirements.txt

Size: 47.9 MB - Last synced: about 1 year ago - Pushed: almost 3 years ago

dmitryrubtsov/Test-on-Job
  • ==0.1.1 FinCase/requirements.txt

Size: 1.29 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago

rbinduran312/ScrapingGrab
  • ==0.1.1 asp_cuz/requirement.txt

Size: 5.6 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

hicham-mrani/Block1_Building-and-powering-a-data-management-infrastructure
⚠️ Block 1 : [Building and Powering a Data Management Infrastructure] Mandatory for Jedha Bootcamp certification
  • ==0.1.1 requirements.txt

Size: 596 KB - Last synced: about 1 year ago - Pushed: about 1 year ago

jayasimhagujulla/python_task
  • ==0.1.1 requirements.txt

Size: 16.6 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago

JetstreamAQ/Cubic-Zirconia
A Discord bot spawned from an inside joke.
  • * requirements.txt

Size: 90.8 KB - Last synced: 9 months ago - Pushed: 9 months ago

daniilpastukhov/scraper
  • * scraper/requirements.txt

Size: 18.6 KB - Last synced: about 1 year ago - Pushed: over 1 year ago

Freddyminu/TCC-II
Trabalho de Conclusão de curso
  • * WebCrawler-master/requirements.txt

Size: 37.7 MB - Last synced: about 1 year ago - Pushed: over 1 year ago

lopentu/nlp_web
2022 台大自然語言處理與網路應用：課程資料
  • * assignments/ptt-crawler/Pipfile

Size: 92.2 MB - Last synced: 10 months ago - Pushed: over 1 year ago