AnthonyBloomer/nrscrapy

Monitor Scrapy using the New Relic Python Agent API

Language: Python - Size: 44.9 KB - Last synced: about 1 month ago - Pushed: over 1 year ago - Stars: 1 - Forks: 2

epu-ntua/qualichain-jobcrawler

Language: Python - Size: 99.6 KB - Last synced: 19 days ago - Pushed: about 2 months ago - Stars: 3 - Forks: 1

mrt-kousha/scrapy

In this repository, I try to share some of the little tips and tricks and amazing spiders that I used to work with on the scrapy framework.

Language: Python - Size: 32.2 KB - Last synced: 3 months ago - Pushed: over 4 years ago - Stars: 11 - Forks: 3

varunnayal15112/E-Commercial-Sites-Scrappers

Developed various python scripts using Scrapy Framework for scraping various E-Commerce Sites like AliExpress, Flipkart, Amazon and Ebay along with the DataBase Connectivity [MYSQLWorkbench].

Language: Python - Size: 18.6 KB - Last synced: about 2 months ago - Pushed: over 6 years ago - Stars: 38 - Forks: 14

mtaziz/email-scraper-using-google-x-ray-search-with-linkedin

Language: HTML - Size: 230 KB - Last synced: 8 months ago - Pushed: almost 6 years ago - Stars: 3 - Forks: 0

skatepedia/skatepedia-api

An skate API with scraped data, using Scrapy + Django

Language: Python - Size: 2.79 MB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 4 - Forks: 0

crawlbase/scrapy-proxycrawl-middleware 📦

Scrapy middleware interface to scrape using ProxyCrawl proxy service

Language: Python - Size: 34.2 KB - Last synced: 23 days ago - Pushed: 11 months ago - Stars: 10 - Forks: 3

xtutran/sohoa-crawler

Scrape users's comment from Vnexpress.net using Python Scrapy

Language: Python - Size: 9.77 KB - Last synced: 10 months ago - Pushed: over 6 years ago - Stars: 0 - Forks: 0

ljanyst/scrapy-do

A daemon for scheduling Scrapy spiders

Language: Python - Size: 1.27 MB - Last synced: 10 days ago - Pushed: about 3 years ago - Stars: 65 - Forks: 18

dojutsu-user/IMDB-Scraper

Scrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.

Language: Python - Size: 15.4 MB - Last synced: about 1 year ago - Pushed: about 4 years ago - Stars: 42 - Forks: 12

CharesFang/WeiboSpider

微博爬虫，一个基于Scrapy框架的轻量微博爬虫，Sina Weibo Spider

Language: Python - Size: 1.12 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 94 - Forks: 22

NikamRohan/Price-Tracker

A Price Tracker to track the prices of your willing to buy products at E-Commerce websites once they fall below your mentioned Desired price.

Language: Python - Size: 142 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 7 - Forks: 7

Jaimin1104/IMDB_Web_Scraping_Project

I have used scrapy framework to scrape data from the IMDB website of Movies like name, directors, actors, votes, duration, genre and imdb rating. i had uploaded this spider on zyte cloud platform to run on it and i scraped about 8 lakhs rows of data from IMDB of different genres.

Language: Python - Size: 33 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 1 - Forks: 1

NikamRohan/News-Aggregator

News Aggregator Using Python,Django ,Scrapy Frameworks.

Language: Python - Size: 5.31 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 18 - Forks: 7

mahmudahsan/webscraping

Lets learn web scraping and apply them in real application.

Language: HTML - Size: 6.53 MB - Last synced: 10 months ago - Pushed: over 1 year ago - Stars: 28 - Forks: 18

yashpatel7025/PriceTracker

Amazon Price tracker using Python, Django, Celery Task Queue and Scrapy Frameworks. Front end is developed using HTML, CSS and Bootstrap

Language: Python - Size: 4.93 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 29 - Forks: 11

santhoshse7en/IMDb-Scrapy

A fun projects made using Scrapy. The Spiders included in this are able to extract Movie, TV-Series, TV-Movies based on year and title type. A lot more to come ahead

Language: Python - Size: 97.7 KB - Last synced: about 1 year ago - Pushed: almost 4 years ago - Stars: 2 - Forks: 0

thawdezin/agent

This is my B.E Thesis project.

Language: PHP - Size: 17.8 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0

matejbasic/PythonScrapyBasicSetup

Basic setup with random user agents and IP addresses for Python Scrapy Framework.

Language: Python - Size: 29.3 KB - Last synced: over 1 year ago - Pushed: over 6 years ago - Stars: 57 - Forks: 14

jayeshmanani/Web-Scraping-Using-Scrapy

This repository consist of the code and some related files for use and scrape the website data. Here in the example it is demonstrated with the craigslist.org website.

Language: Python - Size: 6.84 KB - Last synced: about 1 year ago - Pushed: about 5 years ago - Stars: 3 - Forks: 3

rkeytech/scrapy-adventure

A Scrapy Framework project on scraping a site with pagination, extracting item information, and outputing it to a csv file or inserting it to a database.

Size: 1.95 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

adamfisher/ScrapyRT.Client

A C# client to make calls to a scrapyrt (Scrapy real-time) HTTP endpoint.

Language: C# - Size: 85.9 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0

chaudharypraveen98/QuotesTutorial

This is a scraper which scrapes the quotes on the website using the scrapy framework

Language: Python - Size: 9.55 MB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 0 - Forks: 0

marlesson/scrapy_booking

This is a simple Scrapy Project to scrape Hotels

Language: Python - Size: 15.6 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 1 - Forks: 0

spandanpal22/Web_Scraping_Amazon

This project uses Scrapy framework to do web scraping on Amazon

Language: Python - Size: 15.6 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

an-anurag/learn-scrapy

A complete scrapy course with code snippets and notes

Language: Python - Size: 8.79 KB - Last synced: about 1 year ago - Pushed: about 5 years ago - Stars: 0 - Forks: 1

stivenramireza/quotes-to-scrape-website

Scrapy exercises to extract data from quotes.toscrape.com website.

Language: Python - Size: 6.84 KB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0

rafaelhenrique/curse_spider

Curse client for Mac/Linux/Wherever

Language: Python - Size: 10.7 KB - Last synced: 2 months ago - Pushed: almost 6 years ago - Stars: 9 - Forks: 0

varunnayal15112/Codeforces-AC-Submissions-Downloader

Downloading AC Submisison files for a given user handle from Codeforces Platform using Scrapy Framework in Python.

Language: Python - Size: 38.1 KB - Last synced: over 1 year ago - Pushed: about 6 years ago - Stars: 4 - Forks: 0

heman2002/EdgarDataScrapper

Language: Python - Size: 9.77 KB - Last synced: over 1 year ago - Pushed: over 6 years ago - Stars: 1 - Forks: 0