TheWebScrapingClub/webscraping-from-0-to-hero

The web scraping open project repository aims to share knowledge and experiences about web scraping with Python

Size: 1.13 MB - Last synced at: 6 months ago - Pushed at: 11 months ago - Stars: 1,545 - Forks: 95

kezhenxu94/house-renting 📦

Possibly the best practice of Scrapy 🕷 and renting a house 🏡

Language: Python - Size: 1.43 MB - Last synced at: 8 days ago - Pushed at: over 3 years ago - Stars: 795 - Forks: 144

lkuffo/web-scraping

Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup

Language: Python - Size: 60.6 MB - Last synced at: 19 days ago - Pushed at: 7 months ago - Stars: 353 - Forks: 206

talhashraf/major-scrapy-spiders

Scrapy spiders of major websites. Google Play Store, Facebook, Instagram, Ebay, YTS Movies, Amazon

Language: Python - Size: 77.1 KB - Last synced at: over 1 year ago - Pushed at: almost 8 years ago - Stars: 272 - Forks: 119

djm/python-scrapyd-api

A Python wrapper for working with Scrapyd's API.

Language: Python - Size: 84 KB - Last synced at: 14 days ago - Pushed at: 9 months ago - Stars: 271 - Forks: 33

DiegoCaraballo/Email-extractor

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

Language: Python - Size: 113 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 183 - Forks: 75

havanagrawal/GoodreadsScraper

Scrape data from Goodreads using Scrapy and Selenium :books:

Language: Python - Size: 5.11 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 86 - Forks: 20

AccordBox/scrapy-spider-example

Scrapy spider example for Scrapy Tutorial Series

Language: Python - Size: 7.81 KB - Last synced at: 15 days ago - Pushed at: over 7 years ago - Stars: 77 - Forks: 17

GoTrained/Scrapy-Craigslist

Web Scraping Craigslist's Engineering Jobs in NY with Scrapy

Language: Python - Size: 195 KB - Last synced at: 4 months ago - Pushed at: over 7 years ago - Stars: 66 - Forks: 37

xyjw/python-Reptile

python-Reptile

Size: 281 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 63 - Forks: 25

Sarthakjain1206/Intelligent_Document_Finder

Document Search Engine Tool

Language: Python - Size: 56.3 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 57 - Forks: 13

iam-mhaseeb/Python-Scrapy-Email-Phone-Number-Crawler 📦

Search given query on Google, and crawls for emails & phones related to the result

Language: Python - Size: 166 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 34 - Forks: 22

h7hac9/ThreatCollector

威胁情报采集系统

Language: Python - Size: 81.1 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 32 - Forks: 13

mahmudahsan/webscraping

Lets learn web scraping and apply them in real application.

Language: HTML - Size: 6.53 MB - Last synced at: 2 days ago - Pushed at: over 2 years ago - Stars: 32 - Forks: 18

J4NN0/linkedin-web-scraper

Python Web Scraper for LinkedIn to collect and store company data (e.g. name, description, industry, etc.) into .xls file

Language: Python - Size: 158 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 28 - Forks: 5

verginer/bnb_scrapy_tutorial 📦

A tutorial on how to write a scrapy spider to get data from Airbnb

Language: Python - Size: 11.7 KB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 28 - Forks: 25

Yhinner/SinaWeiboScraper

Web Scraper for Sina Weibo Search by Keywords

Language: Python - Size: 404 KB - Last synced at: 4 months ago - Pushed at: 8 months ago - Stars: 24 - Forks: 8

DotNetAge/scrapy_plus

scrapy 常用爬网必备工具包

Language: Python - Size: 53.7 KB - Last synced at: 26 days ago - Pushed at: about 2 years ago - Stars: 24 - Forks: 10

chinesehuazhou/ScrapyProject

Scrapy项目（mysql+mongodb豆瓣top250电影）

Language: Python - Size: 62.5 KB - Last synced at: 16 days ago - Pushed at: almost 8 years ago - Stars: 22 - Forks: 7

ys2843/sephora-web-crawler

A web crawler crawling all cosmetics information from Sephora implemented in Scrapy

Language: Python - Size: 9.22 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 21 - Forks: 6

gkzz/deephotel 📦

scraping TripAdvisor, Booking.com with Scrapy

Language: Python - Size: 453 KB - Last synced at: 5 days ago - Pushed at: over 4 years ago - Stars: 17 - Forks: 10

ZoranPandovski/ProdirectScraper

:necktie: Web scraper for http://www.prodirectselect.com/ :shoe:

Language: Python - Size: 115 KB - Last synced at: 25 days ago - Pushed at: 3 months ago - Stars: 16 - Forks: 9

chandrasekharan98/Multisite-Python-Crawler

An almost generic web crawler built using Scrapy and Python 3.7 to recursively crawl entire websites.

Language: Python - Size: 15.6 KB - Last synced at: 6 months ago - Pushed at: about 3 years ago - Stars: 16 - Forks: 5

jumbaeric/woocommerce_shop_scraper_to_csv

The WooCommerce Shop Scraper to CSV tool is a powerful python tool designed to simplify the process of extracting product data from a WooCommerce-powered online shop and generating a comprehensive CSV file. Built on the foundations of WordPress and WooCommerce,

Language: Python - Size: 484 KB - Last synced at: 13 days ago - Pushed at: almost 2 years ago - Stars: 14 - Forks: 5

amsimoes/spiderBet

Scrapy spiders to crawl daily betting tips from website, automatically uploading to google sheets.

Language: Python - Size: 74.2 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 14 - Forks: 3

juansimon27/scrapy-walmart

Product scraping from Walmart Canada website, with further cleaning and integration of data from a different store.

Language: Python - Size: 52.9 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 13 - Forks: 10

KaygoYM/Douyu-danmu-spark

Scrape the host's danmu information in Douyu_TV live-show and do the corresponding statistic analysis by SPARK and some Big Data technologies.

Language: Python - Size: 56.1 MB - Last synced at: about 2 years ago - Pushed at: almost 7 years ago - Stars: 12 - Forks: 4

mrt-kousha/scrapy

In this repository, I try to share some of the little tips and tricks and amazing spiders that I used to work with on the scrapy framework.

Language: Python - Size: 32.2 KB - Last synced at: about 1 year ago - Pushed at: about 5 years ago - Stars: 11 - Forks: 3

pr3sh/AppStore

Scraped Apple's App Store's most popular apps using scrapy, and performed some Exploratory Data Analysis on data, after preprocessing

Language: Python - Size: 855 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 10 - Forks: 9

13060923171/Crawl

学习爬虫的经验总结

Language: Python - Size: 5.86 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 10 - Forks: 6

sbmagar13/raidfscrape

Code to Scraping some portion of Data from forum(RaidForums[seized by FBI]) with Python SCRAPY spiders bypassing recaptcha and storing to PostgreSQL database.(used scrapper-API as captcha, proxy bypass) SQLAlchemy as ORM for PostgreSQL - Python.

Size: 482 KB - Last synced at: 1 day ago - Pushed at: about 4 years ago - Stars: 9 - Forks: 3

zhutou1280/scrapy-

校园网新闻站内搜索引擎

Language: Python - Size: 15.6 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 8 - Forks: 1

ekaputra07/kodepos

Scrapper Kode POS Indonesia berbasis Python Scrapy. Sumber kode POS: http://kodepos.nomor.net

Language: Python - Size: 1.79 MB - Last synced at: 19 days ago - Pushed at: 12 months ago - Stars: 7 - Forks: 2

livioso/moritz-tutti-scrapy

🐭 Get notified on Slack about new offers on Tutti.ch

Language: Python - Size: 924 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 7 - Forks: 2

activatedgeek/winemag-dataset

Dataset of Wine Reviews from Wine Enthusiast Magazine :grapes: :wine_glass: :earth_asia:

Language: Python - Size: 23.4 KB - Last synced at: 15 days ago - Pushed at: about 6 years ago - Stars: 7 - Forks: 7

revantg/scraping_courses

Scrapy Spider for scraping an entire complex course-website.

Language: Python - Size: 789 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 7 - Forks: 1

schmwong/APAC-McDelivery-Menu-Logger

Automatically scrapes McDelivery menu data and records it for future visualisation projects

Language: Python - Size: 36.6 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 6 - Forks: 2

vishnu-sagar/Web-Scrapping-E-commerce-websites

Contains all the code of IoT projects in python

Language: Python - Size: 475 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 2

OliverJoo/AI_Stocktrading_Reinforcementlearning

AI Stock Trading System by Reinforcement Learning and Natural Language Processing

Language: Python - Size: 44.9 KB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 6 - Forks: 1

dori-dev/quotes-crawler

Quotes crawler using scrapy and python.

Language: Python - Size: 13.7 KB - Last synced at: 6 days ago - Pushed at: almost 3 years ago - Stars: 6 - Forks: 0

theShmoo/DSA5RegelWikiParser

Scrapy Spider that crawls the DSA5 Regel Wiki "http://www.ulisses-regelwiki.de/"

Language: Python - Size: 23.4 KB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 6 - Forks: 2

vinifsouza/racom-bot

Chatbot construido com o framework Rasa para responder dúvidas referentes ao COVID-19.

Language: Python - Size: 80.3 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 5 - Forks: 0

isabek/Logo-Extractor

Crawler which extracts logos from websites

Language: Python - Size: 17.6 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 0

NguyenDa18/Portland-Jail-Data-Crawler

Scraper used for recording changes to Portland jail database

Language: Jupyter Notebook - Size: 37.8 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 4 - Forks: 0

farukalamai/yelp-scraper-scrapy-python

Yelp Restaurant data scraping using python, scrapy spider

Language: Python - Size: 23.4 KB - Last synced at: 24 days ago - Pushed at: almost 2 years ago - Stars: 4 - Forks: 2

RGGH/Scrapy14

Scraping News Stories From Multiple Sources

Language: Python - Size: 87.9 KB - Last synced at: 18 days ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 3

iam-mhaseeb/OLX-Crawler 📦

This repository contains code of olx crawler to extract public phone numbers.

Language: Python - Size: 297 KB - Last synced at: about 2 years ago - Pushed at: almost 6 years ago - Stars: 4 - Forks: 1

Udit1999/Scrapy-Alibaba-Ecommerce

📷 web scrapping in python using Scrapy

Language: Python - Size: 21.2 MB - Last synced at: 10 months ago - Pushed at: almost 6 years ago - Stars: 4 - Forks: 0

ehsanmojab/scrapy-lms

Scrapy spider to collect student IDs with fullname from LMS website of University of Sistan and Baluchestan.

Language: Python - Size: 215 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 0

venkatamutyala/wordpress-plugins-crawler-scrapy

Scrapy scripts to crawl all WordPress.org plugins

Language: Python - Size: 14.6 KB - Last synced at: 1 day ago - Pushed at: 11 months ago - Stars: 3 - Forks: 0

boh5/xueshu_spider

A spider to crawl papers by xueshu.baidu.com, and download papers

Language: Python - Size: 65.7 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 2

bassem97/scrapy_real_estate_project

data scraping with python scrapy tool ❤

Language: Python - Size: 2.39 MB - Last synced at: 2 days ago - Pushed at: almost 3 years ago - Stars: 3 - Forks: 0

AyemunHossain/Scrapy-Web-Crawler-projects

Python crawler with Scrapy framework, which may help you to learn webscrapping.

Language: Python - Size: 65.4 KB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 0

rashidul738/Selenium-Automation-Project

Selenium Automation Project

Language: Python - Size: 5.56 MB - Last synced at: 2 months ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 2

anoduck/fbcrawl Fork of rugantio/fbcrawl

A Facebook crawler

Language: Python - Size: 1.54 MB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 3 - Forks: 0

santhoshse7en/IMDb-Scrapy

A fun projects made using Scrapy. The Spiders included in this are able to extract Movie, TV-Series, TV-Movies based on year and title type. A lot more to come ahead

Language: Python - Size: 97.7 KB - Last synced at: about 2 months ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 0

akshayjoyinfo/Scrape-books-toscrape-com

This is the sample repository for using Scrapy with extract the contents from web

Language: Python - Size: 68.4 KB - Last synced at: about 2 years ago - Pushed at: almost 6 years ago - Stars: 3 - Forks: 0

jayeshmanani/Web-Scraping-Using-Scrapy

This repository consist of the code and some related files for use and scrape the website data. Here in the example it is demonstrated with the craigslist.org website.

Language: Python - Size: 6.84 KB - Last synced at: about 2 years ago - Pushed at: almost 6 years ago - Stars: 3 - Forks: 3

littlemo/moear-spider-zhihudaily

MoEar的爬虫插件，用以提供对知乎日报的文章爬取以及文章格式化等功能

Language: Python - Size: 283 KB - Last synced at: 14 days ago - Pushed at: almost 7 years ago - Stars: 3 - Forks: 3

franck-gaspoz/MovieDbAssistant

Generates Movie documents (HTML, movie database,...) using Web Crawlers ( IMDb, ... )

Language: C# - Size: 454 MB - Last synced at: 17 days ago - Pushed at: 5 months ago - Stars: 2 - Forks: 0

noseparte/hero-kills-reptile

:snowflake: 英雄杀三部曲：英雄杀爬虫项目, 爬取英雄资料以及卡牌信息

Language: Python - Size: 2.09 MB - Last synced at: 2 months ago - Pushed at: 11 months ago - Stars: 2 - Forks: 0

KarthikDani/LinkedIn-Company-Data-Scraping-System

Scrapy framework based software to scrape the LinkedIn directory and company profiles.

Language: Python - Size: 31.1 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 1

flyosprey/Product-Extractor-Flask

Product Extractor is designed to get main information about a product of zamorskiepodarki.com/

Language: CSS - Size: 30.6 MB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

Jeffallan/Ebook-API

The fast and easy way to fulfill all your ebook needs

Language: Python - Size: 42 KB - Last synced at: 5 days ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 1

PerezChris99/web-crawler-py

This is a web scraper i plan to use for my personal benefit

Language: HTML - Size: 30.3 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

sejal-rajput/Amazon-web-scraping-using-Scrapy-Framework

A web scraping script using scrapy framework of python to extract data from amazon.com website.

Language: Python - Size: 43.9 KB - Last synced at: 2 months ago - Pushed at: about 3 years ago - Stars: 2 - Forks: 1

tanjimanasreen/gsmarena-crawler

A collection of crawlers using Selenium, Scrapy-Framework and BS4

Language: Python - Size: 669 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 2 - Forks: 1

Aly-Reda/Scraper_School

complete guide to scrape almost any website

Language: Python - Size: 53.7 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 2 - Forks: 0

andy-clarke-uofg/Pundits-Review-Scraping

Development of the scraping process used to collect data for the Pundits Review website - https://www.punditsreview.com/

Language: Jupyter Notebook - Size: 431 KB - Last synced at: about 1 month ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 0

EANadim/engineer-lagbe

A scraper that collects job openings in Bangladesh related to information technology from various job searching platform sites as well as career page of various software industries and dumps them into MongoDB.

Language: Python - Size: 21 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 0

diegocedrim/shopify-ratings-spider

An experimental python spider to collect reviews of all Shopify apps

Language: Python - Size: 8.79 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 2 - Forks: 2

diwamishra21/Python-URL-Scrapper

fetch content through URL and save it to a json file using python Scrapy scrapper

Language: Python - Size: 5.86 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 2 - Forks: 0

Aly-Reda/goodreads_qoutes_scraper

Language: Python - Size: 5.86 KB - Last synced at: about 2 years ago - Pushed at: almost 7 years ago - Stars: 2 - Forks: 0

naqushab/GeeksforGeeks-Crawler

Scrapy based GeeksforGeeks crawler

Language: Python - Size: 20.5 KB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 2 - Forks: 2

Austerius/LootBet-scraper

Scripts for scraping esport betting data from web site Loot.bet using Selenium - BeautifulSoup/scrapy and css selectors

Language: Python - Size: 12.7 KB - Last synced at: over 1 year ago - Pushed at: about 7 years ago - Stars: 2 - Forks: 1

julianyulu/itunes-Scrapy

scrape daily top rated songs, artists and albums from iTunes

Language: Python - Size: 190 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 2 - Forks: 0

ahegel/web-scrapers

Programs to scrape websites using the Scrapy package in Python

Language: Python - Size: 82 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 2 - Forks: 0

marinakiseleva/wiki-scraper

This web crawler uses Scrapy py to crawl Wikipedia. It prints the page title, total word count, and page category (using openpyxl) to an Excel workbook, in order to analyze the verbosity of articles by category.

Language: Python - Size: 4.88 KB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 2 - Forks: 1

filipemanuelofs/scrapy-camaralegislativa

Utilização do Scrapy para algumas páginas da Câmara Legislativa

Language: Python - Size: 34.2 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 2 - Forks: 0

jllan/QADoor-Mongo

爬取segmentfault，stackoverflow等网站的数据并展示

Language: JavaScript - Size: 1.89 MB - Last synced at: over 1 year ago - Pushed at: almost 8 years ago - Stars: 2 - Forks: 0

Solihatun1/AI-Cursor-Scraping-Assistant

A powerful tool that leverages Cursor AI and MCP (Model Context Protocol) to easily generate web scrapers for various types of websites.

Language: Python - Size: 16.6 KB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 1 - Forks: 0

aa-nadim/trip-crawler

This project is designed for web scraping and managing data using Docker containers. It includes services for a PostgreSQL database, a web scraper, pgAdmin, and a testing setup.

Language: Python - Size: 33.2 KB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

marcellin-d/Shopclue-Spider

Shopclue Spider is a Scrapy-based web scraper designed to extract product data from Shopclues categories. This project effectively bypasses AJAX requests to collect detailed information about products, sellers, and their ratings.

Language: Python - Size: 0 Bytes - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

marcellin-d/Rightmove-Property-Scraper

A web scraping project developed with Scrapy to extract property data from the Rightmove website. This project collects detailed information on properties for sale in London, including addresses, property types, bedrooms, transactions, and geographical coordinates.

Language: Python - Size: 179 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

hericlibong/HIDDEN_API_FIFA_RANKING_MEN_SCRAPING

Scraping full historical and upataded fifa ranking with hidden fifa API

Language: Python - Size: 1000 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

MargotMarchais/Web_scraping_hiking

Python web scraping project. I scraped data from 3 French websites dedicated to hiking trips, using different techniques: Scrapy, Selenium, Requests x BeautifulSoup. Finally, I cleaned, merged and analyzed data using Dataiku DSS.

Language: Python - Size: 6.84 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 1 - Forks: 0

khinydnlin/webtoons_scraper

Created a web scraper to collect trending webtoons data

Language: Python - Size: 56.6 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

mahendra-shah/news_scrapy

Extracts data from the news articles.

Language: Python - Size: 14.6 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

Ismat-Samadov/birja_com

Web Scraping

Language: HTML - Size: 58.1 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

Ismat-Samadov/h2h_az

Data Scraping

Language: Python - Size: 685 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

Ismat-Samadov/rahatemlak_az

Web Scraping with Scrapy

Language: HTML - Size: 62.2 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

Ismat-Samadov/unvan_az

Language: Jupyter Notebook - Size: 82.6 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

Ayon-SSP/amazon-scraper-alert-system

This is a simple Amazon Product Scraper & Alert System built using scrapy module in python

Language: Python - Size: 17.6 KB - Last synced at: 12 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

Ismat-Samadov/arenda_az

Data Extraction From arenda_az

Language: Python - Size: 1.42 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

thien20/anime-scraping-selenium-and-scrapy

A short cut for handling "Web-Scraping" without importing a full framework using selenium | Scrapy

Language: Jupyter Notebook - Size: 184 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

xxl4tomxu98/scrapy_web_crawler

Integration of django and scrapy package for web scraping

Language: Python - Size: 21.5 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

Jaimin1104/IMDB_Web_Scraping_Project

I have used scrapy framework to scrape data from the IMDB website of Movies like name, directors, actors, votes, duration, genre and imdb rating. i had uploaded this spider on zyte cloud platform to run on it and i scraped about 8 lakhs rows of data from IMDB of different genres.

Language: Python - Size: 33 MB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 1

Jaimin1104/GITHUB_Web_Scraping_Project

This repository is about my web scraping project using Scrapy framework and i used scrapy framework to scrape data from Github website of topics name and topic url. I stored this information in csv and json file.

Language: Python - Size: 33 MB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

Jaimin1104/BCCI_Web_Scraping_Project

I have used scrapy framework to scrape data from the BCCI website of men players like name, date of birth, introduction or their background and their social media profile links. I have also scraped bowling and batting records of their career in all formats like test, ODI and T20I.

Language: Python - Size: 30.8 MB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

MaxValue/IsJavascriptWorking 📦

test if your damn browser has JS enabled

Language: HTML - Size: 1000 Bytes - Last synced at: 12 months ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 1