GitHub topics: python-web-scraper
saidulalimallick04/tenders-data-extraction
An Educational Purpose data extraction python script. Use to extract tenders' data.
Language: Python - Size: 13.7 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 0 - Forks: 0

Ahmocan/cftc
Language: JavaScript - Size: 1.34 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0

jpjacobpadilla/Stealth-Requests
Undetected web-scraping & seamless HTML parsing in Python!
Language: Python - Size: 714 KB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 251 - Forks: 13

omkarcloud/botasaurus
The All in One Framework to Build Undefeatable Scrapers
Language: Python - Size: 62.9 MB - Last synced at: 8 days ago - Pushed at: 15 days ago - Stars: 1,946 - Forks: 165

thewebscraping/tls-requests
TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.
Language: Python - Size: 3.69 MB - Last synced at: 11 days ago - Pushed at: 12 days ago - Stars: 56 - Forks: 4

je-suis-tm/web-scraping
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
Language: Python - Size: 1.88 MB - Last synced at: 14 days ago - Pushed at: over 3 years ago - Stars: 787 - Forks: 177

d60/twikit
Twitter API Scraper | Without an API key | Twitter Internal API | Free | Twitter scraper | Twitter Bot
Language: Python - Size: 3.38 MB - Last synced at: 16 days ago - Pushed at: about 2 months ago - Stars: 2,629 - Forks: 315

oxylabs/Python-Web-Scraping-Tutorial
In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex.
Language: Python - Size: 111 KB - Last synced at: 16 days ago - Pushed at: about 2 months ago - Stars: 282 - Forks: 30

Decodo/Python-scraper-tutorial
A short introduction to scraping with Python with given steps and an example scraper script.
Language: Python - Size: 106 KB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 30 - Forks: 5

oxylabs/aliexpress-scraper
Easily collect public AliExpress data like prices, product details, and ratings with AliExpress Scraper API
Language: Python - Size: 22.5 KB - Last synced at: 15 days ago - Pushed at: about 2 months ago - Stars: 231 - Forks: 3

Conso1eCowb0y/Deepminer 📦
Deep web crawler and search engine
Language: Python - Size: 14.6 KB - Last synced at: about 2 months ago - Pushed at: almost 5 years ago - Stars: 50 - Forks: 12

davidteather/everything-web-scraping
Learn everything web scraping with David Teather Codes on YouTube
Language: HTML - Size: 7.6 MB - Last synced at: about 2 months ago - Pushed at: almost 2 years ago - Stars: 378 - Forks: 76

oxylabs/ebay-scraper
eBay Scraper for extracting product titles, descriptions, prices, specifications, customer reviews, and ratings from eBay
Language: Java - Size: 37.1 KB - Last synced at: 27 days ago - Pushed at: about 2 months ago - Stars: 34 - Forks: 5

oxylabs/scrape-google-python
In this tutorial, we showcase how to scrape public Google data with Python and Oxylabs API.
Size: 36.1 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 47 - Forks: 0

moonlitgrace/mangareader-api
A Python based web scraping api built with fastapi that provides easy access to manga contents
Language: Python - Size: 3.53 MB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 27 - Forks: 8

luminati-io/google-flights-api
Real-time flight data from Google Flights using a free scraper or Bright Data’s high-volume Google Flights Scraper API for reliable, scalable data collection.
Language: HTML - Size: 1.84 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

oxylabs/beautiful-soup-parsing-tutorial
Using Python & Beautiful Soup to Parse Data
Language: Python - Size: 15.6 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 2 - Forks: 1

oxylabs/web-scraping-google-sheets
Guide to Using Google Sheets for Basic Web Scraping
Size: 22.5 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 97 - Forks: 2

1x-eng/chart_data_extractor
This webservice will help scrape data out of chart(s) presented on any given website. (At this moment, I only support scrape from HighCharts and AmCharts. Other libraries, maybe next time).
Language: Python - Size: 79.1 KB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 10 - Forks: 9

gayanukabulegoda/Web-Scraping-Starter-Kit
Repository designed to help freshers easily grasp the basics of web scripting, offering simple guides and examples to build a strong foundation.
Language: Python - Size: 10.7 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 7 - Forks: 0

oxylabs/python-cache-tutorial
A guide to caching web scraping scripts in Python.
Language: Python - Size: 417 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 1

oxylabs/how-to-build-web-scraper
Step by step guide to building a web scraper with Python
Language: JavaScript - Size: 65.4 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

ranindunethmina/Web-Scrapping
Repository designed to help freshers easily grasp the basics of web scripting, offering simple guides and examples to build a strong foundation.
Language: Python - Size: 46.9 KB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

Ak500k/Passwd-Manager
Password Manager WebApp using Flask
Language: HTML - Size: 1.24 MB - Last synced at: 5 months ago - Pushed at: 12 months ago - Stars: 22 - Forks: 39

nazir20/Python-Google-Image-Scrapper
Python Google Image Scraper using Selenium
Language: Python - Size: 8.49 MB - Last synced at: 1 day ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 1

khaledsoudy-1/football-fixtures-scraper
A Python web scraper that extracts detailed football match data from yallakora.com, providing a structured CSV output for easy analysis.
Language: Python - Size: 8.79 KB - Last synced at: 7 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

khaledsoudy-1/Quote-Scraper
A Python-based tool that extracts quotes and their authors from the web, allowing users to gather inspiration from multiple pages effortlessly.
Language: Python - Size: 8.79 KB - Last synced at: 7 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

akumathedyn123/python-webpage-2-txt-web2txt
This Python script extracts text content from webpages and saves it to separate files. It utilizes libraries like requests and BeautifulSoup for efficient web scraping and HTML parsing.
Language: Python - Size: 9.77 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

VaishnavSherla/Google-Scraper
A Simple Python Based Google Search Results Scraper.
Language: Python - Size: 16.6 KB - Last synced at: 9 months ago - Pushed at: over 2 years ago - Stars: 22 - Forks: 9

MaxineXiong/Music-Events-Web-Scraper
A web scraping program built to extract attribute data on music events from a popular event ticketing website. The program collects event data based on the specified country and city, which is then exported to a CSV file for marketing emails and stored efficiently in a local PostgreSQL database.
Language: Python - Size: 118 KB - Last synced at: 2 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

julzerinos/python-scraping-tools 📦
A collection of repeatable methods and concepts appearing in python web scraping with the use of Scrapy and Selenium
Language: Python - Size: 17.6 KB - Last synced at: about 2 months ago - Pushed at: over 4 years ago - Stars: 8 - Forks: 2

nirantak/scraper
Python web scrapers
Language: Python - Size: 16 MB - Last synced at: about 1 month ago - Pushed at: almost 3 years ago - Stars: 17 - Forks: 8

flavien-hugs/flask-web-scrapping
Web Scrapping app with Flask using ayrshare
Language: CSS - Size: 6.61 MB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

matthewlieb/philly-sports-news
Philly sports news content aggregator web app made with Python, HTML, and CSS. Libraries used include BS4, and Flask.
Language: HTML - Size: 43 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

Ki-Sung/100days_of_code_for_python
100days Challenge for Python Study
Language: Jupyter Notebook - Size: 38.8 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

AbderrahimAl/Facebook-Scraper
Collect data from Facebook Posts based on search queries 🦋
Language: Python - Size: 14.8 MB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 31 - Forks: 10

aferapi/funcaptcha-amazon-captcha-solver
Size: 51.8 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

ivanarena/pyscraper-cli
A CLI tool to download a whole website in one click.
Language: Python - Size: 3.91 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

G-Glitch404/daily-prices-scraper
Scraping webstes for local prices of veges everyday using requests
Language: Python - Size: 8.79 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

harishkumarreddy2/WebSpider
An opensource Web Scraping framework
Size: 26.7 MB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

jyotiradityaz/MagnumPy
MagnumPy Is An Web Scrapper And Web Crawler With Advanced Commands Making The Experience of Researching On The Web Easy
Language: Python - Size: 3.91 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

J4NN0/linkedin-web-scraper
Python Web Scraper for LinkedIn to collect and store company data (e.g. name, description, industry, etc.) into .xls file
Language: Python - Size: 158 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 28 - Forks: 5

Aditya130805/TractionF1
An iOS application integrating an extensive array of Formula One race statistics with captivating interactive elements.
Language: Swift - Size: 9.15 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

Sampad-Hegde/PublicTvKannadaLive
python program that make web scraping https://publictv.in/live and play the live stream in full screen mode but you must have good internet connection with minimum 6Mbps bandwidth
Language: Python - Size: 9.77 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 1

PRASANNAPATHI/Jobs-Web-Scraper
Jobs web scraper is the web scraping of jobs post availability
Language: Jupyter Notebook - Size: 13.7 KB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

DablewCodes/Medium-Scrapper
Scrape title, subtitle, author name & url, clap count, reading time, images and article text from Medium articles
Language: Jupyter Notebook - Size: 3.15 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

matthewgrosman/candy-crush-life-bot
Project that automatically sends lives to friends on Candy Crush
Language: Python - Size: 9.77 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

m-rauen/FlightPrices-Tracker
Python bot that scrapes specific websites looking out for flight prices in selected dates
Language: Python - Size: 23.4 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

sallamy2580/python-web-scrapping
Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist
Language: Python - Size: 1.56 MB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 8 - Forks: 0

Janca/fking-spaghetti
A bulk thumbnail downloader to scrape thumbnail images from Getty Images
Language: Python - Size: 135 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

TerranKartikTellus/Web-Scraping
All about scraping domains from the 'World Wide Web'
Language: Python - Size: 5.86 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

Strykez/fastscrape
A simple web scraper built with python and beautifulfoup.
Language: Python - Size: 5.86 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 1

ruanrf/webscraper-folha
Web scraper developed with Python in order to build text corporas from articles in "Folha de São Paulo" under a specific set of conditions.
Language: Jupyter Notebook - Size: 22.5 KB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 1

MichaelYochpaz/DWScraper
A Python web-scraper for downloading DigitalWhisper issues and articles.
Language: Python - Size: 35.2 KB - Last synced at: over 2 years ago - Pushed at: about 4 years ago - Stars: 5 - Forks: 0

Soumya117/finnparser
Language: Python - Size: 4.25 MB - Last synced at: 3 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

carterbourette/instagram-slack
A simple python web scraper to pull instagram content into slack.
Language: Python - Size: 16.6 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 3

vinitshah24/Python-Webscraper-Coronavirus
Python Web scraper to extract Coronavirus data from Worldometers website
Language: Python - Size: 19.5 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

om-mahato/scraping-avengers-characters
Its a simple python web scraper which scrapes the web page and downloads all the Avengers images.
Language: Python - Size: 92.8 KB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 1 - Forks: 0
