GitHub topics: web-scraping-python

Repositories

kaushik-prasad-dey/Data_science_Machine_Learning_Projects

Real_world_data_science_machine_learning_projects

Language: Jupyter Notebook - Size: 54.4 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

Morgscode/desktop-webpage-text-crawler

This desktop GUI will index, format and create .txt files from the text content from webpages you request, so long as HTML or JSON is sent as a response. You can crawl sites as single pages, crawl all internal links on a page, or crawl all links within the page's <nav> tag(s). You can also decide to extract only page titles, the main text content, or all text content from the page. The crawler has some built-in basic error logging.

Language: Python - Size: 103 KB - Last synced at: over 1 year ago - Pushed at: almost 5 years ago - Stars: 4 - Forks: 0

ayush-raj13/WebScrapideo

Text Summarizer, Flipkart Web Scraper and Online Video Downloader

Language: JavaScript - Size: 413 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 2 - Forks: 3

okonb/recover-youtube-playlists

Recover your playlists removed by YouTube's community guidelines bots

Language: Python - Size: 59.6 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

GigaHertzLegacy-SpiderX/Py_Web_Scrape

A handy Web Scraping tool using python

Language: Python - Size: 15.6 KB - Last synced at: almost 2 years ago - Pushed at: about 3 years ago - Stars: 2 - Forks: 2

dumisanimagagula/mercedes-benz-dealership-scraper

An end-to-end Python project that scrapes car dealership data from Cars.com, conducts data analysis and visualization, and provides insights into Mercedes-Benz vehicles in the market.

Language: Jupyter Notebook - Size: 1.41 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

MinahilSadiq1/Introduction-to-Data-Science_Assignments

This repository contains all tasks i performed in my (Introduction to Data Science) course.

Language: HTML - Size: 348 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

partner0307/flask-web-scrapping

This is flask app to scrap the website and export to excel file. Let's create a new world with shinobi

Language: Python - Size: 8.79 KB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

PB2204/Covid-19

This Is A Web Scraping Projects With Covid-19 Data From 2 Very Popular & Authentic Websites

Language: Jupyter Notebook - Size: 9.77 KB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 18 - Forks: 0

Zubdata/.github

Size: 333 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

e-hengirmen/metu-NTE-scraper

Language: Python - Size: 7.22 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 9 - Forks: 3

saiksaif/website-movies-data-scrapper

A website movies data scrapper including m3u8 url

Language: HTML - Size: 29.4 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

BrenoAV/articles-to-kindle

Script to send articles to Kindle

Language: Python - Size: 4.5 MB - Last synced at: 8 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

SemenovY/scrapy_parser_pep

Парсер документов PEP на базе фреймворка Scrapy, собирающий данные о PEP с сайта https://www.python.org/

Language: Python - Size: 44.9 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

zkradija/web-cijene

web scraping FMCG prices / web scraping cijena konditorskih i deterdžentsko-toaletnih proizvoda

Language: Python - Size: 19.6 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

mtttech/cnb

Just a tool to rip UFC fighter stats.

Language: Python - Size: 70.3 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

santost12/python-scraping

scraping websites using python

Language: Python - Size: 9.77 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

scrapingbypass/scrapingbypass.github.io Fork of daviddarnes/alembic

scrapingbypass.github.io

Language: SCSS - Size: 5.5 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

scrapingbypass/google-serp-scraper

Google SERP scraper

Size: 2.93 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

Alex188dot/WebScraping

This Web Scraping program was inspired by PitoneProgrammatore's Youtube video Web Scraping ITA - Tutorial Beautiful Soup Python.

Language: Python - Size: 4.88 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

kawsarlog/funda-scraper

Funda Scraper is a powerful Python web scraping tool designed to gather data from https://www.funda.nl. This versatile script utilizes the popular requests library to retrieve web pages and leverages the parsing capabilities of BeautifulSoup (bs4) to extract relevant information from the HTML content.

Language: Jupyter Notebook - Size: 805 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

Divuzki/DevDiv

A comprehensive platform that aggregates headlines from various sources and allows users to post their own news. Our site employs a powerful web scraping mechanism to extract and clean data from external links, storing it securely in a database. With the convenience of a Django command, performing scheduled scraping tasks via cron jobs.

Language: CSS - Size: 20.9 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 0

kyaiooiayk/Website-Scrapers

Series of scripts to scrap data from websites in order to create a dataset for ML/AI

Language: HTML - Size: 970 KB - Last synced at: 10 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

IIvexII/zameen-com-scrapper

Language: Python - Size: 38.1 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

FeridunDuran/python-website-change-detector

This Python script, "Website Change Detector," is designed to monitor specific websites for content changes.

Language: Python - Size: 1.95 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

albertoscala/onion-peeler

Onion-Peeler is a simple web-crawler designed specifically for understanding the web crawling and navigating the depths of the Tor network, commonly known as the darkweb, in an easier way. This project aims to map and explore hidden websites in this anonymized part of the internet.

Language: Python - Size: 3.91 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

Moffi-bit/Amazon-Scraper

Simple amazon scraper with some cool functionality.

Language: Python - Size: 126 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 11 - Forks: 1

codekushalS/Anime-Data-Scraper

A web scraper to extract anime data from https://animeseries.so/ and convert it into csv format for further use.

Language: Jupyter Notebook - Size: 2.12 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

kconstable/resume-matching-to-job-rss-feed

In this project, I scrape a job search board and calculate and visualise matches to my resume+cover letter using Natural Language Processing (NLP)

Language: Jupyter Notebook - Size: 229 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

MustakAbsarKhan/stock_watch_py_script

Stock Watch Python Script - A tool for scraping stock data from Dhaka Stock Exchange (DSE) and Chittagong Stock Exchange (CSE) websites.

Language: HTML - Size: 39.3 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

drshahizan/python-web

This topic explains how to implement web scraping and python web development. Web scraping topics such as scrapy, beautiful soup, and others will be covered. A case study based on a Malaysian website.

Language: Jupyter Notebook - Size: 3.15 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 53 - Forks: 42

x4leqxinn/telegram-bot-scraper

Work in progress ...

Language: Python - Size: 97.7 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

livxy/Facebook-Marketplace-Vehicle-Scraper Fork of TanmayChhatbar/Facebook-Marketplace-Vehicle-Scraper

Updated version of Facebook-Marketplace-Vehicle-Scraper with more working features!

Language: Python - Size: 34.2 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 18 - Forks: 6

M4theus13/Hashtag-treinamento

Intensivão de Python do hashtag-treinamento abordando alguns temas, como Automação de Processos, Análise de Dados, Web Scrapping e Machine Learning

Language: Python - Size: 167 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

Tarikhoza/JapaneseDataHorder

Data-scraper for various japanese learning tools(Takoboto, Tatoeba, Ichimoe and OJAD)

Language: Python - Size: 83 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

Tipologia-y-Ciclo-de-Vida-de-los-Datos/Practica1-Web_Scraping

Web Scraping de la web Expatistan

Language: Jupyter Notebook - Size: 5.66 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

Nayemjaman/mobilehouse

Scraped news data using Scrapy and make a pipeline to push data in PostgreSQL database.

Language: Python - Size: 3.83 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0

Tackling/Twitch-Channel-Checker

This Python script uses the Twitch API to check if channels are live or offline. It creates multiple worker threads to check channels in parallel and saves the results to two separate text files, one for live channels and another for offline channels.

Language: Python - Size: 10.7 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0