beautifulsoup4 | Topic | Ecosyste.ms: Repos

MakiNaruto/Automatic_ticket_purchase

大麦网抢票脚本

Language: Python - Size: 1.34 MB - Last synced at: 8 months ago - Pushed at: almost 2 years ago - Stars: 4,728 - Forks: 877

PaulMcInnis/JobFunnel

Scrape job websites into a single spreadsheet with no duplicates.

Language: Python - Size: 2.55 MB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 2,070 - Forks: 254

mariosemes/PornHub-downloader-python

Download stuff from PH the easy way.

Language: Python - Size: 40 KB - Last synced at: 3 months ago - Pushed at: about 2 years ago - Stars: 852 - Forks: 198

豆瓣电影top250、斗鱼爬取json数据以及爬取美女图片、淘宝、有缘、CrawlSpider爬取红娘网相亲人的部分基本信息以及红娘网分布式爬取和存储redis、爬虫小demo、Selenium、爬取多点、django开发接口、爬取有缘网信息、模拟知乎登录、模拟github登录、模拟图虫网登录、爬取多点商城整站数据、爬取微信公众号历史文章、爬取微信群或者微信好友分享的文章、itchat监听指定微信公众号分享的文章

Language: Python - Size: 1.68 MB - Last synced at: 8 months ago - Pushed at: over 3 years ago - Stars: 789 - Forks: 276

pcomputo/Whole-Foods-Delivery-Slot

Automated script for Whole Foods and Amazon Fresh delivery slot

Language: Python - Size: 471 KB - Last synced at: 8 months ago - Pushed at: over 4 years ago - Stars: 443 - Forks: 150

sskender/pornhub-api

Unofficial API for PornHub.com in Python

Language: Python - Size: 39.1 KB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 430 - Forks: 93

roniemartinez/dude 📦

dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators

Language: Python - Size: 2.49 MB - Last synced at: 21 days ago - Pushed at: 10 months ago - Stars: 428 - Forks: 19

lkuffo/web-scraping

Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup

Language: Python - Size: 60.5 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 377 - Forks: 215

Trinkle23897/learn2018-autodown

清华大学新版网络学堂课程自动下载脚本 / A python script to clone all files from learn.tsinghua.edu.cn

Language: Python - Size: 1.48 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 336 - Forks: 74

brutalsavage/facebook-post-scraper

Facebook Post Scraper 🕵️🖱️

Language: Python - Size: 37.1 KB - Last synced at: 8 months ago - Pushed at: about 3 years ago - Stars: 332 - Forks: 119

lb2281075105/Python-WeChat-ItChat

微信机器人，基于Python itchat接口功能实例展示：01-itchat获取微信好友或者微信群分享文章、02-itchat获取微信公众号文章、03-itchat监听微信公众号发送的文章、04 itchat监听微信群或好友撤回的消息、05 itchat获得微信好友信息以及表图对比、06 python打印出微信被删除好友、07 itchat自动回复好友、08 itchat微信好友个性签名词云图、09 itchat微信好友性别比例、10 微信群或微信好友撤回消息拦截、11 itchat微信群或好友之间转发消息

Language: Python - Size: 102 KB - Last synced at: 2 months ago - Pushed at: over 5 years ago - Stars: 293 - Forks: 116

tirthajyoti/Web-Database-Analytics

Web scrapping and related analytics using Python tools

Language: Jupyter Notebook - Size: 4.24 MB - Last synced at: 8 months ago - Pushed at: over 5 years ago - Stars: 274 - Forks: 167

cwjokaka/ok_ip_proxy_pool

🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池

Language: Python - Size: 77.1 KB - Last synced at: 9 months ago - Pushed at: almost 5 years ago - Stars: 252 - Forks: 68

bomquote/transistor

Transistor, a Python web scraping framework for intelligent use cases.

Language: Python - Size: 2.19 MB - Last synced at: 7 days ago - Pushed at: 10 days ago - Stars: 214 - Forks: 20

Abhijeet-AR/Competitive_Programming_Score_API

API to get user details for competitive coding platforms - Codeforces, Codechef, SPOJ, Interviewbit

Language: Python - Size: 12.2 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 176 - Forks: 55

0xPrateek/Stardox

Github stargazers information gathering tool

Language: Python - Size: 212 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 171 - Forks: 67

nuhmanpk/WebScrapper

Powerful Telegram bot for web scraping and crawling. Fast, easy, and loved by thousands!

Language: Python - Size: 520 KB - Last synced at: 6 months ago - Pushed at: 11 months ago - Stars: 169 - Forks: 103

Jimut123/jimutmap

API to get enormous amount of high resolution satellite images from satellites.pro quickly through multi-threading! create map your own map dataset. Bringing data to Humans.

Language: Python - Size: 3.9 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 154 - Forks: 18

sakship31/News-Aggregator

Django project to scrape a news website using Beautiful soup and display in our template.

Language: Python - Size: 11.9 MB - Last synced at: 4 months ago - Pushed at: almost 2 years ago - Stars: 128 - Forks: 37

sulasoft/Amacapy-Bot-Telegram-Amazon-Affiliates

Amacapy is a software that does web scraping to the Amazon website and publishes them on Telegram, searches the products by the keyword entered or the direct link of the product. Then you can publish these products on Telegram in a certain time. The technologies used were Flet, Beautiful Soup and Python.

Language: Python - Size: 395 KB - Last synced at: 6 months ago - Pushed at: about 1 year ago - Stars: 127 - Forks: 23

dimitryzub/scrape-google-scholar-py

Extract data from all Google Scholar pages from a single Python module.

Language: Python - Size: 12.9 MB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 116 - Forks: 21

codingforentrepreneurs/Web-Scraping

Learn how to leverage Python's amazing tools to scrape data from other websites. The end goal of this course is to scrape blogs to analyze trending keywords and phrases. We'll be using Python 3.6, Requests, BeautifulSoup, Asyncio, Pandas, Numpy, and more!

Language: Python - Size: 22.5 KB - Last synced at: 5 months ago - Pushed at: about 7 years ago - Stars: 115 - Forks: 65

aglorice/CtripSpider

携程评论爬虫，使用线程池来爬取热门景区评论，简单易用。一键爬取任意省的所有热门景区并分析评论数据，可视化展示。

Language: Python - Size: 3.53 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 110 - Forks: 16

yousefkotp/Movies-and-Series-Scraper

A console application to scrape a valid watching links for any movie or series with exact season and episode number, you can also download a whole season with one click.

Language: Python - Size: 34.3 MB - Last synced at: almost 3 years ago - Pushed at: about 3 years ago - Stars: 90 - Forks: 16

aglorice/new_xxt 📦

学习通,泛雅，超星尔雅，无需浏览器，直接运行（已打包为exe），支持批量导出答案，多用户批量完成作业✨✨✨

Language: Python - Size: 2.6 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 88 - Forks: 3

jcwill415/Stock_Market_Data_Analysis

Scrape, analyze & visualize stock market data for the S&P500 using Python. Build a basic trading strategy using machine learning to assess company performance and determine buy, sell, hold. Read me & instructions available in Spanish. This is a working repo, with plans to expand the project from technical analysis to fundamental analysis.

Language: Jupyter Notebook - Size: 149 MB - Last synced at: 7 months ago - Pushed at: over 5 years ago - Stars: 87 - Forks: 35

skekre98/NBA-Search

flask application designed to explore NBA statistics :basketball:

Language: Python - Size: 8.05 MB - Last synced at: 9 months ago - Pushed at: over 1 year ago - Stars: 83 - Forks: 75

tzuhsial/edgar-10k-mda

Download and extract MDA section from edgar 10k forms

Language: Python - Size: 1.92 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 76 - Forks: 32

farrael004/Quest

This is a web app that integrates GPT-3 with google searches

Language: Python - Size: 1.72 MB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 71 - Forks: 15

melizeche/dolarPy

Checks USD/PYG exchange rate from several sites, with a calculator, RESTful API and a twitter bot

Language: HTML - Size: 217 KB - Last synced at: 3 days ago - Pushed at: 7 days ago - Stars: 68 - Forks: 47

corazzon/finance-data-analysis

인프런 - 증권 데이터 수집과 분석으로 신호와 소음 찾기

Language: Jupyter Notebook - Size: 18.4 MB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 67 - Forks: 61

boringPpl/Linkedin-profiles-scraping

Automatically scrape the web data of people profiles on Linkedin based on a specific search query

Language: Jupyter Notebook - Size: 25.4 KB - Last synced at: 5 months ago - Pushed at: about 2 years ago - Stars: 66 - Forks: 32

MLArtist/WebScraper

Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.

Language: Python - Size: 43.9 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 61 - Forks: 14

sb-child/lsp

python 爬虫, golang 爬虫: 涩涩网站学习资料视频爬取下载工具完美适配 miya(蜜芽)和 yysp(夜夜视频, 夜夜視頻)

Language: Go - Size: 246 KB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 57 - Forks: 7

ZKAW/website-cloner

Basic website cloner written in Python

Language: Python - Size: 3.91 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 53 - Forks: 13

ryanirl/CraigslistScraper

Simple webscraper for Craigslist.

Language: Python - Size: 2.48 MB - Last synced at: about 10 hours ago - Pushed at: over 1 year ago - Stars: 51 - Forks: 23

hackersandslackers/beautifulsoup-tutorial

:sparkles: :ramen: Scrape webpage metadata using BeautifulSoup.

Language: Python - Size: 2.82 MB - Last synced at: 20 days ago - Pushed at: 23 days ago - Stars: 50 - Forks: 17

zocomputer/selectron

AI web parser library + CLI

Language: Python - Size: 107 MB - Last synced at: 2 months ago - Pushed at: 8 months ago - Stars: 48 - Forks: 1

mananapr/akari

python program to manage and automatically tag your image library

Language: Python - Size: 53.7 KB - Last synced at: 16 days ago - Pushed at: about 3 years ago - Stars: 42 - Forks: 1

garganshul108/Code-With-Mosh-Playlist-Downloader

Bash Script: A *.sh script to download full course from codewithmosh.com.

Language: Python - Size: 139 KB - Last synced at: 10 months ago - Pushed at: over 5 years ago - Stars: 41 - Forks: 14

marcotav/supervised-machine-learning

This repo contains regression and classification projects. Examples: development of predictive models for comments on social media websites; building classifiers to predict outcomes in sports competitions; churn analysis; prediction of clicks on online ads; analysis of the opioids crisis and an analysis of retail store expansion strategies using Lasso and Ridge regressions.

Language: Jupyter Notebook - Size: 8.83 MB - Last synced at: about 2 years ago - Pushed at: almost 6 years ago - Stars: 41 - Forks: 19

RyanElliott10/SqueezePredictor

A python script that predicts a stock's susceptibility to a short squeeze.

Language: Python - Size: 9.19 MB - Last synced at: almost 3 years ago - Pushed at: almost 6 years ago - Stars: 38 - Forks: 17

officialpm/scrape-amazon

🤩 Python Package for Scraping Amazon Product Reviews ✨

Language: Python - Size: 134 KB - Last synced at: 3 months ago - Pushed at: about 3 years ago - Stars: 37 - Forks: 13

cyberboysumanjay/Torrent-Searcher

[DEPRECATED] A simple torrent file searcher written in Python

Language: Python - Size: 14.6 KB - Last synced at: 5 months ago - Pushed at: about 5 years ago - Stars: 37 - Forks: 24

HexNio/booking_scraper

A booking.com Web Scraper for Data Mining/Harvesting and Automation

Language: Python - Size: 53.7 KB - Last synced at: 4 days ago - Pushed at: over 4 years ago - Stars: 35 - Forks: 24

kaushalpurohit/Bookdl

Download books from pdf-drive.

Language: Python - Size: 79.1 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 33 - Forks: 9

iiicebearrr/spiders-for-all

A set of useful and scalable spiders to crawl data/videos from bilibili, xiaohongshu, etc.

Language: Python - Size: 1.06 MB - Last synced at: 2 months ago - Pushed at: almost 2 years ago - Stars: 32 - Forks: 11

sushil-rgb/AmazonMe

Introducing the AmazonMe webscraper - a powerful tool for extracting data from Amazon.com using the Requests and Beautifulsoup library in Python. This scraper allows users to easily navigate and extract information from Amazon's website.

Language: Python - Size: 894 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 32 - Forks: 13

mahmudahsan/webscraping

Lets learn web scraping and apply them in real application.

Language: HTML - Size: 6.53 MB - Last synced at: 9 months ago - Pushed at: about 3 years ago - Stars: 32 - Forks: 18

fredysomy/HealthApp

A desktop application to fetch Wikipedia,Google,Disease results and save them as text file,in database.Have a Section to search details about doctors in location

Language: Python - Size: 14.3 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 31 - Forks: 7

BeautifulMoon211/Yelp-Scraping

Web scraping tool used to record business addresses, phone numbers, website, supported area and other relevant information of companies from Yelp.com

Language: Python - Size: 827 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 31 - Forks: 1

Architrixs/Wattpad2Epub

Python Script to Scrape Wattpad Story and convert to Epub and html file. Easiest to use.

Language: Python - Size: 217 KB - Last synced at: 9 months ago - Pushed at: over 2 years ago - Stars: 31 - Forks: 5

smahesh29/Web-Scraping-Python

It contains some web scraping examples implemented using Python.

Language: Python - Size: 5.95 MB - Last synced at: 2 months ago - Pushed at: almost 3 years ago - Stars: 31 - Forks: 11

Mhmd-Hisham/selenium_facebook_scraper

A simple python3 script used to download a users's friend list from facebook.

Language: Python - Size: 12.7 MB - Last synced at: almost 2 years ago - Pushed at: about 3 years ago - Stars: 31 - Forks: 18

rahulkumaran/Utlyz-CLI

Let's you to access your FB account from the command line and returns various things number of unread notifications, messages or friend requests you have.

Language: Python - Size: 6.63 MB - Last synced at: over 2 years ago - Pushed at: about 7 years ago - Stars: 31 - Forks: 25

pltnk/habr-observer

An automatically updated feed with summaries of the best Habr.com articles generated by the YandexGPT neural network.

Language: Python - Size: 70.3 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 30 - Forks: 2

sam0jones0/amazon_wishlist_pricewatch

Periodically check your public Amazon wishlist for price reductions.

Language: Python - Size: 57.6 KB - Last synced at: 25 days ago - Pushed at: about 3 years ago - Stars: 29 - Forks: 4

FrazierLei/PornHub-Downloader

基于 Aiohttp 和 Pyppeteer 的 PornHub 视频下载工具，支持多任务并行下载。

Language: Python - Size: 4.02 MB - Last synced at: 6 months ago - Pushed at: almost 4 years ago - Stars: 29 - Forks: 5

elizabethsiegle/cf-ai-lora-news-summarizer

Python webapp that summarizes news with Cloudflare Workers AI LoRA, Mistral, Beautifulsoup, and Streamlit

Language: Python - Size: 324 KB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 28 - Forks: 5

perfectly-preserved-pie/larentals

An interactive map of for-sale & rental property listings in Los Angeles County, updated weekly.

Language: Python - Size: 227 MB - Last synced at: 19 days ago - Pushed at: 21 days ago - Stars: 26 - Forks: 4

ramonclaudio/Google-Reverse-Image-Search

A lightweight python wrapper designed for leveraging Google's search by image capabilities to perform reverse image searches programatically.

Language: Python - Size: 44.9 KB - Last synced at: 17 days ago - Pushed at: almost 2 years ago - Stars: 26 - Forks: 4

sortedcord/udemyscraper 📦

A Udemy Course Scraper built with bs4 and selenium, that fetches udemy course information. Get udemy course information and convert it to json, csv or xml file, without authentication!

Language: Python - Size: 14.2 MB - Last synced at: about 1 month ago - Pushed at: about 4 years ago - Stars: 26 - Forks: 11

SofianeHamlaoui/b-ok-scraper

A b-ok.cc Simple Python Scraper

Language: Python - Size: 81.1 KB - Last synced at: 8 months ago - Pushed at: about 4 years ago - Stars: 26 - Forks: 7

tridibsamanta/WhatsAppChatBot

WhatsApp Chatting System Automation using Python

Language: Python - Size: 45.9 KB - Last synced at: 8 months ago - Pushed at: almost 6 years ago - Stars: 26 - Forks: 12

kcsoc/society-email-scrape

Scrapes Every Email Address of Every Society in Every University

Language: Python - Size: 1020 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 25 - Forks: 4

billy1125/TRA_time_space_diagram

台灣鐵路局公開資料JSON轉鐵路運行圖(SVG格式)程式

Language: Python - Size: 210 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 25 - Forks: 5

GeovRodri/zapimoveis-scraper

zapimoveis-scraper is a Python package that works as a crawler and scraper using beautifulsoup4 to get data from zap imóveis.

Language: Python - Size: 33.2 KB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 25 - Forks: 12

JackKing-defier/Baiduwenku

Baidu Wenku Crawler——徒手造轮子系列：百度文库爬虫，爬取文档的文字内容

Language: Python - Size: 6.84 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 24 - Forks: 18

shashanoid/Gen2Kindle

Search, download, convert and send files directly to your kindle from Libgen in one place.

Language: Python - Size: 9.89 MB - Last synced at: almost 2 years ago - Pushed at: about 3 years ago - Stars: 24 - Forks: 1

KatrojuSaiChaitanya/Webscraping_email_phone

Web scraping of Emails and Phone numbers from various websites

Language: Python - Size: 16.6 KB - Last synced at: almost 2 years ago - Pushed at: over 5 years ago - Stars: 24 - Forks: 8

ancatmara/learnpython2018

Python course for 2nd year NLP students at NRU HSE, 2018-2019

Language: Jupyter Notebook - Size: 2.65 MB - Last synced at: 7 months ago - Pushed at: about 2 years ago - Stars: 23 - Forks: 25

leandertolksdorf/1001-tracklists-api

Python library for easy access to data from 1001tracklists.com

Language: Python - Size: 85.9 KB - Last synced at: almost 3 years ago - Pushed at: about 3 years ago - Stars: 22 - Forks: 8

coryphoenixxx/telexkcdbot

A functional asynchronous telegram-bot for handy reading xkcd comics. https://t.me/telexkcdbot

Language: Python - Size: 90.4 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 21 - Forks: 1

MauryaRitesh/ImageDownloader

A Python program for downloading images from a Google Search.

Language: Python - Size: 16.6 KB - Last synced at: almost 3 years ago - Pushed at: almost 3 years ago - Stars: 21 - Forks: 8

tisuela/CourseCake

By serving course 📚 data that is more "edible" 🍰 for developers, we hope CourseCake offers a smooth approach to build useful tools for students.

Language: Python - Size: 1.27 MB - Last synced at: almost 3 years ago - Pushed at: about 3 years ago - Stars: 21 - Forks: 3

BnademOverflow/FaceKit

A version of Facebook using the command line.✨

Language: Python - Size: 760 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 21 - Forks: 0

Help-the-community/Web_Scraping_with_Selenium

This repo contains many real-world exercises of scraping various websites using Python with Selenium

Language: Python - Size: 27.1 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 20 - Forks: 4

andprov/krisha.kz

Rental ad parser

Language: Python - Size: 124 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 20 - Forks: 2

gamemann/web-extract-with-chatgpt

A Python project that extracts data from websites with the option to process the data through @openai's ChatGPT API. The results are either printed to stdout or sent via a POST request.

Language: Python - Size: 2.69 MB - Last synced at: 3 months ago - Pushed at: 12 months ago - Stars: 20 - Forks: 1

linhung0319/google-scholar-crawler

A crawler to crawl google scholar search page

Language: Python - Size: 563 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 20 - Forks: 15

kaushalpurohit/rango

Telegram bot to download torrent.

Language: Python - Size: 818 KB - Last synced at: almost 3 years ago - Pushed at: about 3 years ago - Stars: 20 - Forks: 3

ph-root/proxy-GR

Python-based Massive Proxy Grabber. This bot grabs proxies from public websites so you can use them.

Language: Python - Size: 12.7 KB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 20 - Forks: 12

F1Jobs/updater 📦

Update mechanism of f1jobs.co

Language: Python - Size: 48.8 KB - Last synced at: over 2 years ago - Pushed at: about 7 years ago - Stars: 20 - Forks: 1

sidward35/letterboxd-justwatch

Scans your Letterboxd watchlist and shows you where you can watch those movies using JustWatch

Language: Python - Size: 111 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 19 - Forks: 3

Mahitej28/LinkedIn_Bot

LinkedIn bot that automates the process of searching for public profiles on LinkedIn and exporting the data to an Excel sheet.

Language: Python - Size: 17.6 KB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 19 - Forks: 1

dhohirpradana/Python-Youtube-Search-Scraper

Youtube Scrape Scroll using Python

Language: Python - Size: 289 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 19 - Forks: 3

allendema/SnapScrap.py

Downloads public Snapchat stories with Python.

Language: Python - Size: 602 KB - Last synced at: 6 months ago - Pushed at: over 3 years ago - Stars: 19 - Forks: 3

victordomingos/PT-Tracking

Aplicação para registo e acompanhamento de encomendas da CTT Expresso, automatiza a consulta online do estado de tracking para várias remessas e mantém um registo dos pagamentos referentes aos envios à cobrança. As remessas que requerem atenção, devido a atrasos na entrega ou na receção do pagamento correspondente, bem como os cheques cuja data prevista de depósito se esteja a aproximar são destacadas na lista principal, por forma a permitir uma intervenção em conformidade. Adicionalmente, é mantido um histórico facilmente pesquisável de todas as remessas registadas na base de dados.

Language: Python - Size: 125 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 19 - Forks: 0