An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: scraper-python

Decodo/Python-scraper-tutorial

A short introduction to scraping with Python with given steps and an example scraper script.

Language: Python - Size: 98.6 KB - Last synced at: about 20 hours ago - Pushed at: about 22 hours ago - Stars: 30 - Forks: 5

owen-the-kid/stremio-rss-feed

A Stremio News blog Scraper

Language: Python - Size: 53.7 KB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 0 - Forks: 0

oxylabs/Rotating-Proxies-With-Python

Learn about how to rotate proxies by using Python.

Language: Python - Size: 216 KB - Last synced at: about 2 hours ago - Pushed at: 2 months ago - Stars: 37 - Forks: 4

oxylabs/Pagination-With-Python

A guide on how to deal with pagination via Python.

Language: Python - Size: 708 KB - Last synced at: about 2 hours ago - Pushed at: 2 months ago - Stars: 24 - Forks: 5

oxylabs/selenium-proxy-integration-python

Tutorial for integrating Oxylabs' Residential Proxies with Selenium in Python

Language: Python - Size: 40 KB - Last synced at: about 2 hours ago - Pushed at: 2 months ago - Stars: 15 - Forks: 9

oxylabs/how-to-scrape-google-jobs

Learn how to build your own Google Jobs scraper that simultaneously scrapes Google Jobs for multiple search queries and geo-locations with Python and Oxylabs’ Google Jobs Scraper API. https://oxylabs.io/blog/how-to-scrape-google-jobs

Language: Python - Size: 125 KB - Last synced at: 10 days ago - Pushed at: 14 days ago - Stars: 231 - Forks: 4

MrCoolPotato/Web-scraper

This is a simple web scraping application built with Python and Tkinter. It allows you to scrape text content from a webpage and display it in a text box.

Language: Python - Size: 9.77 KB - Last synced at: 5 days ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

oxylabs/quick-start-guide

Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.

Size: 46.9 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 523 - Forks: 3

aalapd/wormpy

A simple Python-based tool designed to scrape websites for content.

Language: Python - Size: 286 KB - Last synced at: 14 days ago - Pushed at: 7 months ago - Stars: 54 - Forks: 8

oofidc/Yorubanames-Scraper

"A web scraper for Yorùbá names and a Flask API to serve the data, providing detailed information on name meanings, origins, and variations.

Language: Python - Size: 6.41 MB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 0 - Forks: 0

oxylabs/Python-Web-Scraping-Tutorial

In this Python Web Scraping Tutorial, we will outline everything needed to get started with web scraping. We will begin with simple examples and move on to relatively more complex.

Language: Python - Size: 104 KB - Last synced at: 15 days ago - Pushed at: 2 months ago - Stars: 280 - Forks: 30

oxylabs/how-to-parse-xml-in-python

Follow this in-depth technical tutorial to learn how to parse XML data in Python, what libraries you should use, how to handle invalid XML, and more.

Language: Python - Size: 27.3 KB - Last synced at: 9 days ago - Pushed at: 2 months ago - Stars: 3 - Forks: 0

Euronymou5/Address-Scrapper

Un simple web scrapping de direcciones, útil para el uso de bins, métodos de compras, etc.

Language: Python - Size: 15.6 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

ai-naymul/ai-captcha-sdk

An AI powered gateway to captchas.Users simply provide their Gemini API key, and the system navigates to their target site, overcomes CAPTCHA challenges in real time, and returns the clean page source—no manual intervention required.

Size: 238 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Kourva/Tscraper

Automated Telegram Scraper that scrapes data when you join the groups...

Language: Python - Size: 27.3 KB - Last synced at: 19 days ago - Pushed at: 8 months ago - Stars: 11 - Forks: 0

datacollectionspecialist/How-to-Scrape-Flight-Data-from-Kayak

Learn how to scrape flight data from Kayak using powerful web scraping tools. This guide provides step-by-step instructions to help you collect accurate and up-to-date flight information for travel analysis, price comparison, and more.

Size: 5.86 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

oxylabs/scraping-ecommerce-websites

A guide to scraping e-commerce websites by overcoming bot protection and CAPTCHAs.

Language: Python - Size: 18.6 KB - Last synced at: 14 days ago - Pushed at: 2 months ago - Stars: 2 - Forks: 0

oxylabs/python-syntax-errors

A practical guide to reading Python syntax errors and fixing them.

Language: Python - Size: 106 KB - Last synced at: 9 days ago - Pushed at: 2 months ago - Stars: 2 - Forks: 0

oxylabs/web-scraping-selenium-python

Web Scraping with Python Selenium: Tutorial for Beginners

Language: Python - Size: 11.7 KB - Last synced at: 9 days ago - Pushed at: 2 months ago - Stars: 2 - Forks: 0

oxylabs/python-requests

Learn how to use Python Requests module

Language: Python - Size: 9.77 KB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0

oxylabs/python-script-service-guide

A guide on running a Python script as a service on Windows & Linux.

Language: Python - Size: 18.6 KB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 2 - Forks: 0

oxylabs/python-parse-json

A tutorial for parsing JSON data with Python

Language: Python - Size: 20.5 KB - Last synced at: about 2 hours ago - Pushed at: 2 months ago - Stars: 2 - Forks: 4

TheLovinator1/sitemap-parser Fork of daveoconnor/site-map-parser

This Python library is designed to scrape sitemaps from websites, providing a simple and efficient way to gather information about the structure of a website.

Language: Python - Size: 1.52 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 5 - Forks: 2

hhhscvx/WildberriesScraper

ТГ Бот парсер Wildberries по артикулу товара

Language: Python - Size: 101 KB - Last synced at: 18 days ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

rathoreakash9773/Projects

Python pipeline scraping , Sql , Power Bi Projects

Language: Jupyter Notebook - Size: 4.24 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

luminati-io/Google-News-Scraper

Extract news data with the #1 Google News API, including top stories, publisher details, article summaries, and trending topics. Start your free trial now!

Language: Python - Size: 443 KB - Last synced at: 15 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

itsmerif/DigMyDomains

This program helps you scrape all the URLs available over a list of websites available. It includes URLs in clear-text as well as hyper-linked.

Language: Python - Size: 6.84 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

nanquan66/python-

使用爬虫爬取一个html上的文字,存入文档后进行过滤处理,最终生成中国地图样式的词云

Language: Python - Size: 143 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

Scoofszlo/eqdatatools

A versatile tool that scrapes earthquake data from PHIVOLCS and JMA, processes it, and provides simple statistical data.

Language: Python - Size: 85.9 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

1970Mr/link-crawler

Web Link Crawler: A Python script to crawl websites and collect links based on a regex pattern. Efficient and customizable.

Language: Python - Size: 32.2 KB - Last synced at: 29 days ago - Pushed at: 11 months ago - Stars: 2 - Forks: 1

CDUT-AI-Club/Web-Scraping-Journey-with-Python

本项目计划用于2024成都理工大学CDUT人工智能协会技术培训使用

Language: Python - Size: 144 KB - Last synced at: about 1 month ago - Pushed at: 7 months ago - Stars: 6 - Forks: 1

btkcodedev/jobify

Scrape jobs

Size: 38.1 KB - Last synced at: 20 days ago - Pushed at: 10 months ago - Stars: 2 - Forks: 0

Angelinei/scraperv1

Scraper web v1 code source with Anti-Capcha, VPN Proxy to customize - Personal Project #NonCommercial

Language: Python - Size: 7.81 KB - Last synced at: 5 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

DJFox11/python-link-scraper

This Python script allows you to scrape links from a webpage and save them to either a TXT or CSV file.

Language: Python - Size: 6.72 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

Xuezha333/DouyinScraper

Scraper built with selenium and bs4 to scrape video metadata for JJ's 大数据案例实践class research

Language: Python - Size: 15.2 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

jmb-ops/Spyder

A web crawler named Spyder. a command line tool like (ZAP) Zed Attack Proxy made for spidering/ crawling web pages made using only the python standard library. meaning no dependencies. For windows.

Language: Python - Size: 8.79 KB - Last synced at: 10 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0

cyterat/mil-products-aggregator

Data scraping and aggregation telegram bot. Retrieves military gear from various Ukrainian online stores.

Language: Python - Size: 6.69 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

Edi-Codutti/MITREport-Analyzer

Tools for analyzing cyber-security reports and extract information

Language: Python - Size: 57.6 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

MuhammadAhmed-0/search-scraper

This Python-based tool scrapes Google search results and presents the top 10 results along with their URLs. Useful for SEO optimization and content writing.

Language: Python - Size: 20.5 KB - Last synced at: 17 days ago - Pushed at: about 1 year ago - Stars: 4 - Forks: 3

ibotsuft/scripts

Scripts written by iBots team.

Language: Python - Size: 13.7 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

gamallo/mastodon-scrape

Scrapper of toots from Mastodon

Language: Python - Size: 27.3 KB - Last synced at: 30 days ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 1

DaveSimoes/Web-Scraping

The goal of this project is to provide a basic structure for web scraping HTML pages and collecting specific data. The main script (main.py) initializes a WebScraper object and calls the scrape() method to collect data from a specific URL.

Language: Python - Size: 7.81 KB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

JJhano/googletranslate_scraper

A simple program to get audio from google translate

Language: Python - Size: 26.4 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

ZeroNiki/yt-search

Language: Python - Size: 2.93 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

salemandreus/web-scrapers

Minimalistic python scrapers that perform a very basic scraping function. Utilizes Python 3.12.

Language: Python - Size: 8.79 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0