Topic: "url-scraper"
Decodo/Decodo
HTTP(S)/SOCKS5 rotating residential proxies - code examples & general information.
Language: Java - Size: 320 KB - Last synced at: about 2 months ago - Pushed at: 2 months ago - Stars: 1,125 - Forks: 43
oxylabs/google-shopping-scraper
Google Shopping Scraper can scrape and parse various Google Shopping page types to collect structured e-commerce data.
Language: Python - Size: 92.8 KB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 464 - Forks: 10
oxylabs/amazon-review-scraper
Amazon Review Scraper for hassle-free review data extraction, including authors, titles, descriptions, ratings, dates, and more.
Language: Python - Size: 68.4 KB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 271 - Forks: 8
oxylabs/amazon-asin-scraper
Amazon ASIN Scraper for effortless product ASIN extraction.
Language: Python - Size: 78.1 KB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 241 - Forks: 5
oxylabs/etsy-scraper
Etsy Scraper for collecting prices, titles, descriptions, specifications, reviews, and other product information from etsy.com
Language: Java - Size: 33.2 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 112 - Forks: 2
oxylabs/ebay-scraper
eBay Scraper for extracting product titles, descriptions, prices, specifications, customer reviews, and ratings from eBay
Language: Java - Size: 37.1 KB - Last synced at: 11 days ago - Pushed at: 3 months ago - Stars: 33 - Forks: 5
its0x08/duckduckgo
A simple DuckDuckGo URL scraper.
Language: Python - Size: 43.9 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 21 - Forks: 3
r3dxpl0it/Damn-Small-URL-Crawler
A Minimal Yet Powerful Crawler for Extracting all The Internal/External/Fuzz-able Links from a website
Language: Python - Size: 26.4 KB - Last synced at: over 2 years ago - Pushed at: over 6 years ago - Stars: 19 - Forks: 9
komodoooo/Arb-tool 📦
Old toolkit
Language: Ruby - Size: 163 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 0
oxylabs/web-scraping-php
A tutorial and code samples of web scraping with PHP
Language: PHP - Size: 26.4 KB - Last synced at: 11 days ago - Pushed at: 4 months ago - Stars: 9 - Forks: 3
krishcdbry/url-scraper
Url scraper which takes the text input and finds the links/urls, scraps them using cheerio and will returns an object with original text, parsed text (using npm-text-parser) and array of objects where each object contains scraped webpage's information.
Language: JavaScript - Size: 1.56 MB - Last synced at: about 1 month ago - Pushed at: over 8 years ago - Stars: 6 - Forks: 1
oxylabs/walmart-scraper
Walmart Scraper for extracting product prices, titles, descriptions, specifications, ratings and reviews from walmart.com
Language: Java - Size: 41 KB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 4 - Forks: 1
oxylabs/scrape-images-from-website
Scrape Images From a Website with Python
Language: Python - Size: 26.4 KB - Last synced at: 21 days ago - Pushed at: 4 months ago - Stars: 3 - Forks: 1
zauberware/url_checker
Quick lookup for HTTP Status codes of a Sitemap!
Language: Ruby - Size: 5.86 KB - Last synced at: 22 days ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0
Gertje823/Microsoft-stream-url-scraper
Scrape all video urls of Microsoft Stream
Language: Python - Size: 18.6 KB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 0
Cyber-Dioxide/Link-Hawk
A software for scrapping emails from the entire website. Link Hawk crawls over the entire site and grabs emails from the given domain and its subdomains too.
Size: 3.91 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 2 - Forks: 2
oxylabs/how-to-build-web-scraper
Step by step guide to building a web scraper with Python
Language: JavaScript - Size: 65.4 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0
amndzdzdz/Web-Crawler
A python web crawler that crawls URLs and scrapes their webpages. Specifically for Yahoo news articles.
Language: Python - Size: 106 KB - Last synced at: 4 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0
joe733/linkeeper
A blazing fast link scraper
Size: 11.7 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0
kaanbasal/url-scraper 📦
Fetch all links recursively from given url
Language: Python - Size: 118 KB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 1
friol/italianScene
Tools to make a list of all the Italian demoscene productions
Language: HTML - Size: 174 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0
moslemp/URL_Scraper
This program extracts all the URLs present on a webpage by entering a web address. It utilizes Tkinter, Requests, and BeautifulSoup libraries for implementation
Language: Python - Size: 98.6 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
Mark10111/Amz-scrape
This Amazon Web Scraper script is designed to extract product information from Amazon.com search pages. It retrieves data such as product titles, prices, ASIN, ratings, and review counts.
Language: Python - Size: 52.7 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
harindujayakody/fetches-all-links
Here's a simple Python program that fetches all links from a given webpage and saves the links in a text file.
Language: Python - Size: 19.5 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
AIessa/Crawling-Twitter-and-Webscraping
This repository contains scripts to crawl Twitter for user profiles and scrape web-data using Python libraries.
Language: Python - Size: 5.86 KB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0
