An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: scrapes

rynmon/malScraper

Scrapes a list of Payload Domains, IOC's & C2 IPs from from various feeds, for easy blacklisting.

Language: Python - Size: 85 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 7 - Forks: 3

LaithALhaware/Web-Scraper-for-News-Websites

This Python project scrapes news headlines from a website (e.g., BBC News) and displays them on a local web interface using Gradio. Users can refresh the headlines and view them in real-time. The headlines are also saved to a text file with the current date and time.

Language: Python - Size: 40 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

praneethravuri/Amazon-Product-Information-Scraper

This Python web-scraping project retrieves product names, prices, review stars, and review counts for a specific product category.

Language: Python - Size: 25.4 MB - Last synced at: 22 days ago - Pushed at: almost 2 years ago - Stars: 15 - Forks: 8

Fefefo/anime-themes-scraper 📦

A scraping tool for Gophers which scrapes /r/AnimeThemes, a simple and consistent repository of anime opening and ending themes.[DEPRECATED]

Language: Go - Size: 18.6 KB - Last synced at: 11 months ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

wpbSabi/oregon-covid-19

This model is available in both R script and R markdown formats to share more information about Oregon COVID-19 cases, through data collected by webscraping from within R.

Language: R - Size: 6.46 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 3 - Forks: 1

Alalalalaki/jpstat

A python package for accessing the official statistics of Japan.

Language: Python - Size: 45.9 KB - Last synced at: 8 months ago - Pushed at: about 2 years ago - Stars: 5 - Forks: 1

ryanelittle/work_samples

Some examples of the work Ryan Little has done as a data reporter at Mother Jones and the Howard Center for Investigative Journalism.

Language: Jupyter Notebook - Size: 1.36 MB - Last synced at: over 1 year ago - Pushed at: about 3 years ago - Stars: 2 - Forks: 0

alanb43/QuantBot

An end-to-end trading bot that makes use of AI to intelligently manage a portfolio.

Language: Python - Size: 7.15 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 6 - Forks: 1

dngatimin95/NY_Food_List

Gathering monthly must-try restaurants from websites such as Eater and The Infatuation before compiling them into a dataset and automatically sending them to users via email.

Language: Python - Size: 54.7 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

dngatimin95/Glassdoor_Scrape

Scraping the Glassdoor website for skills and qualifications needed for certain professions such as Data Analyst, Data Scientist or Software Engineers before visualizing them.

Language: Python - Size: 4.46 MB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

chris102994/docker-toonamiaftermath

This is a simple project that scrapes the website and generates an M3U playlist every 12 hours along with a XMLTV object that is hosted over NGINX. The XMLTV and M3U playlist can be directly imported to Emby or Plex. Or if you'd like a buffer you can also import them into xteve or tvheadend.

Language: Python - Size: 13.9 MB - Last synced at: over 1 year ago - Pushed at: about 4 years ago - Stars: 34 - Forks: 3

salice/reddit_skincare_classification

I used Reddit posts from two different skincare subreddits to build a model to classify the posts and determine what products/ingredients each subreddit discusses

Language: Jupyter Notebook - Size: 2.44 MB - Last synced at: almost 2 years ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0

chris102994/docker-plutotv 📦

This is a simple project that scrapes the website and generates an M3U playlist every 8 hours along with a XMLTV object that is hosted over NGINX. The XMLTV and M3U playlist can be directly imported to Emby or Plex. Or if you'd like a buffer you can also import them into xteve or tvheadend.

Language: Python - Size: 31.3 KB - Last synced at: over 1 year ago - Pushed at: about 4 years ago - Stars: 9 - Forks: 3

KushalVijay/Smart-Buy

Django webapp that scrapes all the required product information like prices ,name, rating , images ,description etc from popular eCommerce websites.The website can be used to compare similar products at different eCommerce stores which will reduce the time given for online shopping.

Language: Python - Size: 1.83 MB - Last synced at: about 2 years ago - Pushed at: about 5 years ago - Stars: 11 - Forks: 7

Victornguli/Skraped

A CLI tool for scraping Kenyan job boards for tech jobs and saving them in a csv format for easier aggregation and job search

Language: Python - Size: 6.01 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 2

harshitjain-hj/IndiaMart-Scraper

Scrapes the supplier details from the given link and generates .csv file for it.

Language: Python - Size: 94.7 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 2

VirtCode/SVRestaurantAPI

An API to scrape things from a SV-Restaurant

Language: Java - Size: 65.4 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

erikayi/web-scraping-challenge

Build a web application on a local server for scraping information about the planet Mars.

Language: Jupyter Notebook - Size: 22.6 MB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

nlewis84/percussion_ensemble

Scrapes a music publisher website for percussion ensembles and allows the user to sort the resulting data.

Language: Ruby - Size: 38.1 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

bartolomej/wikinet

Visualization of wikipedia knowledge graph.

Language: JavaScript - Size: 1.47 MB - Last synced at: 25 days ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 1

harshitjain-hj/Zomato-Scraper

Scrapes the list of restaurants details from the given link and generates .csv file for it.

Language: Python - Size: 87.9 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 2

harshitjain-hj/Justdial-Scraper

Scrapes the list of service provider details from the given link and generates .csv file for it.

Language: Python - Size: 118 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

aanielson/mongo-scraper

Whenever a user visits this app, it scrapes the most recent stories from Deseret News and displays them for the user. Each scraped article is saved to the application database, then displayed using a GET request. Users then have the option to save an article, which PUTs it in the "Saved" collection. This collection of saved articles is displayed on the "Saved" page. Here, users can POST comments on their saved articles.

Language: JavaScript - Size: 4.03 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

SurabhiSood/Mission_to_Mars

Web scraping project- flask-mongodb-HTML

Language: Jupyter Notebook - Size: 16.2 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

SeverinAlexB/autoscrap

Scrapes data from Autoscout24

Language: HTML - Size: 23 MB - Last synced at: about 2 years ago - Pushed at: over 8 years ago - Stars: 0 - Forks: 0