gitlab.com topics: scraping
imn1/rug
Library for fetching various stock data from the internet (official and unofficial APIs).
Last synced at: 3 months ago - Stars: 1 - Forks: 0
woob/woob
Web outside of Browsers (core, site modules and applications)
Last synced at: 10 months ago - Stars: 130 - Forks: 97
hydrargyrum/img-lurker
Scrape a web page and downloads images (even if they are on other linked pages)
Last synced at: 2 months ago - Stars: 0 - Forks: 0
TUVIMEN/invision
A bash script for downloading invision forums in json
Last synced at: about 2 years ago - Stars: 0 - Forks: 0
TUVIMEN/imdb
A very simple shell script for downloading foxnews in json
Last synced at: about 2 years ago - Stars: 0 - Forks: 0
TUVIMEN/xenforo
A bash script for downloading xenforo forums in json
Last synced at: about 2 years ago - Stars: 0 - Forks: 0
cnrdck/disques
Indexeur de disquaires en ligne & moteur de recherche https://disqu.es
Last synced at: about 2 years ago - Stars: 1 - Forks: 0
chriisduranlab/scrapingtool
This is a demo of scrap a website!
Last synced at: about 2 years ago - Stars: 0 - Forks: 0
eathtespagheti/ocm-code-challenge
Code Challenge for ofcourseme hiring process, scraper based on Scrapy for the Federica MOOC platform. Scraped data are stored in a Django database and exposed through a webpanel.
Last synced at: about 2 years ago - Stars: 0 - Forks: 0
rokk1/gasprices
This is a simple website showing current gas prices in EU countries. The data is scraped from https://www.amzs.si/na-poti/cene-goriv-po-evropi.
Last synced at: over 2 years ago - Stars: 0 - Forks: 0
python_training2/flasktry
Python scripts for scraping paginated web search results, converting to SQlite database available on local Flask server
Last synced at: over 2 years ago - Stars: 0 - Forks: 0
TUVIMEN/stackexchange
A bash script for converting stackexchange forums to json
Last synced at: about 2 years ago - Stars: 0 - Forks: 0
TUVIMEN/disqus
A bash script for downloading comments from disqus
Last synced at: about 2 years ago - Stars: 0 - Forks: 0
python_training2/scrap_evc_de
Python script scraping table using bs4, converting to listed dicts and to .csv
Last synced at: over 2 years ago - Stars: 0 - Forks: 0
jonathonhawkins/puppeteer-runner
This project takes manifests and javascript files to drive puppeteer.
Last synced at: over 2 years ago - Stars: 0 - Forks: 0
woob/woob-qt
Web outside of Browsers (Qt applications)
Last synced at: over 2 years ago - Stars: 2 - Forks: 1
laurentbachelier/weboob
mirror of git://git.p.engu.in/laurentb/weboob http://weboob.org/
Last synced at: over 2 years ago - Stars: 1 - Forks: 0
free_zed/askthom
A python CLI for a [Thomson TG789vn gateway](https://fccid.io/RSE-TG789VN/User-Manual/User-Manual-1285790)
Last synced at: over 2 years ago - Stars: 0 - Forks: 0
TUVIMEN/foxnews
A very simple shell script for downloading foxnews in json
Last synced at: about 2 years ago - Stars: 0 - Forks: 0
FaresHerhar/number-collect
A data scraber using Python3, scraping phone numbers from online selling websites
Last synced at: almost 3 years ago - Stars: 0 - Forks: 0
woob/cookiecutter-woob-module
Cookiecutter template for creating woob modules
Last synced at: over 2 years ago - Stars: 1 - Forks: 0
davidevi/ddv-web-text-extractor
Extracts the largest continous block of text from a web page
Last synced at: almost 3 years ago - Stars: 0 - Forks: 0
jpmerx/genscrab
Links creation to digitalized images of departments of France
Last synced at: over 2 years ago - Stars: 1 - Forks: 0
woob/webextension-session-importer
Import Woob session URL and cookies into a real web browser
Last synced at: over 2 years ago - Stars: 1 - Forks: 0
frieagle94/parsing-stackoverflow
The project aims to scan StackOverflow posts to get some of most common problems for some technologies of interest and, eventually, the solution.
Last synced at: 11 months ago - Stars: 0 - Forks: 0
SJort/4chanthreadimagescraper
Retrieves images from threads from a certain board containing the given text in the title.
Last synced at: over 2 years ago - Stars: 0 - Forks: 1
nfriend/snow-day-notifier
A small [Lambda](https://aws.amazon.com/lambda/) function that scrapes [PEI's public schools website](https://edu.princeedwardisland.ca/psb/) and sends alerts (through [IFTTT](https://ifttt.com/)) if school is delayed or closed.
Last synced at: about 2 years ago - Stars: 0 - Forks: 1
jdaniel.asousa/pei-project
Projeto desenvolvido no âmbito da cadeira de Processamento Estruturado de Informação.
Last synced at: about 2 years ago - Stars: 0 - Forks: 1
satyawikananda/covid19-simple-api
Simple scraping covid19 data, for fun and for learning purpose https://covid-simple.satyawikananda.tech
Last synced at: over 2 years ago - Stars: 1 - Forks: 0
socraticdev/job-harvester
Dedicated to HR specialists and skilled job seekers job-harvester connects to job boards and collects postings job-harvester can be used to keep track of job postings for specific roles within a specific area
Last synced at: over 2 years ago - Stars: 0 - Forks: 0
blandfort/kraken
Tools for scraping data from the net.
Last synced at: over 2 years ago - Stars: 0 - Forks: 0
anthbrtn/gofindme
Shcrapes a list of gfm urls
Last synced at: over 2 years ago - Stars: 0 - Forks: 0
KNJO/dt-scraper
Scrape DT and get the information needed for a .json.
Last synced at: over 2 years ago - Stars: 0 - Forks: 0
odg/ua_spoofer
A Python module for collecting and providing popular user agent strings, with a requests session which rotates user agents.
Last synced at: 2 months ago - Stars: 0 - Forks: 0
julzkb/metalobserver
Keeping an eye on the past
Last synced at: about 2 years ago - Stars: 1 - Forks: 1
hectnandez-external/others/daily-trends
App to get feeds by web scraping, from sources that you specify in the app.
Last synced at: over 2 years ago - Stars: 0 - Forks: 0
helrunr/phone-and-email-extractor
A utility that will print particular patterns you have copied in the clipboard to command line. Configured by default to pull out email addresses and phone numbers.
Last synced at: over 2 years ago - Stars: 0 - Forks: 0
autokent/semantic-crawler
Priority-based Semantic Web Crawler
Last synced at: 2 months ago - Stars: 0 - Forks: 0
esavara/vws
a point and click web scraper with plugin support for scraping APIs. Written in Python and Go.
Last synced at: about 2 years ago - Stars: 0 - Forks: 0
ciopres/vizcacha
Web scraper using Scrapy framework to collect prices from online supermarkets and other sources.
Last synced at: over 2 years ago - Stars: 0 - Forks: 0