An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: scrawler

scrawler-labs/scrawler

Create simple but powerful web apps and APIs quickly, with minimum lines of code

Language: PHP - Size: 217 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 4 - Forks: 0

PxyUp/fitter

New way for collect information from the API's/Websites

Language: Go - Size: 44.4 MB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 122 - Forks: 9

MarvinTerry/HustLogin

A python-lib for authenticating HustPass@2023

Language: Python - Size: 93.8 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 9 - Forks: 3

fozbek/scrawler

Simple, schema based scraping tool

Language: PHP - Size: 75.2 KB - Last synced at: 4 days ago - Pushed at: about 1 year ago - Stars: 11 - Forks: 0

franck-gaspoz/MovieDbAssistant

Generates Movie documents (HTML, movie database,...) using Web Crawlers ( IMDb, ... )

Language: C# - Size: 454 MB - Last synced at: 28 days ago - Pushed at: 5 months ago - Stars: 2 - Forks: 0

scrawler-labs/mvc

Template to use Scrawler as MVC framework

Language: PHP - Size: 84 KB - Last synced at: 19 days ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

samttoo22-MewCat/lala_rwkv_chatbot_2.0

使用 rwkv 架構的大型語言模型運作的 Discord 聊天機器人,擁有辨識維基百科條目名並將其當作關鍵字抽取出的能力,並且還會將此關鍵字用於爬取維基百科,並將條目內容回傳給自身參考。近期更新串接API版本。

Language: Python - Size: 11.4 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 10 - Forks: 0

liujuanjuan1984/spiderbot

a spider bot (scrawler) by python, using selenium and chrome driver

Language: Python - Size: 72.3 KB - Last synced at: 19 days ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

susc/pyszugwt

爬虫抓取深大公文通,并进行多版本备份

Language: Python - Size: 824 KB - Last synced at: about 1 year ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

bkataru/kayak-scrawler

selenium and bs4 crawler + scraper to obtain flight listing info from kayak.com

Language: Python - Size: 2.53 MB - Last synced at: 29 days ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

SamsonMXVI/go-wenku-downloader

Go轻小说文库下载工具

Language: Go - Size: 14.2 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 27 - Forks: 3

0010SS/ChatGPTSourceChecker

Checking the Validity of references given by ChatGPT

Language: Python - Size: 94.9 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

HandsomeBrotherShuaiLi/database_system_project

knowledge-graph flask web demo

Language: CSS - Size: 9.42 MB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

xmcp/osufm

Osu Flame Master: The Human Way to Search and Download Osu! Beatmaps

Language: HTML - Size: 208 KB - Last synced at: 2 months ago - Pushed at: over 8 years ago - Stars: 1 - Forks: 0

qinbinhua601/fun-hub

A hub for aggregating the tv series which I'm following :)

Language: CSS - Size: 1.88 MB - Last synced at: over 1 year ago - Pushed at: almost 8 years ago - Stars: 2 - Forks: 1

nkanven/univers

The web scraper for Cameroon news websites and Youtube

Language: Python - Size: 3.95 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

jordan5226/BaHaSpider

巴哈姆特動畫瘋爬蟲 with熱度排行

Language: Python - Size: 74.2 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

NightMarcher/room-renting

用Python爬取安居客房源信息,并用高德地图进行可视化

Language: Python - Size: 6.27 MB - Last synced at: about 2 years ago - Pushed at: about 6 years ago - Stars: 18 - Forks: 7

Sn0wAlice/Babel-Underground

Tor network scrawler. Made for the god of this world who use Deno for all script & public services

Language: TypeScript - Size: 196 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0

ArticSeths/iBotCrawl

Project iBotCrawl

Language: PHP - Size: 40.6 MB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 2 - Forks: 0

huangruichang/1688

抓取 1688 商品信息。

Language: JavaScript - Size: 18.6 KB - Last synced at: 29 days ago - Pushed at: over 8 years ago - Stars: 8 - Forks: 2

hawtim/maoyan-film-picture

抓取猫眼电影的原始图片并批量下载

Language: TypeScript - Size: 3.78 MB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

Jim-bin/Python-spider

python scrawler

Language: Python - Size: 181 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 56 - Forks: 39

intellidev1991/python_rtf_file_analyzer

Read RTF file, convert it to a text string, scrap some info from it, and then for each file create txt and excel file from scrapped data

Language: Rich Text Format - Size: 242 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

madeindjs/ScrawlEO

Web Scrawler for Android.

Language: Java - Size: 280 KB - Last synced at: 29 days ago - Pushed at: about 7 years ago - Stars: 1 - Forks: 1

vanishcode/RNinT

Read noval in your terminal.

Language: Go - Size: 9.77 KB - Last synced at: 1 day ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

edsonsoaresramos/WebSpider

Language: Python - Size: 3.91 KB - Last synced at: about 1 month ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0

edsonsoaresramos/ScrapyPontoV2

Language: Python - Size: 3.91 KB - Last synced at: about 1 month ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0

edsonsoaresramos/ScrapyPonto

Language: Python - Size: 1000 Bytes - Last synced at: about 1 month ago - Pushed at: almost 8 years ago - Stars: 0 - Forks: 0