GitHub topics: task-queue
hibiken/asynq
Simple, reliable, and efficient distributed task queue in Go
Language: Go - Size: 7.65 MB - Last synced at: about 8 hours ago - Pushed at: 2 months ago - Stars: 11,641 - Forks: 826
runabol/tork
Tork is a lightweight, distributed workflow engine that runs tasks as simple scripts within Docker containers.
Language: Go - Size: 7.75 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 716 - Forks: 47
h2337/cppq
Simple, reliable & efficient distributed task queues for C++17
Language: TypeScript - Size: 545 KB - Last synced at: 1 day ago - Pushed at: 6 days ago - Stars: 109 - Forks: 7
django-commons/django-tasks-scheduler
Schedule async tasks using redis protocol. Redis/ValKey/Dragonfly or any broker using the redis protocol can be used.
Language: Python - Size: 3.68 MB - Last synced at: 1 day ago - Pushed at: 8 days ago - Stars: 161 - Forks: 16
pwwang/xqute
A job management system for python
Language: Python - Size: 1.13 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 9 - Forks: 3
procrastinate-org/procrastinate
PostgreSQL-based Task Queue for Python
Language: Python - Size: 21.7 MB - Last synced at: 3 days ago - Pushed at: 10 days ago - Stars: 1,069 - Forks: 73
vmihailenco/taskq
Golang asynchronous task/job queue with Redis, SQS, IronMQ, and in-memory backends
Language: Go - Size: 709 KB - Last synced at: 1 day ago - Pushed at: 3 months ago - Stars: 1,303 - Forks: 106
luocfprime/labtasker
Experiment task scheduling made easy.
Language: Python - Size: 4.81 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 29 - Forks: 5
legout/flowerpower
Simple Workflow Framework - Hamilton + Task Queue (RQ or APScheduler) = FlowerPower
Language: Python - Size: 17.8 MB - Last synced at: 4 days ago - Pushed at: 11 days ago - Stars: 22 - Forks: 1
rq/rq
Simple job queues for Python
Language: Python - Size: 3.88 MB - Last synced at: 7 days ago - Pushed at: 8 days ago - Stars: 10,268 - Forks: 1,440
txello/qtasks
Asynchronous Queue Tasks
Language: Python - Size: 1.45 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 1 - Forks: 0
pjcunningham/flask-huey-example
Example of setting up Flask with the Huey task queue
Language: Python - Size: 523 KB - Last synced at: about 5 hours ago - Pushed at: over 2 years ago - Stars: 25 - Forks: 10
mher/flower
Real-time monitor and web admin for Celery distributed task queue
Language: Python - Size: 5.01 MB - Last synced at: 9 days ago - Pushed at: 11 months ago - Stars: 6,819 - Forks: 1,120
cihga39871/JobSchedulers.jl
A Julia-based job scheduler and workload manager inspired by Slurm, PBS and Crontab.
Language: Julia - Size: 1.56 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 56 - Forks: 6
acaloiaro/neoq
Queue-agnostic background job library for Go, with a pleasant API and powerful features.
Language: Go - Size: 406 KB - Last synced at: 8 days ago - Pushed at: 30 days ago - Stars: 320 - Forks: 6
dymmond/asyncmq
Supercharge your async applications with tasks so fast, you’ll think you’re bending time itself.
Language: Python - Size: 709 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 57 - Forks: 2
justplainstuff/plainjob
SQLite-backed job queue processing 15k jobs/s
Language: TypeScript - Size: 224 KB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 48 - Forks: 2
TkTech/chancy
A postgres-backed task queue for Python.
Language: Python - Size: 7.04 MB - Last synced at: 9 days ago - Pushed at: about 2 months ago - Stars: 128 - Forks: 5
myui/fairque
Fair queue implementation using Redis with work stealing and priority scheduling
Language: Python - Size: 440 KB - Last synced at: 6 days ago - Pushed at: 21 days ago - Stars: 4 - Forks: 0
rq/django-rq
A simple app that provides django integration for RQ (Redis Queue)
Language: Python - Size: 1.04 MB - Last synced at: 4 days ago - Pushed at: 14 days ago - Stars: 1,890 - Forks: 293
TariqAHassan/alsek
Lightweight distributed task queue for Python.
Language: Python - Size: 1.84 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 2 - Forks: 0
zaidfadhil/cerra
Go async task queue
Language: Go - Size: 91.8 KB - Last synced at: 14 days ago - Pushed at: 15 days ago - Stars: 3 - Forks: 0
queue-xec/master
Peer 2 peer distributed/serverless computing solution.Define the problem , the way workers to solve it, code dependencies. Then the most difficult part is to find more workers/peers.. Example usecase : distributed web scraper
Language: JavaScript - Size: 9.34 MB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 24 - Forks: 4
mikestefanello/backlite
Type-safe, persistent, embedded task queues and background job runner w/ SQLite
Language: Go - Size: 105 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 98 - Forks: 7
cadence-workflow/cadence-java-client
Java framework for Cadence Workflow Service
Language: Java - Size: 3.95 MB - Last synced at: 12 days ago - Pushed at: 17 days ago - Stars: 145 - Forks: 113
actumn/celery.node
Celery task queue client/worker for nodejs
Language: TypeScript - Size: 915 KB - Last synced at: 1 day ago - Pushed at: about 1 year ago - Stars: 299 - Forks: 75
byzheng/taskqueue
Task Queue in R based on PostgreSQL Database
Language: R - Size: 4.82 MB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 1 - Forks: 0
cadence-workflow/cadence-go-client
Framework for authoring workflows and activities running on top of the Cadence orchestration engine.
Language: Go - Size: 7.96 MB - Last synced at: 11 days ago - Pushed at: 18 days ago - Stars: 359 - Forks: 137
django-q2/django-q2 Fork of Koed00/django-q
A multiprocessing distributed task queue for Django based on Django-Q
Language: Python - Size: 2.32 MB - Last synced at: 10 days ago - Pushed at: 24 days ago - Stars: 495 - Forks: 51
vduseev/raquel
Distributed task queue for Python with SQL
Language: Python - Size: 526 KB - Last synced at: 3 days ago - Pushed at: about 2 months ago - Stars: 5 - Forks: 2
hans-lizihan/bull-master
Nice UI for bull and bullmq
Language: JavaScript - Size: 4.32 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 164 - Forks: 12
jgujerry/python-frameworks
Another curated list of Python frameworks
Language: HTML - Size: 13.2 MB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 62 - Forks: 4
justrach/kew
🚀 Kew - A Fast, Redis-backed Task Queue Manager for Python
Language: Python - Size: 587 KB - Last synced at: 2 days ago - Pushed at: 7 months ago - Stars: 42 - Forks: 1
coleifer/huey
a little task queue for python
Language: Python - Size: 3.31 MB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 5,546 - Forks: 382
xiyuan-fengyu/ppspider
web spider built by puppeteer, support task-queue and task-scheduling by decorators，support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架，提供灵活的任务队列管理调度方案，提供便捷的数据保存方案（nedb/mongodb），提供数据可视化和用户交互的实现方案
Language: TypeScript - Size: 1.59 MB - Last synced at: 21 days ago - Pushed at: over 3 years ago - Stars: 338 - Forks: 77
wakatime/wakaq
Background task queue for Python backed by Redis, a super minimal Celery
Language: Python - Size: 232 KB - Last synced at: 17 days ago - Pushed at: 3 months ago - Stars: 588 - Forks: 20
Paladin7100/TaskOrganizer
Script to help organize the running of scripts. I use it mainly to run all my reporting scripts, to make sure they are run in the proper order and on the correct date.
Language: PowerShell - Size: 1.39 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0
pranavgupta1234/rqmonitor
Flask based more dynamic and actionable frontend dashboard for monitoring Redis Queue 👩🏿💻 http://python-rq.org
Language: Python - Size: 7.7 MB - Last synced at: 19 days ago - Pushed at: about 2 years ago - Stars: 190 - Forks: 23
samrith-s/concurrent-tasks
A simple task runner which will run all tasks till completion, while maintaining concurrency limits.
Language: TypeScript - Size: 1.26 MB - Last synced at: 6 days ago - Pushed at: 9 months ago - Stars: 40 - Forks: 5
wakatime/wakaq-ts
Background task queue for TypeScript backed by Redis, a super minimal Celery
Language: TypeScript - Size: 267 KB - Last synced at: 11 days ago - Pushed at: about 1 month ago - Stars: 31 - Forks: 2
celery/Celery-Kubernetes-Operator
An operator to manage celery clusters on Kubernetes (Work in Progress)
Language: Python - Size: 136 KB - Last synced at: 1 day ago - Pushed at: over 1 year ago - Stars: 90 - Forks: 8
seung-lab/python-task-queue
Asynchronous serverless task queue with timed leasing of tasks. Threaded implementations for SQS and local filesystem.
Language: Python - Size: 225 KB - Last synced at: 27 days ago - Pushed at: about 2 months ago - Stars: 36 - Forks: 9
myui/fairque-dashboard
Dashboard for monitoring and managing FairQueue task processing system.
Language: Python - Size: 45.9 KB - Last synced at: 6 days ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0
mudittt/remote-job-execution
A Redis-backed job queue system with retry mechanisms, timeouts, and dead letter queues.
Language: Python - Size: 0 Bytes - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0
premana/fairque
FairQueue offers a robust fair queue system built on Redis, featuring priority scheduling and work stealing for efficient task management. With built-in monitoring and error handling, this solution ensures reliability in production environments. 🚀👨💻
Language: Python - Size: 202 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0
abraham-ai/eden
Eden converts your python function into a hosted endpoint with minimal changes to your existing code :mage_man:
Language: Python - Size: 802 KB - Last synced at: 9 days ago - Pushed at: over 2 years ago - Stars: 48 - Forks: 5
quirrel-dev/quirrel
The Task Queueing Solution for Serverless.
Language: TypeScript - Size: 34.6 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 917 - Forks: 68
hoangsonww/The-Ultimate-Task-Board
📋 A dynamic tool that allows users to display and organize tasks on a virtual board. It offers an intuitive interface for task management, supporting various types of tasks and customization options. Ideal for individuals and teams looking for an efficient way to manage projects and daily activities!
Language: Java - Size: 18.6 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 22 - Forks: 8
nekomeowww/timecapsule
A Redis based task scheduling module written in Golang.
Language: Go - Size: 83 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 9 - Forks: 0
XHunter74/Task-Executor
Concurrency-controlled task execution framework
Language: C# - Size: 38.1 KB - Last synced at: 28 days ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0
srivathsashreyas/task-queue
A Redis-backed priority task queue (using a sorted set / ZSET) with Go-based workers, timeouts, and backpressure control
Language: Go - Size: 0 Bytes - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0
adam-rocska/use-task-queue
React hook for managing queues of tasks.
Language: TypeScript - Size: 564 KB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 1 - Forks: 0
choria-io/asyncjobs
Asynchronous Job Processor
Language: Go - Size: 3.52 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 114 - Forks: 5
nicholasmordecai/node-scheduler
Node.js schedule / task manager system for MySQL / Redis
Language: TypeScript - Size: 121 KB - Last synced at: about 2 months ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 1
mjhea0/flask-redis-queue
Example of how to handle background processes with Flask, Redis Queue, and Docker
Language: Python - Size: 146 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 224 - Forks: 73
levsh/arrlio
Asyncio distributed task system with local and RabbitMQ backends
Language: Python - Size: 1.41 MB - Last synced at: 12 days ago - Pushed at: 2 months ago - Stars: 0 - Forks: 1
yarhrn/rozklad
simple persistent task queue for Scala
Language: Scala - Size: 160 KB - Last synced at: 7 days ago - Pushed at: 3 months ago - Stars: 1 - Forks: 1
conveyor-mq/conveyor-mq
A fast, robust and extensible distributed task/job queue for Node.js, powered by Redis.
Language: TypeScript - Size: 2.74 MB - Last synced at: 27 days ago - Pushed at: 8 months ago - Stars: 50 - Forks: 3
testdrivenio/simple-task-queue
asynchronous task queues using python's multiprocessing library
Language: Python - Size: 802 KB - Last synced at: 10 days ago - Pushed at: 11 months ago - Stars: 67 - Forks: 34
codepr/tasq
A simple task queue implementation to enqeue jobs on local or remote processes.
Language: Python - Size: 412 KB - Last synced at: 8 days ago - Pushed at: over 4 years ago - Stars: 98 - Forks: 6
chriscarrollsmith/mcp-taskmanager Fork of kazuph/mcp-taskmanager 📦
MCP tool for exposing a structured task queue to guide AI agent workflows. Great for taming an over-enthusiastic Claude.
Language: TypeScript - Size: 298 KB - Last synced at: 1 day ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0
Yaswanth-C/RapidQ
A lightweight and fast background task processing library for Python, developed with simplicity in mind.
Language: Python - Size: 70.3 KB - Last synced at: 21 days ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0
Pratik980/GigQ
GigQ is a unique platform that connects gig workers with potential job opportunities based on their skills and preferences. Users can create profiles, browse available gigs, and communicate with employers through the secure messaging system.
Language: Python - Size: 1020 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0
hyrfilm/workhorse
High performance transactional task queues for the browser
Language: TypeScript - Size: 432 KB - Last synced at: 29 days ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0
ipsosante/django-taskq
Yet another task queue
Language: Python - Size: 205 KB - Last synced at: 10 days ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 0
ZhannaAV/run-task-manager
Асинхронный менеджер задач с ограничением по targetId и параллелизму
Language: TypeScript - Size: 0 Bytes - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0
vintasoftware/celery-tasks-checklist
Useful checklist for building great Celery tasks.
Size: 93.8 KB - Last synced at: 23 days ago - Pushed at: almost 6 years ago - Stars: 119 - Forks: 28
LaunchPlatform/bq
BeanQueue, a lightweight Python task queue framework based on SQLAlchemy, PostgreSQL SKIP LOCKED queries and NOTIFY / LISTEN statements.
Language: Python - Size: 217 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 17 - Forks: 2
flouthoc/buha.js
Browser based Strictly ordered Task Queue for Sync/Async Javascript Functions
Language: JavaScript - Size: 34.2 KB - Last synced at: 15 days ago - Pushed at: over 6 years ago - Stars: 29 - Forks: 2
theeye-io-team/theeye-of-sauron
TheEye Dockers and QuickStart
Language: JavaScript - Size: 356 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 29 - Forks: 4
eXascaleInfolab/PyExPool
Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture
Language: Python - Size: 2.09 MB - Last synced at: 3 months ago - Pushed at: almost 6 years ago - Stars: 168 - Forks: 12
shuo-s-feng/taskon
A simple javascript/typesciprt tasks queue that supports concurrency control
Language: TypeScript - Size: 199 KB - Last synced at: 24 days ago - Pushed at: 6 months ago - Stars: 8 - Forks: 1
p-ranav/psched
Priority-based Task Scheduling for Modern C++
Language: C++ - Size: 873 KB - Last synced at: 20 days ago - Pushed at: over 4 years ago - Stars: 89 - Forks: 11
f-str/radishmq
Fast and lightweight message broker written in Rust.
Language: Rust - Size: 250 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 2 - Forks: 0
giacbrd/SmartPipeline
A framework for rapid development of robust data pipelines following a simple design pattern
Language: Python - Size: 393 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 27 - Forks: 3
joegasewicz/pytask-io
Python Async Task Queue
Language: Python - Size: 6.03 MB - Last synced at: 1 day ago - Pushed at: about 1 month ago - Stars: 93 - Forks: 5
testdrivenio/fastapi-celery
Example of how to handle background processes with FastAPI, Celery, and Docker
Language: Python - Size: 8.79 KB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 420 - Forks: 97
meelahealth/benthos
A task queue service for Rust
Language: Rust - Size: 46.9 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 2
likhithkp/distributed-task-queue
A lightweight distributed task queue using Go, Redis, and net/http. Supports async task execution with scalable producers and workers.
Language: Go - Size: 12.7 KB - Last synced at: 8 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0
erland1988/async-task-hub
Async Task Hub 基于 Go 语言开发，借助 MySQL 和 Redis 实现异步任务处理。适用于电商等业务场景，可有效管理任务执行流程，具备良好扩展性 。
Language: Vue - Size: 464 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0
Elijas/redis-message-queue
Robust Python queuing with message deduplication
Language: Python - Size: 35.2 KB - Last synced at: 9 days ago - Pushed at: 4 months ago - Stars: 6 - Forks: 1
verumlotus/NFT-Batch-Download
Batch download images from an NFT collection
Language: Python - Size: 315 KB - Last synced at: 4 months ago - Pushed at: about 3 years ago - Stars: 15 - Forks: 3
LgendSourabie/videoflix-backend
Backend of a Netflix-like video streaming platform using ffmpeg video encoding technics, django and django rest framework
Language: Python - Size: 26.1 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 1
alugowski/task-thread-pool
Fast and lightweight thread pool for C++11 and newer.
Language: C++ - Size: 54.7 KB - Last synced at: 4 months ago - Pushed at: 8 months ago - Stars: 42 - Forks: 3
r05323028/eyes
Public Opinion Mining System of Taiwanese Forums
Language: Python - Size: 8.17 MB - Last synced at: 4 months ago - Pushed at: almost 3 years ago - Stars: 120 - Forks: 18
AprilNEA/bullmq-zod
Type-safe BullMQ integration with Zod schema validation
Language: TypeScript - Size: 26.4 KB - Last synced at: 7 days ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0
erdewit/distex 📦
Distributed process pool for Python
Language: Python - Size: 6.93 MB - Last synced at: 27 days ago - Pushed at: almost 3 years ago - Stars: 110 - Forks: 12
agungdwiprasetyo/backend-microservices
Monorepo for backend microservices golang
Language: Go - Size: 849 KB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 69 - Forks: 18
bitleak/lmstfy
A task queue with REST API
Language: Go - Size: 9.06 MB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 829 - Forks: 124
DumbMachine/nq
Cancellable, Efficient and Reliable Distributed Task Queue in Go
Language: Go - Size: 3.64 MB - Last synced at: 4 months ago - Pushed at: almost 3 years ago - Stars: 93 - Forks: 4
4thel00z/task-manager
Bash task worker written in Go. Uses redpanda for queues and sqlite for storage. Very fast, and low mem footprint.
Language: Go - Size: 66.4 KB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0
zhashkevych/musicload-bot
Telegram Bot written in Go
Language: Go - Size: 1.18 MB - Last synced at: 3 months ago - Pushed at: about 6 years ago - Stars: 32 - Forks: 8
lilBunnyRabbit/task-manager
System for managing and executing asynchronous and synchronous tasks with queuing, parallel execution, and progress tracking.
Language: HTML - Size: 827 KB - Last synced at: 5 days ago - Pushed at: 5 months ago - Stars: 4 - Forks: 1
tawounfouet/advanced-django-coursera
Mastering Django and the Django Rest Framework. Creating a blog and an accompanying API using industry-standard tools and software packages
Language: Python - Size: 67.8 MB - Last synced at: 5 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0
senatorpage445/Celery-Task-Queue-latest-2025
Celery is an open-source distributed task queue that helps you handle asynchronous tasks and job queues with ease. Designed for real-time processing, it integrates seamlessly with your Python applications to offload long-running or resource-intensive tasks. 🐍⚙️
Size: 6.84 KB - Last synced at: 5 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0
mugli/orkid-node
Reliable and modern Redis Streams based task queue for Node.js 🤖
Language: JavaScript - Size: 1.95 MB - Last synced at: 20 days ago - Pushed at: over 2 years ago - Stars: 63 - Forks: 9
oshankkumar/taskqueue-go
TaskQueue-Go: A distributed, high-performance task queue library for Go with support for customizable backends and scalable background job processing.
Language: Go - Size: 1.68 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 4 - Forks: 0
cnstark/gputasker
An awesome gpu tasks scheduler. 轻量好用的GPU机群任务调度工具。觉得有用可以点个star
Language: Python - Size: 592 KB - Last synced at: 6 months ago - Pushed at: almost 3 years ago - Stars: 169 - Forks: 18
alexfigliolia/task-queue
A basic queue for handling prioritized and scheduled tasks
Language: TypeScript - Size: 273 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0
chris104957/django-carrot
A lightweight task queue for Django using RabbitMQ
Language: Python - Size: 1.96 MB - Last synced at: 19 days ago - Pushed at: over 2 years ago - Stars: 72 - Forks: 15
