GitHub topics: worker-pool
poolifier/poolifier
Fast and small Node.js worker_threads and cluster worker pool
Language: JavaScript - Size: 31.5 MB - Last synced at: about 20 hours ago - Pushed at: about 23 hours ago - Stars: 431 - Forks: 15
general-CbIC/poolex
A library for managing pools of workers
Language: Elixir - Size: 1.63 MB - Last synced at: about 15 hours ago - Pushed at: 9 days ago - Stars: 77 - Forks: 7
panjf2000/ants
🐜🐜🐜 ants is the most powerful and reliable pooling solution for Go.
Language: Go - Size: 1.81 MB - Last synced at: 1 day ago - Pushed at: 30 days ago - Stars: 13,976 - Forks: 1,415
ankorstore/yokai
Simple, modular, and observable Go framework for backend applications.
Language: Go - Size: 6.09 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 749 - Forks: 23
piscinajs/piscina
A fast, efficient Node.js Worker Thread Pool implementation
Language: TypeScript - Size: 2.52 MB - Last synced at: 7 days ago - Pushed at: 13 days ago - Stars: 4,856 - Forks: 139
zaidsasa/workerpool
Concurrency limiting goroutine pool
Language: Go - Size: 44.9 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 1 - Forks: 0
hibiken/asynq
Simple, reliable, and efficient distributed task queue in Go
Language: Go - Size: 7.65 MB - Last synced at: 8 days ago - Pushed at: 4 months ago - Stars: 11,902 - Forks: 847
noble-gase/xe
[氙-Xe] Go协程并发复用，降低CPU和内存负载
Language: Go - Size: 298 KB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 8 - Forks: 0
poolifier/poolifier-web-worker
Fast and small web worker pool
Language: JavaScript - Size: 15.3 MB - Last synced at: 9 days ago - Pushed at: 10 days ago - Stars: 55 - Forks: 2
goadesign/pulse
⚡Streamlined event streaming and distributed worker pools in Go⚡
Language: Go - Size: 10.7 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 16 - Forks: 1
phun-ky/hybrid-compute
Run compute tasks wherever they run best - local, threaded, or remote - with a pluggable backend architecture.
Language: TypeScript - Size: 2.3 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 2 - Forks: 0
acaloiaro/neoq
Queue-agnostic background job library for Go, with a pleasant API and powerful features.
Language: Go - Size: 406 KB - Last synced at: 8 days ago - Pushed at: 2 months ago - Stars: 320 - Forks: 5
msfragala/slother
Keep your UI snappy by offloading CPU-intensive tasks, but in a lazy way — worker pools that lazy-load when used and spawn new threads as needed
Language: JavaScript - Size: 255 KB - Last synced at: 9 days ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 1
euskadi31/go-worker
Pool Worker in Go
Language: Go - Size: 54.7 KB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 1 - Forks: 2
webpack-contrib/thread-loader
Runs the following loaders in a worker pool
Language: JavaScript - Size: 1.43 MB - Last synced at: 5 days ago - Pushed at: 14 days ago - Stars: 1,129 - Forks: 69
devinus/poolboy
A hunky Erlang worker pool factory
Language: Erlang - Size: 3.18 MB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 1,580 - Forks: 353
pouchlabs/pqueue
A worker pool for bun,nodejs,browser,deno..run cpu intensive tasks in parallel.
Language: TypeScript - Size: 19.5 KB - Last synced at: 14 days ago - Pushed at: 15 days ago - Stars: 1 - Forks: 0
h2337/cppq
Simple, reliable & efficient distributed task queues for C++17
Language: TypeScript - Size: 546 KB - Last synced at: 6 days ago - Pushed at: about 1 month ago - Stars: 112 - Forks: 7
rocketbitz/pool
a simple worker pool for gophers
Language: Go - Size: 9.77 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 1 - Forks: 0
W4G1/multithreading
⚡ Multithreading functions in JavaScript. Designed to feel like writing vanilla functions.
Language: TypeScript - Size: 495 KB - Last synced at: 19 days ago - Pushed at: about 1 year ago - Stars: 328 - Forks: 11
BlueOcean223/worker_pool
Example of Worker Pool Implementation Based on GoLang
Language: Go - Size: 9.77 KB - Last synced at: 23 days ago - Pushed at: 23 days ago - Stars: 0 - Forks: 0
bravo1goingdark/mailgrid
Mailgrid is an ultra-lightweight, high-throughput email automation CLI written in Go. It reads recipients from a CSV or Google Sheet and delivers emails via SMTP (Zoho, Gmail, etc.) with concurrency, rate-limiting, and optional scheduling — all without bloated dependencies.
Language: Go - Size: 5.42 MB - Last synced at: 23 days ago - Pushed at: 24 days ago - Stars: 13 - Forks: 2
alitto/pond
🔘 Minimalistic and High-performance goroutine worker pool written in Go
Language: Go - Size: 815 KB - Last synced at: 23 days ago - Pushed at: 26 days ago - Stars: 1,933 - Forks: 73
andywer/threads.js
🧵 Make web workers & worker threads as simple as a function call.
Language: TypeScript - Size: 1.58 MB - Last synced at: 22 days ago - Pushed at: about 1 year ago - Stars: 3,484 - Forks: 168
sapvs/gopool
go worker pool
Language: Go - Size: 15.6 KB - Last synced at: 29 days ago - Pushed at: 29 days ago - Stars: 0 - Forks: 0
sebastianwessel/quickjs
A typescript package to execute JavaScript and TypeScript code in a webassembly quickjs sandbox
Language: TypeScript - Size: 4.32 MB - Last synced at: 30 days ago - Pushed at: about 1 month ago - Stars: 763 - Forks: 25
izo0x90/pipeline-factory
Pipeline Factory is a Python server framework to define, manage, schedule and execute custom defined code pipelines and series of pipeline across multiple worker processes.
Language: Python - Size: 24.4 KB - Last synced at: 10 days ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0
AmirDahmouni/student-api-worker-thread
Threaded Student API is a minimalist HTTP API built with TypeScript
Language: TypeScript - Size: 43 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0
austinksmith/Hamsters.js
100% Vanilla Javascript Multithreading & Parallel Execution Library
Language: JavaScript - Size: 42.9 MB - Last synced at: 28 days ago - Pushed at: about 1 month ago - Stars: 595 - Forks: 31
egocentryk/nestjs-advanced-concepts
Playground for a deeper understanding of NestJS and learn how to approach more complex scenarios in modern Node applications.
Language: TypeScript - Size: 500 KB - Last synced at: 1 day ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0
ynori7/workerpool
The worker pool library abstracts the setup around creating worker pools, so all you need to take care of is the actual business logic.
Language: Go - Size: 21.5 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 4 - Forks: 1
mmycin/intralb
IntraLB — A high-performance, intelligent intra-process load balancer for Go HTTP services with graceful shutdown and dynamic worker scaling.
Language: Go - Size: 16.6 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0
EkoEdyPurwanto/CLIs-Applications
CLI INTERACTIVE + WORKER + CONCURRENCY + SCRAPING
Language: Go - Size: 5.34 MB - Last synced at: 6 days ago - Pushed at: about 2 years ago - Stars: 19 - Forks: 1
itsdheerajbudhiraja/express-boilerplate-ts
Boilerplate for NodeJS Express Projects written in Typescript The purpose of this template repository is to fast track APIs development and reach to production ASAP. At most places except TSOA, there is very less use of external dependency injection or similar libraries to demonstrate how same thing can be achieved in vanilla code
Language: TypeScript - Size: 652 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 21 - Forks: 5
a-ZINC/Urge
Urge is a high-performance, concurrent command-line tool for batch image processing. Built with Go, it leverages a parallel pipeline architecture to efficiently apply various transformations to images from local files, directories, or remote URLs.
Language: Go - Size: 96.7 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0
davidroman0O/retrypool
A powerful Go library for concurrent task processing with customizable retry logic and backoff strategies. Enhance your applications with robust and efficient worker pools that handle retries seamlessly.
Language: Go - Size: 835 KB - Last synced at: 10 days ago - Pushed at: 7 months ago - Stars: 5 - Forks: 0
goptics/varmq
A Simplest Storage-Agnostic and Zero-dep Message Queue for Your Concurrent Go Program
Language: Go - Size: 74.4 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 151 - Forks: 10
matthewoestreich/workerpoolxt
Concurrency limiting goroutine pool without upper limit on queue length. Extends github.com/gammazero/workerpool
Language: Go - Size: 194 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 15 - Forks: 0
elite-libs/promise-pool
🏖 Configurable async task queue, w/ throttling, retries, error handling - by EliteLibs.
Language: TypeScript - Size: 815 KB - Last synced at: 30 days ago - Pushed at: over 2 years ago - Stars: 7 - Forks: 3
srivathsashreyas/task-queue
A Redis-backed priority task queue (using a sorted set / ZSET) with Go-based workers, timeouts, and backpressure control
Language: Go - Size: 0 Bytes - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0
choria-io/asyncjobs
Asynchronous Job Processor
Language: Go - Size: 3.52 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 114 - Forks: 5
gammazero/workerpool
Concurrency limiting goroutine pool
Language: Go - Size: 85.9 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 1,386 - Forks: 142
YattaDeSune/calc-project
Распределённый вычислитель арифметических выражений. Написан на языке Golang
Language: Go - Size: 496 KB - Last synced at: 19 days ago - Pushed at: 4 months ago - Stars: 2 - Forks: 0
ankorstore/yokai-showroom
Showroom for demo applications based on the Yokai framework.
Language: Go - Size: 854 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 26 - Forks: 4
KrishnaPG/zmq-task-dispatcher
ZeroMQ Pub/Sub based tasks distributed to worker pool with minimum latency in C++23
Language: C++ - Size: 1.35 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0
rickinshah/BugBee-Go
Language: JavaScript - Size: 49.1 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0
ankorstore/yokai-worker-template
Worker application template based on the Yokai Go framework.
Language: Go - Size: 130 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 2 - Forks: 1
fredwu/opq
Elixir queue! A simple, in-memory queue with worker pooling and rate limiting in Elixir.
Language: Elixir - Size: 92.8 KB - Last synced at: 4 months ago - Pushed at: almost 2 years ago - Stars: 269 - Forks: 8
janniclas/beehive
Beehive is a channel-based implementation of the Fan-Out and Fan-In pattern.
Language: Go - Size: 553 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0
lucafmarques/pool
Minimalistic goroutine worker pools
Language: Go - Size: 11.7 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0
WangWilly/labs-gin
A Go-based API service for video downloading and processing using the Gin web framework.
Language: Go - Size: 104 KB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0
coderaiser/node-thread-it
Wrap any sync module to thread worker
Language: JavaScript - Size: 36.1 KB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 2 - Forks: 1
chebyrash/promise
Promise / Future library for Go
Language: Go - Size: 153 KB - Last synced at: 3 months ago - Pushed at: about 2 years ago - Stars: 402 - Forks: 36
savsgio/workerpool
Lightweight and fast worker pool with generics support.
Language: Go - Size: 24.4 KB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 6 - Forks: 0
SiddiqSoft/asynchrony
Classes to allow you to build asynchrony in your applications using standard C++ jthread, semaphore, deque
Language: C++ - Size: 163 KB - Last synced at: 25 days ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0
alphadose/itogami
Fastest and most efficient goroutine pool (experimental)
Language: Go - Size: 38.1 KB - Last synced at: 5 months ago - Pushed at: almost 3 years ago - Stars: 138 - Forks: 7
Elijas/redis-message-queue
Robust Python queuing with message deduplication
Language: Python - Size: 35.2 KB - Last synced at: about 12 hours ago - Pushed at: 6 months ago - Stars: 6 - Forks: 1
joergen7/gruff
A basic worker pool manager for Erlang to showcase gen_pnet.
Language: Erlang - Size: 815 KB - Last synced at: 17 days ago - Pushed at: 7 months ago - Stars: 24 - Forks: 3
kadirlua/WorkerQueue
Cross platform asynchronous worker queue based on modern C++(11 and later)
Language: C++ - Size: 234 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 4 - Forks: 1
sujoncoder/DSA_Async_Architecture_and_OOP
Deep dive Javascript DSA Async Architecture and OOP.
Language: JavaScript - Size: 23.4 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0
shomali11/parallelizer
Simplifies the parallelization of function calls.
Language: Go - Size: 78.1 KB - Last synced at: 5 months ago - Pushed at: about 3 years ago - Stars: 73 - Forks: 6
serpent7776/pg_worker_pool
Postgres extension creating a pool of background workers
Language: C - Size: 19.5 KB - Last synced at: 5 months ago - Pushed at: 8 months ago - Stars: 24 - Forks: 0
gtors/flexpool
A flexible worker pool implementation in Go that supports dynamic resizing
Language: Go - Size: 6.84 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0
hashmap-kz/workerfn
Go package that provides simple functions for executing tasks concurrently
Language: Go - Size: 54.7 KB - Last synced at: 6 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0
JeffersonGibin/thread-tasker
Simplify handling asynchronous tasks with ease. Easily manage task execution with Worker Threads.
Language: TypeScript - Size: 52.7 KB - Last synced at: 10 days ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0
snuffyDev/svelte-worker-store
:zap: Turbocharge your apps with multithreaded Svelte stores.
Language: Svelte - Size: 301 KB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 51 - Forks: 0
flipeador/node-workerpool
Create a pool of workers and execute a function or file in worker threads and child processes.
Language: JavaScript - Size: 12.7 KB - Last synced at: 6 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 1
dc0d/workerpool
A workerpool that can get expanded & shrink dynamically.
Language: Go - Size: 55.7 KB - Last synced at: 5 months ago - Pushed at: over 4 years ago - Stars: 53 - Forks: 5
axah710/Worker-Pool
This Go program efficiently processes tasks using goroutines, channels, and sync.WaitGroup, enabling concurrent execution and synchronization. Ideal for job queues and scalable task processing. 🚀
Language: Go - Size: 3.91 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0
joergen7/cre
common runtime environment for distributed programming languages
Language: Erlang - Size: 3.64 MB - Last synced at: about 1 month ago - Pushed at: 7 months ago - Stars: 22 - Forks: 4
kvzix/wkpool
Primitive implementation of the worker pool.
Language: Go - Size: 1.95 KB - Last synced at: 10 days ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
tianhao-ai/Distributed-Dictionary-COMP90015-2023S2-Assignment-1
Distributed Dictionary
Language: Java - Size: 63.2 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0
utkusen/goroutine-benchmark
runs benchmarks to determine the optimal number of Go routine pool size on the current machine
Language: Go - Size: 5.86 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 1
egnd/go-toolbox
Monorepo for golang tools and helpers
Language: Go - Size: 320 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0
kc596/priorityworkerpool
A worker pool in GoLang which schedules job according to priority.
Language: Go - Size: 27.3 KB - Last synced at: 5 months ago - Pushed at: about 4 years ago - Stars: 6 - Forks: 2
alserok/gokit
🛠️ Golang kit (Limiter, Breaker, Balancer etc.)
Language: Go - Size: 63.5 KB - Last synced at: 3 months ago - Pushed at: 9 months ago - Stars: 5 - Forks: 0
mix-php/worker-pool
Swoole-based worker pool, coroutine pool / 基于 Swoole 的工作池，协程池
Language: PHP - Size: 14.6 KB - Last synced at: about 2 months ago - Pushed at: about 4 years ago - Stars: 4 - Forks: 0
YSZhuoyang/go-dispatcher
A goroutine job dispatcher based on worker-pool pattern.
Language: Go - Size: 58.6 KB - Last synced at: 24 days ago - Pushed at: almost 2 years ago - Stars: 32 - Forks: 8
nikhilbhatia08/taskflow
A distributed, durable job execution platform
Language: Go - Size: 1.02 MB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 1 - Forks: 1
HarjjotSinghh/fetchpix
A stock image API which scrapes various stock image websites and returns a valid image URL.
Language: TypeScript - Size: 159 KB - Last synced at: 19 days ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0
Attumm/meesee
Task queue, Long lived workers for work based parallelization, with processes and Redis as back-end. For distributed computing.
Language: Python - Size: 110 KB - Last synced at: 18 days ago - Pushed at: about 1 year ago - Stars: 18 - Forks: 1
LuFred/goworker
go实现的worker框架
Language: Go - Size: 51.8 KB - Last synced at: 3 days ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0
ORESoftware/poolio
Node.js / NPM module for creating custom worker pools using child processes.
Language: TypeScript - Size: 325 KB - Last synced at: 3 months ago - Pushed at: almost 7 years ago - Stars: 8 - Forks: 0
gremislaw/worker_pool
Terminal User Interface using bubbletea for worker pool (async coding)
Language: Go - Size: 6.01 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0
chsendev/asynq-plus
基于asynq的异步工作流封装
Language: Go - Size: 8.79 KB - Last synced at: 9 months ago - Pushed at: 10 months ago - Stars: 1 - Forks: 0
txaty/gool
Generic goroutine pool: Submit, Map, Async.
Language: Go - Size: 22.5 KB - Last synced at: 8 days ago - Pushed at: almost 2 years ago - Stars: 72 - Forks: 2
codesoap/lineworker
A worker pool which processes work in parallel but outputs results in the order the work was given
Language: Go - Size: 5.86 KB - Last synced at: 4 months ago - Pushed at: 10 months ago - Stars: 14 - Forks: 0
CHINMAYVIVEK/go-worker-pool
fire and forget golang worker pool
Language: Go - Size: 4.88 KB - Last synced at: about 2 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0
ella-to/task
Task runner
Language: Go - Size: 14.6 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0
qxsch/WorkerPool
Parallel Processing WorkerPool for PHP
Language: PHP - Size: 5 MB - Last synced at: 21 days ago - Pushed at: about 1 year ago - Stars: 104 - Forks: 22
erlangpack/sidejob Fork of mworrell/sidejob
Parallel, capacity-limited request pool
Language: Erlang - Size: 164 KB - Last synced at: 5 months ago - Pushed at: 11 months ago - Stars: 15 - Forks: 2
terminalkitten/django-pdf-reactor
Async PDF generation in Django Channels worker or with Django 3.1 async views
Language: Python - Size: 399 KB - Last synced at: 18 days ago - Pushed at: almost 3 years ago - Stars: 2 - Forks: 0
B1NARY-GR0UP/violin
VIOLIN worker/connection pool
Language: Go - Size: 104 KB - Last synced at: 5 months ago - Pushed at: about 1 year ago - Stars: 9 - Forks: 0
octu0/chanque
framework for asynchronous programming and goroutine management and safe use of channels
Language: Go - Size: 137 KB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 1
damnever/workerpool
A handy and fast goroutine pool with a simple pipeline utility.
Language: Go - Size: 57.6 KB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0
vasrem/gopp
Parallel processing functionality with configurable retry mechanism and error handling
Language: Go - Size: 13.7 KB - Last synced at: 6 months ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 0
proullon/workerpool
auto scaling generic worker pool
Language: Go - Size: 98.6 KB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 6 - Forks: 1
Tyill/zmey
A platform to programmatically author, schedule, and monitor workflows
Language: C++ - Size: 30.8 MB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0
TomWright/gopool
Easy to use worker pool with dynamic pool sizing.
Language: Go - Size: 51.8 KB - Last synced at: 4 months ago - Pushed at: about 7 years ago - Stars: 12 - Forks: 1
CherkashinEvgeny/gopool
Golang worker pool pattern implementation
Language: Go - Size: 22.5 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0
