Topic: "worker-pool"
panjf2000/ants
πππ ants is the most powerful and reliable pooling solution for Go.
Language: Go - Size: 1.81 MB - Last synced at: 1 day ago - Pushed at: 11 days ago - Stars: 13,558 - Forks: 1,388
hibiken/asynq
Simple, reliable, and efficient distributed task queue in Go
Language: Go - Size: 7.66 MB - Last synced at: 1 day ago - Pushed at: 23 days ago - Stars: 11,023 - Forks: 781
andywer/threads.js
𧡠Make web workers & worker threads as simple as a function call.
Language: TypeScript - Size: 1.58 MB - Last synced at: 11 days ago - Pushed at: 10 months ago - Stars: 3,455 - Forks: 168
alitto/pond
π Minimalistic and High-performance goroutine worker pool written in Go
Language: Go - Size: 840 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 1,737 - Forks: 71
devinus/poolboy
A hunky Erlang worker pool factory
Language: Erlang - Size: 3.18 MB - Last synced at: 1 day ago - Pushed at: about 2 years ago - Stars: 1,569 - Forks: 352
gammazero/workerpool
Concurrency limiting goroutine pool
Language: Go - Size: 85.9 KB - Last synced at: about 20 hours ago - Pushed at: 2 months ago - Stars: 1,373 - Forks: 140
webpack-contrib/thread-loader
Runs the following loaders in a worker pool
Language: JavaScript - Size: 1.42 MB - Last synced at: about 6 hours ago - Pushed at: 3 months ago - Stars: 1,126 - Forks: 71
sebastianwessel/quickjs
A typescript package to execute JavaScript and TypeScript code in a webassembly quickjs sandbox
Language: TypeScript - Size: 3.73 MB - Last synced at: 10 days ago - Pushed at: 25 days ago - Stars: 719 - Forks: 22
ankorstore/yokai
Simple, modular, and observable Go framework for backend applications.
Language: Go - Size: 5.99 MB - Last synced at: 10 days ago - Pushed at: 23 days ago - Stars: 686 - Forks: 21
austinksmith/Hamsters.js
100% Vanilla Javascript Multithreading & Parallel Execution Library
Language: JavaScript - Size: 42.8 MB - Last synced at: about 19 hours ago - Pushed at: 6 months ago - Stars: 591 - Forks: 33
albrow/jobs π¦
A persistent and flexible background jobs library for go.
Language: Go - Size: 212 KB - Last synced at: 9 months ago - Pushed at: almost 7 years ago - Stars: 499 - Forks: 47
chebyrash/promise
Promise / Future library for Go
Language: Go - Size: 153 KB - Last synced at: 9 days ago - Pushed at: almost 2 years ago - Stars: 401 - Forks: 36
poolifier/poolifier
Fast and small Node.js worker_threads and cluster worker pool
Language: JavaScript - Size: 28.9 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 387 - Forks: 13
W4G1/multithreading
β‘ Multithreading functions in JavaScript to speedup heavy workloads, designed to feel like writing vanilla functions.
Language: TypeScript - Size: 495 KB - Last synced at: 16 days ago - Pushed at: 10 months ago - Stars: 326 - Forks: 11
acaloiaro/neoq
Queue-agnostic background job library for Go, with a pleasant API and powerful features.
Language: Go - Size: 404 KB - Last synced at: 2 days ago - Pushed at: 5 days ago - Stars: 310 - Forks: 4
developit/task-worklet
Task Worklet: explainer, polyfill and demos.
Language: JavaScript - Size: 58.6 KB - Last synced at: 5 days ago - Pushed at: over 3 years ago - Stars: 275 - Forks: 4
fredwu/opq
Elixir queue! A simple, in-memory queue with worker pooling and rate limiting in Elixir.
Language: Elixir - Size: 92.8 KB - Last synced at: 11 days ago - Pushed at: over 1 year ago - Stars: 268 - Forks: 8
alphadose/itogami
Fastest and most efficient goroutine pool (experimental)
Language: Go - Size: 38.1 KB - Last synced at: 22 days ago - Pushed at: over 2 years ago - Stars: 138 - Forks: 7
cahitbeyaz/job-worker
Job/Worker pattern example in golang http://marcio.io/2015/07/handling-1-million-requests-per-minute-with-golang/
Language: Go - Size: 3.91 KB - Last synced at: over 1 year ago - Pushed at: about 8 years ago - Stars: 114 - Forks: 43
choria-io/asyncjobs
Asynchronous Job Processor
Language: Go - Size: 3.47 MB - Last synced at: 9 days ago - Pushed at: 10 months ago - Stars: 107 - Forks: 5
qxsch/WorkerPool
Parallel Processing WorkerPool for PHP
Language: PHP - Size: 5 MB - Last synced at: 13 days ago - Pushed at: 8 months ago - Stars: 104 - Forks: 22
hikmat2337/cppq π¦
Simple, reliable & efficient distributed task queue for C++17
Language: C++ - Size: 463 KB - Last synced at: 3 days ago - Pushed at: 4 months ago - Stars: 96 - Forks: 6
softvar/super-workers
:horse: Distribute load on front-end via parallelism
Language: JavaScript - Size: 805 KB - Last synced at: 4 days ago - Pushed at: over 5 years ago - Stars: 95 - Forks: 13
vardius/worker-pool
Go simple async worker pool
Language: Go - Size: 47.9 KB - Last synced at: 22 days ago - Pushed at: over 4 years ago - Stars: 92 - Forks: 13
shomali11/parallelizer
Simplifies the parallelization of function calls.
Language: Go - Size: 78.1 KB - Last synced at: 8 days ago - Pushed at: almost 3 years ago - Stars: 73 - Forks: 6
txaty/gool
Generic goroutine pool: Submit, Map, Async.
Language: Go - Size: 22.5 KB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 72 - Forks: 2
qianguozheng/go-workerpool
Worker pool implementation
Language: Go - Size: 3.91 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 72 - Forks: 17
general-CbIC/poolex
A library for managing pools of workers
Language: Elixir - Size: 1.36 MB - Last synced at: 3 days ago - Pushed at: 18 days ago - Stars: 69 - Forks: 6
hmdsefi/gowl
Gowl is a process management and process monitoring tool at once. An infinite worker pool gives you the ability to control the pool and processes and monitor their status.
Language: Go - Size: 334 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 65 - Forks: 8
cmitsakis/workerpool-go
auto-scaling worker pool (work queue) in Go, using generics
Language: Go - Size: 82 KB - Last synced at: 10 months ago - Pushed at: over 1 year ago - Stars: 56 - Forks: 2
dc0d/workerpool
A workerpool that can get expanded & shrink dynamically.
Language: Go - Size: 55.7 KB - Last synced at: 11 days ago - Pushed at: about 4 years ago - Stars: 53 - Forks: 5
snuffyDev/svelte-worker-store
:zap: Turbocharge your apps with multithreaded Svelte stores.
Language: Svelte - Size: 301 KB - Last synced at: 17 days ago - Pushed at: almost 2 years ago - Stars: 51 - Forks: 0
earthboundkid/workgroup π¦
Structured concurrency manager for Go
Language: Go - Size: 33.2 KB - Last synced at: 10 months ago - Pushed at: almost 2 years ago - Stars: 45 - Forks: 0
poolifier/poolifier-web-worker
Fast and small web worker pool
Language: JavaScript - Size: 15 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 44 - Forks: 2
g-andrade/taskforce
On-demand worker pools for parallelizable tasks
Language: Erlang - Size: 66.4 KB - Last synced at: 4 days ago - Pushed at: about 3 years ago - Stars: 43 - Forks: 2
yiigo/nightfall
Goεη¨εΉΆεε€η¨οΌιδ½CPUεε εθ΄θ½½
Language: Go - Size: 412 KB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 37 - Forks: 5
d-tsuji/flower
[Proof of Concept] This is the simple implementation of the workflow engine that manages workflows composed of DAGs.
Language: Go - Size: 2.99 MB - Last synced at: 10 months ago - Pushed at: about 5 years ago - Stars: 32 - Forks: 1
YSZhuoyang/go-dispatcher
A goroutine job dispatcher based on worker-pool pattern.
Language: Go - Size: 58.6 KB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 31 - Forks: 8
serdmanczyk/Bifrost
Golang query-able job queue
Language: Go - Size: 95.7 KB - Last synced at: 10 months ago - Pushed at: over 7 years ago - Stars: 27 - Forks: 3
joergen7/gruff
A basic worker pool manager for Erlang to showcase gen_pnet.
Language: Erlang - Size: 815 KB - Last synced at: 14 days ago - Pushed at: 3 months ago - Stars: 24 - Forks: 3
serpent7776/pg_worker_pool
Postgres extension creating a pool of background workers
Language: C - Size: 19.5 KB - Last synced at: 27 days ago - Pushed at: 3 months ago - Stars: 24 - Forks: 0
ankorstore/yokai-showroom
Showroom for demo applications based on the Yokai framework.
Language: Go - Size: 773 KB - Last synced at: 8 days ago - Pushed at: 5 months ago - Stars: 23 - Forks: 3
joergen7/cre
common runtime environment for distributed programming languages
Language: Erlang - Size: 3.64 MB - Last synced at: 1 day ago - Pushed at: 3 months ago - Stars: 22 - Forks: 4
EkoEdyPurwanto/CLIs-Applications
CLI INTERACTIVE + WORKER + CONCURRENCY + SCRAPING
Language: Go - Size: 5.34 MB - Last synced at: 5 days ago - Pushed at: almost 2 years ago - Stars: 22 - Forks: 1
WimJongeneel/ts-workerpool
A worker-pool in TypeScript for parallel programming
Language: TypeScript - Size: 8.79 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 20 - Forks: 7
Attumm/meesee
Task queue, Long lived workers for work based parallelization, with processes and Redis as back-end. For distributed computing.
Language: Python - Size: 110 KB - Last synced at: 15 days ago - Pushed at: 8 months ago - Stars: 18 - Forks: 1
mix-go/xwp
A dynamic golang worker pool, coroutine pool / ιη¨ε¨ζε·₯δ½ζ± γεη¨ζ±
Language: Go - Size: 22.5 KB - Last synced at: 5 days ago - Pushed at: over 1 year ago - Stars: 17 - Forks: 7
nathanschwarz/meteor-cluster
worker pool for meteor using node js native `cluster` module
Language: JavaScript - Size: 120 KB - Last synced at: over 1 year ago - Pushed at: about 3 years ago - Stars: 17 - Forks: 3
enriquebris/goworkerpool
go pool of concurrent workers with the ability to add / kill / pause / resume workers on demand
Language: Go - Size: 112 KB - Last synced at: 4 months ago - Pushed at: about 3 years ago - Stars: 16 - Forks: 6
erlangpack/sidejob Fork of mworrell/sidejob
Parallel, capacity-limited request pool
Language: Erlang - Size: 164 KB - Last synced at: 20 days ago - Pushed at: 6 months ago - Stars: 15 - Forks: 2
matthewoestreich/workerpoolxt
Concurrency limiting goroutine pool without upper limit on queue length. Extends github.com/gammazero/workerpool
Language: Go - Size: 194 KB - Last synced at: 8 days ago - Pushed at: over 4 years ago - Stars: 15 - Forks: 0
yogain123/Workers-Pool
Workers Pooling in NodeJS
Language: JavaScript - Size: 98.6 KB - Last synced at: 20 days ago - Pushed at: over 5 years ago - Stars: 15 - Forks: 0
codesoap/lineworker
A worker pool which processes work in parallel but outputs results in the order the work was given
Language: Go - Size: 4.88 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 14 - Forks: 0
goadesign/pulse
β‘Streamlined event streaming and distributed worker pools in Goβ‘
Language: Go - Size: 10.7 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 13 - Forks: 1
TomWright/gopool
Easy to use worker pool with dynamic pool sizing.
Language: Go - Size: 51.8 KB - Last synced at: 24 days ago - Pushed at: over 6 years ago - Stars: 12 - Forks: 1
utkusen/goroutine-benchmark
runs benchmarks to determine the optimal number of Go routine pool size on the current machine
Language: Go - Size: 5.86 KB - Last synced at: 23 days ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 1
B1NARY-GR0UP/violin
VIOLIN worker/connection pool
Language: Go - Size: 104 KB - Last synced at: 14 days ago - Pushed at: 9 months ago - Stars: 9 - Forks: 0
mstephen19/threadz
A feature rich and scalable general-purpose multi-threading library that makes it easy to utilize all of a given machine's resources in Node.js.
Language: TypeScript - Size: 279 KB - Last synced at: 10 days ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 1
guilhermehubner/worker
A distributed system for enqueuing and processing jobs asynchronously in Go
Language: Go - Size: 29.3 KB - Last synced at: almost 2 years ago - Pushed at: about 7 years ago - Stars: 9 - Forks: 2
reevr/vblaze
Language: JavaScript - Size: 329 KB - Last synced at: 4 days ago - Pushed at: over 2 years ago - Stars: 8 - Forks: 2
hdvianna/parallel-workerpool
The Parallel worker pool uses the PHP parallel extension to provide a simple interface for dealing with parallelization of tasks.
Language: PHP - Size: 348 KB - Last synced at: 22 days ago - Pushed at: over 4 years ago - Stars: 8 - Forks: 0
lnquy/elastic-worker-pool
Go worker pool that can expand and shrink itself with graceful shutdown
Language: Go - Size: 121 KB - Last synced at: 10 months ago - Pushed at: about 6 years ago - Stars: 8 - Forks: 1
lancer-kit/uwe
Supervisor and runtime engine for concurrent workers in your application
Language: Go - Size: 136 KB - Last synced at: 10 months ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 0
ORESoftware/poolio
Node.js / NPM module for creating custom worker pools using child processes.
Language: TypeScript - Size: 325 KB - Last synced at: 9 months ago - Pushed at: over 6 years ago - Stars: 7 - Forks: 0
savsgio/workerpool
Lightweight and fast worker pool with generics support.
Language: Go - Size: 24.4 KB - Last synced at: 10 days ago - Pushed at: 16 days ago - Stars: 6 - Forks: 0
Elijas/redis-message-queue
Robust Python queuing with message deduplication
Language: Python - Size: 35.2 KB - Last synced at: 5 days ago - Pushed at: 29 days ago - Stars: 6 - Forks: 1
proullon/workerpool
auto scaling generic worker pool
Language: Go - Size: 98.6 KB - Last synced at: 25 days ago - Pushed at: almost 2 years ago - Stars: 6 - Forks: 1
elite-libs/promise-pool
π Configurable async task queue, w/ throttling, retries, error handling - by EliteLibs.
Language: TypeScript - Size: 815 KB - Last synced at: 6 days ago - Pushed at: about 2 years ago - Stars: 6 - Forks: 2
delivery-club/bees π¦
Lightweight worker pool for go
Language: Go - Size: 21.5 KB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 6 - Forks: 0
kc596/priorityworkerpool
A worker pool in GoLang which schedules job according to priority.
Language: Go - Size: 27.3 KB - Last synced at: 21 days ago - Pushed at: over 3 years ago - Stars: 6 - Forks: 2
mayur-tolexo/sworker
Easy worker setup for your code
Language: Go - Size: 146 KB - Last synced at: 10 months ago - Pushed at: almost 5 years ago - Stars: 6 - Forks: 0
octu0/chanque
framework for asynchronous programming and goroutine management and safe use of channels
Language: Go - Size: 137 KB - Last synced at: 10 days ago - Pushed at: about 2 years ago - Stars: 5 - Forks: 1
xizhibei/blackfyre
Distributed asynchronous task queue/job queue
Language: TypeScript - Size: 269 KB - Last synced at: 4 days ago - Pushed at: over 5 years ago - Stars: 5 - Forks: 3
bnkamalesh/routinepool
A minimalistic Go package to setup a worker pool which accepts functions of signature `fn()` [not maintained]
Language: Go - Size: 14.6 KB - Last synced at: 14 days ago - Pushed at: almost 6 years ago - Stars: 5 - Forks: 2
kadirlua/WorkerQueue
Cross platform asynchronous worker queue based on modern C++(11 and later)
Language: C++ - Size: 234 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 4 - Forks: 1
ynori7/workerpool
The worker pool library abstracts the setup around creating worker pools, so all you need to take care of is the actual business logic.
Language: Go - Size: 20.5 KB - Last synced at: 10 months ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 1
akshaybharambe14/gowp
High performance, type safe, concurrency limiting worker pool package for golang!
Language: Go - Size: 402 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 4 - Forks: 0
mix-php/worker-pool
Swoole-based worker pool, coroutine pool / εΊδΊ Swoole ηε·₯δ½ζ± οΌεη¨ζ±
Language: PHP - Size: 14.6 KB - Last synced at: 11 days ago - Pushed at: almost 4 years ago - Stars: 4 - Forks: 0
kevlened/threadwork
Simple, no frills, threading in Node.js
Language: JavaScript - Size: 45.9 KB - Last synced at: 19 days ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 0
davidroman0O/retrypool
A powerful Go library for concurrent task processing with customizable retry logic and backoff strategies. Enhance your applications with robust and efficient worker pools that handle retries seamlessly.
Language: Go - Size: 835 KB - Last synced at: 4 days ago - Pushed at: 3 months ago - Stars: 3 - Forks: 0
ezrantn/wpc
Insert 1 Million Data into Database
Language: Go - Size: 25.4 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 2
jgardona/rpools
A minimalist rust workerpool implementation that uses channels to synchronize the jobs. It can spawn a fixed number of worker threads, that waits for a job queue.
Language: Rust - Size: 12.7 KB - Last synced at: 27 days ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0
BinarSkugga/tentacule
Tentacule is an uncomplicated library to deal with a pool of worker processes
Language: Python - Size: 30.3 KB - Last synced at: 18 days ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0
vasrem/gopp
Parallel processing functionality with configurable retry mechanism and error handling
Language: Go - Size: 13.7 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0
damnever/workerpool
A handy and fast goroutine pool with a simple pipeline utility.
Language: Go - Size: 57.6 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0
dc0d/spool
simple worker pool
Language: Go - Size: 29.3 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0
spiretechnology/go-pool
A Go library for goroutine worker pools
Language: Go - Size: 3.91 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 0
prikhi/immortal-queue
Build a Queue-Processing Worker Pool using Immortal
Language: Haskell - Size: 20.5 KB - Last synced at: 12 months ago - Pushed at: about 5 years ago - Stars: 3 - Forks: 1
cookiemonsterproject/cookie-monster
A flexible worker pool that aims to fit all possible use-cases.
Language: Go - Size: 84 KB - Last synced at: 7 months ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 2
letiantech/worker
A lightweight worker framework for golang
Language: Go - Size: 21.5 KB - Last synced at: 27 days ago - Pushed at: about 6 years ago - Stars: 3 - Forks: 0
harwoeck/ipstack
:satellite: ipstack is a helper package for calling the https://ipstack.com API. It includes type-safe response packets and a WorkerPool for asynchronous, once-only, lookup tasks.
Language: Go - Size: 10.7 KB - Last synced at: 14 days ago - Pushed at: over 6 years ago - Stars: 3 - Forks: 4
MiguelCastillo/workit
JavaScript utility for managing child processes in node
Language: JavaScript - Size: 45.9 KB - Last synced at: 13 days ago - Pushed at: over 7 years ago - Stars: 3 - Forks: 0
itsdheerajbudhiraja/express-boilerplate-ts
Boilerplate for NodeJS Express Projects written in Typescript The purpose of this template repository is to fast track APIs development and reach to production ASAP. At most places except TSOA, there is very less use of external dependency injection or similar libraries to demonstrate how same thing can be achieved in vanilla code
Language: TypeScript - Size: 446 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 2 - Forks: 0
ankorstore/yokai-worker-template
Worker application template based on the Yokai Go framework.
Language: Go - Size: 135 KB - Last synced at: 17 days ago - Pushed at: 7 months ago - Stars: 2 - Forks: 1
Tyill/zmey
A platform to programmatically author, schedule, and monitor workflows
Language: C++ - Size: 30.8 MB - Last synced at: 30 days ago - Pushed at: 8 months ago - Stars: 2 - Forks: 0
zekroTJA/r34-crawler
A simple CLI tool to fetch and download images from rule34.xxx
Language: Rust - Size: 93.8 KB - Last synced at: about 2 hours ago - Pushed at: 8 months ago - Stars: 2 - Forks: 0
NikhilRyan/go-routine-worker-pool
The Worker Pool with Batching is a Go library that provides a scalable and concurrent solution for processing large data sets efficiently
Language: Go - Size: 28.3 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 2 - Forks: 1
migcaraballo/workforce
Simple GO worker pool module. Do a lot of things, at the same time, fast.
Language: Go - Size: 4.88 KB - Last synced at: 10 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0
limpo1989/taskgo
taskgo is a lightweight task pool in Go
Language: Go - Size: 5.86 KB - Last synced at: 19 days ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0
jcbritobr/workerpool
A simple workerpool implementation in rust.
Language: Rust - Size: 22.5 KB - Last synced at: 17 days ago - Pushed at: almost 2 years ago - Stars: 2 - Forks: 0
