hibiken/asynq

Simple, reliable, and efficient distributed task queue in Go

Language: Go - Size: 7.66 MB - Last synced at: 42 minutes ago - Pushed at: about 1 month ago - Stars: 11,133 - Forks: 787

YattaDeSune/calc-project

Распределённый вычислитель арифметических выражений. Написан на языке Golang

Language: Go - Size: 81.1 KB - Last synced at: about 3 hours ago - Pushed at: about 4 hours ago - Stars: 2 - Forks: 0

gammazero/workerpool

Concurrency limiting goroutine pool

Language: Go - Size: 85.9 KB - Last synced at: about 17 hours ago - Pushed at: 3 months ago - Stars: 1,380 - Forks: 141

KrishnaPG/zmq-task-dispatcher

ZeroMQ Pub/Sub based tasks distributed to worker pool with minimum latency in C++23

Language: C++ - Size: 1.35 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 0 - Forks: 0

general-CbIC/poolex

A library for managing pools of workers

Language: Elixir - Size: 1.36 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 71 - Forks: 6

ankorstore/yokai-worker-template

Worker application template based on the Yokai Go framework.

Language: Go - Size: 130 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 2 - Forks: 1

davidroman0O/retrypool

A powerful Go library for concurrent task processing with customizable retry logic and backoff strategies. Enhance your applications with robust and efficient worker pools that handle retries seamlessly.

Language: Go - Size: 835 KB - Last synced at: 4 days ago - Pushed at: 3 months ago - Stars: 4 - Forks: 0

ankorstore/yokai-showroom

Showroom for demo applications based on the Yokai framework.

Language: Go - Size: 813 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 24 - Forks: 3

janniclas/beehive

Beehive is a channel-based implementation of the Fan-Out and Fan-In pattern.

Language: Go - Size: 553 KB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 1 - Forks: 0

h2337/cppq 📦

Simple, reliable & efficient distributed task queue for C++17

Language: C++ - Size: 463 KB - Last synced at: 5 days ago - Pushed at: 5 months ago - Stars: 98 - Forks: 6

devinus/poolboy

A hunky Erlang worker pool factory

Language: Erlang - Size: 3.18 MB - Last synced at: 1 day ago - Pushed at: about 2 years ago - Stars: 1,568 - Forks: 352

EkoEdyPurwanto/CLIs-Applications

CLI INTERACTIVE + WORKER + CONCURRENCY + SCRAPING

Language: Go - Size: 5.34 MB - Last synced at: 5 days ago - Pushed at: almost 2 years ago - Stars: 21 - Forks: 1

panjf2000/ants

🐜🐜🐜 ants is the most powerful and reliable pooling solution for Go.

Language: Go - Size: 1.81 MB - Last synced at: 6 days ago - Pushed at: 30 days ago - Stars: 13,601 - Forks: 1,385

euskadi31/go-worker

Pool Worker in Go

Language: Go - Size: 47.9 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 1 - Forks: 2

ankorstore/yokai

Simple, modular, and observable Go framework for backend applications.

Language: Go - Size: 6.03 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 693 - Forks: 22

RickinShah/BugBee-Go

Language: JavaScript - Size: 49.1 MB - Last synced at: 4 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 0

sebastianwessel/quickjs

A typescript package to execute JavaScript and TypeScript code in a webassembly quickjs sandbox

Language: TypeScript - Size: 3.84 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 723 - Forks: 22

noble-gase/xe

[氙-Xe] Go协程并发复用，降低CPU和内存负载

Language: Go - Size: 180 KB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 0 - Forks: 0

poolifier/poolifier

Fast and small Node.js worker_threads and cluster worker pool

Language: JavaScript - Size: 29 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 387 - Forks: 13

choria-io/asyncjobs

Asynchronous Job Processor

Language: Go - Size: 3.5 MB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 109 - Forks: 5

webpack-contrib/thread-loader

Runs the following loaders in a worker pool

Language: JavaScript - Size: 1.42 MB - Last synced at: 3 days ago - Pushed at: 4 months ago - Stars: 1,126 - Forks: 71

acaloiaro/neoq

Queue-agnostic background job library for Go, with a pleasant API and powerful features.

Language: Go - Size: 404 KB - Last synced at: 2 days ago - Pushed at: 23 days ago - Stars: 311 - Forks: 4

poolifier/poolifier-web-worker

Fast and small web worker pool

Language: JavaScript - Size: 15 MB - Last synced at: 11 days ago - Pushed at: 16 days ago - Stars: 44 - Forks: 2

andywer/threads.js

🧵 Make web workers & worker threads as simple as a function call.

Language: TypeScript - Size: 1.58 MB - Last synced at: 13 days ago - Pushed at: 11 months ago - Stars: 3,461 - Forks: 167

alitto/pond

🔘 Minimalistic and High-performance goroutine worker pool written in Go

Language: Go - Size: 844 KB - Last synced at: 16 days ago - Pushed at: 21 days ago - Stars: 1,749 - Forks: 71

coderaiser/node-thread-it

Wrap any sync module to thread worker

Language: JavaScript - Size: 36.1 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 2 - Forks: 1

goadesign/pulse

⚡Streamlined event streaming and distributed worker pools in Go⚡

Language: Go - Size: 10.7 MB - Last synced at: 17 days ago - Pushed at: 25 days ago - Stars: 13 - Forks: 1

chebyrash/promise

Promise / Future library for Go

Language: Go - Size: 153 KB - Last synced at: 27 days ago - Pushed at: almost 2 years ago - Stars: 401 - Forks: 36

savsgio/workerpool

Lightweight and fast worker pool with generics support.

Language: Go - Size: 24.4 KB - Last synced at: 29 days ago - Pushed at: about 1 month ago - Stars: 6 - Forks: 0

SiddiqSoft/asynchrony

Classes to allow you to build asynchrony in your applications using standard C++ jthread, semaphore, deque

Language: C++ - Size: 163 KB - Last synced at: about 17 hours ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

alphadose/itogami

Fastest and most efficient goroutine pool (experimental)

Language: Go - Size: 38.1 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 138 - Forks: 7

Elijas/redis-message-queue

Robust Python queuing with message deduplication

Language: Python - Size: 35.2 KB - Last synced at: 23 days ago - Pushed at: about 2 months ago - Stars: 6 - Forks: 1

W4G1/multithreading

⚡ Multithreading functions in JavaScript to speedup heavy workloads, designed to feel like writing vanilla functions.

Language: TypeScript - Size: 495 KB - Last synced at: about 1 month ago - Pushed at: 11 months ago - Stars: 326 - Forks: 11

joergen7/gruff

A basic worker pool manager for Erlang to showcase gen_pnet.

Language: Erlang - Size: 815 KB - Last synced at: 14 days ago - Pushed at: 3 months ago - Stars: 24 - Forks: 3

kadirlua/WorkerQueue

Cross platform asynchronous worker queue based on modern C++(11 and later)

Language: C++ - Size: 234 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 4 - Forks: 1

sujoncoder/DSA_Async_Architecture_and_OOP

Deep dive Javascript DSA Async Architecture and OOP.

Language: JavaScript - Size: 23.4 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

sujoncoder/Asynchronous_Architecture

Exploring Async-Architecture in Deepth

Language: JavaScript - Size: 13.7 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

egocentryk/nestjs-advanced-concepts

Playground for a deeper understanding of NestJS and learn how to approach more complex scenarios in modern Node applications.

Language: TypeScript - Size: 387 KB - Last synced at: about 1 hour ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

austinksmith/Hamsters.js

100% Vanilla Javascript Multithreading & Parallel Execution Library

Language: JavaScript - Size: 42.8 MB - Last synced at: 1 day ago - Pushed at: 7 months ago - Stars: 591 - Forks: 33

shomali11/parallelizer

Simplifies the parallelization of function calls.

Language: Go - Size: 78.1 KB - Last synced at: 27 days ago - Pushed at: almost 3 years ago - Stars: 73 - Forks: 6

serpent7776/pg_worker_pool

Postgres extension creating a pool of background workers

Language: C - Size: 19.5 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 24 - Forks: 0

gtors/flexpool

A flexible worker pool implementation in Go that supports dynamic resizing

Language: Go - Size: 6.84 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

fredwu/opq

Elixir queue! A simple, in-memory queue with worker pooling and rate limiting in Elixir.

Language: Elixir - Size: 92.8 KB - Last synced at: 29 days ago - Pushed at: over 1 year ago - Stars: 268 - Forks: 8

hashmap-kz/workerfn

Go package that provides simple functions for executing tasks concurrently

Language: Go - Size: 54.7 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

JeffersonGibin/thread-tasker

Simplify handling asynchronous tasks with ease. Easily manage task execution with Worker Threads.

Language: TypeScript - Size: 52.7 KB - Last synced at: 27 days ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

snuffyDev/svelte-worker-store

:zap: Turbocharge your apps with multithreaded Svelte stores.

Language: Svelte - Size: 301 KB - Last synced at: 10 days ago - Pushed at: almost 2 years ago - Stars: 51 - Forks: 0

flipeador/node-workerpool

Create a pool of workers and execute a function or file in worker threads and child processes.

Language: JavaScript - Size: 12.7 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 1

dc0d/workerpool

A workerpool that can get expanded & shrink dynamically.

Language: Go - Size: 55.7 KB - Last synced at: 30 days ago - Pushed at: about 4 years ago - Stars: 53 - Forks: 5

yiigo/nightfall

Go协程并发复用，降低CPU和内存负载

Language: Go - Size: 412 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 37 - Forks: 5

axah710/Worker-Pool

This Go program efficiently processes tasks using goroutines, channels, and sync.WaitGroup, enabling concurrent execution and synchronization. Ideal for job queues and scalable task processing. 🚀

Language: Go - Size: 3.91 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

joergen7/cre

common runtime environment for distributed programming languages

Language: Erlang - Size: 3.64 MB - Last synced at: 19 days ago - Pushed at: 3 months ago - Stars: 22 - Forks: 4

kvizyx/wkpool

Primitive implementation of the worker pool.

Language: Go - Size: 1.95 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

tianhao-ai/Distributed-Dictionary-COMP90015-2023S2-Assignment-1

Distributed Dictionary

Language: Java - Size: 63.2 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

zaidsasa/workerpool

Concurrency limiting goroutine pool

Language: Go - Size: 48.8 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

utkusen/goroutine-benchmark

runs benchmarks to determine the optimal number of Go routine pool size on the current machine

Language: Go - Size: 5.86 KB - Last synced at: 4 days ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 1

kc596/priorityworkerpool

A worker pool in GoLang which schedules job according to priority.

Language: Go - Size: 27.3 KB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 6 - Forks: 2

itsdheerajbudhiraja/express-boilerplate-ts

Boilerplate for NodeJS Express Projects written in Typescript The purpose of this template repository is to fast track APIs development and reach to production ASAP. At most places except TSOA, there is very less use of external dependency injection or similar libraries to demonstrate how same thing can be achieved in vanilla code

Language: TypeScript - Size: 446 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 2 - Forks: 0

mix-php/worker-pool

Swoole-based worker pool, coroutine pool / 基于 Swoole 的工作池，协程池

Language: PHP - Size: 14.6 KB - Last synced at: 29 days ago - Pushed at: almost 4 years ago - Stars: 4 - Forks: 0

nikhilbhatia08/taskflow

A distributed, durable job execution platform

Language: Go - Size: 1.02 MB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 1 - Forks: 1

HarjjotSinghh/fetchpix

A stock image API which scrapes various stock image websites and returns a valid image URL.

Language: TypeScript - Size: 159 KB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

Attumm/meesee

Task queue, Long lived workers for work based parallelization, with processes and Redis as back-end. For distributed computing.

Language: Python - Size: 110 KB - Last synced at: 12 days ago - Pushed at: 9 months ago - Stars: 18 - Forks: 1

gremislaw/worker_pool

Terminal User Interface using bubbletea for worker pool (async coding)

Language: Go - Size: 6.01 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

chsendev/asynq-plus

基于asynq的异步工作流封装

Language: Go - Size: 8.79 KB - Last synced at: 5 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

YSZhuoyang/go-dispatcher

A goroutine job dispatcher based on worker-pool pattern.

Language: Go - Size: 58.6 KB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 31 - Forks: 8

txaty/gool

Generic goroutine pool: Submit, Map, Async.

Language: Go - Size: 22.5 KB - Last synced at: 7 days ago - Pushed at: over 1 year ago - Stars: 72 - Forks: 2

codesoap/lineworker

A worker pool which processes work in parallel but outputs results in the order the work was given

Language: Go - Size: 4.88 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 14 - Forks: 0

CHINMAYVIVEK/go-worker-pool

fire and forget golang worker pool

Language: Go - Size: 4.88 KB - Last synced at: about 1 month ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

ella-to/task

Task runner

Language: Go - Size: 14.6 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

qxsch/WorkerPool

Parallel Processing WorkerPool for PHP

Language: PHP - Size: 5 MB - Last synced at: about 13 hours ago - Pushed at: 9 months ago - Stars: 104 - Forks: 22

erlangpack/sidejob Fork of mworrell/sidejob

Parallel, capacity-limited request pool

Language: Erlang - Size: 164 KB - Last synced at: about 1 month ago - Pushed at: 7 months ago - Stars: 15 - Forks: 2

terminalkitten/django-pdf-reactor

Async PDF generation in Django Channels worker or with Django 3.1 async views

Language: Python - Size: 399 KB - Last synced at: 26 days ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

B1NARY-GR0UP/violin

VIOLIN worker/connection pool

Language: Go - Size: 104 KB - Last synced at: about 1 month ago - Pushed at: 10 months ago - Stars: 9 - Forks: 0

octu0/chanque

framework for asynchronous programming and goroutine management and safe use of channels

Language: Go - Size: 137 KB - Last synced at: 28 days ago - Pushed at: about 2 years ago - Stars: 5 - Forks: 1

damnever/workerpool

A handy and fast goroutine pool with a simple pipeline utility.

Language: Go - Size: 57.6 KB - Last synced at: 2 months ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0

vasrem/gopp

Parallel processing functionality with configurable retry mechanism and error handling

Language: Go - Size: 13.7 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

izo0x90/pipeline-factory

Pipeline Factory is a Python server framework to define, manage, schedule and execute custom defined code pipelines and series of pipeline across multiple worker processes.

Language: Python - Size: 24.4 KB - Last synced at: 25 days ago - Pushed at: 10 months ago - Stars: 1 - Forks: 0

SyntaxErrorLineNULL/worker

A Go library for efficient concurrent task management. Provides a robust worker pool implementation with features like context handling, error management, and graceful shutdown.

Language: Go - Size: 179 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

proullon/workerpool

auto scaling generic worker pool

Language: Go - Size: 98.6 KB - Last synced at: 13 days ago - Pushed at: almost 2 years ago - Stars: 6 - Forks: 1

Tyill/zmey

A platform to programmatically author, schedule, and monitor workflows

Language: C++ - Size: 30.8 MB - Last synced at: 16 days ago - Pushed at: 8 months ago - Stars: 2 - Forks: 0

TomWright/gopool

Easy to use worker pool with dynamic pool sizing.

Language: Go - Size: 51.8 KB - Last synced at: 5 days ago - Pushed at: almost 7 years ago - Stars: 12 - Forks: 1

CherkashinEvgeny/gopool

Golang worker pool pattern implementation

Language: Go - Size: 22.5 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

jgardona/rpools

A minimalist rust workerpool implementation that uses channels to synchronize the jobs. It can spawn a fixed number of worker threads, that waits for a job queue.

Language: Rust - Size: 12.7 KB - Last synced at: 13 days ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

zekroTJA/r34-crawler

A simple CLI tool to fetch and download images from rule34.xxx

Language: Rust - Size: 93.8 KB - Last synced at: about 22 hours ago - Pushed at: 9 months ago - Stars: 2 - Forks: 0

trandung2k1/training-node-core

Language: JavaScript - Size: 121 KB - Last synced at: 3 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

NikhilRyan/go-routine-worker-pool

The Worker Pool with Batching is a Go library that provides a scalable and concurrent solution for processing large data sets efficiently

Language: Go - Size: 28.3 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 2 - Forks: 1

ORESoftware/poolio

Node.js / NPM module for creating custom worker pools using child processes.

Language: TypeScript - Size: 325 KB - Last synced at: 9 months ago - Pushed at: over 6 years ago - Stars: 7 - Forks: 0

agungsptr/go-asynq

An example of a Golang Queue System with Monitoring and Client build with asynq

Language: TypeScript - Size: 1.77 MB - Last synced at: 8 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

emarifer/search-engine

A mini Google. Custom web crawler & indexer written in Golang.

Language: Go - Size: 929 KB - Last synced at: about 2 months ago - Pushed at: 10 months ago - Stars: 1 - Forks: 1

behnambm/go-utils

Some useful packages

Language: Go - Size: 7.81 KB - Last synced at: 2 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

hdvianna/parallel-workerpool

The Parallel worker pool uses the PHP parallel extension to provide a simple interface for dealing with parallelization of tasks.

Language: PHP - Size: 348 KB - Last synced at: about 1 month ago - Pushed at: over 4 years ago - Stars: 8 - Forks: 0

vardius/worker-pool

Go simple async worker pool

Language: Go - Size: 47.9 KB - Last synced at: about 1 month ago - Pushed at: over 4 years ago - Stars: 92 - Forks: 13

softvar/super-workers

:horse: Distribute load on front-end via parallelism

Language: JavaScript - Size: 805 KB - Last synced at: 5 days ago - Pushed at: over 5 years ago - Stars: 95 - Forks: 13

arielsrv/taskpool

Task builder inspired in Java Thread Pool

Language: Go - Size: 40 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

igmagollo/go-sticky-worker-pool

simple zero-dependency key-sticky worker pool

Language: Go - Size: 7.81 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 1 - Forks: 0

kaatinga/luna

thread safe worker pool

Language: Go - Size: 56.6 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

kristyancarvalho/multi-thread-image-processing

Benchmark comparativo entre processamento de imagens em single thread e utilizando Worker Threads em Node.js. Visa medir e comparar o desempenho de ambas as abordagens ao realizar operações de redimensionamento e conversão para escala de cinza em imagens.

Language: JavaScript - Size: 30.3 KB - Last synced at: about 2 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

albrow/jobs 📦

A persistent and flexible background jobs library for go.

Language: Go - Size: 212 KB - Last synced at: 10 months ago - Pushed at: almost 7 years ago - Stars: 499 - Forks: 47

anantadwi13/workers

Golang Workers

Language: Go - Size: 39.1 KB - Last synced at: 11 months ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0

lnquy/elastic-worker-pool

Go worker pool that can expand and shrink itself with graceful shutdown

Language: Go - Size: 121 KB - Last synced at: 11 months ago - Pushed at: about 6 years ago - Stars: 8 - Forks: 1

airnandez/taskq

A lightweight asynchronous task queue

Language: Go - Size: 7.81 KB - Last synced at: 11 months ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0