GitHub topics: parallel-processing

Repositories

sean-hungerford/seedVR2_cudafull

🖥️ Enhance your video and image quality with SeedVR2 for ComfyUI, supporting multi-GPU setups for efficient upscaling.

Language: Python - Size: 4.74 MB - Last synced at: about 8 hours ago - Pushed at: about 9 hours ago - Stars: 1 - Forks: 0

thammanoon-code/parallel-engine

⚙️ Build high-performance applications using parallel processing with this robust implementation of the parallel engine for efficient task execution.

Language: C++ - Size: 26 MB - Last synced at: about 13 hours ago - Pushed at: about 14 hours ago - Stars: 0 - Forks: 0

italoseara/DEC107

Multiplicação de Matrizes (DGEMM) Sequencial e Paralela com OpenMP

Language: Jupyter Notebook - Size: 2.01 MB - Last synced at: about 19 hours ago - Pushed at: about 19 hours ago - Stars: 3 - Forks: 1

BirchKwok/NumPack

🚀 Supercharge Your NumPy Arrays | ⚡️ Instant TB-scale Data Ops | 💾 Zero Memory Overhead | 🔄 Stream Huge Arrays Like Small Ones | 🛡️ Production-Ready

Language: Rust - Size: 981 KB - Last synced at: about 23 hours ago - Pushed at: 1 day ago - Stars: 4 - Forks: 0

dathere/qsv-stats Fork of BurntSushi/rust-stats

Blazing-fast, parallelized statistical functions on streams for Rust.

Language: Rust - Size: 272 KB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 8 - Forks: 0

1xmusty/youtube-bot-views

🚀 Simulate YouTube views at scale with this automated toolkit for testing and research, designed to help developers analyze engagement patterns.

Language: Python - Size: 2.32 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 0 - Forks: 0

Will436851/Raspberry-pi-OS-Documentation

Raspberry pi OS installation and system call demonstration

Language: Shell - Size: 1.32 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 0 - Forks: 0

ARYAN555279/Batch_LLM_Inference_with_Ray_Data_LLM

Batch LLM Inference with Ray Data LLM: From Simple to Advanced

Language: Dockerfile - Size: 1.5 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 1 - Forks: 1

AnswerDotAI/fastcore

Python supercharged for the fastai library

Language: Jupyter Notebook - Size: 7.44 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 1,060 - Forks: 287

gjbex/Workflows-for-HPC

Materials for a training on workflow tools and best practices for HPC.

Language: Python - Size: 11.5 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 6 - Forks: 1

Vujavujavuja/Parallel_file_reg_python

A basic, concurrent file system interface that uses Python's multiprocessing and threading to break large files into chunks, store them in parallel, and safely retrieve them. It includes a memory limit and MD5 checks for data integrity.

Language: Python - Size: 13.7 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 1 - Forks: 0

saworbit/orbit

Production-ready file transfer engine with compression, resume, and parallel operations. Built in Rust.

Language: Rust - Size: 306 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0

esa/pagmo2

A C++ platform to perform parallel computations of optimisation tasks (global and local) via the asynchronous generalized island model.

Language: C++ - Size: 58.4 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 892 - Forks: 171

jobrunr/jobrunr

An extremely easy way to perform background processing in Java. Backed by persistent storage. Open and free for commercial use.

Language: Java - Size: 11.7 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 2,767 - Forks: 283

NoOrientationProgramming/LibNaegCommon

Library based on the SystemCore of NoOrientationProgramming

Language: C++ - Size: 893 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 2 - Forks: 1

hosseinmoein/Leopard

Light-weight Thread Pool library in modern C++

Language: C++ - Size: 758 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 99 - Forks: 6

T-3B/rhefo

Really High Efficient File Optimizer will losslessly recompress files as much as possible according to their mime-types

Language: Shell - Size: 1.13 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 7 - Forks: 0

ORNL/flowcept

Runtime provenance for AI and scientific workflows—capture, enrich, and query workflow data via observability adapters and code annotation across edge, cloud, and HPC.

Language: Python - Size: 54.7 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 8 - Forks: 5

mandelsoft/streaming

Data-pipelining in Go

Language: Go - Size: 61.5 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

LessUp/FqTools

高性能FastQ处理工具

Language: C++ - Size: 499 KB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 1 - Forks: 0

esa/pygmo2

A Python platform to perform parallel computations of optimisation tasks (global and local) via the asynchronous generalized island model.

Language: C++ - Size: 13.9 MB - Last synced at: 11 days ago - Pushed at: about 1 year ago - Stars: 505 - Forks: 64

hj2choi/fast_jigsaw_puzzle_solver

fragments image and re-assemble them back to original image. #Prim's MST algorithm

Language: Python - Size: 2.72 MB - Last synced at: 13 days ago - Pushed at: 14 days ago - Stars: 23 - Forks: 1

diamondburned/oneparallel

Human-friendly parallelization tool similar to GNU/Moreutils Parallel.

Language: Go - Size: 44.9 KB - Last synced at: 14 days ago - Pushed at: 15 days ago - Stars: 0 - Forks: 0

madsjulia/RobustPmap.jl

Robust pmap calls for efficient parallelization and high-performance computing

Language: Julia - Size: 55.7 KB - Last synced at: 14 days ago - Pushed at: 15 days ago - Stars: 2 - Forks: 3

tdiprima/parallel-universe

Concurrency, parallelism, threading, multiprocessing, and AsyncIO

Language: Python - Size: 27.3 KB - Last synced at: 14 days ago - Pushed at: 15 days ago - Stars: 0 - Forks: 0

lilydjwg/pssh

Parallel SSH Tools

Language: Python - Size: 284 KB - Last synced at: 10 days ago - Pushed at: 10 months ago - Stars: 324 - Forks: 66

cresteem/Remige

Remige is an advanced image compression framework, built as a fork of libSquoosh. By integrating Squoosh's powerful image codecs directly into JavaScript applications, Remige offers unparalleled compression performance and file size reduction. Designed for compatibility with the latest Node.js versions, Remige enhances image processing with modern

Language: TypeScript - Size: 14.3 MB - Last synced at: 8 days ago - Pushed at: 12 months ago - Stars: 5 - Forks: 0

futureverse/future

:rocket: R package: future: Unified Parallel and Distributed Processing in R for Everyone

Language: R - Size: 14.4 MB - Last synced at: 16 days ago - Pushed at: 17 days ago - Stars: 995 - Forks: 91

BeRo1985/kraft

Kraft Physics Engine is an open source Object Pascal physics engine library that can be used in 3D games.

Language: Pascal - Size: 88.7 MB - Last synced at: 7 days ago - Pushed at: about 2 months ago - Stars: 120 - Forks: 23

futureverse/future.apply

:rocket: R package: future.apply - Apply Function to Elements in Parallel using Futures

Language: R - Size: 2.2 MB - Last synced at: 16 days ago - Pushed at: 22 days ago - Stars: 218 - Forks: 19

TheMesocarp/aika

A somehow lock-free multi-agent coordination layer.

Language: Rust - Size: 247 KB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 46 - Forks: 1

LinusBwana/ALXprodev-Devops

Automation with Shell Scripting from API data extraction to parallel processing

Language: Shell - Size: 29.3 KB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 0 - Forks: 0

lehins/massiv

Efficient Haskell Arrays featuring Parallel computation

Language: Haskell - Size: 6.65 MB - Last synced at: 13 days ago - Pushed at: 4 months ago - Stars: 401 - Forks: 26

futureverse/future.callr

:rocket: R package future.callr: A Future API for Parallel Processing using 'callr'

Language: R - Size: 2.02 MB - Last synced at: 28 days ago - Pushed at: 28 days ago - Stars: 62 - Forks: 1

UoB-HPC/BabelStream

STREAM, for lots of devices written in many programming models

Language: C++ - Size: 2.39 MB - Last synced at: 11 days ago - Pushed at: about 2 months ago - Stars: 350 - Forks: 122

exaxorg/accelerator

The Accelerator is a tool for fast and reproducible processing of eBay-scale datasets on a single computer.

Language: Python - Size: 3.56 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 4 - Forks: 2

JKamsker/FSEqual

Compare two folders by using 100% of your hardware

Language: C# - Size: 355 KB - Last synced at: 23 days ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

austinksmith/Hamsters.js

100% Vanilla Javascript Multithreading & Parallel Execution Library

Language: JavaScript - Size: 42.9 MB - Last synced at: 24 days ago - Pushed at: 3 months ago - Stars: 596 - Forks: 31

al3rez/1brc-ruby

ruby solution for the 1 billion row challenge - parallel processing with fork

Language: Ruby - Size: 418 KB - Last synced at: 23 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

Lemniscate-world/HPCS.jl

Building a High-Performance-Computer Simulator in Julia

Language: Julia - Size: 1.95 KB - Last synced at: 19 days ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

joeycumines/go-microbatch

Package microbatch groups tasks into small batches, e.g. to reduce the number of round trips.

Language: Go - Size: 18.6 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

seantanly/elixir-paratize

Elixir library providing some handy parallel processing facilities that supports configuring number of workers and timeout.

Language: Elixir - Size: 620 KB - Last synced at: 11 days ago - Pushed at: over 7 years ago - Stars: 29 - Forks: 3

W4G1/multithreading

⚡ Multithreading functions in JavaScript. Designed to feel like writing vanilla functions.

Language: TypeScript - Size: 495 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 328 - Forks: 11

baggepinnen/ThreadTools.jl

Some tools for working with threads in Julia

Language: Julia - Size: 17.6 KB - Last synced at: 13 days ago - Pushed at: about 1 month ago - Stars: 39 - Forks: 3

sail-sg/envpool

C++-based high-performance parallel environment execution engine (vectorized env) for general RL environments.

Language: C++ - Size: 3.53 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 1,195 - Forks: 117

swansonk14/p_tqdm

Parallel processing with progress bars

Language: Python - Size: 55.7 KB - Last synced at: 11 days ago - Pushed at: about 1 year ago - Stars: 489 - Forks: 40

PJDude/librer

A cross-platform GUI file cataloging program with extensive customization options to suit user preferences. Highly optimized for multi-core parallel search speed, data integrity, and repository portability.

Language: Python - Size: 1.73 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 45 - Forks: 2

foo123/FILTER.js

Video and Image Processing and Computer Vision Library in pure JavaScript (Browser and Node.js)

Language: JavaScript - Size: 38 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 401 - Forks: 47

RaveGeneration/Sonic-Sweep-2

VST Presets for Sonic Sweep 2 (SonicSweep2-Presets.zip) + User Manual

Size: 5.17 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

teran/checksum

SHA256 file verification for consistency check purposes

Language: Go - Size: 870 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 1

Not-Buddy/HackerXAPI

High-performance Rust API with AI, multi-format docs, Gemini integration, security, CLI.

Language: Rust - Size: 148 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

wagoodman/bashful

Use a yaml file to stitch together commands and bash snippits and run them with a bit of style. Why? Because your bash script should be quiet and shy-like (...and not such a loud mouth).

Language: Go - Size: 3.98 MB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 1,165 - Forks: 45

SatvikPraveen/OctaveMasterPro

Advanced numerical computing framework with GNU Octave featuring parallel processing, optimization algorithms, statistical analysis, and comprehensive data science applications. Includes Dockerized Jupyter environment, financial modeling, signal/image processing pipelines, industrial analytics, and real-world demonstrations.

Language: MATLAB - Size: 330 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

vergissberlin/faker-example-javascript

Real world example for big data creation with javascript. Running javascript in parallel processes.

Language: JavaScript - Size: 313 KB - Last synced at: 14 days ago - Pushed at: 15 days ago - Stars: 0 - Forks: 0

sanitaravel/starship_analyzer

A Python tool that extracts telemetry data from SpaceX Starship launch videos using computer vision and OCR. Analyzes flight parameters (speed, altitude, engine status), calculates derived metrics, and generates visualizations for comparing launch performance characteristics. Features parallel processing and a user-friendly command-line interface.

Language: Python - Size: 9.63 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 2 - Forks: 0

amphp/parallel

An advanced parallelization library for PHP, enabling efficient multitasking, optimizing resource use, and application responsiveness through multiple CPU threads.

Language: PHP - Size: 1.53 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 828 - Forks: 67

R0X4R/vaayu

A modern, secure, parallel, and resumable SSH file transfer CLI (scp/rsync replacement).

Language: Python - Size: 83 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

lvyahui8/spring-boot-data-aggregator

基于注解实现并行地依赖注入（数据聚合），可以看做 Spring Async 注解的升级版

Language: Java - Size: 608 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 179 - Forks: 60

accelatrix/accelatrix

A parallel functional programming framework for in-browser processing of enumerations of business entities

Size: 1.82 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

ClaudeCluster/claudecluster

Open-source orchestration framework that transforms Claude Code into a scalable coding cluster with parallel task execution

Language: Shell - Size: 450 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

Nirikshan95/TalentIQ

An agentic AI system that evaluates candidates by analyzing resumes, GitHub projects, and LinkedIn profiles in parallel, delivering a comprehensive fit score.

Size: 2.93 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

n-hor/pcntl-parallel

Simple solution for running PHP code concurrently

Language: PHP - Size: 26.4 KB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 28 - Forks: 2

Urpagin/DiscordGuildSpammer

Full-async multi-bot mass Discord guild channel spammer

Language: Rust - Size: 5.86 KB - Last synced at: 8 days ago - Pushed at: 10 months ago - Stars: 2 - Forks: 0

sourabh-kumar2/lyra

Type-safe DAG task orchestration library for Go with automatic concurrency and dependency resolution

Language: Go - Size: 77.1 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

terremoth/php-async

Async and Parallel Processing with PHP with no threads or reactive libs

Language: PHP - Size: 101 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 26 - Forks: 0

jppf-grid/JPPF

The open source grid computing solution

Language: Java - Size: 446 MB - Last synced at: 2 months ago - Pushed at: over 3 years ago - Stars: 70 - Forks: 12

envelope-project/laik

Language: C - Size: 2.29 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 9 - Forks: 11

hxz393/BrutalityExtractor

适用于高性能系统的多进程解压缩软件(A multiprocess decompression software for high-performance system)

Language: Python - Size: 4.91 MB - Last synced at: 2 months ago - Pushed at: almost 2 years ago - Stars: 187 - Forks: 12

Hydepwns/zmin

Ultra-fast JSON minifier. Multiple performance modes, and cross-platform language bindings.

Language: Zig - Size: 18.7 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

Matrix030/SteamLens

Game analytics platform that converts Steam review data into actionable development insights, reducing feedback analysis time by 95% for game studios.

Language: Jupyter Notebook - Size: 224 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 5 - Forks: 0

nikhiljsk/preprocess_nlp

A fast framework for pre-processing (Cleaning text, Reduction of vocabulary, Feature extraction and Vectorization). Implemented with parallel processing using custom number of processes.

Language: Python - Size: 58.6 KB - Last synced at: 6 days ago - Pushed at: over 3 years ago - Stars: 11 - Forks: 4

SJTU-YONGFU-RESEARCH-GRP/core-cc

A comprehensive framework for benchmarking, analyzing, and comparing different Error Correction Code (ECC) implementations with support for hardware verification, detailed performance analysis, and parallel processing capabilities.

Language: Python - Size: 7.17 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

Bbs1412/DistributedAttendanceSystem

This is the distributed processing version of the 'Smart Attendance System' project.

Language: Python - Size: 959 KB - Last synced at: 23 days ago - Pushed at: 6 months ago - Stars: 2 - Forks: 0

famzah/mpssh-py

Mass Parallel Secure Shell command execution

Language: Python - Size: 34.2 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 12 - Forks: 0

NishantGhanate/FileSwirl

Now sort you files with just one command.

Language: Python - Size: 181 KB - Last synced at: 5 days ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

DidactHQ/didact-engine

The REST API and execution engine for the Didact Platform.

Language: C# - Size: 261 KB - Last synced at: 20 days ago - Pushed at: 7 months ago - Stars: 78 - Forks: 3

naporin0624/mosaic-art-rust

🎨 High-performance mosaic art generator written in Rust. Creates stunning mosaic images using intelligent color matching, parallel processing, and simulated annealing optimization.

Language: Rust - Size: 53.3 MB - Last synced at: 6 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

legalaspro/marl-ppo-suite

Clean, documented implementations of PPO-based algorithms for cooperative multi-agent reinforcement learning, focusing on SMAC environments. Features MLP and RNN-based MAPPO and HAPPO with various techniques.

Language: Python - Size: 4.17 MB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 3 - Forks: 1

santisq/PSParallelPipeline

Parallel processing of pipeline input objects!

Language: C# - Size: 240 KB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 32 - Forks: 0

liuzuxin/easy-runner

⭐ A lightweight tool for efficiently managing and executing parallel experiments.

Language: Python - Size: 396 KB - Last synced at: about 1 month ago - Pushed at: 11 months ago - Stars: 8 - Forks: 1

Ashfaqbs/Concurrency-Multithreading-and-Parallel-Computing-in-Java

Concurrency, Multithreading and Parallel Computing in Java

Language: Java - Size: 7.09 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

JuliaAPlavin/DistributedAdhoc.jl

Ad-hoc distributed computing utilities for quick parallel processing tasks.

Language: Julia - Size: 8.79 KB - Last synced at: 12 days ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0

GhassenRabii/Storyteller

Serverless audio mixer backend: Python/FFmpeg container Lambda for narration & music, Amazon Polly speech API, S3 storage, and full CI/CD automation (CloudFormation IaC). Ideal for audiobooks, podcasts, and storytelling apps.

Language: Python - Size: 334 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

yasir13001/MoonAI

An AI-powered Python tool for generating lunar visibility reports using LLMs (Large Language Models) such as Gemini, Groq, and LLaMA3 (via Ollama). Designed for astronomers, developers, and researchers interested in moon sighting, Hilal reports, and Islamic calendar computations.

Language: Python - Size: 779 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 11 - Forks: 8