GitHub topics: slurm
Kirito7111/stepup-queue
Integrates queued jobs into a StepUp workflow.
Language: Python - Size: 37.1 KB - Last synced at: about 3 hours ago - Pushed at: about 4 hours ago - Stars: 0 - Forks: 0
cmkobel/CompareM2
🦠📇 Microbial genomes-to-report pipeline
Language: Python - Size: 95.6 MB - Last synced at: about 9 hours ago - Pushed at: about 9 hours ago - Stars: 57 - Forks: 3
mahendrapaipuri/ceems
A Prometheus exporter and a REST API server to export metrics of compute units of resource managers like SLURM, Openstack, k8s, _etc_
Language: C - Size: 10.1 MB - Last synced at: about 15 hours ago - Pushed at: about 16 hours ago - Stars: 35 - Forks: 2
pipefunc/pipefunc
Lightweight fast function pipeline (DAG) creation in pure Python for scientific workflows 🕸️🧪
Language: Python - Size: 2.15 MB - Last synced at: about 14 hours ago - Pushed at: about 14 hours ago - Stars: 371 - Forks: 15
dell/omnia
An open-source toolkit for deploying and managing high performance clusters for HPC, AI, and data analytics workloads.
Language: YAML - Size: 83.4 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 254 - Forks: 140
larsbuntemeyer/enjoy-slurm
naive python slurm control
Language: Python - Size: 193 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 2 - Forks: 0
hpjeonGIT/Tips
Some examples for various purposes
Language: Python - Size: 630 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 4 - Forks: 3
NREL/torc
Workflow management system
Language: Python - Size: 2.71 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 0 - Forks: 0
link89/oh-my-batch
A toolkit to manipulate batch tasks with command line. Designed for scientific computing community.
Language: Python - Size: 724 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 18 - Forks: 4
stackhpc/ansible-slurm-appliance
A Slurm-based HPC workload management environment, driven by Ansible.
Language: HCL - Size: 4.53 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 61 - Forks: 34
mjay-kerberos/POC_Exporters
Modular Prometheus exporters for GPU, CPU, and I/O insights — designed for Slurm-managed HPC clusters. Built with Python, Go, and Ansible for seamless observability, job-level tracking, and infrastructure automation.
Language: Python - Size: 12.4 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0
ck37/ck37r
R functions for project setup, data cleaning, machine learning, SuperLearner, parallelization, and targeted learning.
Language: R - Size: 1.15 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 19 - Forks: 5
itkovian/sarchive
Slurm job script archival
Language: Rust - Size: 699 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 12 - Forks: 3
glotzerlab/row
Row is a command line tool that helps you manage workflows on HPC resources.
Language: Rust - Size: 1.14 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 12 - Forks: 1
esi-neuroscience/slurmfun
MATLAB tools to submit jobs into SLURM
Language: MATLAB - Size: 125 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 0 - Forks: 2
dstackai/dstack
dstack is an open-source alternative to Kubernetes and Slurm, designed to simplify GPU allocation and AI workload orchestration for ML teams across top clouds, on-prem clusters, and accelerators.
Language: Python - Size: 115 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 1,800 - Forks: 177
justanhduc/task-spooler
A scheduler for GPU/CPU tasks
Language: C - Size: 535 KB - Last synced at: 2 days ago - Pushed at: over 1 year ago - Stars: 334 - Forks: 31
saforem2/ezpz
Train across all your devices, ezpz 🍋
Language: Python - Size: 5.94 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 21 - Forks: 6
pyiron/pysqa
Simple HPC queuing system adapter for Python on based jinja templates to automate the submission script creation.
Language: Python - Size: 1.11 MB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 27 - Forks: 8
bio-phys/asyncmd
asyncmd is a library to write concurrent code for setup, run and analysis of molecular dynamics simulations using pythons async/await synthax.
Language: Python - Size: 1.37 MB - Last synced at: 4 days ago - Pushed at: 6 days ago - Stars: 11 - Forks: 4
SchedMD/slurm
Slurm: A Highly Scalable Workload Manager
Language: C - Size: 318 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 3,088 - Forks: 703
charmed-hpc/slurm-charms
Juju charms for automating the Day 0 to Day 2 operations of the Slurm workload manager ⚖️🐧
Language: Python - Size: 875 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1 - Forks: 5
aws-samples/aws-do-hyperpod
Create and manage Amazon SageMaker HyperPod clusters, run distributed model training
Language: Shell - Size: 3.42 MB - Last synced at: 1 day ago - Pushed at: 18 days ago - Stars: 22 - Forks: 5
SlinkyProject/slurm-operator
Run Slurm on Kubernetes. A Slinky project.
Language: Go - Size: 926 KB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 108 - Forks: 27
ManiAm/slurm-docker-cluster
A fully containerized Slurm cluster using Docker Compose - complete with controller, compute nodes, accounting (SlurmDBD + MariaDB), and REST API support
Language: Shell - Size: 303 KB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 0 - Forks: 0
nextflow-io/nextflow
A DSL for data-driven computational pipelines
Language: Groovy - Size: 59.1 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 2,946 - Forks: 689
rackslab/Slurm-web
Open source web interface for Slurm HPC & AI clusters
Language: Python - Size: 19.1 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 423 - Forks: 105
aws-samples/aws-hpc-recipes
Contains example recipes that demonstrate how to build HPC systems using AWS services and solutions.
Language: Shell - Size: 132 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 78 - Forks: 28
NathanP23/Big-Data-Mining-52002
Midterm and Final assignments of the course "Big Data Mining (52002)" at The Hebrew University of Jerusalem, in the Department of Statistics and Data Science. Focuses on analyzing massive datasets using Python, SQL, cloud computing, and network analysis. Includes project guidelines for scalable data mining techniques and distributed computing.
Language: Jupyter Notebook - Size: 21 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 1 - Forks: 0
SlinkyProject/slurm-client
OpenAPI Golang client library for Slurm REST API. A Slinky project.
Language: Go - Size: 622 KB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 8 - Forks: 0
EBI-Metagenomics/emgapi-v2
MGnify API (v2) and production automation system
Language: HTML - Size: 5.67 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 1 - Forks: 1
anoopkcn/zenv
Python Environment Manager for HPC and Development Systems
Language: Zig - Size: 662 KB - Last synced at: 1 day ago - Pushed at: 7 days ago - Stars: 0 - Forks: 0
basnijholt/adaptive-scheduler
Run many functions (adaptively) on many cores (>10k-100k) using mpi4py.futures, ipyparallel, loky, or dask-mpi. :tada:
Language: Python - Size: 939 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 30 - Forks: 11
pyiron/executorlib
Up-scale python functions for high performance computing (HPC)
Language: Python - Size: 2.63 MB - Last synced at: 5 days ago - Pushed at: 7 days ago - Stars: 32 - Forks: 4
pitt-crc/wrappers
User focused command line wrappers around Slurm
Language: Python - Size: 445 KB - Last synced at: 7 days ago - Pushed at: 8 days ago - Stars: 1 - Forks: 1
nebius/soperator
Run Slurm in Kubernetes
Language: Go - Size: 36.5 MB - Last synced at: 7 days ago - Pushed at: 8 days ago - Stars: 232 - Forks: 31
bsc-wdc/compss
COMP Superscalar (COMPSs) is a framework which aims to ease the development and execution of applications for distributed infrastructures, such as Clusters, Grids and Clouds.
Language: Java - Size: 288 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 54 - Forks: 21
PySlurm/pyslurm
Python Interface to Slurm
Language: Cython - Size: 5.27 MB - Last synced at: 4 days ago - Pushed at: 21 days ago - Stars: 519 - Forks: 121
charmed-hpc/slurmutils
Utilities and APIs for interfacing with the Slurm workload manager ⚙️🔌
Language: Python - Size: 320 KB - Last synced at: about 4 hours ago - Pushed at: 10 days ago - Stars: 3 - Forks: 4
SLUR-m-Py/SLURPY
SLUR(M)-py: A SLURM Powered Pythonic Pipeline for Parallel Processing of 3D (Epi)genomic Profiles
Language: Python - Size: 473 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 1 - Forks: 0
pc2/slurm_jupyter_kernel
Manage (create, list, modify and delete) and starting jupyter kernels using sbatch
Language: Python - Size: 768 KB - Last synced at: 1 day ago - Pushed at: about 2 years ago - Stars: 10 - Forks: 4
stas00/ml-engineering
Machine Learning Engineering Open Book
Language: Python - Size: 10 MB - Last synced at: 10 days ago - Pushed at: 11 days ago - Stars: 13,840 - Forks: 834
Antvirf/stui
Terminal user interface for Slurm HPC clusters
Language: Go - Size: 27.5 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 5 - Forks: 0
kabouzeid/turm
TUI for the Slurm Workload Manager
Language: Rust - Size: 89.8 KB - Last synced at: 4 days ago - Pushed at: about 1 month ago - Stars: 175 - Forks: 13
alezab/cs-parallel-processing-proj
A project demonstrating sequential and parallel (OpenMP) insertion sort implementations with SLURM job scripts for multiprocessor performance analysis.
Language: C++ - Size: 26.4 KB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 0
NYU-Molecular-Pathology/LG-PACT
NYU Langone Genome PACT (Genome Profiling of Actionable Cancer Targets) targeted exome sequencing analysis pipeline.
Language: Nextflow - Size: 2.16 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 8 - Forks: 1
gerlero/foamlib
A modern Python package for interacting with OpenFOAM
Language: Python - Size: 1.4 MB - Last synced at: 10 days ago - Pushed at: 11 days ago - Stars: 103 - Forks: 13
Daylily-Informatics/snakemake-executor-plugin-pcluster-slurm
slurm executor for use by snakemake when running on the slurm flavor which is unique to aws parallel cluster slrum pcluster.
Language: Python - Size: 178 KB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 1 - Forks: 0
rhfeiyang/slurm-tutorial
SLURM Tutorial
Size: 1.95 KB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 7 - Forks: 0
geoalgo/slurmpilot
Launching and monitoring Slurm experiments in Python
Language: Python - Size: 298 KB - Last synced at: 6 days ago - Pushed at: 13 days ago - Stars: 18 - Forks: 2
DataBiosphere/toil
A scalable, efficient, cross-platform (Linux/macOS) and easy-to-use workflow engine in pure Python.
Language: Python - Size: 34.6 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 911 - Forks: 241
jaantollander/slurm-scripts
Scripts for self-restarting slurm jobs for continous (daemon-like) and periodic (cron-like) jobs.
Language: Shell - Size: 3.91 KB - Last synced at: about 18 hours ago - Pushed at: 13 days ago - Stars: 0 - Forks: 0
MPUSP/snakemake-ont-basecalling
A Snakemake workflow for basecalling and demultiplexing of Oxford Nanopore data using Dorado.
Language: Python - Size: 254 KB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 1 - Forks: 0
ohsu-comp-bio/funnel
Funnel is a toolkit for distributed task execution via a simple, standard API.
Language: Go - Size: 57.6 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 129 - Forks: 36
SlinkyProject/containers
OCI container images. A Slinky project.
Language: Dockerfile - Size: 156 KB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 4 - Forks: 8
PrincetonUniversity/job_defense_shield
Identify and reduce instances of underutilization by the users of high-performance computing systems
Language: Python - Size: 1.47 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 5 - Forks: 0
mbhall88/ssubmit
Submit slurm sbatch jobs without a script
Language: Rust - Size: 145 KB - Last synced at: 8 days ago - Pushed at: 9 months ago - Stars: 69 - Forks: 4
pytorch/torchx
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
Language: Python - Size: 34.1 MB - Last synced at: 5 days ago - Pushed at: 18 days ago - Stars: 366 - Forks: 132
Azure/batch-shipyard 📦
Simplify HPC and Batch workloads on Azure
Language: Python - Size: 6.15 MB - Last synced at: 1 day ago - Pushed at: about 2 years ago - Stars: 278 - Forks: 121
goldentooth/clog
The changelog formerly known as "Kubernetes, the _Excruciating_ Way".
Language: JavaScript - Size: 10.4 MB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 0 - Forks: 0
codekansas/dotfiles
Dotfiles that I like to use
Language: Python - Size: 394 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 3 - Forks: 6
faithByte/HPC-Cluster
Language: Jinja - Size: 1.8 MB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 0 - Forks: 0
TUM-DAML/seml
SEML: Slurm Experiment Management Library
Language: Python - Size: 1.51 MB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 182 - Forks: 31
ilri/hpc-infrastructure-scripts
Scripts used in ILRI's research computing infrastructure
Language: Shell - Size: 192 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 8 - Forks: 10
vultr/slik 📦
Slurm in Kubernetes
Language: Go - Size: 9.91 MB - Last synced at: 4 days ago - Pushed at: 6 months ago - Stars: 42 - Forks: 6
neilmunday/slurm-mail
Slurm-Mail is a drop in replacement for Slurm's e-mails to give users much more information about their jobs compared to the standard Slurm e-mails.
Language: Python - Size: 1.39 MB - Last synced at: 16 days ago - Pushed at: 18 days ago - Stars: 107 - Forks: 40
KempnerInstitute/scalable-vision-workflows
Efficient and Scalable Vision Model Training
Language: Shell - Size: 7.86 MB - Last synced at: about 5 hours ago - Pushed at: 19 days ago - Stars: 0 - Forks: 0
cta-observatory/lstmcpipe
Scripts to analyse MC files on LST cluster at La Palma
Language: Python - Size: 7.87 MB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 7 - Forks: 15
mlr-org/batchtools
Tools for computation on batch systems
Language: R - Size: 5.69 MB - Last synced at: 7 days ago - Pushed at: 19 days ago - Stars: 180 - Forks: 51
LambdaLabsML/distributed-training-guide
Best practices & guides on how to write distributed pytorch training code
Language: Python - Size: 429 KB - Last synced at: 18 days ago - Pushed at: 4 months ago - Stars: 425 - Forks: 34
SlinkyProject/slurm-exporter
Prometheus collector and exporter for Slurm cluster metrics. A Slinky project.
Language: Go - Size: 147 KB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 7 - Forks: 4
giovtorres/slurm-docker-cluster
A Slurm cluster using docker-compose
Language: Dockerfile - Size: 40 KB - Last synced at: 17 days ago - Pushed at: 9 months ago - Stars: 371 - Forks: 200
Cellular-Imaging-Amsterdam-UMC/NL-BIOMERO-Local-Slurm Fork of giovtorres/slurm-docker-cluster
A Slurm cluster using docker-compose
Language: Dockerfile - Size: 40 KB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 5 - Forks: 1
Bioinformatics-Munich/scas_dashboard
SCAS dashboard: A tool to intuitively and interactively analyze Slurm cluster usage
Language: R - Size: 8.1 MB - Last synced at: 9 days ago - Pushed at: about 1 year ago - Stars: 10 - Forks: 2
aws-samples/aws-parallelcluster-post-install-scripts
Scripts to customize AWS ParallelCluster
Language: Shell - Size: 114 KB - Last synced at: 5 days ago - Pushed at: 20 days ago - Stars: 24 - Forks: 15
jhn-nt/docksing
CLI utility for deployment of containerized jobs on SLURM HPCs
Language: Python - Size: 40 KB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 0 - Forks: 0
facebookincubator/submitit
Python 3.8+ toolbox for submitting jobs to Slurm
Language: Python - Size: 220 KB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 1,434 - Forks: 137
prehensilecode/slurm_utilization
Show cluster utilization by arbitrary TRES.
Language: Python - Size: 137 KB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 3 - Forks: 2
hunoutl/slurmtop
Slurmtop is a refreshing and intuitive terminal user interface for monitoring SLURM clusters
Language: Python - Size: 301 KB - Last synced at: 18 days ago - Pushed at: 9 months ago - Stars: 6 - Forks: 0
uschpc/slurm-tools
Slurm CLI tools used on CARC HPC clusters
Language: Python - Size: 72.3 KB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 12 - Forks: 1
uabrc/uabrc.github.io
UAB Research Computing Documentation
Language: Python - Size: 87.8 MB - Last synced at: 11 days ago - Pushed at: 12 days ago - Stars: 21 - Forks: 12
powsybl/powsybl-hpc
High Performance Computing modules for powsybl
Language: Java - Size: 506 KB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 2 - Forks: 0
tazend/zig-slurm
Zig bindings for Slurm
Language: Zig - Size: 164 KB - Last synced at: 4 days ago - Pushed at: 24 days ago - Stars: 1 - Forks: 0
ULHPC/puppet-slurm
A Puppet module designed to configure and manage SLURM(see https://slurm.schedmd.com/), an open source, fault-tolerant, and highly scalable cluster management and job scheduling system for large and small Linux clusters
Language: Puppet - Size: 605 KB - Last synced at: 16 days ago - Pushed at: 25 days ago - Stars: 18 - Forks: 25
reproducible-reporting/stepup-queue
Integrates queued jobs into a StepUp workflow.
Language: Python - Size: 656 KB - Last synced at: 22 days ago - Pushed at: 25 days ago - Stars: 1 - Forks: 0
alexliyihao/EFIGA_WGS
Implementation of WGS genotyping pipeline for EFIGA FBS FAMILY dataset
Language: Shell - Size: 104 KB - Last synced at: 25 days ago - Pushed at: 25 days ago - Stars: 0 - Forks: 0
unlhcc/job-examples
Example jobs for popular applications on HCC clusters.
Language: Jupyter Notebook - Size: 59 MB - Last synced at: 26 days ago - Pushed at: 26 days ago - Stars: 16 - Forks: 11
Guillawme/cryoem-computing
Some scientific computing stuff
Language: Shell - Size: 101 KB - Last synced at: 28 days ago - Pushed at: 28 days ago - Stars: 2 - Forks: 0
getzlab/canine
A modular, high-performance computing solution to run jobs using SLURM
Language: Python - Size: 1.48 MB - Last synced at: 12 days ago - Pushed at: 13 days ago - Stars: 7 - Forks: 6
jose-d/slurm_for_Rocky9
Build of Slurm done by Github actions
Language: Shell - Size: 91.8 KB - Last synced at: 28 days ago - Pushed at: 28 days ago - Stars: 0 - Forks: 0
NREL/HPC
A collection of various resources, examples, and executables for the general NREL HPC user community's benefit. Use the following website for accessing documentation.
Language: Jupyter Notebook - Size: 118 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 127 - Forks: 77
WEHI-Education/Workshop-intermediate-slurm
Intermedate Slurm Workshop source code using the Software Carpentry Workbench style.
Language: R - Size: 14.7 MB - Last synced at: about 4 hours ago - Pushed at: about 5 hours ago - Stars: 1 - Forks: 0
aws-samples/aws-eda-slurm-cluster
AWS Slurm Cluster for EDA Workloads
Language: Python - Size: 3.68 MB - Last synced at: 5 days ago - Pushed at: 29 days ago - Stars: 27 - Forks: 7
diegozain/alles
All small projects that need a place to live, live here. Optimization, numerical methods, graph theory, and more.
Language: MATLAB - Size: 61.1 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 7 - Forks: 2
WATonomous/slurm-gha
Run Github Actions on Slurm
Language: Python - Size: 662 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 2 - Forks: 0
nikolaussuess/slurm-dashboard
A simple dashboard for Slurm clusters written in PHP.
Language: PHP - Size: 1.06 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0
MiniZinc/mzn-bench
A framework to performing benchmark testing on MiniZinc models, solvers, and/or the compiler itself.
Language: Python - Size: 210 KB - Last synced at: 29 days ago - Pushed at: about 1 month ago - Stars: 6 - Forks: 7
thediymaker/slurm-node-dashboard
Slurm HPC node status page
Language: TypeScript - Size: 4.24 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 36 - Forks: 9
rayid-mojumder/GaN_Point_Defect_Investigation_with_DFT_VASP-PyDefect
Point Defects Formation Energy Calculation of GaN - using VASP (DFT) and PyDefect
Language: Python - Size: 50.5 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 3 - Forks: 2
ace-bioinformatics/ace-hpc-wiki
Wiki for the ACE HPC
Language: JavaScript - Size: 1.49 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 0 - Forks: 0
