GitHub / converged-computing 84 Repositories
The best of cloud and high performance computing: technology and community combined.
converged-computing/usernetes-azure
Language: Python - Size: 1000 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

converged-computing/performance-study
Performance study for HPC applications across Google, AWS, and Azure clouds âī¸
Language: HTML - Size: 453 MB - Last synced at: about 20 hours ago - Pushed at: 14 days ago - Stars: 7 - Forks: 4

converged-computing/aks-infiniband-install
Example prototype for installing Infiniband on an AKS cluster
Language: Shell - Size: 36.1 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 1 - Forks: 0

converged-computing/flux-tutorials
The Flux Tutorials! But not official, this is a Dinosaur Tutorial series. :t-rex:
Language: Jupyter Notebook - Size: 678 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 4 - Forks: 0

converged-computing/flux-apps-helm
Deploy HPC applications to Kubernetes using helm charts
Language: Smarty - Size: 94.7 KB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 1 - Forks: 0

converged-computing/mummi-experiments
Experiments to test the Mummi Operator and new designs
Language: Python - Size: 6.3 GB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 0 - Forks: 0

converged-computing/state-machine-operator
State machine workflow orchestration for Kubernetes (under development)
Language: Python - Size: 503 KB - Last synced at: 29 days ago - Pushed at: 29 days ago - Stars: 1 - Forks: 0

converged-computing/aws-performance-study
Language: Dockerfile - Size: 8.79 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

converged-computing/flux-usernetes
Running Flux Framework alongside Kubernetes in user space (Usernetes)
Language: Shell - Size: 8.53 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 2

converged-computing/google-performance-study
Experiments on Google Cloud, hoping to extend the performance study
Language: HCL - Size: 43.7 MB - Last synced at: 10 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 0

converged-computing/fluxnetes-burst
Bursting to and from AWS via Flux and Usernetes (under development)
Language: Shell - Size: 17.6 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

converged-computing/fluxqueue
Job scheduling in Kubernetes with Flux
Language: Go - Size: 461 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

converged-computing/flux-service
Using Flux Framework to provide a service for running latency tests or other tasks across nodes
Language: Shell - Size: 14.6 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

converged-computing/jobspec-database
Database of jobs, starting with Slurm (under development(
Language: Shell - Size: 1.01 GB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 1

converged-computing/slurm-operator
Testing if I can implement slurm in an operator
Language: Go - Size: 165 KB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 14 - Forks: 1

converged-computing/flux-distribute
Install flux directly to kubelets to (TBA) help the kubelet, pulling containers, the sky is the limit!
Language: Python - Size: 6.4 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

converged-computing/cise-special-issue
The Converged Computing CiSE Special Issue, 2024
Language: JavaScript - Size: 17.7 MB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

converged-computing/aws-osu-christmas
Thank you to Heidi and Evan at AWS for a great year!
Size: 1.03 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

converged-computing/lise-azure
Azure bases for Lise! đ
Language: Dockerfile - Size: 3.91 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

converged-computing/metrics-operator
Testing designs for a benchmarking operator (in experimental mode!)
Language: Go - Size: 18.2 MB - Last synced at: 27 days ago - Pushed at: 7 months ago - Stars: 5 - Forks: 0

converged-computing/usernetes-python
Python SDK for user-space Kubernetes "Usernetes" (under development)
Language: Python - Size: 28.3 KB - Last synced at: 23 days ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

converged-computing/slurm-scrape
slurm assets for descriptive jobset work
Size: 780 KB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

converged-computing/supermarket-fish-problem
What architecture do you get for your cloud instance? It's like white fish at the supermarket - maybe you don't know.
Language: HTML - Size: 536 MB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

converged-computing/soci-installer
Install the SOCI (Seekable OCI) snapshotter to Kubernetes with a Daemonset
Language: Shell - Size: 9.77 KB - Last synced at: 4 months ago - Pushed at: 7 months ago - Stars: 3 - Forks: 0

converged-computing/cloud-select
Cloud selection tool (under development)
Language: Python - Size: 7.02 MB - Last synced at: 26 days ago - Pushed at: 5 months ago - Stars: 2 - Forks: 2

converged-computing/converged-computing.github.io
Community terms and documentation for Converged Computing
Language: HTML - Size: 3.84 MB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

converged-computing/lammps-time
Building lammps over time, 2016 until 2024 (testing, and under development)
Language: Python - Size: 5.27 MB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

converged-computing/container-chonks
Experiments to test pull efficiency of containers across registries, layer counts, and sizes.
Language: Dockerfile - Size: 454 MB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

converged-computing/fluxgen
Generate flux framework configuration and install scripts for on-the-fly Flux!
Language: Python - Size: 26.4 KB - Last synced at: 21 days ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

converged-computing/flux-jobset
HPC workloads using Flux and Kubernetes JobSet and eventually Kubeflow Training (under development)
Size: 13.7 KB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

converged-computing/change-over-time
Looking at the impact of different variables change over time on software
Size: 675 KB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

converged-computing/kubernetes-jobs
Small database of Kubernetes job files, and associated job descriptive metadata understanding
Language: Python - Size: 44.8 MB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

converged-computing/ensemble-operator
Kubernetes operator to deploy ensembles of HPC applications đī¸ (under development)
Language: Go - Size: 6.79 MB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

converged-computing/ensemble-python
Orchestrate ensembles of jobs based on events and state machine logic (under development)
Language: Python - Size: 96.7 KB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 4 - Forks: 0

converged-computing/fluxnetes
Fluxion in-tree scheduler for Kubernetes (under development)
Language: Go - Size: 12.1 MB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

converged-computing/ensemble-containers
Matrix of containers for assembly into ensembles (under development)
Language: Dockerfile - Size: 42 KB - Last synced at: 4 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

converged-computing/container-crafter
Matrix container builder for controlled experiments that vary size and layers
Language: Go - Size: 25.4 KB - Last synced at: 4 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

converged-computing/oras-operator
Artifact caching using OCI Registry as Storage (ORAS) for workflows or experiments (under development)
Language: Go - Size: 5.68 MB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0

converged-computing/oras-csi
ORAS (OCI registry as storage) container storage interface
Language: Go - Size: 524 KB - Last synced at: 4 months ago - Pushed at: 11 months ago - Stars: 16 - Forks: 4

converged-computing/metrics-containers
Metrics containers to support the metrics operator
Language: Dockerfile - Size: 3.47 MB - Last synced at: 4 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

converged-computing/rainbow
đī¸ Where keebler elves and schedulers live, somewhere in the clouds, and with marshmallows (under development)
Language: Go - Size: 2.37 MB - Last synced at: 2 days ago - Pushed at: 10 months ago - Stars: 6 - Forks: 1

converged-computing/flux-metrics-api
An experiment to make a custom metrics API (for Kubernetes) just for a Flux instance
Language: Python - Size: 41 KB - Last synced at: 14 days ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

converged-computing/flux-views
Isolated view builds of flux intended for a (testing) refactor of the Flux Operator
Language: Dockerfile - Size: 26.4 KB - Last synced at: 4 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 1

converged-computing/flux-terraform-gcp
Packer and terraform recipes for deploying a Flux Framework cluster on Compute Engine VMs
Language: HCL - Size: 116 KB - Last synced at: 4 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

converged-computing/metrics-operator-experiments
Experiments for the metrics operator (and work to better understand metrics)
Language: Dockerfile - Size: 65.4 MB - Last synced at: 4 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 1

converged-computing/flux-netmark
Flux + netmark on AWS with efa terraform setup
Language: Shell - Size: 18.6 KB - Last synced at: 4 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

converged-computing/bare-vm-container-study
Testing the impact of containers vs. "bare meta" VM on the cloud
Language: Python - Size: 5.82 MB - Last synced at: 4 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 1

converged-computing/ebpf-hpc
Learning ground for eBPF in the context of HPC applications (under development)
Language: Dockerfile - Size: 36.1 KB - Last synced at: 4 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 1

converged-computing/flux-ascii
Having some fun with the flux logo with ascii art! đī¸
Language: HTML - Size: 4.88 KB - Last synced at: 4 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

converged-computing/flex-container
Testing the possibility of adding a container abstraction to the resource graph
Language: Go - Size: 12.7 KB - Last synced at: 4 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

converged-computing/flux-aws
Terraform deployments for Flux Framework on AWS
Language: Shell - Size: 10.7 KB - Last synced at: 4 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

converged-computing/rainbow-experiments
Repository for rainbow-scheduler experiments (under development)
Language: Python - Size: 58.8 MB - Last synced at: 4 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

converged-computing/flux-terraform-ami
Terraform + packer build setup for Flux Framework deployment on AWS (under development)
Language: Shell - Size: 34.2 KB - Last synced at: 4 months ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 1

converged-computing/operator-experiments
experiments for the flux operator
Language: Shell - Size: 46.2 MB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

converged-computing/playground
the fun cloud wrapper đŦī¸ to deploy tutorial containers! đĻī¸
Language: Python - Size: 1.11 MB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 0

converged-computing/fluxion
Fluxion is Flux Framework's flux-sched "fluxion" project, a hierarchical memory graph database, provided as a service.
Language: Python - Size: 1.76 MB - Last synced at: 4 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

converged-computing/scheduler-sniffer
Basic setup for recording Kubernetes scheduler decisions
Language: Go - Size: 387 KB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

converged-computing/fluxterm
Interact with jobs, view the Flux cheat sheet, a code browser, and Flux bird "the pink bird who knows things!" đĻŠī¸
Language: Python - Size: 371 KB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

converged-computing/cloud-transparency
Experiments to assess cloud transparency and resources
Language: Python - Size: 400 KB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

converged-computing/gomq
gomq is an experiment to allow for distributed, large-scale data processing workflows using a cloud-native language (Go)
Language: Go - Size: 346 KB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

converged-computing/distributed-fractal
Distributed Go (leader and worker design) using GRPC to generate fractals!
Language: Go - Size: 15.8 MB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 1

converged-computing/nfd-source
Prototype / experiment or example for moving the node feature discovery extractors out of tree
Language: Go - Size: 657 KB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

converged-computing/half-baked
Building a half-baked container to finalize the build (on the fly) during runtime.
Language: CMake - Size: 688 KB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

converged-computing/jsongraph-go
Json Graph Format (JGF) structure in Go (under development)
Language: Go - Size: 30.3 KB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

converged-computing/fluence-kubectl
kubectl plugin for the Fluence scheduler flux-framework/flux-k8s
Language: Go - Size: 42 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

converged-computing/lammps-stream-ml
Prototype for online (streaming) machine learning using LAMMPS and Kubernetes (under development)
Language: Python - Size: 184 KB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

converged-computing/flex-aws-topology
Mapping AWS topology API into a fluxion graph
Language: Go - Size: 34.2 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

converged-computing/flex-archspec
Use fluxion Go bindings to request a machine architecture (under development)
Language: Go - Size: 24.4 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

converged-computing/flex-ice-cream
Example of flux-framework/flux-sched "fluxion" Go bindings building an out of tree graph-based scheduling or matching tool. "Just flex it!" đĒī¸âĸī¸đĻī¸ (under development)
Language: Go - Size: 12.7 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

converged-computing/cyclecloud-flux
Flux Framework on CycleCloud (WIP)
Language: Shell - Size: 9.77 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

converged-computing/flux-lima
Flux Framework running in a LIMA (Linux Virtual Machine) with eBPF stuffs installed for learning!
Language: Shell - Size: 140 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

converged-computing/usernetes-lima
Testing running usernetes in lima VMs
Size: 11.7 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

converged-computing/usernetes-tofu-gcp
Development environment for usernetes on Google Cloud (using HashiCorp Packer and Terraform)
Language: HCL - Size: 64.5 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

converged-computing/aws-tofu
OpenTofu recipes for Amazon Web Services
Language: HCL - Size: 1.73 MB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

converged-computing/htcondor-operator
Kubernetes operator for HTCondor (under development)
Language: Go - Size: 80.1 KB - Last synced at: 4 months ago - Pushed at: almost 2 years ago - Stars: 2 - Forks: 0

converged-computing/check-aws-costs
Simple script to generate single interface of daily costs for inspection
Language: Python - Size: 10.7 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

converged-computing/usernetes-terraform-aws
Usernetes setup with terraform on AWS (under development)
Language: Shell - Size: 12.7 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

converged-computing/flux-architecture
Design documents and metadata about flux architecture (under development)
Language: HTML - Size: 347 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

converged-computing/google-batch
HPC workflows run on Google Batch
Language: Python - Size: 1.32 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

converged-computing/flux-burst
Remote bursting for Flux using a plugin framework (prototype in Python)
Language: Python - Size: 3.63 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

converged-computing/goshare
Testing a producer/consumer model that spans namespaces for flux + application pods!
Language: Go - Size: 79.1 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

converged-computing/flux-burst-local
Prototyping local bursting (under development!)
Language: Python - Size: 741 KB - Last synced at: 14 days ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

converged-computing/flux-burst-compute-engine
Burst Flux Framework jobs to compute engine (uses terraform)
Language: Python - Size: 32.2 KB - Last synced at: 27 days ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

converged-computing/flux-burst-eks
Flux Plugin for bursting to EKS (under development)
Language: Python - Size: 21.5 KB - Last synced at: 6 days ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

converged-computing/flux-burst-gke
Experimental bursting plugin for flux-burst to Google Kubernetes Engine (GKE)
Language: Python - Size: 33.2 KB - Last synced at: 13 days ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

converged-computing/flux-operator-argo
Simple experiment to run a Flux Operator MiniCluster (CRD) with Argo
Language: Dockerfile - Size: 5.86 KB - Last synced at: 4 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

converged-computing/flux-operator-component
Developing a KubeFlow componen to burst jobs to the Flux Operator (under development)
Language: Python - Size: 21.5 KB - Last synced at: 4 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

converged-computing/hyperqueue-operator
Testing out hyperqueue as a Kubernetes operator (under development)
Language: Go - Size: 141 KB - Last synced at: 4 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

converged-computing/prometheus-flux
Export metrics about Flux for Prometheus
Language: Python - Size: 20.5 KB - Last synced at: 4 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

converged-computing/kubescaler
Supporting classes in Python for easily scaling Kubernetes clusters (under development)
Language: Python - Size: 1.63 MB - Last synced at: 17 days ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 1

converged-computing/flux-c-examples
Getting started examples, environment, and builds for using Flux in C/C++!
Language: C - Size: 269 KB - Last synced at: 4 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

converged-computing/flux-go
Example of interacting with Flux Framework using Go!
Language: Go - Size: 552 KB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

converged-computing/flux-csi
Container Storage Interface (CSI) to assist with generating Flux Framework assets (under development!)
Size: 0 Bytes - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

converged-computing/flux-operator-validator
Basic checks for your Flux Operator flux runner container! đĸī¸đ´ī¸
Language: Python - Size: 9.77 KB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

converged-computing/workflows
Testing ground for porting workflows between HPC and cloud
Language: Shell - Size: 43.9 KB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

converged-computing/eks-nvme-ssd-provisioner
EKS NVMe SSD provisioner for Amazon EC2 Instance Stores
Language: Shell - Size: 20.5 KB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

converged-computing/flux-cloud
deploy workflows to the flux operator in the cloud! âī¸
Language: Python - Size: 4.99 MB - Last synced at: about 3 hours ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

converged-computing/projects
project planning and discussion for the converged computing community
Size: 0 Bytes - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0
