Samirnunes/chimera

Chimera is a Python package for distributed machine learning.

Language: Python - Size: 7.38 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 4 - Forks: 0

leondavi/NErlNet

Nerlnet is a framework for research and development of distributed machine learning models on IoT

Language: Python - Size: 66 MB - Last synced at: 5 days ago - Pushed at: 2 months ago - Stars: 46 - Forks: 8

AmishiDesai04/Distributed-Machine-Learning

A lightweight, scalable system that demonstrates model and data parallelism in machine learning using Dask, PyTorch, and Flask. Features distributed CNN inference and linear regression training across multiple networked devices.

Language: HTML - Size: 295 KB - Last synced at: 3 days ago - Pushed at: 8 days ago - Stars: 0 - Forks: 0

makgyver/gossipy

Python module for simulating gossip learning.

Language: Python - Size: 2.08 MB - Last synced at: 1 day ago - Pushed at: about 1 year ago - Stars: 40 - Forks: 11

terrytangyuan/distributed-ml-patterns

Distributed Machine Learning Patterns from Manning Publications by Yuan Tang https://bit.ly/2RKv8Zo

Language: Python - Size: 7.2 MB - Last synced at: 14 days ago - Pushed at: about 2 months ago - Stars: 423 - Forks: 40

PaddlePaddle/PaddleDTX

Paddle with Decentralized Trust based on Xuperchain

Language: Go - Size: 5.31 MB - Last synced at: 3 days ago - Pushed at: 8 months ago - Stars: 88 - Forks: 36

monk1337/Aweome-Heathcare-Federated-Learning

A curated list of Federated Learning papers/articles and recent advancements.

Size: 454 KB - Last synced at: 4 days ago - Pushed at: about 2 years ago - Stars: 93 - Forks: 16

Samirnunes/chimera-examples

Examples using the Chimera package, which is a Python package for distributed machine learning.

Language: Python - Size: 4.82 MB - Last synced at: 16 days ago - Pushed at: 24 days ago - Stars: 0 - Forks: 0

jtirana98/MultiHop-Federeated-Split-Learning

Framework that supports pipeline federated split learning with multiple hops.

Language: C++ - Size: 1.77 MB - Last synced at: 26 days ago - Pushed at: 26 days ago - Stars: 12 - Forks: 1

anupamkliv/FedERA

FedERA is a modular and fully customizable open-source FL framework, aiming to address these issues by offering comprehensive support for heterogeneous edge devices and incorporating both standalone and distributed computing. It includes new software modules to enhance usability and promote environ- mental sustainability.

Language: Jupyter Notebook - Size: 2.82 MB - Last synced at: 29 days ago - Pushed at: 29 days ago - Stars: 137 - Forks: 61

emilstahl97/Scalable-Machine-Learning-and-Deep-Learning-ID2223 📦

The course studies fundamentals of distributed machine learning algorithms and the fundamentals of deep learning. We will cover the basics of machine learning and introduce techniques and systems that enable machine learning algorithms to be efficiently parallelized.

Language: Jupyter Notebook - Size: 604 MB - Last synced at: 28 days ago - Pushed at: over 3 years ago - Stars: 2 - Forks: 2

DCP-CloudMesh/CloudMesh Fork of DCP-CloudMesh/PeerToPeer

CloudMesh is a UW SE capstone project that aims to create a decentralized, P2P approach to distributed machine learning training.

Language: C++ - Size: 25.1 MB - Last synced at: 29 days ago - Pushed at: 29 days ago - Stars: 4 - Forks: 0

r-gg/flower-async

Implementation of asynchronous federated learning in flower.

Language: Python - Size: 145 KB - Last synced at: 17 days ago - Pushed at: 9 months ago - Stars: 14 - Forks: 2

Collaborative-AI/colda

Collaborative Data Analysis for All

Language: Jupyter Notebook - Size: 468 MB - Last synced at: 3 days ago - Pushed at: almost 2 years ago - Stars: 19 - Forks: 3

akaanirban/Awesome-Federated-Learning-Papers Fork of chaoyanghe/Awesome-Federated-Learning

:closed_book: :sunglasses: Mostly a collection of research papers categorized into broad topics in federated learning.

Size: 85 KB - Last synced at: 10 days ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 2

PengKuang/team_scalable_timeseries

Group 13's project for the WASP course: Scalable Data Science and Distributed Machine Learning

Language: Jupyter Notebook - Size: 35.2 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

beiyuouo/fedhf

🔨 A Flexible Federated Learning Simulator for Heterogeneous and Asynchronous.

Language: Python - Size: 905 KB - Last synced at: 3 days ago - Pushed at: over 2 years ago - Stars: 22 - Forks: 20

Fangjin98/distributed-training-INA

A PS ML training architecture with p4 programmable switches.

Language: Python - Size: 10.4 MB - Last synced at: 18 days ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 4

benedekrozemberczki/AV_Ultimate_Student_Hunt

Solution for the Ultimate Student Hunt Challenge (1st place).

Language: R - Size: 43 KB - Last synced at: 11 days ago - Pushed at: about 3 years ago - Stars: 9 - Forks: 9

benedekrozemberczki/NestedSubtreeHash

A distributed implementation of "Nested Subtree Hash Kernels for Large-Scale Graph Classification Over Streams" (ICDM 2012).

Language: Python - Size: 151 KB - Last synced at: 11 days ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 8

pooyanjamshidi/mls

CSCE 585 - Machine Learning Systems

Language: TeX - Size: 921 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 40 - Forks: 8

soumyadipghosh/eventgrad

Event-Triggered Communication in Parallel Machine Learning

Language: C++ - Size: 76.2 KB - Last synced at: 15 days ago - Pushed at: over 3 years ago - Stars: 25 - Forks: 4

Shakleen/CitiBike-Demand-Prediction

An End-to-End Machine Learning project where I predict demand of bikes at citibike stations at hourly level.

Language: Python - Size: 104 MB - Last synced at: 16 days ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

diaoenmao/HeteroFL-Computation-and-Communication-Efficient-Federated-Learning-for-Heterogeneous-Clients

[ICLR 2021] HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients

Language: Python - Size: 23.8 MB - Last synced at: 8 months ago - Pushed at: about 2 years ago - Stars: 141 - Forks: 33

aliciatang07/Spark-Ring-AllReduce

Ring Allreduce implmentation in Spark with Barrier Scheduling experiment

Language: Scala - Size: 20.9 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 4 - Forks: 1

cleanzr/dblink

Distributed Bayesian Entity Resolution in Apache Spark

Language: Scala - Size: 455 KB - Last synced at: 8 months ago - Pushed at: almost 4 years ago - Stars: 57 - Forks: 9

GuanhuaWang/sensAI

sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data

Language: Python - Size: 1.27 MB - Last synced at: 7 days ago - Pushed at: 9 months ago - Stars: 64 - Forks: 8

ray-project/ray-acm-workshop-2023 📦

Scalable/Distributed Computer Vision with Ray

Language: Jupyter Notebook - Size: 9.06 MB - Last synced at: 10 months ago - Pushed at: about 2 years ago - Stars: 9 - Forks: 4

ray-project/ray-saturday-dec-2022 📦

Ray Saturday Dec 2022 edition

Language: Jupyter Notebook - Size: 18 MB - Last synced at: 10 months ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 1

ray-project/anyscale-workshop-nyc-2023 📦

Scalable NLP model fine-tuning and batch inference with Ray and Anyscale

Language: Jupyter Notebook - Size: 11.2 MB - Last synced at: 10 months ago - Pushed at: about 2 years ago - Stars: 6 - Forks: 0

ray-project/ray-educational-materials 📦

This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.

Language: Jupyter Notebook - Size: 24 MB - Last synced at: 11 months ago - Pushed at: about 1 year ago - Stars: 298 - Forks: 52

borgwang/pseudo-distributed-ml

Language: Python - Size: 25.4 KB - Last synced at: 11 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 1

zxsimple/dmls

Distributed Machine Learning Studio

Language: Scala - Size: 149 KB - Last synced at: 11 months ago - Pushed at: about 7 years ago - Stars: 8 - Forks: 0

MihhailSokolov/DistributedKNN

Master-slave distributed system that works together to speed up the kNN classification.

Language: Python - Size: 43 KB - Last synced at: 12 months ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

Gatmatz/Survey-Distributed-Machine-Learning

This is a bibliography survey upon Distributed Machine Learning. The survey contains algorithmic selections and architectures that can facilitate distributed learning on ML models. There is also a part that presents MLlib, a ML library from Apache Spark for distributed ML implementations.

Size: 556 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

sagoresarker/federated-learning-thesis-final-year-cse-just

Title: Privacy-Preserving Synthetic Data Generation via Local Random Forest Models in Federated Learning

Language: Jupyter Notebook - Size: 15.6 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

borgwang/distributed-ml

Distributed Neural Networks Training

Language: Python - Size: 22.5 KB - Last synced at: 11 months ago - Pushed at: over 5 years ago - Stars: 5 - Forks: 0

INET-RC/GeoMX

GeoMX: A fast and unified system for distributed machine learning over geo-distributed data centers.

Language: C++ - Size: 14.7 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 114 - Forks: 13

ishugaepov/MLBD

Materials for "Machine Learning on Big Data" course

Language: Jupyter Notebook - Size: 88.6 MB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 21 - Forks: 60

mma735/TFM-DS

Comparison of distributed machine learning techniques applied to openly available datasets

Language: Jupyter Notebook - Size: 105 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

Lemon-cmd/DistributedML

A quick library for Distributed Machine Learning which includes a matrix-math utils library built around CUDA kernels.

Language: C++ - Size: 23 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

diaoenmao/Decentralized-Multi-Target-Cross-Domain-Recommendation-for-Multi-Organization-Collaborations

[arXiv] Decentralized Multi-Target Cross-Domain Recommendation for Multi-Organization Collaborations

Language: Python - Size: 47.3 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

Brandon-Martinez27/spark-exercises

This repo contains exercises for Distributed ML: Using Spark.

Language: Jupyter Notebook - Size: 166 KB - Last synced at: over 1 year ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

orion-orion/FedAO

🔨 A toolbox for federated learning, aiming to provide implementations of FedAvg, FedProx, Ditto, etc. in multiple versions, such as Pytorch/Tensorflow, single-machine/distributed, synchronized/asynchronous.

Language: Python - Size: 1.06 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 33 - Forks: 7

Mohamed-Imed-Eddine/Distributed-Clustering-using-K-Medoids

Distributed problem solving using Machine Learning : K-Medoids Clustering

Language: Java - Size: 2.29 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

diaoenmao/SemiFL-Semi-Supervised-Federated-Learning-for-Unlabeled-Clients-with-Alternate-Training

[NeurIPS 2022] SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Training

Language: Python - Size: 55.4 MB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 18 - Forks: 5

netroid314/ASWCS_front

Language: Python - Size: 17.8 MB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 1

diaoenmao/Semi-Supervised-Federated-Learing-for-Keyword-Spotting

[ICME 2023] Semi-Supervised Federated Learing for Keyword Spotting

Language: Python - Size: 49.6 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 1

diaoenmao/GAL-Gradient-Assisted-Learning-for-Decentralized-Multi-Organization-Collaborations

[NeurIPS 2022] GAL: Gradient Assisted Learning for Decentralized Multi-Organization Collaborations

Language: Python - Size: 24 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 5 - Forks: 1

orion-orion/Distributed-ML-PySpark

🔨使用Spark/Pytorch实现分布式算法，包括图/矩阵计算（graph/matrix computation）、随机算法、优化（optimization）和机器学习。参考刘铁岩《分布式机器学习》和CME 323课程

Language: Python - Size: 591 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 12 - Forks: 1

diaoenmao/DRASIC-Distributed-Recurrent-Autoencoder-for-Scalable-Image-Compression

[DCC 2020] DRASIC: Distributed Recurrent Autoencoder for Scalable Image Compression

Language: Python - Size: 45.9 MB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 0

INSPIRE-Lab-US/Byzantine-resilient-distributed-learning

Associated codebase for Byzantine-resilient distributed / decentralized machine learning papers from INSPIRE Lab

Language: Python - Size: 458 MB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 10 - Forks: 4

TinfoilHat0/Defending-Against-Backdoors-with-Robust-Learning-Rate

The code of AAAI-21 paper titled "Defending against Backdoors in Federated Learning with Robust Learning Rate".

Language: Python - Size: 25.2 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 15 - Forks: 12

Marko19907/ML-assignments

Machine Learning assignments, Machine Learning (IE500618) course, fall 2022.

Language: Jupyter Notebook - Size: 289 KB - Last synced at: 2 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

xinyandai/gradient-quantization

vector quantization for stochastic gradient descent.

Language: Python - Size: 111 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 31 - Forks: 7

deepspark/deepspark_java

Java based Convolutional Neural Network package running on Apache Spark framework

Language: Java - Size: 3.74 MB - Last synced at: about 2 years ago - Pushed at: over 8 years ago - Stars: 4 - Forks: 5

snuspl/harmony

Harmony: A new scheduling framework that executes multiple Parameter-Server (PS) Machine Learning (ML) training jobs efficiently to improve cluster resource utilization.

Language: Java - Size: 8.41 MB - Last synced at: 12 months ago - Pushed at: about 6 years ago - Stars: 8 - Forks: 2

kimihe/Petrel

A lightweight community-aware heterogeneous parameter server paradigm.

Language: C++ - Size: 165 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 2 - Forks: 1

karimboubouh/peernet

Robust P2P Personalized Learning

Language: Python - Size: 3.15 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 0

xinyandai/mpi-tensorflow

😂Distributed optimizer implemented with TensorFlow MPI operation

Language: Python - Size: 15.8 MB - Last synced at: about 2 years ago - Pushed at: about 6 years ago - Stars: 2 - Forks: 1

hwang595/ATOMO

Atomo: Communication-efficient Learning via Atomic Sparsification

Language: Python - Size: 341 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 23 - Forks: 5

netroid314/ASWCS_back

This is repository for DAIG backend development

Language: Python - Size: 249 KB - Last synced at: almost 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 2

Davide-DD/distributed-machine-learning-architectures

A collection of hand-made distributed (except for 1) machine learning architectures

Language: Python - Size: 834 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 2 - Forks: 2

xinyandai/distributed-sgd-mpi

distributed sgd implementation with tensorflow and mpi4py.

Language: Python - Size: 14.2 MB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 3 - Forks: 0

kaushikacharya/Distributed_Machine_Learning_with_Apache_Spark_CS120x_edx

Distributed Machine Learning with Apache Spark (CS120x)(Edx) Assignment Solutions

Language: Jupyter Notebook - Size: 103 KB - Last synced at: almost 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

salekali/DistributedTF-with-SageMaker

This repo includes a TF estimator implemented in Amazon SageMaker, distributed over 2 nodes.

Language: Jupyter Notebook - Size: 16.6 KB - Last synced at: 3 months ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 0

ben-denham/hdsm

Hierarchical Distributed Stream Miner: A Distributed Data Mining Approach to Classifying Heterogeneous Data Streams

Language: Jupyter Notebook - Size: 232 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 1

FraFabbri/distributedsvm

Simulation of distributed SVM

Language: Jupyter Notebook - Size: 97.7 KB - Last synced at: about 1 year ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0