leondavi/NErlNet

Nerlnet is a distributed machine learning platform for experiments and IoT deployment.

Language: Python - Size: 12.5 MB - Last synced: 6 days ago - Pushed: 6 days ago - Stars: 24 - Forks: 3

monk1337/Aweome-Heathcare-Federated-Learning

A curated list of Federated Learning papers/articles and recent advancements.

Size: 454 KB - Last synced: 6 days ago - Pushed: over 1 year ago - Stars: 76 - Forks: 14

anupamkliv/FedERA

FedERA is a modular and fully customizable open-source FL framework, aiming to address these issues by offering comprehensive support for heterogeneous edge devices and incorporating both standalone and distributed computing. It includes new software modules to enhance usability and promote environ- mental sustainability.

Language: Jupyter Notebook - Size: 2.81 MB - Last synced: 7 days ago - Pushed: 7 days ago - Stars: 121 - Forks: 52

ray-project/ray-educational-materials 📦

This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.

Language: Jupyter Notebook - Size: 24 MB - Last synced: 6 days ago - Pushed: 4 months ago - Stars: 298 - Forks: 52

terrytangyuan/distributed-ml-patterns

Distributed Machine Learning Patterns from Manning Publications by Yuan Tang https://bit.ly/2RKv8Zo

Language: Python - Size: 2.04 MB - Last synced: 9 days ago - Pushed: 4 months ago - Stars: 330 - Forks: 33

jtirana98/MultiHop-Federeated-Split-Learning

Framework that supports pipeline federated split learning with multiple hops.

Language: C++ - Size: 1.77 MB - Last synced: 12 days ago - Pushed: 14 days ago - Stars: 10 - Forks: 1

PaddlePaddle/PaddleDTX

Paddle with Decentralized Trust based on Xuperchain

Language: Go - Size: 5.3 MB - Last synced: 13 days ago - Pushed: 14 days ago - Stars: 88 - Forks: 36

borgwang/pseudo-distributed-ml

Language: Python - Size: 25.4 KB - Last synced: 15 days ago - Pushed: 8 months ago - Stars: 0 - Forks: 1

zxsimple/dmls

Distributed Machine Learning Studio

Language: Scala - Size: 149 KB - Last synced: 16 days ago - Pushed: over 6 years ago - Stars: 8 - Forks: 0

r-gg/flower-async

Implementation of asynchronous federated learning in flower.

Language: Python - Size: 84 KB - Last synced: 17 days ago - Pushed: 17 days ago - Stars: 1 - Forks: 0

MihhailSokolov/DistributedKNN

Master-slave distributed system that works together to speed up the kNN classification.

Language: Python - Size: 43 KB - Last synced: 25 days ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

makgyver/gossipy

Python module for simulating gossip learning.

Language: Python - Size: 2.08 MB - Last synced: about 19 hours ago - Pushed: 4 months ago - Stars: 28 - Forks: 12

Gatmatz/Survey-Distributed-Machine-Learning

This is a bibliography survey upon Distributed Machine Learning. The survey contains algorithmic selections and architectures that can facilitate distributed learning on ML models. There is also a part that presents MLlib, a ML library from Apache Spark for distributed ML implementations.

Size: 556 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0

GuanhuaWang/sensAI

sensAI: ConvNets Decomposition via Class Parallelism for Fast Inference on Live Data

Language: Python - Size: 1.26 MB - Last synced: 25 days ago - Pushed: 25 days ago - Stars: 62 - Forks: 8

sagoresarker/federated-learning-thesis-final-year-cse-just

Title: Privacy-Preserving Synthetic Data Generation via Local Random Forest Models in Federated Learning

Language: Jupyter Notebook - Size: 15.6 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 0 - Forks: 0

borgwang/distributed-ml

Distributed Neural Networks Training

Language: Python - Size: 22.5 KB - Last synced: 15 days ago - Pushed: over 4 years ago - Stars: 5 - Forks: 0

beiyuouo/fedhf

🔨 A Flexible Federated Learning Simulator for Heterogeneous and Asynchronous.

Language: Python - Size: 905 KB - Last synced: 7 days ago - Pushed: almost 2 years ago - Stars: 18 - Forks: 20

Collaborative-AI/colda

Collaborative Data Analysis for All

Language: Jupyter Notebook - Size: 468 MB - Last synced: 29 days ago - Pushed: 12 months ago - Stars: 18 - Forks: 3

INET-RC/GeoMX

GeoMX: A fast and unified system for distributed machine learning over geo-distributed data centers.

Language: C++ - Size: 14.7 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 114 - Forks: 13

akaanirban/Awesome-Federated-Learning-Papers Fork of chaoyanghe/Awesome-Federated-Learning

:closed_book: :sunglasses: Mostly a collection of research papers categorized into broad topics in federated learning.

Size: 85 KB - Last synced: 10 days ago - Pushed: almost 4 years ago - Stars: 3 - Forks: 2

mma735/TFM-DS

Comparison of distributed machine learning techniques applied to openly available datasets

Language: Jupyter Notebook - Size: 105 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0

Lemon-cmd/DistributedML

A quick library for Distributed Machine Learning which includes a matrix-math utils library built around CUDA kernels.

Language: C++ - Size: 23 MB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 2 - Forks: 0

diaoenmao/Decentralized-Multi-Target-Cross-Domain-Recommendation-for-Multi-Organization-Collaborations

[arXiv] Decentralized Multi-Target Cross-Domain Recommendation for Multi-Organization Collaborations

Language: Python - Size: 47.3 MB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 0 - Forks: 0

Brandon-Martinez27/spark-exercises

This repo contains exercises for Distributed ML: Using Spark.

Language: Jupyter Notebook - Size: 166 KB - Last synced: 7 months ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

Fangjin98/distributed-training-INA

A PS ML training architecture with p4 programmable switches.

Language: Python - Size: 10.4 MB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 9 - Forks: 4

orion-orion/FedAO

🔨 A toolbox for federated learning, aiming to provide implementations of FedAvg, FedProx, Ditto, etc. in multiple versions, such as Pytorch/Tensorflow, single-machine/distributed, synchronized/asynchronous.

Language: Python - Size: 1.06 MB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 33 - Forks: 7

splithor1zon/FederatedFitnessAnalytics

Using a federated learning approach for privacy enablement in fitness tracking apps leveraging AI analytics.

Size: 3.91 KB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 0 - Forks: 0

Mohamed-Imed-Eddine/Distributed-Clustering-using-K-Medoids

Distributed problem solving using Machine Learning : K-Medoids Clustering

Language: Java - Size: 2.29 MB - Last synced: 8 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

emilstahl97/Scalable-Machine-Learning-and-Deep-Learning-ID2223 📦

The course studies fundamentals of distributed machine learning algorithms and the fundamentals of deep learning. We will cover the basics of machine learning and introduce techniques and systems that enable machine learning algorithms to be efficiently parallelized.

Language: Jupyter Notebook - Size: 604 MB - Last synced: 8 months ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

diaoenmao/SemiFL-Semi-Supervised-Federated-Learning-for-Unlabeled-Clients-with-Alternate-Training

[NeurIPS 2022] SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Training

Language: Python - Size: 55.4 MB - Last synced: 8 months ago - Pushed: 10 months ago - Stars: 18 - Forks: 5

netroid314/ASWCS_front

Language: Python - Size: 17.8 MB - Last synced: 9 months ago - Pushed: almost 3 years ago - Stars: 0 - Forks: 1

cleanzr/dblink

Distributed Bayesian Entity Resolution in Apache Spark

Language: Scala - Size: 455 KB - Last synced: 7 months ago - Pushed: almost 3 years ago - Stars: 51 - Forks: 9

ray-project/anyscale-workshop-nyc-2023 📦

Scalable NLP model fine-tuning and batch inference with Ray and Anyscale

Language: Jupyter Notebook - Size: 11.2 MB - Last synced: 10 months ago - Pushed: about 1 year ago - Stars: 5 - Forks: 0

ray-project/ray-acm-workshop-2023 📦

Scalable/Distributed Computer Vision with Ray

Language: Jupyter Notebook - Size: 9.06 MB - Last synced: 10 months ago - Pushed: about 1 year ago - Stars: 9 - Forks: 4

diaoenmao/Semi-Supervised-Federated-Learing-for-Keyword-Spotting

[ICME 2023] Semi-Supervised Federated Learing for Keyword Spotting

Language: Python - Size: 49.6 MB - Last synced: 11 months ago - Pushed: 11 months ago - Stars: 0 - Forks: 1

diaoenmao/GAL-Gradient-Assisted-Learning-for-Decentralized-Multi-Organization-Collaborations

[NeurIPS 2022] GAL: Gradient Assisted Learning for Decentralized Multi-Organization Collaborations

Language: Python - Size: 24 MB - Last synced: 11 months ago - Pushed: 11 months ago - Stars: 5 - Forks: 1

orion-orion/Distributed-ML-PySpark

🔨使用Spark/Pytorch实现分布式算法，包括图/矩阵计算（graph/matrix computation）、随机算法、优化（optimization）和机器学习。参考刘铁岩《分布式机器学习》和CME 323课程

Language: Python - Size: 591 KB - Last synced: 11 months ago - Pushed: 11 months ago - Stars: 12 - Forks: 1

diaoenmao/HeteroFL-Computation-and-Communication-Efficient-Federated-Learning-for-Heterogeneous-Clients

[ICLR 2021] HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients

Language: Python - Size: 23.8 MB - Last synced: 12 months ago - Pushed: about 1 year ago - Stars: 89 - Forks: 26

pooyanjamshidi/mls

CSCE 585 - Machine Learning Systems

Language: TeX - Size: 674 MB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 37 - Forks: 7

ishugaepov/MLBD

Materials for "Machine Learning on Big Data" course

Language: Jupyter Notebook - Size: 88.6 MB - Last synced: 11 months ago - Pushed: 11 months ago - Stars: 20 - Forks: 59

diaoenmao/DRASIC-Distributed-Recurrent-Autoencoder-for-Scalable-Image-Compression

[DCC 2020] DRASIC: Distributed Recurrent Autoencoder for Scalable Image Compression

Language: Python - Size: 45.9 MB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 4 - Forks: 0

INSPIRE-Lab-US/Byzantine-resilient-distributed-learning

Associated codebase for Byzantine-resilient distributed / decentralized machine learning papers from INSPIRE Lab

Language: Python - Size: 458 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 10 - Forks: 4

ray-project/ray-saturday-dec-2022 📦

Ray Saturday Dec 2022 edition

Language: Jupyter Notebook - Size: 18 MB - Last synced: 10 months ago - Pushed: over 1 year ago - Stars: 4 - Forks: 1

TinfoilHat0/Defending-Against-Backdoors-with-Robust-Learning-Rate

The code of AAAI-21 paper titled "Defending against Backdoors in Federated Learning with Robust Learning Rate".

Language: Python - Size: 25.2 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 15 - Forks: 12

Marko19907/ML-assignments

Machine Learning assignments, Machine Learning (IE500618) course, fall 2022.

Language: Jupyter Notebook - Size: 289 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

xinyandai/gradient-quantization

vector quantization for stochastic gradient descent.

Language: Python - Size: 111 MB - Last synced: about 1 year ago - Pushed: about 4 years ago - Stars: 31 - Forks: 7

deepspark/deepspark_java

Java based Convolutional Neural Network package running on Apache Spark framework

Language: Java - Size: 3.74 MB - Last synced: about 1 year ago - Pushed: over 7 years ago - Stars: 4 - Forks: 5

snuspl/harmony

Harmony: A new scheduling framework that executes multiple Parameter-Server (PS) Machine Learning (ML) training jobs efficiently to improve cluster resource utilization.

Language: Java - Size: 8.41 MB - Last synced: 21 days ago - Pushed: about 5 years ago - Stars: 8 - Forks: 2

kimihe/Petrel

A lightweight community-aware heterogeneous parameter server paradigm.

Language: C++ - Size: 165 KB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 2 - Forks: 1

karimboubouh/peernet

Robust P2P Personalized Learning

Language: Python - Size: 3.15 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 2 - Forks: 0

benedekrozemberczki/AV_Ultimate_Student_Hunt

Solution for the Ultimate Student Hunt Challenge (1st place).

Language: R - Size: 43 KB - Last synced: 27 days ago - Pushed: about 2 years ago - Stars: 8 - Forks: 9

xinyandai/mpi-tensorflow

😂Distributed optimizer implemented with TensorFlow MPI operation

Language: Python - Size: 15.8 MB - Last synced: about 1 year ago - Pushed: about 5 years ago - Stars: 2 - Forks: 1

benedekrozemberczki/NestedSubtreeHash

A distributed implementation of "Nested Subtree Hash Kernels for Large-Scale Graph Classification Over Streams" (ICDM 2012).

Language: Python - Size: 151 KB - Last synced: 27 days ago - Pushed: almost 2 years ago - Stars: 7 - Forks: 8

hwang595/ATOMO

Atomo: Communication-efficient Learning via Atomic Sparsification

Language: Python - Size: 341 KB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 23 - Forks: 5

netroid314/ASWCS_back

This is repository for DAIG backend development

Language: Python - Size: 249 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 0 - Forks: 2

Davide-DD/distributed-machine-learning-architectures

A collection of hand-made distributed (except for 1) machine learning architectures

Language: Python - Size: 834 KB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 2 - Forks: 2

xinyandai/distributed-sgd-mpi

distributed sgd implementation with tensorflow and mpi4py.

Language: Python - Size: 14.2 MB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 3 - Forks: 0

aliciatang07/Spark-Ring-AllReduce

Ring Allreduce implmentation in Spark with Barrier Scheduling experiment

Language: Scala - Size: 20.9 MB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 2 - Forks: 1

kaushikacharya/Distributed_Machine_Learning_with_Apache_Spark_CS120x_edx

Distributed Machine Learning with Apache Spark (CS120x)(Edx) Assignment Solutions

Language: Jupyter Notebook - Size: 103 KB - Last synced: about 1 year ago - Pushed: almost 4 years ago - Stars: 0 - Forks: 0

ben-denham/hdsm

Hierarchical Distributed Stream Miner: A Distributed Data Mining Approach to Classifying Heterogeneous Data Streams

Language: Jupyter Notebook - Size: 232 KB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 0 - Forks: 1

FraFabbri/distributedsvm

Simulation of distributed SVM

Language: Jupyter Notebook - Size: 97.7 KB - Last synced: 3 months ago - Pushed: almost 6 years ago - Stars: 0 - Forks: 0