seaweedfs/seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.

Language: Go - Size: 124 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 25,732 - Forks: 2,460

ceph/ceph

Ceph is a distributed object, block, and file storage platform

Language: C++ - Size: 824 MB - Last synced at: about 10 hours ago - Pushed at: about 11 hours ago - Stars: 15,473 - Forks: 6,157

cubefs/cubefs

cloud-native distributed storage

Language: Go - Size: 158 MB - Last synced at: 5 days ago - Pushed at: 8 days ago - Stars: 5,238 - Forks: 674

gluster/glusterfs

Gluster Filesystem : Build your distributed storage in minutes

Language: C - Size: 169 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 5,020 - Forks: 1,110

moosefs/moosefs

MooseFS Distributed Storage – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System / Software-Defined Storage

Language: C - Size: 6.83 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1,817 - Forks: 218

NVIDIA/aistore

AIStore: scalable storage for AI applications

Language: Go - Size: 93.3 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 1,588 - Forks: 217

lizardfs/lizardfs

LizardFS is an Open Source Distributed File System licensed under GPLv3.

Language: C++ - Size: 12.8 MB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 973 - Forks: 188

rust-rse/reed-solomon-erasure

[Looking for new owners/maintainers, see #88] Rust implementation of Reed-Solomon erasure coding

Language: Rust - Size: 850 KB - Last synced at: 11 days ago - Pushed at: about 2 years ago - Stars: 203 - Forks: 64

vivint/infectious

Reed-Solomon forward error correcting library

Language: Go - Size: 68.4 KB - Last synced at: 4 months ago - Pushed at: almost 2 years ago - Stars: 195 - Forks: 17

helyim/helyim

seaweedfs implemented in pure Rust

Language: Rust - Size: 377 KB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 188 - Forks: 20

gbletr42/bef

Block Erasure Format - An extensible, fast, and usable file utility to encode and decode interleaved erasure coded streams of data.

Language: C - Size: 1.24 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 55 - Forks: 2

aicodix/code

Reusable C++ coding-related code library

Language: C++ - Size: 327 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 50 - Forks: 15

somethingnew2-0/go-erasure

Erasure coding (Reed–Solomon coding) in Go

Language: C - Size: 412 KB - Last synced at: 29 days ago - Pushed at: almost 6 years ago - Stars: 48 - Forks: 10

Archistar/archistar-smc

Secret sharing library in Java for the Archistar multi-cloud storage system

Language: Java - Size: 712 KB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 45 - Forks: 18

egbakou/reedsolomon

Reed-Solomon Erasure Coding in C#/.NET

Language: C# - Size: 349 KB - Last synced at: 7 days ago - Pushed at: 2 months ago - Stars: 29 - Forks: 7

yeliqseu/sparsenc

A library for encoding and decoding sparse network codes

Language: C - Size: 5.86 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 28 - Forks: 8

btmorr/leifdb

LeifDB - a distributed database using the Raft protocol, built in Go

Language: Go - Size: 808 KB - Last synced at: 11 days ago - Pushed at: almost 2 years ago - Stars: 26 - Forks: 2

frugalos/liberasurecode

A Rust wrapper for `openstack/liberasurecode`

Language: Rust - Size: 46.9 KB - Last synced at: about 1 month ago - Pushed at: almost 5 years ago - Stars: 21 - Forks: 7

itzmeanjan/kodr

Random Linear Network Coding

Language: Go - Size: 2.17 MB - Last synced at: 4 days ago - Pushed at: 3 months ago - Stars: 19 - Forks: 5

sleepybishop/nanors

fast reed solomon codes in GF2^8

Language: C - Size: 208 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 17 - Forks: 3

Mellanox/hw_offload_api_examples

Examples of usage for Mellanox HW offloads

Language: C - Size: 266 KB - Last synced at: 3 months ago - Pushed at: over 3 years ago - Stars: 17 - Forks: 11

frugalos/ecpool

A Rust crate that provides thread pool for managing executions of erasure coding

Language: Rust - Size: 24.4 KB - Last synced at: 26 days ago - Pushed at: over 4 years ago - Stars: 14 - Forks: 2

YuchongHu/echash

ACM SoCC 2019, "Coupling Decentralized Key-Value Stores with Erasure Coding"

Language: C++ - Size: 10.4 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 12 - Forks: 4

nexoedge/nexoedge

Linux Foundation Edge - Nexoedge

Language: C++ - Size: 57 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 4

parsamlm/DistributedComputing

This repository contains the code for the project of Distributed Computing course at the University of Genoa.

Language: Python - Size: 3.14 MB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 0

malaire/reed-solomon-16

Reed-Solomon GF(2^16) erasure coding with O(n log n) complexity

Language: Rust - Size: 47.9 KB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 10

IcicleF/Nos

[OSDI'25] Stripeless Data Placement for Erasure-Coded In-Memory Storage.

Language: Rust - Size: 4.81 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 5 - Forks: 0

ibukisaar/ErasureCoding

C# Erasure Coding（纠删码）

Language: C++ - Size: 250 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 5 - Forks: 0

sebva/ErasureBench

Have a Seat on the ErasureBench: Easy Evaluation of Erasure Coding Libraries for Distributed Storage Systems

Language: TeX - Size: 64.8 MB - Last synced at: over 2 years ago - Pushed at: about 7 years ago - Stars: 5 - Forks: 3

darrenldl/ocaml-reed-solomon-erasure 📦

OCaml implementation of Reed-Solomon erasure coding

Language: OCaml - Size: 120 KB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 5 - Forks: 0

managata/ezio

file archiver with modern cipher and compression

Language: Go - Size: 41 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 5 - Forks: 1

helenchw/ncloud-community-version

Community version of nCloud

Language: C++ - Size: 58.3 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 2

vihu/reed-solomon-erasure

Reed solomon erasure coding for Elixir with Rust bindings

Language: Elixir - Size: 1.2 MB - Last synced at: 3 months ago - Pushed at: over 7 years ago - Stars: 4 - Forks: 0

mempirate/zc-rlnc

A high-performance, Byzantine-resilient RLNC implementation in Rust

Language: Rust - Size: 85.9 KB - Last synced at: 6 days ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 0

rot256/portage

An implementation of replica encodings without timing assumptions.

Language: Rust - Size: 35.2 KB - Last synced at: 12 days ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 0

nitisht/erasure-decoding

Simple tool to understand read quorum and data/parity shards used in reedsoloman based erasure coding.

Language: Go - Size: 6.84 KB - Last synced at: 3 months ago - Pushed at: almost 8 years ago - Stars: 3 - Forks: 1

Archistar/archistar-smc-js

JavaScript secret sharing library optimized for storage applications

Language: JavaScript - Size: 117 KB - Last synced at: over 1 year ago - Pushed at: about 7 years ago - Stars: 2 - Forks: 0

abkarada/Full_CPU_Version

Language: Makefile - Size: 1.63 MB - Last synced at: 16 days ago - Pushed at: 21 days ago - Stars: 1 - Forks: 0

i5heu/ouroboros-db-overhead-calculator

A calculator for estimating storage space and durability using erasure coding. Built for OuroborosDB, this tool helps determine the most efficient settings for erasure coding data storage.

Language: Svelte - Size: 5.94 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 1 - Forks: 0

lonerapier/shittyrs-rs

A naive, shitty rust implementation of the Reed-Solomon erasure codes algorithm

Language: Rust - Size: 13.7 KB - Last synced at: 5 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

anoushk1234/rs2d

A crate for encoding and decoding data in a 2D Reed-Solomon matrix.

Language: Rust - Size: 43 KB - Last synced at: 17 days ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

alireza-87/erasure_code_sim

erasure coding simulation

Language: Python - Size: 614 KB - Last synced at: 6 months ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 0

ElsevierSoftwareX/SOFTX-D-20-00043 Fork of suaybarslan/founsure

An Erasure Code Library with Efficient Repair and Update Features. To cite this software publication: https://www.sciencedirect.com/science/article/pii/S2352711021000078

Size: 1.6 MB - Last synced at: over 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

zhanghan1990/D-Target

Language: Java - Size: 457 KB - Last synced at: almost 2 years ago - Pushed at: about 8 years ago - Stars: 1 - Forks: 0

CoderSerio/erasure-coding

纠删编码的一些简化版实现和原理分析

Language: TypeScript - Size: 4.88 KB - Last synced at: 3 days ago - Pushed at: 20 days ago - Stars: 0 - Forks: 0

MuhamadAjiW/Tugas-Akhir-IF

Thesis document for bachelor's program informatics engineering at Institut Teknologi Bandung

Language: TeX - Size: 109 MB - Last synced at: 1 day ago - Pushed at: 27 days ago - Stars: 0 - Forks: 0

MuhamadAjiW/DistKV-Erasure-Coding

Repository for my thesis implementation

Language: Jupyter Notebook - Size: 50.2 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

kig/wirehair-wasm Fork of catid/wirehair

Wirehair : O(N) Fountain Code for Large Data - WASM build

Language: C++ - Size: 2.22 MB - Last synced at: 19 days ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

elfikop/Erasure_codes_LT_coder

C++ console implementation of an LT coder, the decoder and code documentation in english is beeing processed: )

Language: Rich Text Format - Size: 0 Bytes - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

MuhamadAjiW/rust-distkv-benchmark

Benchmarking program to compare replication against erasure coding (reed_solomon_erasure)

Language: Rust - Size: 67.4 KB - Last synced at: 6 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

fx2y/kriya

Kriya: High-performance, S3 compatible object storage for machine learning, analytics, and application data workloads. Supports encryption, identity management, access control, erasure coding, bitrot protection, object locking, search, and analytics.

Language: Python - Size: 33.2 KB - Last synced at: 14 days ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

xdsopl/erasure

Cauchy Reed Solomon Erasure Coding

Language: C - Size: 39.1 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

noelsimbolon/reed-solomon

Simple and efficient Reed-Solomon erasure code implementation in Java

Language: Java - Size: 133 KB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

ankit78gupta45/Secure-and-reliable-data-cloud-storage-using-Reed-Solomon-codes

Security and reliability to the data on cloud storage is achieved using erasure coding

Language: Java - Size: 33.2 KB - Last synced at: over 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

gongotar/partner-xor

Partner-XOR combined Checkpoint/Restart Library

Language: C - Size: 266 KB - Last synced at: about 1 year ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

hustlijian/simplecfs

Simple Coded File System

Language: C - Size: 3.22 MB - Last synced at: over 2 years ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0

andyxzq/EncodingBasedStorage

erasure coding

Language: C++ - Size: 30.3 KB - Last synced at: almost 2 years ago - Pushed at: over 8 years ago - Stars: 0 - Forks: 0

gitlab-com-seaweedfs/seaweedfs

Mirror of https://github.com/seaweedfs/seaweedfs

Language: Go - Size: 150 MB - Last synced at: almost 2 years ago - Stars: 0 - Forks: 0

mirrors/seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

Language: Go - Size: 155 MB - Last synced at: about 1 year ago - Stars: 0 - Forks: 0