seaweedfs/seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

Language: Go - Size: 54.1 MB - Last synced: about 10 hours ago - Pushed: about 12 hours ago - Stars: 21,202 - Forks: 2,178

helyim/helyim

seaweedfs implemented in pure Rust

Language: Rust - Size: 375 KB - Last synced: about 3 hours ago - Pushed: about 3 hours ago - Stars: 116 - Forks: 11

darrenldl/ocaml-reed-solomon-erasure 📦

OCaml implementation of Reed-Solomon erasure coding

Language: OCaml - Size: 120 KB - Last synced: 13 days ago - Pushed: almost 6 years ago - Stars: 5 - Forks: 0

rust-rse/reed-solomon-erasure

[Looking for new owners/maintainers, see #88] Rust implementation of Reed-Solomon erasure coding

Language: Rust - Size: 850 KB - Last synced: 3 days ago - Pushed: 9 months ago - Stars: 171 - Forks: 58

gbletr42/bef

Block Erasure Format - An extensible, fast, and usable file utility to encode and decode interleaved erasure coded streams of data.

Language: C - Size: 1.24 MB - Last synced: 30 days ago - Pushed: 30 days ago - Stars: 55 - Forks: 2

egbakou/reedsolomon

Reed-Solomon Erasure Coding in C#/.NET

Language: C# - Size: 337 KB - Last synced: 12 days ago - Pushed: 8 months ago - Stars: 24 - Forks: 5

ceph/ceph

Ceph is a distributed object, block, and file storage platform

Language: C++ - Size: 725 MB - Last synced: 30 days ago - Pushed: about 1 month ago - Stars: 13,175 - Forks: 5,811

cubefs/cubefs

cloud-native file store

Language: Go - Size: 240 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 4,307 - Forks: 624

gluster/glusterfs

Gluster Filesystem : Build your distributed storage in minutes

Language: C - Size: 168 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 4,468 - Forks: 1,068

Mellanox/hw_offload_api_examples

Examples of usage for Mellanox HW offloads

Language: C - Size: 266 KB - Last synced: about 1 month ago - Pushed: over 2 years ago - Stars: 16 - Forks: 11

aicodix/code

Reusable C++ coding-related code library

Language: C++ - Size: 312 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 34 - Forks: 13

lizardfs/lizardfs

LizardFS is an Open Source Distributed File System licensed under GPLv3.

Language: C++ - Size: 12.8 MB - Last synced: about 1 month ago - Pushed: 8 months ago - Stars: 944 - Forks: 189

parsamlm/DistributedComputing

This repository contains the code for the project of Distributed Computing course at the University of Genoa.

Language: Python - Size: 3.14 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 2 - Forks: 0

btmorr/leifdb

LeifDB - a distributed database using the Raft protocol, built in Go

Language: Go - Size: 808 KB - Last synced: 26 days ago - Pushed: 7 months ago - Stars: 25 - Forks: 2

Archistar/archistar-smc

Secret sharing library in Java for the Archistar multi-cloud storage system

Language: Java - Size: 712 KB - Last synced: 19 days ago - Pushed: about 6 years ago - Stars: 45 - Forks: 18

Archistar/archistar-smc-js

JavaScript secret sharing library optimized for storage applications

Language: JavaScript - Size: 117 KB - Last synced: 20 days ago - Pushed: almost 6 years ago - Stars: 2 - Forks: 0

malaire/reed-solomon-16

Reed-Solomon GF(2^16) erasure coding with O(n log n) complexity

Language: Rust - Size: 47.9 KB - Last synced: 14 days ago - Pushed: 4 months ago - Stars: 4 - Forks: 5

frugalos/liberasurecode

A Rust wrapper for `openstack/liberasurecode`

Language: Rust - Size: 46.9 KB - Last synced: 11 days ago - Pushed: over 3 years ago - Stars: 21 - Forks: 8

vivint/infectious

Reed-Solomon forward error correcting library

Language: Go - Size: 68.4 KB - Last synced: 2 months ago - Pushed: 7 months ago - Stars: 186 - Forks: 15

zhanghan1990/D-Target

Language: Java - Size: 457 KB - Last synced: 5 months ago - Pushed: over 6 years ago - Stars: 1 - Forks: 0

andyxzq/EncodingBasedStorage

erasure coding

Language: C++ - Size: 30.3 KB - Last synced: 7 months ago - Pushed: about 7 years ago - Stars: 0 - Forks: 0

fx2y/kriya

Kriya: High-performance, S3 compatible object storage for machine learning, analytics, and application data workloads. Supports encryption, identity management, access control, erasure coding, bitrot protection, object locking, search, and analytics.

Language: Python - Size: 33.2 KB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 0 - Forks: 0

managata/ezio

file archiver with modern cipher and compression

Language: Go - Size: 41 KB - Last synced: 8 months ago - Pushed: about 6 years ago - Stars: 5 - Forks: 1

helenchw/ncloud-community-version

Community version of nCloud

Language: C++ - Size: 58.3 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 4 - Forks: 2

YuchongHu/echash

ACM SoCC 2019, "Coupling Decentralized Key-Value Stores with Erasure Coding"

Language: C++ - Size: 10.4 MB - Last synced: 9 months ago - Pushed: almost 3 years ago - Stars: 12 - Forks: 4

ibukisaar/ErasureCoding

C# Erasure Coding（纠删码）

Language: C++ - Size: 250 KB - Last synced: 9 months ago - Pushed: about 4 years ago - Stars: 5 - Forks: 0

itzmeanjan/kodr

Random Linear Network Coding

Language: Go - Size: 2.18 MB - Last synced: 10 months ago - Pushed: over 2 years ago - Stars: 6 - Forks: 2

somethingnew2-0/go-erasure

Erasure coding (Reed–Solomon coding) in Go

Language: C - Size: 412 KB - Last synced: 10 months ago - Pushed: over 4 years ago - Stars: 47 - Forks: 9

xdsopl/erasure

Cauchy Reed Solomon Erasure Coding

Language: C - Size: 39.1 KB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 0 - Forks: 0

yeliqseu/sparsenc

A library for encoding and decoding sparse network codes

Language: C - Size: 424 KB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 18 - Forks: 10

lonerapier/shittyrs-rs

A naive, shitty rust implementation of the Reed-Solomon erasure codes algorithm

Language: Rust - Size: 13.7 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 0 - Forks: 0

sleepybishop/nanors

fast reed solomon codes in GF2^8

Language: C - Size: 240 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 13 - Forks: 2

anoushk1234/rs2d

A crate for encoding and decoding data in a 2D Reed-Solomon matrix.

Language: Rust - Size: 43 KB - Last synced: 22 days ago - Pushed: about 1 year ago - Stars: 1 - Forks: 0

frugalos/ecpool

A Rust crate that provides thread pool for managing executions of erasure coding

Language: Rust - Size: 24.4 KB - Last synced: 11 days ago - Pushed: about 3 years ago - Stars: 14 - Forks: 2

vihu/reed-solomon-erasure

Reed solomon erasure coding for Elixir with Rust bindings

Language: Elixir - Size: 1.2 MB - Last synced: 20 days ago - Pushed: about 6 years ago - Stars: 4 - Forks: 0

ElsevierSoftwareX/SOFTX-D-20-00043 Fork of suaybarslan/founsure

An Erasure Code Library with Efficient Repair and Update Features. To cite this software publication: https://www.sciencedirect.com/science/article/pii/S2352711021000078

Size: 1.6 MB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 1 - Forks: 0

noelsimbolon/reed-solomon

Simple and efficient Reed-Solomon erasure code implementation in Java

Language: Java - Size: 133 KB - Last synced: 12 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

rot256/portage

An implementation of replica encodings without timing assumptions.

Language: Rust - Size: 35.2 KB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 3 - Forks: 0

alireza-87/erasure_code_sim

erasure coding simulation

Language: Python - Size: 614 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 1 - Forks: 0

ankit78gupta45/Secure-and-reliable-data-cloud-storage-using-Reed-Solomon-codes

Security and reliability to the data on cloud storage is achieved using erasure coding

Language: Java - Size: 33.2 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

nitisht/erasure-decoding

Simple tool to understand read quorum and data/parity shards used in reedsoloman based erasure coding.

Language: Go - Size: 6.84 KB - Last synced: about 1 year ago - Pushed: over 6 years ago - Stars: 3 - Forks: 1

gongotar/partner-xor

Partner-XOR combined Checkpoint/Restart Library

Language: C - Size: 266 KB - Last synced: 12 months ago - Pushed: about 3 years ago - Stars: 0 - Forks: 0

sebva/ErasureBench

Have a Seat on the ErasureBench: Easy Evaluation of Erasure Coding Libraries for Distributed Storage Systems

Language: TeX - Size: 64.8 MB - Last synced: about 1 year ago - Pushed: almost 6 years ago - Stars: 5 - Forks: 3

hustlijian/simplecfs

Simple Coded File System

Language: C - Size: 3.22 MB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 0 - Forks: 0