seaweedfs/seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

Language: Go - Size: 68.4 MB - Last synced at: 3 days ago - Pushed at: 5 days ago - Stars: 24,165 - Forks: 2,382

ceph/ceph

Ceph is a distributed object, block, and file storage platform

Language: C++ - Size: 790 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 14,898 - Forks: 6,039

cubefs/cubefs

cloud-native distributed storage

Language: Go - Size: 243 MB - Last synced at: about 4 hours ago - Pushed at: 6 days ago - Stars: 5,022 - Forks: 658

gluster/glusterfs

Gluster Filesystem : Build your distributed storage in minutes

Language: C - Size: 169 MB - Last synced at: 3 days ago - Pushed at: 4 days ago - Stars: 4,895 - Forks: 1,099

moosefs/moosefs

MooseFS Distributed Storage – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System / Software-Defined Storage

Language: C - Size: 6.59 MB - Last synced at: 11 days ago - Pushed at: 18 days ago - Stars: 1,775 - Forks: 217

NVIDIA/aistore

AIStore: scalable storage for AI applications

Language: Go - Size: 84.9 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 1,466 - Forks: 201

lizardfs/lizardfs

LizardFS is an Open Source Distributed File System licensed under GPLv3.

Language: C++ - Size: 12.8 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 944 - Forks: 189

rust-rse/reed-solomon-erasure

[Looking for new owners/maintainers, see #88] Rust implementation of Reed-Solomon erasure coding

Language: Rust - Size: 850 KB - Last synced at: 2 days ago - Pushed at: over 1 year ago - Stars: 195 - Forks: 63

vivint/infectious

Reed-Solomon forward error correcting library

Language: Go - Size: 68.4 KB - Last synced at: 13 days ago - Pushed at: over 1 year ago - Stars: 193 - Forks: 17

helyim/helyim

seaweedfs implemented in pure Rust

Language: Rust - Size: 377 KB - Last synced at: 12 days ago - Pushed at: 21 days ago - Stars: 183 - Forks: 20

gbletr42/bef

Block Erasure Format - An extensible, fast, and usable file utility to encode and decode interleaved erasure coded streams of data.

Language: C - Size: 1.24 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 55 - Forks: 2

aicodix/code

Reusable C++ coding-related code library

Language: C++ - Size: 312 KB - Last synced at: 26 days ago - Pushed at: 26 days ago - Stars: 49 - Forks: 15

somethingnew2-0/go-erasure

Erasure coding (Reed–Solomon coding) in Go

Language: C - Size: 412 KB - Last synced at: 11 days ago - Pushed at: over 5 years ago - Stars: 48 - Forks: 10

Archistar/archistar-smc

Secret sharing library in Java for the Archistar multi-cloud storage system

Language: Java - Size: 712 KB - Last synced at: 12 months ago - Pushed at: about 7 years ago - Stars: 45 - Forks: 18

yeliqseu/sparsenc

A library for encoding and decoding sparse network codes

Language: C - Size: 5.86 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 28 - Forks: 8

egbakou/reedsolomon

Reed-Solomon Erasure Coding in C#/.NET

Language: C# - Size: 337 KB - Last synced at: 15 days ago - Pushed at: over 1 year ago - Stars: 26 - Forks: 5

btmorr/leifdb

LeifDB - a distributed database using the Raft protocol, built in Go

Language: Go - Size: 808 KB - Last synced at: 8 days ago - Pushed at: over 1 year ago - Stars: 25 - Forks: 2

frugalos/liberasurecode

A Rust wrapper for `openstack/liberasurecode`

Language: Rust - Size: 46.9 KB - Last synced at: 10 days ago - Pushed at: over 4 years ago - Stars: 21 - Forks: 7

sleepybishop/nanors

fast reed solomon codes in GF2^8

Language: C - Size: 208 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 17 - Forks: 3

Mellanox/hw_offload_api_examples

Examples of usage for Mellanox HW offloads

Language: C - Size: 266 KB - Last synced at: 3 months ago - Pushed at: over 3 years ago - Stars: 17 - Forks: 11

frugalos/ecpool

A Rust crate that provides thread pool for managing executions of erasure coding

Language: Rust - Size: 24.4 KB - Last synced at: 10 days ago - Pushed at: about 4 years ago - Stars: 14 - Forks: 2

itzmeanjan/kodr

Random Linear Network Coding

Language: Go - Size: 2.18 MB - Last synced at: 21 days ago - Pushed at: over 3 years ago - Stars: 13 - Forks: 5

YuchongHu/echash

ACM SoCC 2019, "Coupling Decentralized Key-Value Stores with Erasure Coding"

Language: C++ - Size: 10.4 MB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 12 - Forks: 4

nexoedge/nexoedge

Linux Foundation Edge - Nexoedge

Language: C++ - Size: 57 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 7 - Forks: 4

parsamlm/DistributedComputing

This repository contains the code for the project of Distributed Computing course at the University of Genoa.

Language: Python - Size: 3.14 MB - Last synced at: 14 days ago - Pushed at: about 1 year ago - Stars: 6 - Forks: 0

malaire/reed-solomon-16

Reed-Solomon GF(2^16) erasure coding with O(n log n) complexity

Language: Rust - Size: 47.9 KB - Last synced at: 24 days ago - Pushed at: about 1 year ago - Stars: 6 - Forks: 9

ibukisaar/ErasureCoding

C# Erasure Coding（纠删码）

Language: C++ - Size: 250 KB - Last synced at: over 1 year ago - Pushed at: about 5 years ago - Stars: 5 - Forks: 0

sebva/ErasureBench

Have a Seat on the ErasureBench: Easy Evaluation of Erasure Coding Libraries for Distributed Storage Systems

Language: TeX - Size: 64.8 MB - Last synced at: about 2 years ago - Pushed at: almost 7 years ago - Stars: 5 - Forks: 3

darrenldl/ocaml-reed-solomon-erasure 📦

OCaml implementation of Reed-Solomon erasure coding

Language: OCaml - Size: 120 KB - Last synced at: 12 months ago - Pushed at: almost 7 years ago - Stars: 5 - Forks: 0

managata/ezio

file archiver with modern cipher and compression

Language: Go - Size: 41 KB - Last synced at: over 1 year ago - Pushed at: about 7 years ago - Stars: 5 - Forks: 1

helenchw/ncloud-community-version

Community version of nCloud

Language: C++ - Size: 58.3 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 2

vihu/reed-solomon-erasure

Reed solomon erasure coding for Elixir with Rust bindings

Language: Elixir - Size: 1.2 MB - Last synced at: about 2 months ago - Pushed at: about 7 years ago - Stars: 4 - Forks: 0

rot256/portage

An implementation of replica encodings without timing assumptions.

Language: Rust - Size: 35.2 KB - Last synced at: 3 days ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 0

nitisht/erasure-decoding

Simple tool to understand read quorum and data/parity shards used in reedsoloman based erasure coding.

Language: Go - Size: 6.84 KB - Last synced at: about 1 month ago - Pushed at: over 7 years ago - Stars: 3 - Forks: 1

Archistar/archistar-smc-js

JavaScript secret sharing library optimized for storage applications

Language: JavaScript - Size: 117 KB - Last synced at: 12 months ago - Pushed at: almost 7 years ago - Stars: 2 - Forks: 0

i5heu/ouroboros-db-overhead-calculator

A calculator for estimating storage space and durability using erasure coding. Built for OuroborosDB, this tool helps determine the most efficient settings for erasure coding data storage.

Language: Svelte - Size: 5.94 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

lonerapier/shittyrs-rs

A naive, shitty rust implementation of the Reed-Solomon erasure codes algorithm

Language: Rust - Size: 13.7 KB - Last synced at: 8 days ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

anoushk1234/rs2d

A crate for encoding and decoding data in a 2D Reed-Solomon matrix.

Language: Rust - Size: 43 KB - Last synced at: 20 days ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

alireza-87/erasure_code_sim

erasure coding simulation

Language: Python - Size: 614 KB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

ElsevierSoftwareX/SOFTX-D-20-00043 Fork of suaybarslan/founsure

An Erasure Code Library with Efficient Repair and Update Features. To cite this software publication: https://www.sciencedirect.com/science/article/pii/S2352711021000078

Size: 1.6 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

zhanghan1990/D-Target

Language: Java - Size: 457 KB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0

MuhamadAjiW/DistKV-Erasure-Coding

Repository for my thesis implementation

Language: Rust - Size: 139 KB - Last synced at: about 11 hours ago - Pushed at: about 12 hours ago - Stars: 0 - Forks: 0

MuhamadAjiW/Tugas-Akhir-IF

Thesis document for bachelor's program informatics engineering at Institut Teknologi Bandung

Language: TeX - Size: 86.1 MB - Last synced at: about 17 hours ago - Pushed at: about 18 hours ago - Stars: 0 - Forks: 0

elfikop/Erasure_codes_LT_coder

C++ console implementation of an LT coder, the decoder and code documentation in english is beeing processed: )

Language: Rich Text Format - Size: 0 Bytes - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

MuhamadAjiW/rust-distkv-benchmark

Benchmarking program to compare replication against erasure coding (reed_solomon_erasure)

Language: Rust - Size: 67.4 KB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

fx2y/kriya

Kriya: High-performance, S3 compatible object storage for machine learning, analytics, and application data workloads. Supports encryption, identity management, access control, erasure coding, bitrot protection, object locking, search, and analytics.

Language: Python - Size: 33.2 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

xdsopl/erasure

Cauchy Reed Solomon Erasure Coding

Language: C - Size: 39.1 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

noelsimbolon/reed-solomon

Simple and efficient Reed-Solomon erasure code implementation in Java

Language: Java - Size: 133 KB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

ankit78gupta45/Secure-and-reliable-data-cloud-storage-using-Reed-Solomon-codes

Security and reliability to the data on cloud storage is achieved using erasure coding

Language: Java - Size: 33.2 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

gongotar/partner-xor

Partner-XOR combined Checkpoint/Restart Library

Language: C - Size: 266 KB - Last synced at: 9 months ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

hustlijian/simplecfs

Simple Coded File System

Language: C - Size: 3.22 MB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

andyxzq/EncodingBasedStorage

erasure coding

Language: C++ - Size: 30.3 KB - Last synced at: over 1 year ago - Pushed at: about 8 years ago - Stars: 0 - Forks: 0

gitlab-com-seaweedfs/seaweedfs

Mirror of https://github.com/seaweedfs/seaweedfs

Language: Go - Size: 150 MB - Last synced at: over 1 year ago - Stars: 0 - Forks: 0

mirrors/seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

Language: Go - Size: 155 MB - Last synced at: 10 months ago - Stars: 0 - Forks: 0