Topic: "lsm-tree"
skyzh/mini-lsm
A course of building an LSM-Tree storage engine (database) in a week.
Language: Rust - Size: 779 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 3,280 - Forks: 465
lotusdblabs/lotusdb
Most advanced key-value database written in Go, extremely fast, compatible with LSM tree and B+ tree.
Language: Go - Size: 7.22 MB - Last synced at: 15 days ago - Pushed at: 2 months ago - Stars: 2,144 - Forks: 179
slatedb/slatedb
A cloud native embedded storage engine built on object storage.
Language: Rust - Size: 1.27 MB - Last synced at: about 8 hours ago - Pushed at: about 10 hours ago - Stars: 1,933 - Forks: 102
fjall-rs/fjall
🗻 Log-structured embeddable key-value storage engine written in Rust
Language: Rust - Size: 3.11 MB - Last synced at: 1 day ago - Pushed at: 5 days ago - Stars: 1,016 - Forks: 39
tonbo-io/tonbo
A portable embedded database using Arrow.
Language: Rust - Size: 2.19 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 983 - Forks: 53
Fullstop000/wickdb
Pure Rust LSM-tree based embedded storage engine
Language: Rust - Size: 969 KB - Last synced at: 7 days ago - Pushed at: about 2 years ago - Stars: 629 - Forks: 69
tontinton/dbeel
A distributed thread-per-core document database
Language: Rust - Size: 589 KB - Last synced at: 28 days ago - Pushed at: over 1 year ago - Stars: 512 - Forks: 19
koculu/ZoneTree
ZoneTree is a persistent, high-performance, transactional, and ACID-compliant ordered key-value database for .NET. It operates seamlessly both in-memory and on local/cloud storage, making it an ideal choice for a wide range of applications requiring efficient data management.
Language: C# - Size: 1.39 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 349 - Forks: 32
KipData/kipdb
Lightweight, asynchronous based on LSM Leveled Compaction KV database
Language: Rust - Size: 1.67 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 279 - Forks: 25
rosedblabs/wal
Write Ahead Log for LSM or bitcask storage(or any append-only write).
Language: Go - Size: 104 KB - Last synced at: 17 days ago - Pushed at: 3 months ago - Stars: 257 - Forks: 45
guycipher/k4
High-performance open-source, durable, transactional embedded storage engine designed for low-latency, and optimized read and write efficiency.
Language: Go - Size: 9.34 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 243 - Forks: 4
eBay/Jungle
An embedded key-value store library specialized for building state machine and log store
Language: C++ - Size: 1.01 MB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 226 - Forks: 54
fjall-rs/lsm-tree
K.I.S.S. LSM-tree implementation in safe Rust
Language: Rust - Size: 1.79 MB - Last synced at: 1 day ago - Pushed at: 4 days ago - Stars: 208 - Forks: 15
tidesdb/tidesdb
High-performance durable, transactional embedded storage engine designed for flash and RAM optimization.
Language: C - Size: 1.91 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 199 - Forks: 20
burhanxz/Distributed-KV
分布式键值系统，供学习使用，不断完善中。截至目前：根据LSM论文，并结合CPP已有的实现，利用Java实现了LSM架构；综合Dubbo等框架的特点，实现了简洁的RPC框架。
Language: Java - Size: 1.64 MB - Last synced at: over 1 year ago - Pushed at: about 6 years ago - Stars: 126 - Forks: 37
starskey-io/starskey
Package for fast persistent, transactional, and embedded key-value storage. LevelDB-WiscKey inspired.
Language: Go - Size: 649 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 122 - Forks: 11
CocaineCong/tangseng
Tangseng search engine including full text search and vector search base on golang. 基于go语言的搜索引擎，信息检索系统
Language: Go - Size: 6.12 MB - Last synced at: 21 days ago - Pushed at: 3 months ago - Stars: 122 - Forks: 35
aronszanto/sLSM-Tree
High-Performance C++ Data System
Language: C++ - Size: 43.1 MB - Last synced at: 5 months ago - Pushed at: about 1 year ago - Stars: 120 - Forks: 29
vidardb/pgrocks-fdw
Bring RocksDB to PostgreSQL as an extension. It is the first foreign data wrapper (FDW) that introduces LSM-tree into PostgreSQL. The underneath storage engine can be RocksDB. The FDW also serves for VidarDB engine, a versatile storage engine for various workloads. See the link for more info about VidarDB engine.
Language: C - Size: 801 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 117 - Forks: 11
yetone/mirdb
MirDB: A Persistent Key-Value Store with Memcached protocol.
Language: Rust - Size: 12 MB - Last synced at: 5 days ago - Pushed at: over 5 years ago - Stars: 101 - Forks: 6
BBVA/qed
The scalable, auditable and high-performance tamper-evident log project
Language: Go - Size: 4.82 MB - Last synced at: 3 months ago - Pushed at: about 5 years ago - Stars: 97 - Forks: 19
tomfran/LSM-Tree
Log-Structured Merge Tree Java implementation
Language: Java - Size: 1.02 MB - Last synced at: 3 days ago - Pushed at: 12 months ago - Stars: 92 - Forks: 18
robaho/keydb
high performance key value database written in Go. Deprecated. Use robaho/leveldb
Language: Go - Size: 103 KB - Last synced at: 20 days ago - Pushed at: over 2 years ago - Stars: 86 - Forks: 7
whuanle/lsm
使用 Go 实现一个 LSM Tree 数据库
Language: Go - Size: 55.7 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 75 - Forks: 19
slatedb/slatedb-go
A cloud native embedded storage engine built on object storage.
Language: Go - Size: 390 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 72 - Forks: 12
adambcomer/database-engine
LSM-Tree Key-Value Store based on RocksDB
Language: Rust - Size: 39.1 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 62 - Forks: 3
XiangpengHao/bf-tree-docs
Bf-Tree: A Modern Read-Write-Optimized Concurrent Larger-Than-Memory Range Index
Size: 2.73 MB - Last synced at: 3 days ago - Pushed at: 7 months ago - Stars: 54 - Forks: 1
bh1xuw/rust-rocks
Make RocksDB really rocks! The Rust style API.
Language: Rust - Size: 1.18 MB - Last synced at: 29 days ago - Pushed at: almost 4 years ago - Stars: 47 - Forks: 7
unum-cloud/ucsb
Wide NoSQL benchmark for RocksDB, LevelDB, Redis, WiredTiger and MongoDB extending the Yahoo Cloud Serving Benchmark
Language: C++ - Size: 1.69 MB - Last synced at: 11 months ago - Pushed at: over 1 year ago - Stars: 43 - Forks: 6
maxpoletaev/kivi
Dynamo-inspired distributed leader-less key-value database that has no unique features and no apparent reason to exist
Language: Go - Size: 1.08 MB - Last synced at: 27 days ago - Pushed at: over 1 year ago - Stars: 42 - Forks: 1
heineiuo/rippledb
Embeddable key-value database engine in pure TypeScript, based on LSM-Tree
Language: TypeScript - Size: 2.5 MB - Last synced at: 6 days ago - Pushed at: about 2 years ago - Stars: 41 - Forks: 3
marvin-j97/rust-storage-bench
Benchmarking Rust storage engines
Language: Rust - Size: 1.46 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 35 - Forks: 5
marvin-j97/smoltable
Bigtable but smol
Language: Rust - Size: 2.34 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 34 - Forks: 1
guycipher/lsmt
Embedded durable, extensive, concurrent safe, highly configurable, transactional LSM tree based key-value store package
Language: Go - Size: 178 KB - Last synced at: 2 months ago - Pushed at: 6 months ago - Stars: 33 - Forks: 1
krasun/lsmtree
Log-structured merge-tree
Language: Go - Size: 42 KB - Last synced at: 6 days ago - Pushed at: about 2 years ago - Stars: 30 - Forks: 7
krasun/gosqldb
A key-value persistent database that supports SQL queries over B+ and LSM trees
Language: Go - Size: 55.7 KB - Last synced at: 6 days ago - Pushed at: over 3 years ago - Stars: 30 - Forks: 7
nidorx/sqlog
SQLog - Connecting the dots
Language: Go - Size: 880 KB - Last synced at: 18 days ago - Pushed at: 5 months ago - Stars: 29 - Forks: 2
alexander-akhmetov/mdb
LSM tree based key-value database
Language: Go - Size: 112 KB - Last synced at: 11 days ago - Pushed at: about 1 year ago - Stars: 29 - Forks: 8
Gifted-s/velarixdb
An LSM storage engine designed for high throughput and significant reduction in I/O amplification written in safe rust (Under active development)
Language: Rust - Size: 17.8 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 28 - Forks: 3
WyattJia/Pomegranate
🌳 A tiny skiplist based log-structured merge-tree written in Rust.
Language: Rust - Size: 5.07 MB - Last synced at: 6 months ago - Pushed at: over 1 year ago - Stars: 26 - Forks: 1
vidardb/PyVidarDB
PyVidarDB is a simple, fast, and persistent key-value store that can store terabytes of data. It is the Python binding for VidarDB.
Language: Python - Size: 115 KB - Last synced at: about 1 month ago - Pushed at: almost 3 years ago - Stars: 21 - Forks: 1
fgmacedo/soonerdb
A LSM-Tree key/value database in Python.
Language: Python - Size: 62.5 KB - Last synced at: about 1 year ago - Pushed at: over 4 years ago - Stars: 18 - Forks: 2
robaho/leveldb
high performance key-value database written in Go. Based on Google LevelDB api.
Language: Go - Size: 139 KB - Last synced at: 20 days ago - Pushed at: 11 months ago - Stars: 17 - Forks: 0
afiskon/hurmadb
HurmaDB
Language: C++ - Size: 142 KB - Last synced at: 26 days ago - Pushed at: over 2 years ago - Stars: 16 - Forks: 3
learn-decentralized-systems/Chotki
An LSM database turned a CRDT database. Really fast counters!
Language: Go - Size: 1.09 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 15 - Forks: 1
Krien/TropoDB
ZNS Append-only based LSM key-value store
Language: C++ - Size: 36.1 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 15 - Forks: 3
impact-eintr/raftd
raftd 基于raft和bolt的分布式KV数据库 由于简单实现了租约系统 可以用于简单的服务发现 基于gin框架提供http服务
Language: Go - Size: 104 KB - Last synced at: 16 days ago - Pushed at: about 3 years ago - Stars: 13 - Forks: 1
xiaonanln/distributed-system-papers-must-read
Collect must-read papers on distributed systems
Size: 10.6 MB - Last synced at: about 1 month ago - Pushed at: over 6 years ago - Stars: 13 - Forks: 1
GZTimeWalker/YYDB 📦
Yat another MySQL storage engine, a database course project.
Language: Rust - Size: 1.51 MB - Last synced at: about 23 hours ago - Pushed at: over 2 years ago - Stars: 12 - Forks: 2
stonet-research/zwal
ZWAL : Rethinking Write-ahead Logs for ZNS SSDs (SIGOPS OSR'24 and CHEOPS'24)
Language: C++ - Size: 17.7 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 11 - Forks: 3
adambcomer/WiscKey
Key-value database based on the WiscKey paper.
Language: C - Size: 142 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 11 - Forks: 0
impact-eintr/lsmdb
基于Wisckey论文的LSM Tree Key Value Pair 数据库存储引擎
Language: Go - Size: 756 KB - Last synced at: 24 days ago - Pushed at: about 3 years ago - Stars: 11 - Forks: 2
fanx-dev/axdb2
High performance distributed key-value database
Language: Fantom - Size: 121 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 11 - Forks: 2
xxks-kkk/HyperPebblesDB
A PebblesDB fork with a few enhancements
Language: C++ - Size: 1.24 MB - Last synced at: 13 days ago - Pushed at: almost 7 years ago - Stars: 11 - Forks: 1
jsc0218/PostgresForeignDataWrapper
has been moved to https://github.com/vidardb/PostgresForeignDataWrapper. It is the first foreign data wrapper introducing LSM-tree into PostgreSQL.
Language: C - Size: 329 KB - Last synced at: almost 2 years ago - Pushed at: about 5 years ago - Stars: 10 - Forks: 1
unum-cloud/udisk
The fastest ACID-transactional persisted Key-Value store designed as modified LSM-Tree for NVMe block-devices with GPU-acceleration and SPDK to bypass the Linux kernel
Size: 3.91 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 9 - Forks: 0
zxjcarrot/silkstore
SIngle Level Key-value Store
Language: C++ - Size: 10.3 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 5
yfractal/lsm-tree
A Ruby implemented Log-Structured Merge Tree(LSM Tree) for study purpose.
Language: Ruby - Size: 44.9 KB - Last synced at: 25 days ago - Pushed at: about 3 years ago - Stars: 9 - Forks: 0
robaho/keydbr
remote protocol layer for keydb using gRPC. deprecated. use robaho/leveldbr
Language: Go - Size: 52.7 KB - Last synced at: 20 days ago - Pushed at: over 2 years ago - Stars: 8 - Forks: 1
Naplesoul/LSM-KV
A key-value storage system based on LSM Tree, using Skip List and Bloom Filter to accelerate.
Language: C++ - Size: 2.59 MB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 8 - Forks: 0
tidesdb/tidesdb-cpp
Official C++ binding for TidesDB
Language: C++ - Size: 2 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 7 - Forks: 2
Sean04111/kv-raft
kv serivce based on raft and lsm tree
Language: Go - Size: 1.33 MB - Last synced at: 20 days ago - Pushed at: 12 months ago - Stars: 7 - Forks: 0
Terkwood/AugustDB
Key/value store backed by LSM Tree architecture.
Language: Elixir - Size: 306 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 7 - Forks: 1
Jasonbourne723/platodb
platodb 是一款高性能的基于 LSM-Tree 的键值数据库，采用模块化架构设计，支持快速的读写性能和崩溃恢复能力。适用于高吞吐量和低延迟需求的存储场景。
Language: Go - Size: 922 KB - Last synced at: 6 days ago - Pushed at: 3 months ago - Stars: 6 - Forks: 0
SarthakMakhija/storage-engine-workshop
Repository for a workshop on the topic - building storage engine
Language: Go - Size: 119 KB - Last synced at: 27 days ago - Pushed at: 7 months ago - Stars: 6 - Forks: 2
adlternative/adlsm-tree
a lsm-tree implement
Language: C++ - Size: 414 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 1
hengfeiyang/lsmdb
LSM Tree demo project
Language: Go - Size: 30.3 KB - Last synced at: 20 days ago - Pushed at: about 3 years ago - Stars: 6 - Forks: 1
hetudb/hetu
HetuDB is a real-time OLAP database management system in the cloud
Language: Rust - Size: 15.4 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 5 - Forks: 0
NikolaOgnjenovic/NoSQLDB
Rust NoSQL key-value engine. Get, set, probabilistic types. Made for the Advanced algorithms and data structures course, III semester, Faculty of Technical Sciences in Novi Sad.
Language: Rust - Size: 584 KB - Last synced at: 9 months ago - Pushed at: about 1 year ago - Stars: 5 - Forks: 0
wxiao1002/SampleDB
go 语言实现一个简易的KV 存储引擎,存储使用LSM
Language: Go - Size: 13.7 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 1
robaho/leveldbr
remote access to robaho/leveldb databases
Language: Go - Size: 42 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 0
nopper/kiwi
LSM tree to the rescue
Language: C - Size: 563 KB - Last synced at: about 1 year ago - Pushed at: about 12 years ago - Stars: 5 - Forks: 0
B1NARY-GR0UP/originium
LSM-Tree based storage engine used by FOIVER system.
Language: Go - Size: 285 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 4 - Forks: 0
lnikon/tinykvpp
Horizontally scalable, highly available, key-value storage service with distributed transaction support written in C++
Language: C++ - Size: 620 KB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 4 - Forks: 0
SarthakMakhija/tinyDB
Tiny relational DB implementation over an LSM tree based storage engine
Language: Go - Size: 115 KB - Last synced at: 27 days ago - Pushed at: 4 months ago - Stars: 4 - Forks: 0
SleepyLGod/miscellaneous
miscellaneous things with C++, to be updated~
Language: C++ - Size: 1.93 MB - Last synced at: 12 months ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 0
leonwind/LSM-Tree
A proof of concept implementation of a Key Value Store using an LSM-Tree with benchmarks against RocksDB.
Language: C++ - Size: 156 KB - Last synced at: 26 days ago - Pushed at: almost 3 years ago - Stars: 4 - Forks: 0
the123saurav/rabi
A LSM based key value database in Java
Language: Java - Size: 157 KB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 4 - Forks: 2
rockit-ba/r_wisckey
rust 实现wisckey 优化的 LSM
Language: Rust - Size: 173 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 4 - Forks: 2
kirubasankars/kdb
LSM based key, value store written in C# (embedded database)
Language: C# - Size: 12.7 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 0
Pr65/minilsm
A simple, single threaded LSM tree implementation
Language: Rust - Size: 16.6 KB - Last synced at: about 2 years ago - Pushed at: about 5 years ago - Stars: 4 - Forks: 1
robaho/cpp_leveldb
A port of the ultra-high-performance robaho key-value database using modern C++.
Language: C++ - Size: 300 KB - Last synced at: about 2 months ago - Pushed at: 2 months ago - Stars: 3 - Forks: 1
tidesdb/tidesdb-python
Official Python binding for TidesDB
Language: Python - Size: 46.9 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 3 - Forks: 3
SarthakMakhija/go-lsm
Implementation of LSM tree in Golang, mainly for educational purposes.
Language: Go - Size: 48.8 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 3 - Forks: 1
robaho/jkeydb
Java version of keydb. Deprecated. Use robaho/jleveldb
Language: Java - Size: 44.9 MB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0
jiangyinzuo/KVLite
A toy key-value storage based on LSM-tree
Language: Rust - Size: 813 KB - Last synced at: 7 days ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 0
sevagh/raft-badgerdb
Hashicorp Raft LogStore + StableStore backed by dgraph-io's BadgerDB
Language: Go - Size: 20.5 KB - Last synced at: 3 days ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 0
akangakang/LSM_Tree
SE-算法设计与实现-PRO1
Language: C++ - Size: 3.09 MB - Last synced at: about 1 year ago - Pushed at: about 5 years ago - Stars: 3 - Forks: 1
Mnwa/ReconEngine
Fast library realised lsm tree key value store.
Language: Go - Size: 51.8 KB - Last synced at: about 1 month ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 0
iknite/molletree
Small playground for ideas and mini-trees for QED
Language: Go - Size: 50.8 KB - Last synced at: 6 months ago - Pushed at: over 6 years ago - Stars: 3 - Forks: 0
yetanotherbot/embedded-lsmdb
A simple embedded lsm-based database, CSE 291 Storage System course project
Language: Java - Size: 1.17 MB - Last synced at: 6 months ago - Pushed at: over 7 years ago - Stars: 3 - Forks: 0
tidesdb/tidesdb-lua
Official Lua binding for TidesDB
Language: Lua - Size: 44.9 KB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 2 - Forks: 2
al8n/memorable
Lock-free, ordered and multiple version memory table for key-value databases.
Language: Rust - Size: 34.2 KB - Last synced at: 5 days ago - Pushed at: 2 months ago - Stars: 2 - Forks: 1
clamkv/clamkv
A C library that provides an embeddable, persistent key-value store for fast storage.
Language: C - Size: 653 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 2 - Forks: 0
robaho/jleveldb
Java version of Google's leveldb based on the original implementation of robaho/jkeydb
Language: Java - Size: 45 MB - Last synced at: about 2 months ago - Pushed at: 11 months ago - Stars: 2 - Forks: 0
VMois/LSM-Compactron3000
FPGA-based accelerator for compactions in LSM-tree based KV stores. Making compaction great again, again!
Language: C - Size: 3.33 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 1
Avash027/MidDB
A High-Performance and Fault-Tolerant Key-Value Store Built with LSM Trees and Bloom Filters with Strong Consistency Guarantees
Language: Go - Size: 1.48 MB - Last synced at: 10 months ago - Pushed at: almost 2 years ago - Stars: 2 - Forks: 0
Kirov7/FayKV
Key-Value storage engine based on LSM-Tree
Language: Go - Size: 131 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0
whodarewin/pdb
基于LSM树的本地KV 存储
Language: Java - Size: 284 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0
lnsp/kvstore
flexible key-value store built on LSM trees
Language: Go - Size: 128 KB - Last synced at: 20 days ago - Pushed at: about 3 years ago - Stars: 2 - Forks: 0
