zero-copy | Topic | Ecosyste.ms: Repos

Topic: "zero-copy"

google/flatbuffers

FlatBuffers: Memory Efficient Serialization Library

Language: C++ - Size: 19.4 MB - Last synced at: 1 day ago - Pushed at: 20 days ago - Stars: 24,285 - Forks: 3,344

apache/fory

A blazingly fast multi-language serialization framework powered by JIT and zero-copy.

Language: Java - Size: 12.6 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 3,299 - Forks: 277

rkyv/rkyv

Zero-copy deserialization framework for Rust

Language: Rust - Size: 4.26 MB - Last synced at: 3 days ago - Pushed at: about 1 month ago - Stars: 3,272 - Forks: 186

sanshengshui/netty-learning-example

:egg: Netty实践学习案例，见微知著！带着你的心，跟着教程。我相信你行欧。

Language: Java - Size: 2 MB - Last synced at: 9 days ago - Pushed at: over 2 years ago - Stars: 2,923 - Forks: 817

6over3/bebop

🎷No ceremony, just code. Blazing fast, typesafe binary serialization.

Language: C# - Size: 101 MB - Last synced at: 13 days ago - Pushed at: 3 months ago - Stars: 2,049 - Forks: 42

felixguendling/cista

Cista is a simple, high-performance, zero-copy C++ serialization & reflection library.

Language: C++ - Size: 1020 KB - Last synced at: 10 days ago - Pushed at: 13 days ago - Stars: 2,021 - Forks: 134

google/zerocopy

Zerocopy makes zero-cost memory manipulation effortless. We write `unsafe` so you don’t have to.

Language: Rust - Size: 5.63 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1,937 - Forks: 114

eclipse-iceoryx/iceoryx

Eclipse iceoryx™ - true zero-copy inter-process-communication

Language: C++ - Size: 22.9 MB - Last synced at: 9 days ago - Pushed at: 10 days ago - Stars: 1,807 - Forks: 422

eclipse-iceoryx/iceoryx2

Eclipse iceoryx2™ - true zero-copy inter-process-communication in pure Rust

Language: Rust - Size: 7.39 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 1,510 - Forks: 65

Marwes/combine

A parser combinator library for Rust

Language: Rust - Size: 2.26 MB - Last synced at: 1 day ago - Pushed at: 4 months ago - Stars: 1,324 - Forks: 96

cloudflare/mmap-sync

Rust library for concurrent data access, using memory-mapped files, zero-copy deserialization, and wait-free synchronization.

Language: Rust - Size: 80.1 KB - Last synced at: 9 days ago - Pushed at: 5 months ago - Stars: 553 - Forks: 44

acln0/zerocopy

Zero-copy I/O primitives and pipelines for Go. Linux-specific.

Language: Go - Size: 40 KB - Last synced at: 3 days ago - Pushed at: 10 months ago - Stars: 546 - Forks: 35

simonhf/sharedhashfile

Share Hash Tables With Stable Key Hints Stored In Memory Mapped Files Between Arbitrary Processes

Language: C - Size: 465 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 448 - Forks: 70

udoprog/musli

Müsli is a flexible and efficient serialization framework

Language: Rust - Size: 66.9 MB - Last synced at: 9 days ago - Pushed at: 20 days ago - Stars: 387 - Forks: 17

Flow-IPC/ipc

[Start here!] Flow-IPC - Modern C++ toolkit for high-speed inter-process communication (IPC)

Language: C++ - Size: 162 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 387 - Forks: 15

only-cliches/NoProto

Flexible, Fast & Compact Serialization with RPC

Language: Rust - Size: 41.9 MB - Last synced at: 14 days ago - Pushed at: about 2 years ago - Stars: 374 - Forks: 13

xfbs/imstr

Immutable strings, in Rust.

Language: Rust - Size: 305 KB - Last synced at: 5 days ago - Pushed at: over 1 year ago - Stars: 245 - Forks: 13

voidDB/voidDB

A transactional key-value database written in Go for Linux and macOS

Language: Go - Size: 171 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 185 - Forks: 3

ZhenshengLee/ros2_shm_msgs

ROS2 shm_msg based zero-copy for image and pointcloud.

Language: C++ - Size: 9.9 MB - Last synced at: 27 days ago - Pushed at: 5 months ago - Stars: 142 - Forks: 23

J-Schoepplenberg/zero-packet

A zero-copy Rust library that builds and parses network packets in-place.

Language: Rust - Size: 155 KB - Last synced at: 28 days ago - Pushed at: 2 months ago - Stars: 112 - Forks: 4

databento/dbn

Databento Binary Encoding (DBN) - Fast message encoding and storage format for market data

Language: Rust - Size: 1.74 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 108 - Forks: 14

MengRao/WFMPMC

A bounded wait-free(almost) zero-copy MPMC queue written in C++11, which can also reside in SHM for IPC

Language: C++ - Size: 77.1 KB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 103 - Forks: 32

tugrul512bit/Cekirdekler

Multi-device OpenCL kernel load balancer and pipeliner API for C#. Uses shared-distributed memory model to keep GPUs updated fast while using same kernel on all devices(for simplicity).

Language: C# - Size: 10.6 MB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 86 - Forks: 9

dholroyd/mpeg2ts-reader

Rust reader for MPEG2 Transport Stream data

Language: Rust - Size: 530 KB - Last synced at: 23 days ago - Pushed at: about 1 month ago - Stars: 55 - Forks: 14

HBPVIS/ZeroBuf

zero-copy, zero-serialize, zero-hassle protocol buffers

Language: C++ - Size: 1.46 MB - Last synced at: about 1 year ago - Pushed at: over 7 years ago - Stars: 54 - Forks: 18

GeniusesGroup/memar-go

Developing software framework for the GO programming language

Language: Go - Size: 1.79 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 42 - Forks: 5

tier4/agnocast

True Zero Copy Communication Middleware for Unsized ROS 2 Message Types.

Language: C - Size: 1.1 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 41 - Forks: 0

avitex/rust-zc

Rust library providing `Zc` for self-referential zero-copy structures

Language: Rust - Size: 155 KB - Last synced at: 24 days ago - Pushed at: over 4 years ago - Stars: 41 - Forks: 1

Ygg01/Linguini

C# Port of fluent.rs zero-copy parser

Language: C# - Size: 697 KB - Last synced at: about 16 hours ago - Pushed at: 2 months ago - Stars: 34 - Forks: 10

pragus/gonetmap

Golang binding for netmap https://github.com/luigirizzo/netmap

Language: Go - Size: 38.1 KB - Last synced at: 12 months ago - Pushed at: over 6 years ago - Stars: 30 - Forks: 5

niXman/flatjson

The extremely fast zero allocation and zero copying JSON parser

Language: C++ - Size: 13 MB - Last synced at: 2 days ago - Pushed at: over 2 years ago - Stars: 29 - Forks: 5

charlesvdv/nom-bibtex

A feature complete bibtex parser using nom

Language: Rust - Size: 5.04 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 25 - Forks: 15

evasnowind/framework-dev-learning

常见框架开发技术的demo汇总，包括java字节码编程（java agent, instrument, byte buddy）, java动态代理，自定义classloader，java spi, zero copy, netty, spring aop/condition，spring boot starter, 数据库连接池等。

Language: Java - Size: 933 KB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 25 - Forks: 7

DavidBuchanan314/unPNG

A backward-compatible subset of the PNG file format, for uncompressed bitmaps

Language: C - Size: 43.9 KB - Last synced at: 1 day ago - Pushed at: 9 months ago - Stars: 24 - Forks: 2

red-9m/libipc

Industry-proven, lightweight and productive zero-copy IPC library written in C

Language: C - Size: 25.4 KB - Last synced at: almost 2 years ago - Pushed at: over 5 years ago - Stars: 20 - Forks: 2

JeffyCN/xorg-xserver

X server with glamor hacks for gles2 and rga based exa

Language: C - Size: 58.5 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 18 - Forks: 26

chusitoo/flatbush

Flatbush for C++

Language: C++ - Size: 122 KB - Last synced at: 23 days ago - Pushed at: 4 months ago - Stars: 18 - Forks: 0

hslam/splice

Package splice wraps the splice system call.

Language: Go - Size: 36.1 KB - Last synced at: about 1 month ago - Pushed at: over 4 years ago - Stars: 17 - Forks: 2

althonos/iocursor

A zero-copy file-like wrapper for Python byte buffers, inspired by Rust's std::io::Cursor.

Language: C - Size: 63.5 KB - Last synced at: 12 days ago - Pushed at: about 2 years ago - Stars: 15 - Forks: 2

mzabaluev/chunked-bytes

A non-contiguous byte output buffer for Rust

Language: Rust - Size: 119 KB - Last synced at: 28 days ago - Pushed at: over 4 years ago - Stars: 14 - Forks: 2

elkodon/elkodon 📦

Elkodon - true zero-copy inter-process-communication in rust

Language: Rust - Size: 990 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 13 - Forks: 3

quininer/tokio-linux-zio

[deprecated] Tokio Linux zero-copy IO

Language: Rust - Size: 25.4 KB - Last synced at: 11 days ago - Pushed at: over 1 year ago - Stars: 13 - Forks: 1

hazae41/fleche

Zero-copy HTTP protocol for the web 🏎️ (JS + WebAssembly)

Language: TypeScript - Size: 772 KB - Last synced at: 5 days ago - Pushed at: 9 months ago - Stars: 12 - Forks: 2

FelixMcFelix/discortp

Lightweight, multipurpose rust library for handling RTP streams.

Language: Rust - Size: 38.1 KB - Last synced at: 22 days ago - Pushed at: over 1 year ago - Stars: 12 - Forks: 1

hslam/sendfile

Package sendfile wraps the sendfile system call.

Language: Go - Size: 21.5 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 0

dsirotkin256/matching-cpp 📦

Order matching engine

Language: C++ - Size: 951 KB - Last synced at: 4 months ago - Pushed at: over 3 years ago - Stars: 10 - Forks: 1

hevz/gst-amc-sink

The Android media codec video sink for GStreamer 1.0

Language: C - Size: 59.6 KB - Last synced at: 5 days ago - Pushed at: over 4 years ago - Stars: 10 - Forks: 2

hazae41/cadenas

Zero-copy TLS protocol for the web 🏎️ (JS + WebAssembly)

Language: TypeScript - Size: 1.61 MB - Last synced at: about 2 months ago - Pushed at: 9 months ago - Stars: 9 - Forks: 0

ZhenshengLee/ros2_v4l2_camera

ros2_v4l2_camera with shm_msg based zero-copy and more!

Language: Jupyter Notebook - Size: 277 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 8 - Forks: 2

Flow-IPC/ipc_shm

Flow-IPC Sub-project - Shared Memory - End-to-end zero-copy transport support; direct work with SHM; SHM-classic provider [See `ipc` repo first]

Language: C++ - Size: 288 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 7 - Forks: 1

pjsny/macos-zero-copy-ipc

Zero-copy IPC for macOS: POSIX shared memory, lock-free patterns, and Apple Silicon SIMD optimizations

Language: C - Size: 47.9 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 7 - Forks: 0

zhukao/ros2_comm_examples

ros2不同通信方式的使用示例，包括进程间（inter process）、零拷贝（zero copy）、进程内（intra process）通信，并结合测试数据和通信机制分析不同通信方式的性能差异。

Language: C++ - Size: 16.6 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 6 - Forks: 2

d-plaindoux/parsec.rust

Rust Parser Combinators

Language: Rust - Size: 1.28 MB - Last synced at: 2 months ago - Pushed at: almost 6 years ago - Stars: 6 - Forks: 0

apofiget/netlink-example

Linux Netlink example

Language: C - Size: 12.7 KB - Last synced at: almost 2 years ago - Pushed at: over 8 years ago - Stars: 6 - Forks: 5

KSXGitHub/zero-copy-pads

Padding/aligning values without heap allocation

Language: Rust - Size: 103 KB - Last synced at: 25 days ago - Pushed at: about 2 years ago - Stars: 5 - Forks: 0

bitmeal/ueye-wrapper

iDS uEye camera C++ wrapper with dead simple (but limited) interface - high performance asynchronous concurrent image capture with zero-copy

Language: C++ - Size: 118 KB - Last synced at: 2 months ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 1

jemc/pony-rope

Pony implementation of a rope data structure for efficient, zero-copy manipulation of byte buffers.

Language: Pony - Size: 7.81 KB - Last synced at: 3 months ago - Pushed at: about 6 years ago - Stars: 5 - Forks: 2

maxxhuang/zero-copy-in-java-and-webflux

A dockerized application exemplifying copying files in Java and serving files in Spring Webflux with and without "Zero Copy" mechanism

Language: Java - Size: 18.8 MB - Last synced at: over 1 year ago - Pushed at: about 7 years ago - Stars: 5 - Forks: 1

jzombie/rust-simd-r-drive

Zero-copy access, schema-less, append-only, SIMD-optimized binary storage engine for Rust.

Language: Rust - Size: 166 KB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 4 - Forks: 0

zacharygolba/to2txt

🚧 Rewriting 🚧 A zero-copy parser for the todo.txt format

Language: Rust - Size: 152 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 4 - Forks: 0

maandree/shr 📦

n-fold buffered shared memory segment for low-latency data streaming

Language: C - Size: 50.8 KB - Last synced at: 2 months ago - Pushed at: 8 months ago - Stars: 4 - Forks: 1

demiryavas/sip-parser

SIP message parser with zero-copy approach

Language: C - Size: 523 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 4 - Forks: 1

franz1981/franz_flow

Single Consumer implementations of a fixed & variable sized FastFlow-Lamport-Thompson ring-buffers

Language: C - Size: 46.9 KB - Last synced at: about 1 month ago - Pushed at: about 8 years ago - Stars: 4 - Forks: 1

TuxCoding/pwned-check

Check passwords against the offline haveibeenpwned database with focus on performance, but without any index or conversions

Language: Rust - Size: 182 KB - Last synced at: 3 days ago - Pushed at: 3 months ago - Stars: 3 - Forks: 2

hazae41/binary

Zero-copy binary data types 🏎️

Language: TypeScript - Size: 310 KB - Last synced at: about 2 months ago - Pushed at: 9 months ago - Stars: 3 - Forks: 1

JeffyCN/mpv Fork of mpv-player/mpv

MPV with vo_xv/vo_opengl hacks

Language: C - Size: 86.3 MB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 3 - Forks: 3

Reve1988/zero-copy

This is a tool for testing zero copy using Java.

Language: Java - Size: 729 KB - Last synced at: over 2 years ago - Pushed at: about 6 years ago - Stars: 3 - Forks: 2

franz1981/franz-flow-j

Single Consumer implementations of a fixed & variable sized FastFlow-Lamport-Thompson ring-buffers

Language: Java - Size: 55.7 KB - Last synced at: 3 months ago - Pushed at: over 8 years ago - Stars: 3 - Forks: 1

mausys/rtipc

Real-Time IPC, based on a zero-copy, lock-free triple buffer implementation.

Language: C - Size: 164 KB - Last synced at: 24 days ago - Pushed at: 25 days ago - Stars: 2 - Forks: 1

hazae41/x509

Zero-copy X.509 certificates for the web 🏎️

Language: TypeScript - Size: 875 KB - Last synced at: 18 days ago - Pushed at: 9 months ago - Stars: 2 - Forks: 0

hazae41/asn1

Zero-copy ASN.1 and DER coding 🏎️

Language: TypeScript - Size: 825 KB - Last synced at: 13 days ago - Pushed at: 9 months ago - Stars: 2 - Forks: 2

scaledteam/obs-studio Fork of obsproject/obs-studio

Fork OBS Studio to enable zero-copy KMSGrab capture

Language: C - Size: 61.6 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

aabbdev/UniSerializer

Fast and efficient universal data serializer

Language: C - Size: 35.2 KB - Last synced at: 4 days ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

crystal-dataop/crystal

A data storage and analysis library.

Language: C++ - Size: 592 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 2 - Forks: 0

isilence/libdmt

abstraction library for devices memory copy with cross-framework support

Language: C - Size: 90.8 KB - Last synced at: almost 2 years ago - Pushed at: about 7 years ago - Stars: 2 - Forks: 1

intob/peregrine

A high-performance HTTP server, written from scratch in Zig. Built on kqueue/epoll.

Language: Zig - Size: 223 KB - Last synced at: 2 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

jalalmostafa/mining-afxdp

Mining Linux Kernel Repositories to extract knowledge about AF_XDP

Language: Python - Size: 8.79 KB - Last synced at: 3 months ago - Pushed at: 10 months ago - Stars: 1 - Forks: 0

francc/bigpacks

BigPacks is a data serialization format designed for 32-bit microcontrollers. It aims at being minimal and fast, without obsessing over achieving the smallest possible binary representation.

Language: Python - Size: 113 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

PzaThief/benchmark-go-multipart

benchmark of various http file send method

Language: Go - Size: 6.84 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

yourarj/solana-anchor-zero-copy

demo for zero-copy accounts with anchor framework

Language: TypeScript - Size: 35.2 KB - Last synced at: 3 months ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 0

demiryavas/in-situMQTT

In-situ MQTT Parser in C

Language: C - Size: 35.2 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 1

paulohrpinheiro/mycp

Meus experimentos em copiar um arquivo na linguagem C em Linux

Language: C - Size: 6.84 KB - Last synced at: 10 days ago - Pushed at: about 7 years ago - Stars: 1 - Forks: 0

The concept of zero-copy in Rust refers to a technique of working with data in memory without making unnecessary copies, which significantly improves performance, particularly in high-throughput and low-latency environments. Since no data is copied, zero-copy, facilitated by references, leads to significant performance gains/

Size: 943 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 0 - Forks: 0

NotQuis/cpp-match

cpp-match is a powerful C++ library for pattern matching and functional-style programming, allowing developers to write concise and expressive code for handling complex data structures efficiently. The library provides a clean and intuitive syntax for matching patterns, making it easier to work with data in a functional programming paradigm.

Language: C++ - Size: 24.4 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 0 - Forks: 0

pshdev0/viewbuffer

ViewBuffer - Schemaless Codeless Self-Describing Zero-Copy Flat Buffer for D, Java, etc

Language: Java - Size: 693 KB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 0 - Forks: 0

Laugharne/solana_optimized_programs

This video transcription explores techniques for optimizing Solana programs, focusing on the efficiency of computation, storage, and data. It includes practical tips, code examples, and performance comparisons between different frameworks such as Anchor and Pinocchio, as well as optimizations in assembly language.

Size: 99.6 KB - Last synced at: 2 days ago - Pushed at: 14 days ago - Stars: 0 - Forks: 0

Priyabug/Efficient-Data-Transfer-with-RDMA-Memory-Registration-and-Request-Handling

This project explores efficient data transfer mechanisms using RDMA, focusing on memory registration, request handling, and performance optimizations.Here we can see the demonstration of how RDMA improves network efficiency by bypassing the operating system kernel and offloading data movement to the network interface card.

Language: C - Size: 15.6 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

tommygrammar/Optimized-Networked-Distributed-Systems

This is a distributed systems project where I was enhancing data access and transmission speeds using memory optimizations and zero copy networking techniques.

Language: C - Size: 7.81 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0

teragrep/net_01

Teragrep zero copy networking library for Java

Language: Java - Size: 43.9 KB - Last synced at: about 2 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 3

ShawnJeffersonWang/netty

This project focuses on Java NIO (Non-blocking I/O) and its three main components: Channels, Buffers, and Selectors. It includes examples of network programming, zero-copy techniques, I/O models, and the Netty framework.

Language: Java - Size: 50.8 KB - Last synced at: 4 days ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

sashamakarenko/icp

Immutable and Compact Pointers to reduce memory footprint in C++ apps

Language: C++ - Size: 44.9 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Banyc/field_block

A definition language for buffer parsing. No code gen. Restrict business code to outside of the codec.

Language: Rust - Size: 47.9 KB - Last synced at: 16 days ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

sinainnet/zcgh-qemu-virtio

Size: 1000 Bytes - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

lmlg/zser

zero-copy (de)serialization for python

Language: Python - Size: 146 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

mossmaurice/iceoryx Fork of eclipse-iceoryx/iceoryx

iceoryx project

Language: C++ - Size: 3.27 MB - Last synced at: about 1 month ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0