data-storage | Topic | Ecosyste.ms: Repos

Topic: "data-storage"

ammarahm-ed/react-native-mmkv-storage

An ultra fast (0.0002s read/write), small & encrypted mobile key-value storage framework for React Native written in C++ using JSI

Language: C++ - Size: 4.54 MB - Last synced at: 19 days ago - Pushed at: about 1 month ago - Stars: 1,750 - Forks: 121

fstpackage/fst

Lightning Fast Serialization of Data Frames for R

Language: R - Size: 2.34 MB - Last synced at: 8 months ago - Pushed at: over 1 year ago - Stars: 625 - Forks: 41

datalad/datalad

Keep code, data, containers under control with git and git-annex

Language: Python - Size: 40.5 MB - Last synced at: 15 days ago - Pushed at: 16 days ago - Stars: 619 - Forks: 117

qsbase/qs

Quick serialization of R objects

Language: C - Size: 4.72 MB - Last synced at: 26 days ago - Pushed at: 2 months ago - Stars: 433 - Forks: 20

JuliaIO/HDF5.jl

Save and load data in the HDF5 file format from Julia

Language: Julia - Size: 10.7 MB - Last synced at: about 1 hour ago - Pushed at: 6 days ago - Stars: 407 - Forks: 143

knoxite/knoxite

A data storage & backup system

Language: Go - Size: 836 KB - Last synced at: 9 months ago - Pushed at: over 2 years ago - Stars: 290 - Forks: 27

JuliaIO/JLD.jl

Saving and loading julia variables while preserving native types

Language: Julia - Size: 1.34 MB - Last synced at: about 9 hours ago - Pushed at: about 1 month ago - Stars: 285 - Forks: 55

45Drives/autotier

A passthrough FUSE filesystem that intelligently moves files between storage tiers based on frequency of use, file age, and tier fullness.

Language: C++ - Size: 6.16 MB - Last synced at: 9 months ago - Pushed at: almost 2 years ago - Stars: 285 - Forks: 15

pracdata/awesome-open-source-data-engineering

A curated list of open source tools used in analytics platforms and data engineering ecosystem

Size: 219 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 274 - Forks: 29

karthik/rdrop2

Dropbox Interface from R

Language: R - Size: 1.21 MB - Last synced at: 4 months ago - Pushed at: almost 2 years ago - Stars: 253 - Forks: 60

airscholar/e2e-data-engineering

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

Language: Python - Size: 289 KB - Last synced at: 8 months ago - Pushed at: 11 months ago - Stars: 250 - Forks: 123

ganweisoft/Gateway

Gateway is a high-performance, centralized communication and scheduling module for various device plugins. It uniformly converts heterogeneous data into standardized models and delivers core functionalities such as real-time data storage, alarm triggering, linkage control, and task planning.

Language: C# - Size: 196 KB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 232 - Forks: 1

GridProtectionAlliance/openHistorian

The Open Source Time-Series Data Historian

Language: TypeScript - Size: 2.8 GB - Last synced at: 12 days ago - Pushed at: 14 days ago - Stars: 194 - Forks: 53

Weedshaker/PeerWebSite

Peer to Peer decentral Web Site hosting at your fingertips! Send full featured HTML (incl. CSS, JS) sites from your browser and attach files eg. videos, audios, images, etc.

Language: JavaScript - Size: 85.1 MB - Last synced at: 2 days ago - Pushed at: about 1 year ago - Stars: 194 - Forks: 26

GlitterWare/Passy

Offline password manager with cross-platform synchronization

Language: Dart - Size: 11.5 MB - Last synced at: 2 days ago - Pushed at: 3 days ago - Stars: 176 - Forks: 25

marceloboeira/bojack 📦

🐴 The unreliable key-value store

Language: Crystal - Size: 413 KB - Last synced at: 10 months ago - Pushed at: almost 8 years ago - Stars: 109 - Forks: 13

lf-edge/edge-home-orchestration-go

Home Edge Project in LF Edge - Edge Orchestration for home edge devices to enabling smart home use cases.

Language: Go - Size: 5.14 MB - Last synced at: 25 days ago - Pushed at: 8 months ago - Stars: 100 - Forks: 51

artiomn/NAS

Scripts and config files for the secure Linux-based multiservice server on ZFS

Language: Python - Size: 21.8 MB - Last synced at: 9 months ago - Pushed at: over 4 years ago - Stars: 71 - Forks: 22

Jayvardhan-Reddy/Azure-Certification-DP-200

Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution

Size: 4.42 MB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 57 - Forks: 46

hegongshan/Storage-for-AI-Paper

Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)

Size: 29.3 KB - Last synced at: 18 days ago - Pushed at: 22 days ago - Stars: 56 - Forks: 5

qsbase/qs2

Language: C - Size: 34.9 MB - Last synced at: 13 days ago - Pushed at: about 2 months ago - Stars: 55 - Forks: 2

bearframework/bearframework

An open-source PHP framework. Incredibly lightweight. Powerful enough.

Language: PHP - Size: 1.24 MB - Last synced at: about 1 month ago - Pushed at: 7 months ago - Stars: 46 - Forks: 8

msdeep14/DeepDataBase

A relational database engine using B+ tree indexing

Language: C++ - Size: 6.96 MB - Last synced at: 2 months ago - Pushed at: over 4 years ago - Stars: 46 - Forks: 12

PFund-Software-Ltd/pfeed

Data Engine for Manual/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.

Language: Python - Size: 5.62 MB - Last synced at: 2 days ago - Pushed at: 5 days ago - Stars: 29 - Forks: 5

MannLabs/alpharaw

An open-source Python package to unify raw MS data accession and storage.

Language: Python - Size: 62.2 MB - Last synced at: 18 days ago - Pushed at: 21 days ago - Stars: 29 - Forks: 11

mozilla-lockwise/lockbox-datastore 📦

Experimental Data Storage module for Firefox Lockbox project, not being actively developed

Language: JavaScript - Size: 1.27 MB - Last synced at: 4 months ago - Pushed at: over 7 years ago - Stars: 28 - Forks: 3

bitdust-io/public

BitDust project source codes : official Public Git repository (mirror on GitHub) : https://bitdust.io

Language: Python - Size: 16.2 MB - Last synced at: 4 days ago - Pushed at: 5 months ago - Stars: 25 - Forks: 3

bitdust-io/devel

BitDust project source codes development cycle, official Development Git repository (mirror on GitHub) : https://bitdust.io

Language: Python - Size: 84.3 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 24 - Forks: 14

deverte/awesome-science

A currated list of awesome scientific software, libraries and services.

Language: Just - Size: 880 KB - Last synced at: 2 days ago - Pushed at: over 1 year ago - Stars: 24 - Forks: 3

gbeckers/Darr

A Python library for numpy arrays that persist on disk in a format that is simple, self-documented and tool-independent, and maximizes universal readability.

Language: Python - Size: 1.85 MB - Last synced at: about 1 month ago - Pushed at: 6 months ago - Stars: 23 - Forks: 3

ZorPastaman/Event-Based-Blackboard

Event Based Blackboard for Unity is a flexible data storage that can contain any count of properties of any type. The properties can be accessed with property names.

Language: C# - Size: 86.9 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 19 - Forks: 0

gerold-penz/bun-sqlite-key-value

A super fast key-value store with SQLite that uses bun:sqlite and v8 as a fast JSON replacement.

Language: TypeScript - Size: 613 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 19 - Forks: 1

aureleoules/bitcandle

Store data on Bitcoin for 350 sats/KB up to 185 KB by using P2SH-P2WSH witness scripts

Language: Go - Size: 70.3 KB - Last synced at: 9 months ago - Pushed at: over 1 year ago - Stars: 19 - Forks: 3

CodingSamrat/FileXdb.py

A lightweight, dependency-free, file-based NoSQL database for Python with simple collection/document APIs.

Language: Python - Size: 52.7 KB - Last synced at: 16 days ago - Pushed at: almost 2 years ago - Stars: 19 - Forks: 2

AAROC/DevOps

DevOps code to deploy eScience services

Language: Jinja - Size: 43.7 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 19 - Forks: 39

khoih-prog/RP2040_SD 📦

This library enables you to use SPI SD cards with RP2040-based boards such as Nano_RP2040_Connect, RASPBERRY_PI_PICO using either RP2040 Arduino-mbed or arduino-pico core. This SD-Fat v2 can support FAT16, FAT32, exFAT file systems. exFAT supports files larger than 4GB by using uint64_t as file offset.

Language: C++ - Size: 149 KB - Last synced at: almost 3 years ago - Pushed at: about 3 years ago - Stars: 16 - Forks: 4

gamontal/mongod-starter

:bug: A menu bar helper for starting your local MongoDB Server.

Language: Swift - Size: 378 KB - Last synced at: over 1 year ago - Pushed at: about 5 years ago - Stars: 15 - Forks: 2

ivopetkov/object-storage

A better way to work with files. Metadata available too.

Language: PHP - Size: 163 KB - Last synced at: 4 months ago - Pushed at: 9 months ago - Stars: 14 - Forks: 0

krassowski/data-vault

IPython magic for simple, organized, compressed and encrypted: storage & transfer of files between notebooks.

Language: Python - Size: 81.1 KB - Last synced at: 4 months ago - Pushed at: about 3 years ago - Stars: 13 - Forks: 2

kevinkhanda/bubba-db

Graph database developed on Go

Language: Go - Size: 364 KB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 13 - Forks: 2

Dina-Hosny/ChainCare

ChainCare is a health information system that uses smart contracts to handle medical procedures and stores the medical history in Block Chains.

Language: JavaScript - Size: 67.9 MB - Last synced at: 6 months ago - Pushed at: almost 3 years ago - Stars: 12 - Forks: 3

rundef/chronostore

Fast binary time series store for Python. No DB, no server, just mmap.

Language: Jupyter Notebook - Size: 175 KB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 11 - Forks: 0

abeltavares/MarketPipe

🛠 Containerized and configurable Airflow ETL pipeline for collecting and storing stock and cryptocurrency market data.

Language: Python - Size: 664 KB - Last synced at: 9 months ago - Pushed at: 12 months ago - Stars: 11 - Forks: 0

CREDITSCOM/Documentation

Project documents

Size: 4.97 MB - Last synced at: almost 3 years ago - Pushed at: over 6 years ago - Stars: 11 - Forks: 91

nuzulul/kv-storage

💾 Create data storage that uses a simple key-value method for Node, Browser, Deno, Bun, Cloudflare Workers

Language: TypeScript - Size: 74.2 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 1

Dangerous-Community/Dangerous-net

The cloud storage / internet system for cypher punks, decentralized enthusiasts and bio-hackers. Built on a Proof of Storage mentality, You can pass all of your files, messages, and data through the private network. Secure them in a MFA and implant focused (AES) approach to data processing and encryption.

Language: Go - Size: 27.6 MB - Last synced at: 3 months ago - Pushed at: about 2 years ago - Stars: 10 - Forks: 0

khoih-prog/LittleFS_Mbed_RP2040 📦

Wrapper of LittleFS for Arduino MBED RP2040 boards. This library facilitates your usage of LittleFS for the onboard flash. LittleFS supports power fail safety and high performance

Language: C++ - Size: 5.41 MB - Last synced at: almost 3 years ago - Pushed at: about 3 years ago - Stars: 10 - Forks: 4

labex-labs/practice-mysql-programming-projects

Build real MySQL projects with 85 beginner-friendly challenges. Learn by doing with guided coding exercises and practical applications.

Size: 58.6 KB - Last synced at: 5 days ago - Pushed at: 3 months ago - Stars: 9 - Forks: 0

Geobatpo07/datahut-duckhouse

DataHut-DuckHouse is a modern, modular, and multi-tenant analytics platform that combines DuckDB, Apache Iceberg, Arrow Flight, dbt, and Trino to build a hybrid, lightweight, and scalable data stack ready for SaaS.

Language: Python - Size: 507 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 9 - Forks: 0

ricmua/nml_bag

A simple Python package for working with ROS2 bag files

Language: Python - Size: 30.3 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 9 - Forks: 6

js2me/stonex

💡 Simple state container for JavaScript/TypeScript applications 💡

Language: TypeScript - Size: 1.02 MB - Last synced at: about 2 months ago - Pushed at: about 3 years ago - Stars: 9 - Forks: 0

ian-andrich/StorageCombinatorsPython

Language: Python - Size: 63.5 KB - Last synced at: over 2 years ago - Pushed at: about 4 years ago - Stars: 9 - Forks: 1

utsmannn/pocketdb

Android SharedPreferences Helper

Language: Kotlin - Size: 156 KB - Last synced at: almost 3 years ago - Pushed at: over 5 years ago - Stars: 9 - Forks: 5

scheb/in-memory-data-storage 📦

A simple in-memory data storage for PHP

Language: PHP - Size: 54.7 KB - Last synced at: 6 months ago - Pushed at: over 6 years ago - Stars: 9 - Forks: 2

bocaletto-luca/PhoneBook

This is a Python application that implements a simple phone book with a graphical user interface (GUI) using PyQt5. The application allows users to add, view and delete phone contacts. Furthermore, it offers an "About" function to display information about the author of the application.

Language: Python - Size: 23.4 KB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 8 - Forks: 0

bocaletto-luca/SD-Card-Format

SD-Card Format Free is a software application developed by Luca Bocaletto to simplify the process of formatting SD memory cards. This software offers an intuitive and user-friendly interface that allows users to quickly format their SD cards in FAT32 format.

Language: Python - Size: 24.4 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 8 - Forks: 0

ayaanhossain/ShareDB

An on-disk pythonic embedded key-value store for compressed data storage and distributed data analysis

Language: Python - Size: 1.76 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 8 - Forks: 0

stillmatic/catcher

Catcher: Drop in caching for R functions

Language: R - Size: 29.3 KB - Last synced at: 7 months ago - Pushed at: about 7 years ago - Stars: 8 - Forks: 1

Polyfrost/DataStorage

Static data storage for Polyfrost projects.

Language: HTML - Size: 7.71 MB - Last synced at: 14 days ago - Pushed at: 16 days ago - Stars: 7 - Forks: 8

jflatdb/jflatdb

jflatdb — The next-gen lightweight JSON database for Python, built for speed, simplicity, and secure local data management.

Language: Python - Size: 220 KB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 7 - Forks: 13

RNABioInfo/rna-interaction-format

RNA Interaction Format (RIF) with reference implementations in C++, JavaScript, and Python

Language: C++ - Size: 298 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 7 - Forks: 0

petrosDemetrakopoulos/ethairballoons-CRUD-API

A CRUD REST API for EthairBalloons library

Language: Solidity - Size: 966 KB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 7 - Forks: 3

khoih-prog/FS_Nano33BLE 📦

Wrapper of FS (LittleFS or not-advisable FATFS) for Arduino MBED nRF52840-based boards, such as Nano_33_BLE boards. This library facilitates your usage of FS (LittleFS or FATFS) for the onboard flash. FS supports power fail safety and high performance

Language: C++ - Size: 82 KB - Last synced at: almost 3 years ago - Pushed at: about 3 years ago - Stars: 7 - Forks: 1

khoih-prog/FlashStorage_STM32F1 📦

The FlashStorage_STM32F1 library aims to provide a convenient way to store and retrieve user's data using the non-volatile flash memory of STM32F1/F3. It's using the buffered read and write to minimize the access to Flash. It now supports writing and reading the whole object, not just byte-and-byte. New STM32 core v2.0.0 is supported now. Useful if the EEPROM is not available or too small. Currently, STM32F1/F3 are supported.

Language: C - Size: 314 KB - Last synced at: almost 3 years ago - Pushed at: about 3 years ago - Stars: 7 - Forks: 3

Darnelo-Inc/sky-storage

MERN: Fullstack cloud storage project includes standard remote storage functionality, as well as data backup and sync capabilities between devices | React / TypeScript / SCSS / Redux Toolkit / RTK Query / NodeJS / ExpressJS / MongoDB

Language: TypeScript - Size: 5.59 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 6 - Forks: 0

mimesis-inria/SimulationSimpleDatabase

SQL for numerical simulations.

Language: Python - Size: 9.56 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 6 - Forks: 2

onedionys/onedionys-data-storage

A simple abstraction for storing and retrieving data from local storage or session storage.

Language: JavaScript - Size: 142 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 0

buildersoftio/andyxstorage

Buildersoft Andy X Data Storage. This project will be deprecated by the end of 2022

Language: C# - Size: 1.63 MB - Last synced at: over 2 years ago - Pushed at: over 3 years ago - Stars: 6 - Forks: 0

AnotherKamila/stalky

Self-hosted app to keep track of anything you want. Don't let others stalk you, stalk yourself!

Language: Elm - Size: 435 KB - Last synced at: 9 months ago - Pushed at: over 4 years ago - Stars: 6 - Forks: 2

petrbouchal/purrrow

R package for iteratively collating Arrow datasets out of memory

Language: R - Size: 979 KB - Last synced at: 3 months ago - Pushed at: almost 5 years ago - Stars: 6 - Forks: 1

AmphibiaWeb/amphibian-disease-tracker 📦

Amphibian Disease Tracker Portal

Language: HTML - Size: 246 MB - Last synced at: almost 3 years ago - Pushed at: almost 5 years ago - Stars: 6 - Forks: 0

willow385/tapelion 📦

A collection of programs for reading and writing data on cassette tapes with modern computers. Can also be used for storing data on other audio recording mediums and for transmitting data via audio cables.

Language: Python - Size: 35.2 KB - Last synced at: almost 2 years ago - Pushed at: about 6 years ago - Stars: 6 - Forks: 2

alexbrt/DNAdrive

DNAdrive is a science project which makes data storage in bacteria possible. Given binary data, it constructs DNA sequences (aka packets) which can be used as protospacers in CRISPR-based systems, such as the one found in Escherichia Coli. 🔬

Language: C++ - Size: 717 KB - Last synced at: 11 months ago - Pushed at: about 7 years ago - Stars: 6 - Forks: 0

omnixerio/ubo

NBT inspired data I/O. Made for games.

Language: Java - Size: 774 KB - Last synced at: 4 days ago - Pushed at: 5 months ago - Stars: 5 - Forks: 1

midassystems/mbinary

A binary encoding library designed for efficient data storage and transportation in trading platforms.

Language: Rust - Size: 403 KB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 5 - Forks: 1

nathadriele/cnpj-data-pipeline

The CNPJ Data ETL Pipeline is designed to automate the download, processing, and storage of public CNPJ data from the Brazilian Federal Revenue. The pipeline is built with Mage.ai and AWS S3 to ensure efficient data management and scalability.

Language: Python - Size: 46.9 KB - Last synced at: 10 months ago - Pushed at: 11 months ago - Stars: 5 - Forks: 0

kfrancischen/pslx

Python Standard Library eXtension

Language: Python - Size: 1.82 MB - Last synced at: 7 months ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 1

the-code-genin/Simple-JWT-API

A simple JWT powered API boiler plate written in NodeJS/Typescript and uses an SQL database for data storage out of the box.

Language: TypeScript - Size: 434 KB - Last synced at: almost 3 years ago - Pushed at: about 3 years ago - Stars: 5 - Forks: 0

bigin/ItemManager_2.0 📦

ItemManager (IM) is a simple flat-file framework for GetSimple-CMS that allows you to develop completely customizable PHP applications bundled with GetSimple-CMS.

Language: PHP - Size: 6.87 MB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 5 - Forks: 3