data-storage | Topic | Ecosyste.ms: Repos

Topic: "data-storage"

ammarahm-ed/react-native-mmkv-storage

An ultra fast (0.0002s read/write), small & encrypted mobile key-value storage framework for React Native written in C++ using JSI

Language: C++ - Size: 4.44 MB - Last synced at: 7 days ago - Pushed at: 6 months ago - Stars: 1,680 - Forks: 117

fstpackage/fst

Lightning Fast Serialization of Data Frames for R

Language: R - Size: 2.34 MB - Last synced at: 16 days ago - Pushed at: 8 months ago - Stars: 625 - Forks: 41

datalad/datalad

Keep code, data, containers under control with git and git-annex

Language: Python - Size: 40.2 MB - Last synced at: 9 days ago - Pushed at: 2 months ago - Stars: 571 - Forks: 109

qsbase/qs

Quick serialization of R objects

Language: C - Size: 4.71 MB - Last synced at: 5 days ago - Pushed at: about 2 months ago - Stars: 421 - Forks: 20

JuliaIO/HDF5.jl

Save and load data in the HDF5 file format from Julia

Language: Julia - Size: 9.44 MB - Last synced at: 6 days ago - Pushed at: 14 days ago - Stars: 395 - Forks: 142

knoxite/knoxite

A data storage & backup system

Language: Go - Size: 836 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 290 - Forks: 27

45Drives/autotier

A passthrough FUSE filesystem that intelligently moves files between storage tiers based on frequency of use, file age, and tier fullness.

Language: C++ - Size: 6.16 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 285 - Forks: 15

JuliaIO/JLD.jl

Saving and loading julia variables while preserving native types

Language: Julia - Size: 1.38 MB - Last synced at: 6 days ago - Pushed at: about 1 year ago - Stars: 281 - Forks: 56

pracdata/awesome-open-source-data-engineering

A curated list of open source tools used in analytics platforms and data engineering ecosystem

Size: 219 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 274 - Forks: 29

karthik/rdrop2

Dropbox Interface from R

Language: R - Size: 1.21 MB - Last synced at: 30 days ago - Pushed at: about 1 year ago - Stars: 253 - Forks: 60

airscholar/e2e-data-engineering

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

Language: Python - Size: 289 KB - Last synced at: 30 days ago - Pushed at: 3 months ago - Stars: 240 - Forks: 117

Weedshaker/PeerWebSite

Peer to Peer decentral Web Site hosting at your fingertips! Send full featured HTML (incl. CSS, JS) sites from your browser and attach files eg. videos, audios, images, etc.

Language: JavaScript - Size: 85.1 MB - Last synced at: 4 days ago - Pushed at: 6 months ago - Stars: 185 - Forks: 25

GridProtectionAlliance/openHistorian

The Open Source Time-Series Data Historian

Language: TypeScript - Size: 2.6 GB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 180 - Forks: 50

GlitterWare/Passy

Offline password manager with cross-platform synchronization

Language: Dart - Size: 14.7 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 148 - Forks: 23

marceloboeira/bojack 📦

🐴 The unreliable key-value store

Language: Crystal - Size: 413 KB - Last synced at: about 2 months ago - Pushed at: over 7 years ago - Stars: 109 - Forks: 13

lf-edge/edge-home-orchestration-go

Home Edge Project in LF Edge - Edge Orchestration for home edge devices to enabling smart home use cases.

Language: Go - Size: 5.12 MB - Last synced at: 23 days ago - Pushed at: 25 days ago - Stars: 97 - Forks: 51

artiomn/NAS

Scripts and config files for the secure Linux-based multiservice server on ZFS

Language: Python - Size: 21.8 MB - Last synced at: about 1 month ago - Pushed at: almost 4 years ago - Stars: 71 - Forks: 22

TheSethRose/Time-Capsule 📦

Time Capsule continuously captures and stores digital activities to create a comprehensive memory system. It features real-time audio recording, speech-to-text with Fast-Whisper, plugin support, database storage via Chroma, and a web interface for management. Ideal for documenting life or building digital memories.

Language: Python - Size: 1.46 MB - Last synced at: 2 months ago - Pushed at: 6 months ago - Stars: 69 - Forks: 6

Jayvardhan-Reddy/Azure-Certification-DP-200

Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution

Size: 4.42 MB - Last synced at: almost 2 years ago - Pushed at: almost 5 years ago - Stars: 57 - Forks: 46

bearframework/bearframework

An open-source PHP framework. Incredibly lightweight. Powerful enough.

Language: PHP - Size: 1.37 MB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 46 - Forks: 8

msdeep14/DeepDataBase

A relational database engine using B+ tree indexing

Language: C++ - Size: 6.96 MB - Last synced at: about 1 month ago - Pushed at: almost 4 years ago - Stars: 43 - Forks: 12

mozilla-lockwise/lockbox-datastore 📦

Experimental Data Storage module for Firefox Lockbox project, not being actively developed

Language: JavaScript - Size: 1.27 MB - Last synced at: 30 days ago - Pushed at: over 6 years ago - Stars: 27 - Forks: 3

bitdust-io/public

BitDust project source codes : official Public Git repository (mirror on GitHub) : https://bitdust.io

Language: Python - Size: 16 MB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 24 - Forks: 3

PFund-Software-Ltd/pfeed

Data Engine for Manual/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.

Language: Python - Size: 3.57 MB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 23 - Forks: 5

bitdust-io/devel

BitDust project source codes development cycle, official Development Git repository (mirror on GitHub) : https://bitdust.io

Language: Python - Size: 83.4 MB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 23 - Forks: 14

MannLabs/alpharaw

An open-source Python package to unify raw MS data accession and storage.

Language: Jupyter Notebook - Size: 61.8 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 23 - Forks: 6

gbeckers/Darr

A Python library for numpy arrays that persist on disk in a format that is simple, self-documented and tool-independent, and maximizes universal readability.

Language: Python - Size: 1.91 MB - Last synced at: 15 days ago - Pushed at: 6 months ago - Stars: 23 - Forks: 3

deverte/awesome-science

A currated list of awesome scientific software, libraries and services.

Language: Just - Size: 880 KB - Last synced at: 15 days ago - Pushed at: 8 months ago - Stars: 22 - Forks: 2

qsbase/qs2

Language: C - Size: 34.8 MB - Last synced at: 6 days ago - Pushed at: 2 months ago - Stars: 21 - Forks: 1

aureleoules/bitcandle

Store data on Bitcoin for 350 sats/KB up to 185 KB by using P2SH-P2WSH witness scripts

Language: Go - Size: 70.3 KB - Last synced at: 28 days ago - Pushed at: 11 months ago - Stars: 19 - Forks: 3

AAROC/DevOps

DevOps code to deploy eScience services

Language: Jinja - Size: 43.7 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 19 - Forks: 39

gerold-penz/bun-sqlite-key-value

A super fast key-value store with SQLite that uses bun:sqlite and v8 as a fast JSON replacement.

Language: TypeScript - Size: 622 KB - Last synced at: 29 days ago - Pushed at: 4 months ago - Stars: 18 - Forks: 1

ZorPastaman/Event-Based-Blackboard

Event Based Blackboard for Unity is a flexible data storage that can contain any count of properties of any type. The properties can be accessed with property names.

Language: C# - Size: 86.9 KB - Last synced at: 4 days ago - Pushed at: over 4 years ago - Stars: 18 - Forks: 0

CodingSamrat/FileXdb.py

A lightweight local NoSQL database

Language: Python - Size: 52.7 KB - Last synced at: about 17 hours ago - Pushed at: about 1 year ago - Stars: 17 - Forks: 1

khoih-prog/RP2040_SD 📦

This library enables you to use SPI SD cards with RP2040-based boards such as Nano_RP2040_Connect, RASPBERRY_PI_PICO using either RP2040 Arduino-mbed or arduino-pico core. This SD-Fat v2 can support FAT16, FAT32, exFAT file systems. exFAT supports files larger than 4GB by using uint64_t as file offset.

Language: C++ - Size: 149 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 16 - Forks: 4

hegongshan/Storage-for-AI-Paper

Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)

Size: 16.6 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 15 - Forks: 2

gamontal/mongod-starter

:bug: A menu bar helper for starting your local MongoDB Server.

Language: Swift - Size: 378 KB - Last synced at: about 1 year ago - Pushed at: over 4 years ago - Stars: 15 - Forks: 2

kevinkhanda/bubba-db

Graph database developed on Go

Language: Go - Size: 364 KB - Last synced at: 10 months ago - Pushed at: about 7 years ago - Stars: 13 - Forks: 2

ivopetkov/object-storage

A better way to work with files. Metadata available too.

Language: PHP - Size: 155 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 12 - Forks: 0

Dina-Hosny/ChainCare

ChainCare is a health information system that uses smart contracts to handle medical procedures and stores the medical history in Block Chains.

Language: JavaScript - Size: 67.9 MB - Last synced at: 2 months ago - Pushed at: about 2 years ago - Stars: 12 - Forks: 2

krassowski/data-vault

IPython magic for simple, organized, compressed and encrypted: storage & transfer of files between notebooks.

Language: Python - Size: 81.1 KB - Last synced at: 22 days ago - Pushed at: over 2 years ago - Stars: 12 - Forks: 2

abeltavares/MarketPipe

🛠 Containerized and configurable Airflow ETL pipeline for collecting and storing stock and cryptocurrency market data.

Language: Python - Size: 664 KB - Last synced at: 20 days ago - Pushed at: 4 months ago - Stars: 11 - Forks: 0

CREDITSCOM/Documentation

Project documents

Size: 4.97 MB - Last synced at: about 2 years ago - Pushed at: almost 6 years ago - Stars: 11 - Forks: 91

khoih-prog/LittleFS_Mbed_RP2040 📦

Wrapper of LittleFS for Arduino MBED RP2040 boards. This library facilitates your usage of LittleFS for the onboard flash. LittleFS supports power fail safety and high performance

Language: C++ - Size: 5.41 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 10 - Forks: 4

nuzulul/kv-storage

💾 Create data storage that uses a simple key-value method for Node, Browser, Deno, Bun, Cloudflare Workers

Language: TypeScript - Size: 74.2 KB - Last synced at: 11 days ago - Pushed at: 10 months ago - Stars: 9 - Forks: 0

ricmua/nml_bag

A simple Python package for working with ROS2 bag files

Language: Python - Size: 30.3 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 9 - Forks: 6

js2me/stonex

💡 Simple state container for JavaScript/TypeScript applications 💡

Language: TypeScript - Size: 1.02 MB - Last synced at: 4 days ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 0

ian-andrich/StorageCombinatorsPython

Language: Python - Size: 63.5 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 9 - Forks: 1

utsmannn/pocketdb

Android SharedPreferences Helper

Language: Kotlin - Size: 156 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 9 - Forks: 5

scheb/in-memory-data-storage 📦

A simple in-memory data storage for PHP

Language: PHP - Size: 54.7 KB - Last synced at: 6 months ago - Pushed at: about 6 years ago - Stars: 9 - Forks: 2

Polyfrost/DataStorage

Static data storage for Polyfrost projects.

Size: 200 KB - Last synced at: 3 months ago - Pushed at: 9 months ago - Stars: 8 - Forks: 4

ayaanhossain/ShareDB

An on-disk pythonic embedded key-value store for compressed data storage and distributed data analysis

Language: Python - Size: 1.76 MB - Last synced at: 28 days ago - Pushed at: 6 months ago - Stars: 7 - Forks: 0

Dangerous-Community/Dangerous-net

The cloud storage / internet system for cypher punks, decentralized enthusiasts and bio-hackers. Built on a Proof of Storage mentality, You can pass all of your files, messages, and data through the private network. Secure them in a MFA and implant focused (AES) approach to data processing and encryption.

Language: Go - Size: 27.6 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 0

petrosDemetrakopoulos/ethairballoons-CRUD-API

A CRUD REST API for EthairBalloons library

Language: Solidity - Size: 966 KB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 7 - Forks: 3

khoih-prog/FS_Nano33BLE 📦

Wrapper of FS (LittleFS or not-advisable FATFS) for Arduino MBED nRF52840-based boards, such as Nano_33_BLE boards. This library facilitates your usage of FS (LittleFS or FATFS) for the onboard flash. FS supports power fail safety and high performance

Language: C++ - Size: 82 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 7 - Forks: 1

khoih-prog/FlashStorage_STM32F1 📦

The FlashStorage_STM32F1 library aims to provide a convenient way to store and retrieve user's data using the non-volatile flash memory of STM32F1/F3. It's using the buffered read and write to minimize the access to Flash. It now supports writing and reading the whole object, not just byte-and-byte. New STM32 core v2.0.0 is supported now. Useful if the EEPROM is not available or too small. Currently, STM32F1/F3 are supported.

Language: C - Size: 314 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 7 - Forks: 3

stillmatic/catcher

Catcher: Drop in caching for R functions

Language: R - Size: 29.3 KB - Last synced at: almost 2 years ago - Pushed at: over 6 years ago - Stars: 7 - Forks: 1

mimesis-inria/SimulationSimpleDatabase

SQL for numerical simulations.

Language: Python - Size: 9.56 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 6 - Forks: 2

onedionys/onedionys-data-storage

A simple abstraction for storing and retrieving data from local storage or session storage.

Language: JavaScript - Size: 142 KB - Last synced at: 9 months ago - Pushed at: about 1 year ago - Stars: 6 - Forks: 0

RNABioInfo/rna-interaction-format

RNA Interaction Format (RIF) with reference implementations in C++, JavaScript, and Python

Language: C++ - Size: 298 KB - Last synced at: 1 day ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 0

buildersoftio/andyxstorage

Buildersoft Andy X Data Storage. This project will be deprecated by the end of 2022

Language: C# - Size: 1.63 MB - Last synced at: over 1 year ago - Pushed at: about 3 years ago - Stars: 6 - Forks: 0

AnotherKamila/stalky

Self-hosted app to keep track of anything you want. Don't let others stalk you, stalk yourself!

Language: Elm - Size: 435 KB - Last synced at: 23 days ago - Pushed at: almost 4 years ago - Stars: 6 - Forks: 2

AmphibiaWeb/amphibian-disease-tracker 📦

Amphibian Disease Tracker Portal

Language: HTML - Size: 246 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 6 - Forks: 0

willow385/tapelion 📦

A collection of programs for reading and writing data on cassette tapes with modern computers. Can also be used for storing data on other audio recording mediums and for transmitting data via audio cables.

Language: Python - Size: 35.2 KB - Last synced at: over 1 year ago - Pushed at: over 5 years ago - Stars: 6 - Forks: 2

alexbrt/DNAdrive

DNAdrive is a science project which makes data storage in bacteria possible. Given binary data, it constructs DNA sequences (aka packets) which can be used as protospacers in CRISPR-based systems, such as the one found in Escherichia Coli. 🔬

Language: C++ - Size: 717 KB - Last synced at: 3 months ago - Pushed at: over 6 years ago - Stars: 6 - Forks: 0

nathadriele/cnpj-data-pipeline

The CNPJ Data ETL Pipeline is designed to automate the download, processing, and storage of public CNPJ data from the Brazilian Federal Revenue. The pipeline is built with Mage.ai and AWS S3 to ensure efficient data management and scalability.

Language: Python - Size: 46.9 KB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 5 - Forks: 0

Darnelo-Inc/sky-storage

MERN: Fullstack cloud storage project includes standard remote storage functionality, as well as data backup and sync capabilities between devices | React / TypeScript / SCSS / Redux Toolkit / RTK Query / NodeJS / ExpressJS / MongoDB

Language: TypeScript - Size: 4.92 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 5 - Forks: 0

kfrancischen/pslx

Python Standard Library eXtension

Language: Python - Size: 1.82 MB - Last synced at: 6 months ago - Pushed at: almost 2 years ago - Stars: 5 - Forks: 1

the-code-genin/Simple-JWT-API

A simple JWT powered API boiler plate written in NodeJS/Typescript and uses an SQL database for data storage out of the box.

Language: TypeScript - Size: 434 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 0

petrbouchal/purrrow

R package for iteratively collating Arrow datasets out of memory

Language: R - Size: 979 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 5 - Forks: 1

bigin/ItemManager_2.0 📦

ItemManager (IM) is a simple flat-file framework for GetSimple-CMS that allows you to develop completely customizable PHP applications bundled with GetSimple-CMS.

Language: PHP - Size: 6.87 MB - Last synced at: almost 2 years ago - Pushed at: about 5 years ago - Stars: 5 - Forks: 3

gcr/lab-workbook

Monitor your experiments and save progress to S3!

Language: Lua - Size: 457 KB - Last synced at: about 1 year ago - Pushed at: about 9 years ago - Stars: 5 - Forks: 0

mlab-modules/BATDATUNIT01

Multiple parallel Li-ion 18650 battery cell module with BMS and data storage with MCU control.

Language: HTML - Size: 208 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 4 - Forks: 0

Paulsenik/java-project-library

A Java-Library for making small Coding-Projects really fast

Language: Java - Size: 286 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 4 - Forks: 0

NanoSector/collections

Simple Collection class allowing storage of specific data.

Language: PHP - Size: 260 KB - Last synced at: 21 days ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 1

Astrodynamic/Key-Value-Storage-Redis-in-CPP

The project is a key-value store. The project uses data structures such as hash tables, self-balancing binary search trees, and B+ trees. The code is written in C++ with CMake as a build tool. It supports sanitization, testing, coverage, formatting, and static analysis.

Language: C++ - Size: 1.13 MB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 4 - Forks: 0