GitHub topics: data-format
lancedb/lance
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
Language: Rust - Size: 21.7 MB - Last synced at: about 12 hours ago - Pushed at: about 12 hours ago - Stars: 4,515 - Forks: 285

HeavyIonAnalysis/AnalysisTree
AnalysisTree data format
Language: C++ - Size: 29 MB - Last synced at: about 13 hours ago - Pushed at: about 14 hours ago - Stars: 4 - Forks: 8

farizalsalman21/keon
A human readable object notation / serialization format that syntactic similar to Rust and completely supports Serde's data model.
Size: 1000 Bytes - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 0 - Forks: 0

BAMWelDX/weldx
The welding data exchange format
Language: Python - Size: 7.75 MB - Last synced at: 1 day ago - Pushed at: 2 days ago - Stars: 21 - Forks: 9

ron-rs/ron
Rusty Object Notation
Language: Rust - Size: 5.93 MB - Last synced at: about 15 hours ago - Pushed at: 3 days ago - Stars: 3,537 - Forks: 129

NeurodataWithoutBorders/pynwb
A Python API for working with Neurodata stored in the NWB Format
Language: Python - Size: 44.9 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 193 - Forks: 86

securisec/chepy
Chepy is a python lib/cli equivalent of the awesome CyberChef tool.
Language: Python - Size: 4.82 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 968 - Forks: 55

theobori/nix-converter
All-in-one converter configuration language to Nix and vice versa
Language: Go - Size: 40 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 5 - Forks: 1

fundsxml/schema
FundsXML XSD Files
Size: 4.09 MB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 7 - Forks: 1

poseidon-framework/poseidon-schema
An archaeogenetic genotype data organisation file format
Size: 978 KB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 1 - Forks: 2

apache/carbondata
High performance data store solution
Language: Scala - Size: 82.6 MB - Last synced at: 4 days ago - Pushed at: 22 days ago - Stars: 1,435 - Forks: 703

couchbase/fleece
A super-fast, compact, JSON-equivalent binary data format
Language: C++ - Size: 4.8 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 320 - Forks: 33

zarr-developers/blog
Zarr Official Blog
Language: Ruby - Size: 436 KB - Last synced at: 13 days ago - Pushed at: 20 days ago - Stars: 2 - Forks: 7

erikw/nestedtext-ruby
A ruby implementation of NestedText https://nestedtext.org/
Language: Ruby - Size: 1.94 MB - Last synced at: about 3 hours ago - Pushed at: 21 days ago - Stars: 8 - Forks: 1

kinverarity1/lasio
Python library for reading and writing well data using Log ASCII Standard (LAS) files
Language: Lasso - Size: 5.02 MB - Last synced at: 12 days ago - Pushed at: 23 days ago - Stars: 356 - Forks: 156

joedeveloper55/pon
PON is a lightwight text-based data-interchange format by and for Python programmers
Language: Python - Size: 5.86 KB - Last synced at: 23 days ago - Pushed at: 23 days ago - Stars: 0 - Forks: 0

PEtab-dev/PEtab
PEtab - an SBML and TSV based data format for parameter estimation problems in systems biology
Size: 10.9 MB - Last synced at: 10 days ago - Pushed at: 25 days ago - Stars: 61 - Forks: 12

jcbhmr/record-jar
🥤 The unofficial record-jar data format monorepo
Size: 1.95 KB - Last synced at: 27 days ago - Pushed at: 27 days ago - Stars: 0 - Forks: 0

NeurodataWithoutBorders/nwb-schema
Data format specification schema for the NWB neurophysiology data format
Size: 67.2 MB - Last synced at: 19 days ago - Pushed at: 26 days ago - Stars: 56 - Forks: 16

NeuroJSON/jsnirf
A JSON/binary JSON extension to the SNIRF format
Size: 81.1 KB - Last synced at: 4 days ago - Pushed at: about 1 month ago - Stars: 2 - Forks: 7

bevry/cson
CoffeeScript-Object-Notation. Same as JSON but for CoffeeScript objects.
Language: CoffeeScript - Size: 679 KB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 1,339 - Forks: 56

cheminfo/netcdfjs
Read and explore NetCDF files
Language: TypeScript - Size: 5.31 MB - Last synced at: 19 days ago - Pushed at: over 1 year ago - Stars: 152 - Forks: 32

reflektone-games/SimaiSharp
A serializer/deserializer for the rhythm game chart format simai.
Language: C# - Size: 223 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 37 - Forks: 7

monsterkodi/noon
no ordinary object notation
Language: JavaScript - Size: 1.72 MB - Last synced at: 3 days ago - Pushed at: about 2 months ago - Stars: 9 - Forks: 1

eternal-io/keon
A human readable object notation / serialization format that syntactic similar to Rust and completely supports Serde's data model.
Language: Rust - Size: 133 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 52 - Forks: 1

bevry/envfile
Parse and write environment files with Node.js
Language: TypeScript - Size: 918 KB - Last synced at: 3 days ago - Pushed at: 6 months ago - Stars: 62 - Forks: 10

svenvc/ston
STON - Smalltalk Object Notation - A lightweight text-based, human-readable data interchange format for class-based object-oriented languages like Smalltalk.
Language: Smalltalk - Size: 561 KB - Last synced at: 23 days ago - Pushed at: about 1 year ago - Stars: 139 - Forks: 32

LorisYounger/LinePutScript
LinePutScript是一种数据交换格式定义行读取结构和描述其内容的标准语言
Language: C# - Size: 24 MB - Last synced at: 3 days ago - Pushed at: 2 months ago - Stars: 11 - Forks: 2

hltcoe/concrete-js
JavaScript library for working with Concrete, a data serialization format for NLP
Language: JavaScript - Size: 4.26 MB - Last synced at: 4 days ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 2

jorinvo/edn-data
EDN parser and generator that works with plain JS data, with support for TS and node streams
Language: TypeScript - Size: 452 KB - Last synced at: 17 days ago - Pushed at: 10 months ago - Stars: 101 - Forks: 6

hltcoe/concrete-python
Python modules and scripts for working with Concrete, a data serialization format for NLP
Language: Python - Size: 1.96 MB - Last synced at: 12 days ago - Pushed at: over 1 year ago - Stars: 21 - Forks: 8

tkarabela/ensight-reader
A pure Python reader for the EnSight Gold format
Language: Python - Size: 337 KB - Last synced at: 8 days ago - Pushed at: 3 months ago - Stars: 9 - Forks: 3

nuald/glSatellite-Demo
Technological demo featuring various areas as using OpenGL ES with Android NDK, custom message queues, interacting JNI and Java activities, using NORAD databases and parsing their data.
Language: C++ - Size: 6.21 MB - Last synced at: 10 days ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 1

master-co/business
A business data model for quick verification, access and output of specific data formats.
Language: TypeScript - Size: 332 KB - Last synced at: 3 days ago - Pushed at: about 3 years ago - Stars: 4 - Forks: 0

reflektone-games/simai.js
A serializer/deserializer for the rhythm game chart format simai.
Language: TypeScript - Size: 183 KB - Last synced at: 10 days ago - Pushed at: 7 months ago - Stars: 5 - Forks: 1

m-sequeira/pyIBA
A Python library aimed at simplifying the life of Ion Beam Scientists
Language: Python - Size: 88.9 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

ALANVF/reon
REON is an expressive data format based on Red/Rebol syntax that can be converted to/from JSON
Language: CoffeeScript - Size: 176 KB - Last synced at: 9 days ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

peterkuma/pst
Plain Structured Text (PST)
Language: Python - Size: 110 KB - Last synced at: 30 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

NaturalIntelligence/nimn-spec
Just Data. Save up to 85% network bandwidth and storage.
Size: 64.5 KB - Last synced at: 19 days ago - Pushed at: over 1 year ago - Stars: 89 - Forks: 5

biomarkersParkinson/tsdf
A package to read, modify and write TSDF data in Python.
Language: Python - Size: 4.17 MB - Last synced at: 11 days ago - Pushed at: 16 days ago - Stars: 2 - Forks: 0

twesterhout/hdf5-hs
High-level Haskell bindings to HDF5
Language: Haskell - Size: 170 KB - Last synced at: 21 days ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

gnh1201/catsplit-format
Catsplit is data interaction format without rich or high-cost syntax parsers.
Size: 142 KB - Last synced at: 26 days ago - Pushed at: 12 months ago - Stars: 0 - Forks: 1

CHollasch/LSON4J 📦
Java LSON parser.
Language: Java - Size: 697 KB - Last synced at: 10 days ago - Pushed at: over 6 years ago - Stars: 2 - Forks: 0

abrudz/parsing
Dyalog APL expressions to parse common and unusual data formats from text files
Language: APL - Size: 3.91 KB - Last synced at: 18 days ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 0

dnaka91/mabo
Data format and schema, with a type system as strong as Rust's.
Language: Rust - Size: 2.5 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 7 - Forks: 1

supervisely-ecosystem/convert-yolov5-to-supervisely-format
YOLOv5 to Supervisely format
Language: Python - Size: 2.18 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 1 - Forks: 2

deshima-dev/dems
:truck: DESHIMA measurement set by DataArray
Language: Python - Size: 164 KB - Last synced at: 11 days ago - Pushed at: 9 months ago - Stars: 2 - Forks: 1

RNABioInfo/rna-interaction-format
RNA Interaction Format (RIF) with reference implementations in C++, JavaScript, and Python
Language: C++ - Size: 298 KB - Last synced at: 9 days ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 0

vimaec/vim
VIM - Runtime 3D BIM Data Format for AEC
Language: C# - Size: 153 KB - Last synced at: 18 days ago - Pushed at: over 1 year ago - Stars: 9 - Forks: 2

andreas19/gemina-spec
Specification of the Gemina format
Size: 19.5 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

DahnJ/Awesome-Zarr
🎀 Awesome Zarr resources
Size: 201 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 77 - Forks: 1

fin-org/fin-site
Website for the Fin text format
Language: HTML - Size: 293 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

fin-org/fin-data
Generate arbitrary fin data for testing and benchmarking
Language: TypeScript - Size: 99.6 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

burtonageo/bvh_anim
Loader for bvh animation files
Language: Rust - Size: 524 KB - Last synced at: 10 days ago - Pushed at: 12 months ago - Stars: 9 - Forks: 6

iddev5/inon
:floppy_disk: Data serialization format in Zig
Language: Zig - Size: 169 KB - Last synced at: 5 months ago - Pushed at: 11 months ago - Stars: 10 - Forks: 0

metayeti/Lime
Game data packer
Language: C++ - Size: 28.6 MB - Last synced at: 11 months ago - Pushed at: 12 months ago - Stars: 5 - Forks: 0

insightindustry/spss-converter
A simple utility that converts SPSS data to / from Pandas DataFrames, CSV, Excel, JSON, YAML, and dict.
Language: Python - Size: 69.3 KB - Last synced at: 9 months ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 3

Zeyu-Li/data_formatting 📦
Formats data from file and creates new file 📃
Language: Python - Size: 3.91 KB - Last synced at: 12 months ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0

sigmasoldi3r/wad-rs
A simple library for WAD files, where WAD (short for Where's All the Data) is the file extension for Half-Life texture packages.
Language: Rust - Size: 1000 Bytes - Last synced at: 8 days ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

regnostandard/regno-standard-documentation
The Regno Standard is an open standard data format, that describes time based data combined with static data. It provides a common structure to ensure controlled communication between applications willing to share, combine and analyse data
Size: 136 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

JohnnyBravo75/DataBridge.NET
Configurable data bridge for permanent ETL jobs
Language: C# - Size: 11.1 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 20 - Forks: 10

lifs-tools/rmzTab-m
The R-language bindings for mzTab-M
Language: R - Size: 2.04 MB - Last synced at: 11 months ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 1

shifteverywhere/dime-dotnet-ref
Di:ME (Data Integrity Message Envelope) is a powerful universal data format that is built for secure, and integrity protected communication between entities in a trusted network. It is built with modern thinking and ease-of-use throughout. Although it can be used together with X.509 certificates, it has its own built in public key-based entity identification through a trusted chain. This makes it equally suitable as an alternative to certificate-based PKIs.
Language: C# - Size: 1.38 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

kesh-lang/sode
kesh tree structured data format
Size: 93.8 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

hltcoe/concrete
Thrift definitions, making HLT data specifications concrete
Language: Thrift - Size: 4.61 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 16 - Forks: 5

SmolSoftBoi/php-data-format
Convert between various data formats.
Language: PHP - Size: 9.77 KB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

ViliOrg/Vili
A nice and readable data format !
Language: C++ - Size: 834 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 27 - Forks: 3

gmggroup/omf-python
Python library for working with OMF files
Language: Jupyter Notebook - Size: 21.3 MB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 77 - Forks: 19

veevol/lumen
A simple configuration format
Size: 5.86 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

trilobite-stdlib/trilo-xfile-c
That format framework from the laboratory. Basically, the data format handling functionality for JSON, CSV, XML, and more written in C.
Language: C - Size: 79.1 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 1

digitallinguistics/DFT
Discourse Functional Transcription
Size: 23.4 KB - Last synced at: about 1 month ago - Pushed at: about 5 years ago - Stars: 2 - Forks: 1

AmateurPanda92/game-data-schema
🗂️ A TypeScript data model and JSON schema for encapsulating game data, with a focus on flexibility and human readability.
Size: 2.93 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

open-gamma-ray-astro/gamma-astro-data-formats
Data formats for gamma-ray astronomy
Language: Python - Size: 9.23 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 27 - Forks: 27

OGRECave/DotSceneFormat 📦
Now in the main repository
Language: C++ - Size: 67.4 KB - Last synced at: over 1 year ago - Pushed at: almost 6 years ago - Stars: 6 - Forks: 2

openculinary/soupson
SoupSON is an open data format used to describe the workflows involved in recipe preparation
Size: 13.7 KB - Last synced at: 14 days ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

kikones34/dsmap-serial-format
Low-level description of the format in which GameMaker Studio serializes ds_map objects.
Size: 1.95 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 0

JoiLa/cdt
convert between different data types easily and conveniently, with golang. support json and sql serialize
Language: Go - Size: 156 KB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 5 - Forks: 0

nexusformat/exampledata
Examples of (mostly) real world NeXus files to inspect, test and train reading software with.
Language: Python - Size: 45.8 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 7

ccmaymay/concrete Fork of hltcoe/concrete
Thrift definitions, making HLT data specifications concrete
Language: Thrift - Size: 646 KB - Last synced at: 24 days ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

cs91chris/flask_response_builder
Implementations of flask response in many formats like: json, xml, html...
Language: Python - Size: 83 KB - Last synced at: 11 days ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 0

HealthyPear/XCDF Fork of jimbraun/XCDF
Fork of the repository of the eXplicitly Compacted Data Format (XCDF)
Language: C++ - Size: 428 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

ready-steady/hdf5
Reader and writer of HDF5 files
Language: Go - Size: 28.3 KB - Last synced at: 2 days ago - Pushed at: almost 8 years ago - Stars: 18 - Forks: 2

JHZ-D/SE-Web-project Fork of Xeon-all/SE-Web-project
Language: Python - Size: 1.28 MB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

gusenov/examples-json
Примеры работы с форматом данных JSON.
Size: 0 Bytes - Last synced at: 2 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

silmeth/pocztowka
Pocztówka z Kotliny – postcard for kotlinx.serialization, mirror of https://gitlab.com/silmeth/pocztowka/
Language: Kotlin - Size: 83 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

armagansalman/CKAV
CKAV is a text based data format (inspired by csv) which adds type information to all data.
Language: HTML - Size: 48.8 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

hollowness-inside/BencodeCLI
CLI tool for decoding torrent files and encoding json into torrent file format
Language: Go - Size: 5.86 KB - Last synced at: about 1 year ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

DFASDL/dfasdl-core 📦
Moved: https://codeberg.org/tensei-data/dfasdl-core
Language: Scala - Size: 93.8 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 4 - Forks: 2

DFASDL/dfasdl-utils 📦
Moved: https://codeberg.org/tensei-data/dfasdl-utils
Language: Scala - Size: 705 KB - Last synced at: almost 2 years ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 2

peterpf/formatter 📦
JSONArray to custom-data-format converter
Language: JavaScript - Size: 51.8 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

andrevdl/SmartIO
Transforms common data formats from one type to another, such as JSON, XML and datasets
Language: C++ - Size: 220 KB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

ccmaymay/concrete-js Fork of hltcoe/concrete-js
JavaScript/Node.js library for working with Concrete, a data serialization format for NLP
Language: JavaScript - Size: 3.92 MB - Last synced at: 24 days ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

robianchini/react-data-formatter
A react-data-formatter é uma biblioteca em JavaScript para formatação de dados brasileiros como CPF, CNPJ, CEP, telefone, moeda, placa e gênero.
Language: JavaScript - Size: 616 KB - Last synced at: 27 days ago - Pushed at: almost 2 years ago - Stars: 3 - Forks: 0

niyiyu/CloudPyASDF
ASDF Python reader for cloud environment
Language: Jupyter Notebook - Size: 4.97 MB - Last synced at: 12 months ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 1

softlandia/glasio
golang library for read/write/control las files
Language: Go - Size: 6.01 MB - Last synced at: 10 months ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 1

AvailLang/avail-json
Read and write freeform JSON with precise error checking.
Language: Kotlin - Size: 160 KB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

ccmaymay/concrete-python Fork of hltcoe/concrete-python
Python modules and scripts for working with Concrete
Language: Python - Size: 1.55 MB - Last synced at: 24 days ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

shifteverywhere/dime-java-ref
Di:ME (Data Integrity Message Envelope) is a powerful universal data format that is built for secure, and integrity protected communication between entities in a trusted network. It is built with modern thinking and ease-of-use throughout. Although it can be used together with X.509 certificates, it has its own built in public key-based entity identification through a trusted chain. This makes it equally suitable as an alternative to certificate-based PKIs.
Language: Java - Size: 1.29 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

Naira0/datax
a custom data format parser.
Language: C++ - Size: 6.84 KB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 0

antgon/edfrw
A Python library for reading and writing European Data Format (EDF) files
Language: Python - Size: 2.86 MB - Last synced at: 21 days ago - Pushed at: almost 3 years ago - Stars: 3 - Forks: 0
