GitHub topics: jsonlines
mrpudn/maltrends
(mirror) MyAnimeList.net manga and anime trend data.
Language: Python - Size: 81.5 MB - Last synced at: about 10 hours ago - Pushed at: about 11 hours ago - Stars: 1 - Forks: 0
Kledenai/jsonweaver
A powerful and easy-to-use library for transforming JSON data into popular formats such as CSV, XML, Markdown tables, YAML, and JSONLines (NDJSON).
Language: TypeScript - Size: 111 KB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 0 - Forks: 0
OADA/cli
Pipeable OADA CLI client
Language: TypeScript - Size: 5.76 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 2 - Forks: 0
thombashi/sqlitebiter
A CLI tool to convert CSV / Excel / HTML / JSON / Jupyter Notebook / LDJSON / LTSV / Markdown / SQLite / SSV / TSV / Google-Sheets to a SQLite database file.
Language: Python - Size: 917 KB - Last synced at: 8 days ago - Pushed at: 12 months ago - Stars: 864 - Forks: 49
umarbutler/orjsonl
A lightweight, high-performance Python library for parsing jsonl files.
Language: Python - Size: 28.3 KB - Last synced at: 10 days ago - Pushed at: over 1 year ago - Stars: 31 - Forks: 1
elecena/jsonl-parser
Add, read and remove entries from JSON Lines formatted files
Language: PHP - Size: 47.9 KB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 1 - Forks: 0
MeltanoLabs/target-jsonl-blob
JSONL Singer target for local storage, S3, GCS and Azure Blob Storage
Language: Go - Size: 442 KB - Last synced at: 10 days ago - Pushed at: 14 days ago - Stars: 4 - Forks: 1
apicrafter/pyiterable
Python library to read, write and convert data files with formats BSON, JSON, NDJSON, Parquet, ORC, XLS, XLSX and XML
Language: Python - Size: 392 KB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 16 - Forks: 0
json-next/awesome-json-next
A Collection of What's Next for Awesome JSON (JavaScript Object Notation) for Structured (Meta) Data in Text - JSON5, HJSON, HanSON, TJSON, SON, CSON, USON, JSONX/JSON11 & Many More
Size: 56.6 KB - Last synced at: 9 days ago - Pushed at: about 4 years ago - Stars: 62 - Forks: 3
aminnairi/cristaline
An immutable database engine built on the Event Sourcing pattern.
Language: TypeScript - Size: 313 KB - Last synced at: 14 days ago - Pushed at: about 1 month ago - Stars: 2 - Forks: 0
CGI-FR/PIMO
Private Input Masked Output - PIMO is a tool for data masking (anonymization, pseudonymization, ...).
Language: Go - Size: 7.31 MB - Last synced at: 28 days ago - Pushed at: 28 days ago - Stars: 43 - Forks: 13
meilisearch/meilisearch-importer
A CLI to import massive CSV and NdJson into Meilisearch
Language: Rust - Size: 119 KB - Last synced at: 6 days ago - Pushed at: 3 months ago - Stars: 30 - Forks: 4
diegoperea20/clean-dataset-jsonlines
clean dataset jsonlines about store and sales with objective of create all needed transformations in order to get a clean dataset with the required features to train a machine learning model that predicts if a product is new or used.
Language: Jupyter Notebook - Size: 785 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0
fumito-ito/SwiftyJSONLines
The better way to deal with JSONLines data in Swift.
Language: Swift - Size: 18.6 KB - Last synced at: 6 days ago - Pushed at: about 2 months ago - Stars: 2 - Forks: 0
busterc/ndjson-generate-schema
:information_source: Effortlessly convert your NDJSON data to a JSON Schema.
Language: JavaScript - Size: 80.1 KB - Last synced at: 21 days ago - Pushed at: over 6 years ago - Stars: 4 - Forks: 0
jwodder/serde-jsonlines
Read & write JSON Lines documents
Language: Rust - Size: 92.8 KB - Last synced at: 14 days ago - Pushed at: 2 months ago - Stars: 28 - Forks: 4
27escape/mqtt2jsonl
Record and replay MQTT messages sent to a particular topic. The messages are recorded to a JSONL (https://jsonlines.org/) file
Language: Python - Size: 65.4 KB - Last synced at: 29 days ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0
rmoralespp/jsonl
A simple Python library for handling jsonlines files
Language: Python - Size: 3.36 MB - Last synced at: 10 days ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0
dwinkler1/JSONLines.jl
JSONLines reader/writer for Julia
Language: Julia - Size: 238 KB - Last synced at: 3 days ago - Pushed at: about 3 years ago - Stars: 10 - Forks: 0
Salaah01/json-lineage
Tool to allow parsing large JSON files without laoding into memory. Developed in Rust with adapters in other programming langauges for easy adoption
Language: Rust - Size: 9.39 MB - Last synced at: 18 days ago - Pushed at: over 1 year ago - Stars: 28 - Forks: 0
gr-b/jsonltui
A fast TUI application (with optional webui) to visually navigate and inspect JSON and JSONL data. Easily localize parse errors in large JSONL files. Made with LLM fine-tuning workflows in mind.
Language: HTML - Size: 233 KB - Last synced at: 5 days ago - Pushed at: 7 months ago - Stars: 13 - Forks: 0
ImKairat/flex_json
flex_json is a Python utility that converts JSON files into the JSON Lines (JSONL) format. It reads a standard JSON file, which typically contains a list or array of objects, and outputs a corresponding JSONL file where each object is written to a new line.
Language: Python - Size: 55.7 KB - Last synced at: 21 days ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0
gaborbata/todo
✔ todo list manager on the command-line inspired by todo.txt using the jsonl format
Language: Ruby - Size: 2.82 MB - Last synced at: about 8 hours ago - Pushed at: 5 months ago - Stars: 6 - Forks: 0
ismailhammounou/db2ixf
db2ixf is a python package with a CLI that simplifies the parsing and processing of IBM Integration eXchange Format (IXF) files.
Language: Python - Size: 1 MB - Last synced at: 14 days ago - Pushed at: about 1 year ago - Stars: 17 - Forks: 1
datacoon/undatum
undatum: a command-line tool for data processing. Brings CSV simplicity to JSON lines and BSON
Language: Python - Size: 4.97 MB - Last synced at: 4 months ago - Pushed at: 7 months ago - Stars: 48 - Forks: 7
kekyo/JsonStreamer
JSON Lines streaming serializer/deserializer on .NET and ASP.NET Core.
Language: C# - Size: 200 KB - Last synced at: 6 months ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 1
nuveraxgroup/openai-fine-tune-gpt-schema
OpenAI fine-tune GPTs JSON Schema validator
Language: TypeScript - Size: 112 KB - Last synced at: 11 days ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0
Cheng-Lin-Li/KnowledgeGraph
This repository for Web Crawling, Information Extraction, and Knowledge Graph build up.
Language: Julia - Size: 5.19 MB - Last synced at: 14 days ago - Pushed at: about 7 years ago - Stars: 33 - Forks: 4
benjajaja/rowfiles
Go library for reading files with rows (CSV, JSONLines, Parquet...)
Language: Go - Size: 39.1 KB - Last synced at: 2 days ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0
CGI-FR/LINO
Large Input Narrow Output - LINO is a simple ETL tool to manage tests data.
Language: Go - Size: 2.22 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 17 - Forks: 2
leodeveloper/fine-tune-with-google-cloud
Generative AI custom data fine tuning with google cloud vertax ai
Language: Jupyter Notebook - Size: 382 KB - Last synced at: 21 days ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0
trisongz/pylines
Simplifying parsing of large jsonline files in NLP Workflows
Language: Python - Size: 244 KB - Last synced at: 8 days ago - Pushed at: about 3 years ago - Stars: 12 - Forks: 1
ownport/sqlite2json 📦
Simple script for returning SQL query result as JSONline
Language: Python - Size: 3.91 KB - Last synced at: 11 months ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0
Wing924/go-jsonstream
JSON Stream (JSON Lines, JSON Array) Go Library
Language: Go - Size: 10.7 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0
itsluketwist/jldc
Easily read/write JSONLines files that include dataclasses.
Language: Python - Size: 16.6 KB - Last synced at: 12 days ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0
ckmishra8/pyjsonlines
A Python library to convert Json to Jsonlines and Jsonlines to Json. This library is helpful to convert ndjson to Json and vice versa too.
Language: Python - Size: 32.2 KB - Last synced at: about 1 month ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 1
franck-mahieu/datasets-toolbox
datasets-toolbox are some scripts usefull to generate, transfom and valid large dataset files, not openable with editor because too large. datasets-toolbox provide also a ping script.
Language: JavaScript - Size: 24.4 KB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0
an-dist/ReadableStream.readAsJson
Reading the stream of "JSON / JSON Lines" from ReadableStream so that it can be used in "for await...of" statement.
Language: JavaScript - Size: 10.7 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
kuriofoolio/JSONPlayground
A beginner's guide on how to get started with .json and .jsonl file formats, along with a sample project
Language: Jupyter Notebook - Size: 218 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
fracpete/gsonlines
Java library for reading/writing JSON lines data.
Language: Java - Size: 27.3 KB - Last synced at: 6 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
brokeyourbike/doccano-to-automl-jsonl
Transform doccano JSONL to the format expected by AutoML
Language: Go - Size: 69.3 KB - Last synced at: 10 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0
busterc/vscode-ndjson-colorizer
:art: VSCode extension colorizes NDJSON (Newline Delimited JSON) files
Size: 113 KB - Last synced at: 2 months ago - Pushed at: about 6 years ago - Stars: 3 - Forks: 1
busterc/fs-ndjson
:information_source: read and write NDJSON files (Newline Delimited JSON)
Language: JavaScript - Size: 45.9 KB - Last synced at: 2 days ago - Pushed at: over 5 years ago - Stars: 6 - Forks: 1
neroist/jsonlines
Simple JSON Lines parser in Nim
Language: Nim - Size: 84 KB - Last synced at: 22 days ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0
spekulatius/jsonl-2-json-files
Converts `jsonl` files into single json files.
Language: Shell - Size: 3.91 KB - Last synced at: about 2 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0
salauddintapu/JSONL-To-DataFrame
Convert JSONL files to pandas dataframe
Language: Python - Size: 1.95 KB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0
winebarrel/jljoin
Read two NDJSON files and combine lines with common member values.
Language: Rust - Size: 27.3 KB - Last synced at: 24 days ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0
winebarrel/jlsort
Sort ndjson/JSON Lines using External merge sort
Language: Rust - Size: 43 KB - Last synced at: 6 months ago - Pushed at: over 3 years ago - Stars: 5 - Forks: 0
CGI-FR/TIPO
Enable reproducible data shuffling for JSONLines streams.
Language: Go - Size: 64.5 KB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0
damian-anslik/jsonl
Python library for working with JSON Lines (JSON) files
Language: Python - Size: 1.95 KB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0
EqualMa/jsonlines
stringify / parse jsonlines for NodeJS using streams
Language: TypeScript - Size: 1.09 MB - Last synced at: about 18 hours ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0
inkrement/tsv2jsonl
Minimalistic CLI-tool to convert MySQL/MariaDB dumps to line-wise json
Language: C++ - Size: 22.5 KB - Last synced at: almost 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0
IBM-Cloud/logdna-search 📦
Search and export JSONL records from Activity Tracker with LogDNA service on IBM Cloud
Language: Python - Size: 15.6 KB - Last synced at: 12 months ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 6
unfoldml/jsonl
JSON Lines
Language: Haskell - Size: 26.4 KB - Last synced at: 10 days ago - Pushed at: almost 2 years ago - Stars: 4 - Forks: 0
jpmikkers/Delimit-Json
Powershell function that splits text consisting of concatenated JSON objects into separate JSON chunks.
Language: PowerShell - Size: 6.84 KB - Last synced at: 22 days ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0
CGI-FR/jsonline
JSONLine data container with command line utility.
Language: Go - Size: 229 KB - Last synced at: 10 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0
neverendingqs/pprint-ndjson-ui
For pretty-printing newline delimited JSON.
Language: JavaScript - Size: 2.3 MB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0
blachlylab/mucor3
Parses VCF data into tabular spreadsheets and aggregates data by sample
Language: D - Size: 854 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0
musichin/ktlint-jsonlines-reporter
ktlint JSON Lines reporter
Language: Kotlin - Size: 65.4 KB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0
tilfin/jsonlines-processor
JSON Lines streaming processor for CLI
Language: JavaScript - Size: 24.4 KB - Last synced at: 22 days ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 0
winebarrel/jluniq
Remove duplicate key member lines from sorted NDJSON.
Language: Rust - Size: 11.7 KB - Last synced at: 6 months ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0
ascoderu/compression-benchmarks
Benchmark to compare serialization and compression algorithms
Language: Python - Size: 83 KB - Last synced at: 14 days ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 3
PennockTech/textar
textar: text archival format
Size: 11.7 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0
fmind/jsonpipe
Demonstrate how to process jsonlines files in parallel with Clojure
Language: Clojure - Size: 23.2 MB - Last synced at: 10 days ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0
fmind/couchlines
Print one json document per line from the output of CouchDB "db/_all_docs"
Language: Go - Size: 20.5 KB - Last synced at: 10 days ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0
blachlylab/vcf_atomizer
Parses a VCF file into line-delimited json
Language: Go - Size: 52.7 KB - Last synced at: about 2 years ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 0
kamoo1/JsonAnalysis
Summarise JSONL files.
Language: Python - Size: 6.84 KB - Last synced at: almost 2 years ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0
