GitHub / lancedb / lance
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/lancedb%2Flance
Stars: 4,470
Forks: 280
Open issues: 626
License: apache-2.0
Language: Rust
Size: 21.8 MB
Dependencies parsed at: Pending
Created at: almost 3 years ago
Updated at: 2 days ago
Pushed at: 2 days ago
Last synced at: 2 days ago
Topics: apache-arrow, computer-vision, data-analysis, data-analytics, data-centric, data-format, data-science, dataops, deep-learning, duckdb, embeddings, llms, machine-learning, mlops, python, rust