apache/incubator-gluten

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.

Language: Scala - Size: 198 MB - Last synced at: about 3 hours ago - Pushed at: about 4 hours ago - Stars: 1,343 - Forks: 487

amrajib/velox

Velox is a work in progress, experimental Rust based Operating System written for fun and learning

Language: Rust - Size: 232 KB - Last synced at: about 12 hours ago - Pushed at: about 13 hours ago - Stars: 0 - Forks: 0

JanKaul/iceberg-rust

Rust implementation of Apache Iceberg with integration for Datafusion

Language: Rust - Size: 4.71 MB - Last synced at: about 20 hours ago - Pushed at: about 24 hours ago - Stars: 179 - Forks: 26

apecloud/myduckserver

Unified MySQL, Postgres & FlightSQL Server, Powered by DuckDB.

Language: Go - Size: 5.67 MB - Last synced at: about 14 hours ago - Pushed at: 4 months ago - Stars: 435 - Forks: 19

InfluxCommunity/influxdb3-python

Python module that provides a simple and convenient way to interact with InfluxDB 3.0.

Language: Python - Size: 1.74 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 79 - Forks: 14

mabel-dev/opteryx

🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.

Language: Python - Size: 362 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 105 - Forks: 13

knime/knime-python

KNIME Python Integration

Language: Java - Size: 12.2 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 76 - Forks: 37

arrow-kt/arrow

The perfect companion for your Kotlin journey - Inspired by functional, data-oriented and concurrent programming

Language: Kotlin - Size: 56.2 MB - Last synced at: 2 days ago - Pushed at: 3 days ago - Stars: 6,339 - Forks: 454

apache/arrow-site

Mirror of Apache Arrow site

Language: HTML - Size: 2.55 GB - Last synced at: about 12 hours ago - Pushed at: about 13 hours ago - Stars: 38 - Forks: 113

milenkovicm/adhesive

Apache Datafusion JVM User Defined Functions (UDF), integration nobody asked for 😀

Language: Rust - Size: 45.9 KB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 4 - Forks: 1

Query-farm/duckdb-airport-extension

The Airport extension for DuckDB, enables the use of Arrow Flight with DuckDB

Language: C++ - Size: 1.06 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 197 - Forks: 11

apache/datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine

Language: Rust - Size: 20.5 MB - Last synced at: 3 days ago - Pushed at: 11 days ago - Stars: 1,750 - Forks: 217

datafusion-contrib/datafusion-materialized-views

Incremental view maintenance & query rewriting for materialized views in DataFusion

Language: Rust - Size: 111 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 33 - Forks: 2

vortex-data/vortex

An extensible, state of the art columnar file format

Language: Rust - Size: 14.4 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 1,239 - Forks: 41

pierpo/react-archer

🏹 Draw arrows between React elements 🖋

Language: TypeScript - Size: 3.8 MB - Last synced at: 3 days ago - Pushed at: 4 months ago - Stars: 1,218 - Forks: 73

duckdb/duckdb-rs

Ergonomic bindings to duckdb for Rust

Language: Rust - Size: 90 MB - Last synced at: about 23 hours ago - Pushed at: 24 days ago - Stars: 636 - Forks: 147

mluttikh/xml2arrow

Efficiently convert XML data to Apache Arrow format for high-performance data processing

Language: Rust - Size: 236 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 4 - Forks: 0

crs-org/extract-audio

Extract audio files from a parquet or arrow file generated by Hugging Face `datasets` library.

Language: Rust - Size: 314 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 8 - Forks: 0

replaysMike/Binner

Open source parts inventory system for makers, electronics hobby, and professional engineers

Language: C# - Size: 16.9 MB - Last synced at: 1 day ago - Pushed at: 4 days ago - Stars: 428 - Forks: 52

apache/datafusion

Apache DataFusion SQL Query Engine

Language: Rust - Size: 140 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 7,181 - Forks: 1,480

apache/arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

Language: C++ - Size: 200 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 15,395 - Forks: 3,706

pola-rs/polars

Dataframes powered by a multithreaded, vectorized query engine, written in Rust

Language: Rust - Size: 186 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 33,596 - Forks: 2,227

mongodb-labs/mongo-arrow

MongoDB integrations for Apache Arrow. Export MongoDB documents to numpy array, parquet files, and pandas dataframes in one line of code.

Language: Python - Size: 605 KB - Last synced at: about 8 hours ago - Pushed at: 4 days ago - Stars: 104 - Forks: 16

loicalleyne/quacfka

Go library to stream Kafka protobuf messages to DuckDB

Language: Go - Size: 114 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 14 - Forks: 0

lakehq/sail

LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive (AI) workloads.

Language: Rust - Size: 3.49 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 741 - Forks: 31

kylebarron/parquet-wasm

Rust-based WebAssembly bindings to read and write Apache Parquet data

Language: Rust - Size: 2.67 MB - Last synced at: 2 days ago - Pushed at: 4 days ago - Stars: 583 - Forks: 20

apache/arrow-rs

Official Rust implementation of Apache Arrow

Language: Rust - Size: 42.5 MB - Last synced at: 4 days ago - Pushed at: 5 days ago - Stars: 2,924 - Forks: 921

rapidsai/cudf

cuDF - GPU DataFrame Library

Language: C++ - Size: 155 MB - Last synced at: 4 days ago - Pushed at: 5 days ago - Stars: 8,907 - Forks: 945

anseki/leader-line 📦

Draw a leader line in your web page.

Language: JavaScript - Size: 1.41 MB - Last synced at: 5 days ago - Pushed at: about 1 month ago - Stars: 3,114 - Forks: 445

XiangpengHao/liquid-cache

10x lower latency for cloud-native DataFusion

Language: Rust - Size: 4.49 MB - Last synced at: 2 days ago - Pushed at: 6 days ago - Stars: 146 - Forks: 12

jesperancinha/space-ship-adventures

Using project arrow in similar to real-life scenarios

Language: HTML - Size: 439 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 0 - Forks: 0

jesperancinha/note-manager-app

A note manager application that implements a search engine for story telling texts. It feeds a UI and the idea is to show how can we, with Arrow, use its benefits to create a more robust, resilient, back-pressure resistent, innovative application with support for high capacity and high availability.

Language: Kotlin - Size: 2.99 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 1 - Forks: 1

xhtmlboi/yocaml

YOCaml is a static site generator, mostly written in OCaml

Language: OCaml - Size: 848 KB - Last synced at: 3 days ago - Pushed at: about 2 months ago - Stars: 120 - Forks: 10

jesperancinha/public-transport-declarer

A public transport declaration calculator. It is used to automatically filter out all relevant travelling segments when travelling with a general public transport card. It receives a PDF file as an input and generates a CSV file with the results as Local Date / Complete value.

Language: Kotlin - Size: 1.59 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 0 - Forks: 1

arrow-py/arrow

🏹 Better dates & times for Python

Language: Python - Size: 2.21 MB - Last synced at: 4 days ago - Pushed at: 6 months ago - Stars: 8,844 - Forks: 692

jesperancinha/jeorg-kotlin-test-drives

Kotlin studies. Includes Project Arrow, Kotlin Coroutines, Flows and More

Language: Kotlin - Size: 4.12 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1 - Forks: 0

alekLukanen/ChapterhouseDB-example-app

An example application using the ChapterhouseDB processing engine

Language: Go - Size: 79.1 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

alekLukanen/ChapterhouseDB-v1

Allows you to create simple data streaming warehouses written in Golang using Apache Parquet and Arrow.

Language: Go - Size: 189 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1 - Forks: 0

datafusion-contrib/datafusion-dft

Batteries included CLI, TUI, and server implementations for DataFusion.

Language: Rust - Size: 15.8 MB - Last synced at: 2 days ago - Pushed at: 6 days ago - Stars: 153 - Forks: 13

apache/datafusion-comet

Apache DataFusion Comet Spark Accelerator

Language: Rust - Size: 16.6 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 944 - Forks: 202

roapi/roapi

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

Language: Rust - Size: 1.4 MB - Last synced at: 3 days ago - Pushed at: 10 days ago - Stars: 3,299 - Forks: 193

xvw/capsule

Micro blogging for fun and profit

Language: OCaml - Size: 89.1 MB - Last synced at: 3 days ago - Pushed at: 7 days ago - Stars: 9 - Forks: 3

stac-utils/stac-geoparquet

Convert STAC items between JSON, GeoParquet, pgstac, and Delta Lake.

Language: Python - Size: 2.77 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 96 - Forks: 12

apache/arrow-adbc

Database connectivity API standard and libraries for Apache Arrow

Language: C# - Size: 57.7 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 435 - Forks: 116

DanielAvdar/pandas-pyarrow

Seamlessly switch Pandas DataFrame backend to PyArrow.

Language: Python - Size: 705 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 8 - Forks: 3

lakesoul-io/LakeSoul

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

Language: Java - Size: 35.2 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 2,739 - Forks: 405

arrow-udf/arrow-udf

A User-Defined Function Framework for Apache Arrow.

Language: Rust - Size: 913 KB - Last synced at: about 8 hours ago - Pushed at: 7 days ago - Stars: 89 - Forks: 17

tonbo-io/tonbo

A portable embedded database using Arrow.

Language: Rust - Size: 2.27 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 996 - Forks: 54

childmindresearch/bids2table

Index BIDS datasets fast, locally or in the cloud

Language: Python - Size: 672 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 17 - Forks: 7

alex-amenos/Jetpack

Experimental Android project

Language: Kotlin - Size: 7.24 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 4 - Forks: 0

freshOS/Arrow

🏹 Parse JSON with style

Language: Swift - Size: 21.2 MB - Last synced at: 4 days ago - Pushed at: 8 months ago - Stars: 388 - Forks: 27

ToucanToco/fastexcel

A Python wrapper around calamine

Language: Rust - Size: 46.9 MB - Last synced at: about 21 hours ago - Pushed at: 2 days ago - Stars: 153 - Forks: 10

serhatci/cryptocurrency-historical-data-downloader

A desktop application to download historical data of desired crypto assets by connecting several different crypto-exchanges' API

Language: Python - Size: 976 KB - Last synced at: 1 day ago - Pushed at: almost 4 years ago - Stars: 16 - Forks: 7

returnString/convergence

A set of tools for writing servers that speak PostgreSQL's wire protocol

Language: Rust - Size: 255 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 92 - Forks: 15

BlazingDB/blazingsql

BlazingSQL is a lightweight, GPU accelerated, SQL engine for Python. Built on RAPIDS cuDF.

Language: C++ - Size: 41.4 MB - Last synced at: 1 day ago - Pushed at: over 2 years ago - Stars: 1,964 - Forks: 184

milenkovicm/ballista_extensions

Extending datafusion ballista to support custom made logical and physical operators

Language: Rust - Size: 37.1 KB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 0

milenkovicm/ballista_python

Ballista cluster pyarrow udf support

Language: Rust - Size: 162 KB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 1 - Forks: 0

apache/arrow-nanoarrow

Helpers for Arrow C Data & Arrow C Stream interfaces

Language: C - Size: 29 MB - Last synced at: 7 days ago - Pushed at: 13 days ago - Stars: 188 - Forks: 43

pola-rs/r-polars

Polars R bindings

Language: R - Size: 8.18 MB - Last synced at: 3 days ago - Pushed at: 4 days ago - Stars: 506 - Forks: 39

grouzen/zio-apache-arrow

Scala ZIO-powered Apache Arrow library

Language: Scala - Size: 485 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 21 - Forks: 1

fb64/uquery-rs

Language: Rust - Size: 437 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 2 - Forks: 0

biodatageeks/polars-bio

Blazing-Fast Bioinformatic Operations on Python DataFrames

Language: Python - Size: 8.04 MB - Last synced at: 13 days ago - Pushed at: about 2 months ago - Stars: 56 - Forks: 4

wilhelmagren/falkorflight

Apache Arrow Flight SQL server for FalkorDB, written in Python.

Size: 0 Bytes - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 0 - Forks: 0

baggiponte/awesome-pandas-alternatives

Awesome list of alternative dataframe libraries in Python.

Size: 21.5 KB - Last synced at: 8 days ago - Pushed at: over 2 years ago - Stars: 48 - Forks: 2

sal-openlab/datafusion-server

Rust DataFusion Server

Language: Rust - Size: 1.53 MB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 16 - Forks: 3

zagum/Android-ExpandIcon

Nice and simple customizable implementation of Google style up/down expand arrow.

Language: Java - Size: 262 KB - Last synced at: about 8 hours ago - Pushed at: almost 5 years ago - Stars: 864 - Forks: 82

wheretrue/exon

Exon is an OLAP query engine specifically for biology and life science applications.

Language: Rust - Size: 59.3 MB - Last synced at: 16 days ago - Pushed at: about 2 months ago - Stars: 63 - Forks: 6

metrico/influxdb3-community

Community InfluxDB 3.0 "IOx" static builds + containers + Examples for Developers & Integrators. Experiment with low-cost storage, unlimited cardinality and FlightSQL APIs

Language: Shell - Size: 225 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 45 - Forks: 2

JavierSegoviaCordoba/network-either-kmp

Language: Kotlin - Size: 10.1 MB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 4 - Forks: 0

timeseer-ai/kukur

Provides time series data and metadata as Apache Arrow.

Language: Python - Size: 1.45 MB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 15 - Forks: 1

JosephBARBIERDARNAL/drawarrow

Drawing arrows for matplotlib made easy

Language: Python - Size: 5.6 MB - Last synced at: 4 days ago - Pushed at: 22 days ago - Stars: 30 - Forks: 0

jakzal/kotlin-mastermind

Mastermind game

Language: Kotlin - Size: 1.02 MB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 3 - Forks: 0

chmp/serde_arrow

Convert sequences of Rust objects to Arrow tables

Language: Rust - Size: 2.89 MB - Last synced at: about 5 hours ago - Pushed at: about 1 month ago - Stars: 86 - Forks: 26

apache/arrow-testing

Auxiliary testing files for Apache Arrow

Language: Shell - Size: 29.1 MB - Last synced at: 6 days ago - Pushed at: 4 months ago - Stars: 17 - Forks: 43

wheretrue/biobear

Work with bioinformatic files using Arrow, Polars, and/or DuckDB

Language: Rust - Size: 2.01 MB - Last synced at: 20 days ago - Pushed at: 2 months ago - Stars: 182 - Forks: 12

manojkarthick/pqrs

Command line tool for inspecting Parquet files

Language: Rust - Size: 188 KB - Last synced at: 27 days ago - Pushed at: 9 months ago - Stars: 326 - Forks: 31

jcoreio/react-arrow

a simple svg arrow component

Language: JavaScript - Size: 724 KB - Last synced at: 4 days ago - Pushed at: over 1 year ago - Stars: 8 - Forks: 0

appifyhub/actual-number-picker 📦

Android: A horizontal number picker

Language: Java - Size: 7.42 MB - Last synced at: 5 days ago - Pushed at: over 2 years ago - Stars: 221 - Forks: 36

eitsupi/r-glaredb

R bindings for GlareDB

Language: R - Size: 1.82 MB - Last synced at: 3 days ago - Pushed at: 3 months ago - Stars: 4 - Forks: 2

AceFire6/ordered-arrowverse

A listing of all shows in the Arrowverse in watch order to ensure continuity and sensible ordering for crossover episodes

Language: HTML - Size: 491 KB - Last synced at: 10 days ago - Pushed at: about 2 months ago - Stars: 107 - Forks: 33

KxSystems/arrowkdb

kdb+ integration with Apache Arrow and Parquet

Language: C++ - Size: 468 KB - Last synced at: about 8 hours ago - Pushed at: about 1 month ago - Stars: 30 - Forks: 15

lancedb/ocra

OCRA: Object-store Cache in Rust for All

Language: Rust - Size: 44.9 KB - Last synced at: 15 days ago - Pushed at: about 1 month ago - Stars: 9 - Forks: 5

inspect-js/is-arrow-function

Determine if a function is an ES6 arrow function or not.

Language: JavaScript - Size: 101 KB - Last synced at: 1 day ago - Pushed at: about 1 year ago - Stars: 23 - Forks: 3

Swoorup/arrow-convert

Derive for arrow-rs, ported from arrow2-convert

Language: Rust - Size: 274 KB - Last synced at: 8 days ago - Pushed at: about 1 month ago - Stars: 11 - Forks: 9

duyet/ballista

Example of Ballista Rust

Language: Rust - Size: 35.7 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

ClickHouse/spark-clickhouse-connector

Spark ClickHouse Connector build on DataSourceV2 API

Language: Scala - Size: 2.4 MB - Last synced at: 13 days ago - Pushed at: 3 months ago - Stars: 195 - Forks: 71

chmp/marrow

Minimalist Arrow interop

Language: Rust - Size: 228 KB - Last synced at: 12 days ago - Pushed at: about 1 month ago - Stars: 2 - Forks: 1

shauryashaurya/learn-data-munging

Notes on Data Engineering with Pandas, PySpark, Dask, Ray, Arrow DataFusion, Polars etc.

Language: Jupyter Notebook - Size: 627 MB - Last synced at: 2 days ago - Pushed at: about 1 month ago - Stars: 48 - Forks: 21

0x0L/pgeon

Apache Arrow PostgreSQL connector

Language: C++ - Size: 408 KB - Last synced at: 24 days ago - Pushed at: over 1 year ago - Stars: 59 - Forks: 2

sefirosweb/minecraftHawkEye

Minecraft bot for equations when shooting an arrow

Language: TypeScript - Size: 3.64 MB - Last synced at: 29 days ago - Pushed at: about 1 year ago - Stars: 33 - Forks: 4

domoritz/streamlit-vega-lite

A Streamlit component to render interactive Vega, Vega-Lite, and Altair visualizations and access the selected data from Python

Language: Python - Size: 4.87 MB - Last synced at: 1 day ago - Pushed at: about 4 years ago - Stars: 93 - Forks: 6

unum-cloud/ustore

Multi-Modal Database replacing MongoDB, Neo4J, and Elastic with 1 faster ACID solution, with NetworkX and Pandas interfaces, and bindings for C 99, C++ 17, Python 3, Java, GoLang 🗄️

Language: C++ - Size: 6.56 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 587 - Forks: 34

surfingreg/rust-in-memory-db-with-chart

Implement a fast, in-memory, time-series database. Query data using SQL and visualize in ChartJS over websocket.

Language: Rust - Size: 358 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

alttch/myval

Lightweight Apache Arrow data frame for Rust

Language: Rust - Size: 219 KB - Last synced at: 6 days ago - Pushed at: about 2 years ago - Stars: 63 - Forks: 3

stdlib-js/assert-has-arrow-function-support

Detect native arrow function support.

Language: JavaScript - Size: 351 KB - Last synced at: 7 days ago - Pushed at: about 1 month ago - Stars: 2 - Forks: 0

JDASoftwareGroup/kartothek

A consistent table management library in python

Language: Python - Size: 2.09 MB - Last synced at: 23 days ago - Pushed at: about 2 years ago - Stars: 159 - Forks: 53

NNNIC/Yajirushi

Just simple Unity component for drawing an arrow

Language: C# - Size: 91.8 KB - Last synced at: 21 days ago - Pushed at: about 8 years ago - Stars: 13 - Forks: 5

quackscience/quackflight

DuckDB API Server with Arrow Flight SQL Airport support and concurrent writes/reads (quackpipe)

Language: Python - Size: 193 KB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 70 - Forks: 3

sutoiku/puffin

Serverless HTAP cloud data platform powered by Arrow × DuckDB × Iceberg

Size: 17.8 MB - Last synced at: 19 days ago - Pushed at: about 2 years ago - Stars: 327 - Forks: 12

Hakorr/UniversalBoardDrawer

A userscript library for seamlessly adding chess move arrows to game boards on popular platforms like Chess.com, Lichess.org, and almost anywhere else.

Language: JavaScript - Size: 413 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 1