Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / apache / datafusion

Apache DataFusion SQL Query Engine

JSON API: https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/apache%2Fdatafusion

Stars: 4,942
Forks: 910
Open Issues: 997

License: apache-2.0
Language: Rust
Repo Size: 62.2 MB
Dependencies: 844

Created: about 3 years ago
Updated: 14 days ago
Last pushed: 15 days ago
Last synced: 14 days ago

Commit Stats

Commits: 7145
Authors: 582
Mean commits per author: 12.28
Development Distribution Score: 0.873
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/apache/datafusion

Topics: arrow, big-data, dataframe, datafusion, olap, python, query-engine, rust, sql

Files

Readme

Dependencies

docs/requirements.txt pypi

.github/workflows/dev_pr.yml actions

actions/checkout v3 composite
actions/labeler 4.1.0 composite

.github/workflows/rust.yml actions

./.github/actions/setup-builder * composite
actions/cache v3 composite
actions/checkout v3 composite
actions/setup-node v3 composite
actions/setup-python v4 composite
postgres 15 docker

benchmarks/Cargo.toml cargo

datafusion-proto 16.0.0 development
arrow 30.0.1
datafusion 16.0.0
env_logger 0.10
futures 0.3
mimalloc 0.1
num_cpus 1.13.0
object_store 0.5.0
parquet 30.0.1
parquet-test-utils 0.1.0
rand 0.8.4
serde 1.0.136
serde_json 1.0.78
snmalloc-rs 0.3
structopt 0.3
test-utils 0.1.0
tokio ^1.0

datafusion/core/Cargo.toml cargo

arrow 30.0.1 development
async-trait 0.1.53 development
criterion 0.4 development
csv 1.1.6 development
ctor 0.1.22 development
doc-comment 0.3 development
env_logger 0.10 development
rstest 0.16.0 development
sqllogictest 0.10.0 development
thiserror 1.0.37 development
ahash 0.8
apache-avro 0.14
arrow 30.0.1
async-compression 0.3.14
async-trait 0.1.41
bytes 1.1
bzip2 0.4.3
chrono 0.4.23
dashmap 5.4.0
datafusion-common 16.0.0
datafusion-expr 16.0.0
datafusion-jit 16.0.0
datafusion-optimizer 16.0.0
datafusion-physical-expr 16.0.0
datafusion-row 16.0.0
datafusion-sql 16.0.0
flate2 1.0.24
futures 0.3
glob 0.3.0
hashbrown 0.13
indexmap 1.9.2
itertools 0.10
lazy_static ^1.4.0
log ^0.4
num-traits 0.2
num_cpus 1.13.0
object_store 0.5.0
parking_lot 0.12
parquet 30.0.1
paste ^1.0
percent-encoding 2.2.0
pin-project-lite ^0.2.7
pyo3 0.17.1
rand 0.8
rayon 1.5
smallvec 1.6
sqlparser 0.30
tempfile 3
tokio 1.0
tokio-stream 0.1
tokio-util 0.7.4
url 2.2
uuid 1.0
xz2 0.1

datafusion/optimizer/Cargo.toml cargo

ctor 0.1.22 development
datafusion-sql 16.0.0 development
env_logger 0.10.0 development
arrow 30.0.1
async-trait 0.1.41
chrono 0.4.23
datafusion-common 16.0.0
datafusion-expr 16.0.0
datafusion-physical-expr 16.0.0
hashbrown 0.13
log ^0.4
regex-syntax 0.6.28

datafusion/physical-expr/Cargo.toml cargo

criterion 0.4 development
rand 0.8 development
ahash 0.8
arrow 30.0.1
arrow-buffer 30.0.1
arrow-schema 30.0.1
blake2 ^0.10.2
blake3 1.0
chrono 0.4.23
datafusion-common 16.0.0
datafusion-expr 16.0.0
datafusion-row 16.0.0
half 2.1
hashbrown 0.13
indexmap 1.9.2
itertools 0.10
lazy_static ^1.4.0
md-5 ^0.10.0
num-traits 0.2
paste ^1.0
rand 0.8
regex ^1.4.3
sha2 ^0.10.1
unicode-segmentation ^1.7.1
uuid ^1.2

datafusion/wasmtest/datafusion-wasm-app/package.json npm

copy-webpack-plugin 6.4.1 development
webpack 5.88.2 development
webpack-cli 5.1.4 development
webpack-dev-server 4.15.1 development
datafusion-wasmtest ../pkg

.github/workflows/dev.yml actions

actions/checkout v3 composite
actions/setup-node v3 composite
actions/setup-python v4 composite

datafusion-cli/Dockerfile docker

debian bullseye-slim build
rust 1.62 build

conbench/requirements-test.txt pypi

black * test
flake8 * test
isort * test

conbench/requirements.txt pypi

conbench *

.github/actions/setup-builder/action.yaml actions

.github/workflows/dev_pr/labeler.yml actions

.github/workflows/docs.yaml actions

actions/checkout v4 composite
actions/setup-python v4 composite

.github/workflows/docs_pr.yaml actions

./.github/actions/setup-builder * composite
actions/checkout v4 composite

Cargo.toml cargo

datafusion/common/Cargo.toml cargo

rand 0.8.4 development
apache-avro 0.15
num_cpus 1.13.0
object_store 0.7.0
pyo3 0.19.0

datafusion/execution/Cargo.toml cargo

datafusion/expr/Cargo.toml cargo

ctor 0.2.0 development
env_logger 0.10 development
ahash 0.8
datafusion-common 31.0.0
strum 0.25.0
strum_macros 0.25.0

datafusion/physical-plan/Cargo.toml cargo

rstest 0.18.0 development
termtree 0.4.1 development
tokio 1.28 development
ahash 0.8
async-trait 0.1.41
chrono 0.4.23
datafusion-common 31.0.0
datafusion-execution 31.0.0
datafusion-expr 31.0.0
datafusion-physical-expr 31.0.0
futures 0.3
half 2.1
hashbrown 0.14
indexmap 2.0.0
itertools 0.11
log ^0.4
once_cell 1.18.0
parking_lot 0.12
pin-project-lite ^0.2.7
rand 0.8
tokio 1.28
uuid ^1.2

datafusion-cli/Cargo.toml cargo

assert_cmd 2.0 development
ctor 0.2.0 development
predicates 3.0 development
rstest 0.17 development
arrow 46.0.0
async-trait 0.1.41
aws-config 0.55
aws-credential-types 0.55
clap 3
datafusion 31.0.0
dirs 4.0.0
env_logger 0.9
mimalloc 0.1
object_store 0.7.0
parking_lot 0.12
regex 1.8
rustyline 11.0
tokio 1.24
url 2.2

datafusion-examples/Cargo.toml cargo

datafusion/proto/Cargo.toml cargo

tokio 1.18 development
datafusion 33.0.0
pbjson 0.5
prost 0.12.0
serde 1.0

datafusion/proto/gen/Cargo.toml cargo

datafusion/sql/Cargo.toml cargo

paste ^1.0 development
rstest 0.18 development

datafusion/sqllogictest/Cargo.toml cargo

bytes 1.4.0
datafusion 33.0.0
futures 0.3.28
postgres-protocol 0.6.4
postgres-types 0.2.4
rust_decimal 1.27.0
sqllogictest 0.19.0
tokio 1.0
tokio-postgres 0.7.7

datafusion/substrait/Cargo.toml cargo

datafusion/wasmtest/Cargo.toml cargo

docs/Cargo.toml cargo

test-utils/Cargo.toml cargo

datafusion-cli/Cargo.lock cargo

279 dependencies

datafusion/wasmtest/datafusion-wasm-app/package-lock.json npm

358 dependencies