dataframes | Topic | Ecosyste.ms: Repos

Topic: "dataframes"

pola-rs/polars

Extremely fast Query Engine for DataFrames, written in Rust

Language: Rust - Size: 204 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 35,882 - Forks: 2,442

unionai-oss/pandera

A light-weight, flexible, and expressive statistical data testing library

Language: Python - Size: 4.45 MB - Last synced at: 6 days ago - Pushed at: 20 days ago - Stars: 4,069 - Forks: 361

TileDB-Inc/TileDB

The Universal Storage Engine

Language: C++ - Size: 104 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 1,990 - Forks: 199

JuliaData/DataFrames.jl

In-memory tabular data in Julia

Language: Julia - Size: 29.9 MB - Last synced at: 8 days ago - Pushed at: 16 days ago - Stars: 1,796 - Forks: 374

skrub-data/skrub

Machine learning with dataframes

Language: Python - Size: 13.6 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1,483 - Forks: 167

rocketlaunchr/dataframe-go

DataFrames for Go: For statistics, machine-learning, and data manipulation/exploration

Language: Go - Size: 1010 KB - Last synced at: 9 days ago - Pushed at: over 3 years ago - Stars: 1,263 - Forks: 101

elixir-explorer/explorer

Series (one-dimensional) and dataframes (two-dimensional) for fast and elegant data exploration in Elixir

Language: Elixir - Size: 3.52 MB - Last synced at: about 23 hours ago - Pushed at: 9 days ago - Stars: 1,224 - Forks: 141

graphframes/graphframes

GraphFrames is a package for Apache Spark which provides DataFrame-based Graphs

Language: Scala - Size: 5.4 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1,086 - Forks: 254

pdpipe/pdpipe

Easy pipelines for pandas DataFrames.

Language: Jupyter Notebook - Size: 2.69 MB - Last synced at: about 4 hours ago - Pushed at: about 6 hours ago - Stars: 720 - Forks: 45

elastic/eland

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

Language: Python - Size: 20.9 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 685 - Forks: 109

capitalone/datacompy

Pandas, Polars, Spark, and Snowpark DataFrame comparison for humans and more!

Language: Python - Size: 11.6 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 605 - Forks: 147

polyaxon/traceml

Engine for ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

Language: Python - Size: 118 MB - Last synced at: 16 days ago - Pushed at: 5 months ago - Stars: 519 - Forks: 45

JuliaData/DataFramesMeta.jl

Metaprogramming tools for DataFrames

Language: Julia - Size: 1.54 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 492 - Forks: 57

static-frame/static-frame

Immutable and statically-typeable DataFrames with runtime type and data validation

Language: Python - Size: 34.2 MB - Last synced at: 7 days ago - Pushed at: 9 days ago - Stars: 474 - Forks: 35

stefmolin/pandas-workshop

An introductory workshop on pandas with notebooks and exercises for following along. Slides contain all solutions.

Language: Jupyter Notebook - Size: 27.5 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 410 - Forks: 832

aiguofer/gspread-pandas

A package to easily open an instance of a Google spreadsheet and interact with worksheets through Pandas DataFrames.

Language: Python - Size: 671 KB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 404 - Forks: 56

rtosholdings/riptable

64bit multithreaded python data analytics tools for numpy arrays and datasets

Language: Python - Size: 6.02 MB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 386 - Forks: 26

typedef-ai/fenic

Build reliable AI and agentic applications with DataFrames

Language: Python - Size: 21.5 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 373 - Forks: 23

Quick start: pip install jsoniq ⛈️ RumbleDB 2.0.0 "Lemon Ironwood" 🌳 for Apache Spark | Run queries on your large-scale, messy datasets (JSON, text, CSV, Parquet, Delta...) | Data Lakehouse with Updates, Scripting, Declarative Machine Learning and more

Language: Java - Size: 378 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 226 - Forks: 85

mahmoudparsian/data-algorithms-with-spark

O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian

Language: Python - Size: 44.9 MB - Last synced at: 6 months ago - Pushed at: over 2 years ago - Stars: 215 - Forks: 93

open2c/bioframe

Genomic interval operations on Pandas DataFrames

Language: Python - Size: 2.99 MB - Last synced at: 27 days ago - Pushed at: about 1 month ago - Stars: 183 - Forks: 34

alteryx/woodwork

Woodwork is a Python library that provides robust methods for managing and communicating data typing information.

Language: Python - Size: 3.2 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 155 - Forks: 23

DataHaskell/dh-core

Functional data science

Language: Haskell - Size: 1.18 MB - Last synced at: 12 days ago - Pushed at: almost 4 years ago - Stars: 142 - Forks: 22

sl-solution/InMemoryDatasets.jl

Multithreaded package for working with tabular data in Julia

Language: Julia - Size: 7.66 MB - Last synced at: 7 days ago - Pushed at: 18 days ago - Stars: 130 - Forks: 19

JuliaAcademy/DataFrames

Welcome to DataFrames.jl with Bogumił Kamiński

Language: Jupyter Notebook - Size: 501 KB - Last synced at: 2 months ago - Pushed at: over 2 years ago - Stars: 129 - Forks: 64

data-apis/dataframe-api

RFC document, tooling and other content related to the dataframe API standard

Language: Python - Size: 1.98 MB - Last synced at: 7 days ago - Pushed at: over 1 year ago - Stars: 108 - Forks: 21

biodatageeks/polars-bio

Blazing-Fast Bioinformatic Operations on Python DataFrames

Language: Python - Size: 33.1 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 100 - Forks: 25

zbrookle/dataframe_sql

A Python package that parses SQL and interprets it as methods that act upon existing pandas (or other types of) DataFrames that have been declared and registered

Language: Python - Size: 390 KB - Last synced at: about 1 month ago - Pushed at: about 4 years ago - Stars: 98 - Forks: 13

red-data-tools/red_amber

A dataframe library for Rubyists.

Language: Ruby - Size: 5.34 MB - Last synced at: 13 days ago - Pushed at: 6 months ago - Stars: 72 - Forks: 13

Thomas-George-T/Movies-Analytics-in-Spark-and-Scala

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

Language: Scala - Size: 11.3 MB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 63 - Forks: 46

zbrookle/sql_to_ibis

A Python package that parses sql and converts it to ibis expressions

Language: Python - Size: 499 KB - Last synced at: 7 months ago - Pushed at: almost 2 years ago - Stars: 54 - Forks: 7

wesselhuising/pandantic

Gone are the days of black-box dataframes in otherwise type-safe code! Pandantic builds off the Pydantic API to enable validation and filtering of the usual dataframe types (i.e., pandas, etc.)

Language: Python - Size: 342 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 53 - Forks: 3

hablapps/sparkOptics

Optics for Spark DataFrames

Language: Scala - Size: 58.6 KB - Last synced at: 4 months ago - Pushed at: over 4 years ago - Stars: 47 - Forks: 6

dlab-berkeley/R-Data-Wrangling-Legacy

D-Lab's 6 hour introduction to data wrangling with R. Learn how to manipulate dataframes using the tidyverse in R.

Language: R - Size: 6.23 MB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 37 - Forks: 17

JuliaGraphs/GraphDataFrameBridge.jl

Tools for interoperability between DataFrame objects and LightGraphs and MetaGraphs objects

Language: Julia - Size: 54.7 KB - Last synced at: 11 days ago - Pushed at: 2 months ago - Stars: 32 - Forks: 13

openweathermap/deker

Multidimensional arrays storage engine

Language: Python - Size: 5.22 MB - Last synced at: 3 months ago - Pushed at: about 1 year ago - Stars: 30 - Forks: 6

hackersandslackers/pandas-sqlalchemy-tutorial

:panda_face: :computer: Load or insert data into a SQL database using Pandas DataFrames.

Language: Python - Size: 3 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 29 - Forks: 7

isarn/isarn-sketches-spark

Routines and data structures for using isarn-sketches idiomatically in Apache Spark

Language: Scala - Size: 1.33 MB - Last synced at: 7 months ago - Pushed at: over 1 year ago - Stars: 29 - Forks: 12

ocramz/heidi

heidi : tidy data in Haskell

Language: Haskell - Size: 347 KB - Last synced at: 27 days ago - Pushed at: about 4 years ago - Stars: 29 - Forks: 3

JuliaData/DataTables.jl 📦

(DEPRECATED) A rewrite of DataFrames.jl based on Nullable

Language: Julia - Size: 7.96 MB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 29 - Forks: 11

sl-solution/DLMReader.jl

High-performance delimited-file reader and writer for Julia

Language: Julia - Size: 674 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 28 - Forks: 1

5j9/tsetmc

An async Python library to fetch data from https://tsetmc.com/

Language: Python - Size: 8.34 MB - Last synced at: 12 days ago - Pushed at: 21 days ago - Stars: 27 - Forks: 5

zgbjgg/jun

JUN - python pandas, plotly, seaborn support & dataframes manipulation over erlang

Language: Erlang - Size: 2.39 MB - Last synced at: about 1 month ago - Pushed at: about 5 years ago - Stars: 25 - Forks: 3

SemyonSinchenko/ibisgraph

An implementation of Pregel framework and graph algorithms on top of it with Ibis project DataFrames.

Language: Python - Size: 1000 KB - Last synced at: 20 days ago - Pushed at: 7 months ago - Stars: 23 - Forks: 0

JohannesOehm/FhirExtinguisher

FHIR Search Interface & Flatten FHIR resources into CSVs/DataFrames using FHIRPath.

Language: Vue - Size: 16.3 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 22 - Forks: 2

dkaslovsky/ElasticBatch

Elasticsearch tool for easily collecting and batch inserting Python data and pandas DataFrames

Language: Python - Size: 48.8 KB - Last synced at: 7 days ago - Pushed at: almost 6 years ago - Stars: 21 - Forks: 2

VangelisTech/archetype

An AI-Native ECS Simulation Engine combining the composibility of Pydantic with the distributed processing power of Daft Dataframes and Multi-Modal Big Data storage with LanceDB

Language: Python - Size: 1.84 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 19 - Forks: 3

scottlepp/go-duck

A Golang DuckDB library that doesn't require CGO

Language: Go - Size: 155 KB - Last synced at: 6 months ago - Pushed at: 9 months ago - Stars: 18 - Forks: 3

kmatarese/glide

Easy ETL

Language: Python - Size: 576 KB - Last synced at: about 2 months ago - Pushed at: about 3 years ago - Stars: 18 - Forks: 2

williambdean/frame-search

A GitHub search inspired interface to DataFrames

Language: Python - Size: 12.6 MB - Last synced at: about 17 hours ago - Pushed at: about 19 hours ago - Stars: 17 - Forks: 1

abhilash-1/pyspark-project

This is the first project where we worked on apache spark, In this project what we have done is that we downloaded the datasets from KAGGLE where everyone is aware of, we have downloaded loan, customers credit card and transactions datasets . After downloading the datsaets we have cleaned the data . Then after by using new tools and technologies like spark, HDFS, Hive and many more we have executed new use cases on the datasets we have downloaded from kaggle. As we all know apache spark is a framework that can quickly process the very large datsets.

Language: Jupyter Notebook - Size: 1.87 MB - Last synced at: 7 months ago - Pushed at: about 4 years ago - Stars: 17 - Forks: 13

ClementWalter/cairo-vm-df

A dataframe approach to the Cairo framework

Language: TypeScript - Size: 361 KB - Last synced at: 7 months ago - Pushed at: 9 months ago - Stars: 16 - Forks: 11

mohammadreza-mohammadi94/Data-Analysis-And-Machine-Learning-Projects

A comprehensive collection of data analysis and machine learning projects, showcasing techniques and models for various data challenges. Dive in to explore code examples, analyses, and machine learning workflows.

Language: Jupyter Notebook - Size: 194 MB - Last synced at: 27 days ago - Pushed at: 10 months ago - Stars: 15 - Forks: 3

surister/datasaurus

Data Engineering framework written in Python based in Polars.

Language: Python - Size: 377 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 14 - Forks: 4

lungben/TableIO.jl

A glue package for reading and writing tabular data. It aims to provide a uniform api for reading and writing tabular data from and to multiple sources.

Language: Julia - Size: 139 KB - Last synced at: 21 days ago - Pushed at: about 3 years ago - Stars: 14 - Forks: 3

AdikaStyle/go-df

Dataframes for Golang

Language: Go - Size: 104 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 14 - Forks: 2

PolicyEngine/microdf

Analysis tools for working with survey microdata as DataFrames.

Language: Python - Size: 12.6 MB - Last synced at: 14 days ago - Pushed at: 3 months ago - Stars: 13 - Forks: 10

FabianSchuetze/DataFrame

A Pandas-like DataFrame in c++

Language: C++ - Size: 27.3 MB - Last synced at: over 2 years ago - Pushed at: about 6 years ago - Stars: 13 - Forks: 4

MammothPHP/WoollyM

Dataframes library for data analysis. Providing an interface for easy data access, manipulation, and calculation. Data are stored in memory (native driver) or external storage (sql drivers or others), enabling the library to be used seamlessly as a connector. Exports and imports with popular formats (CSV, Spreadsheet, Json...) are also supported.

Language: PHP - Size: 1.95 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 11 - Forks: 0

cmungall/json-flattener

Python library for denormalizing nested dicts or json objects to tables and back

Language: Python - Size: 98.6 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 4

spark-root/laurelin

Allows reading ROOT TTrees into Apache Spark as DataFrames

Language: Java - Size: 934 KB - Last synced at: 2 months ago - Pushed at: over 2 years ago - Stars: 11 - Forks: 5

viraltux/SQLdf.jl

SQL for Julia Tables |> DataFrame

Language: Julia - Size: 25.4 KB - Last synced at: about 2 months ago - Pushed at: about 4 years ago - Stars: 11 - Forks: 0

oneoffcoder/pyspark-formula

R-like formula approach to Spark Dataframes

Language: Python - Size: 167 KB - Last synced at: about 1 month ago - Pushed at: almost 5 years ago - Stars: 10 - Forks: 1

hrbrain/goban

Fast and robust Dataframe package for Go

Language: Go - Size: 44.9 KB - Last synced at: over 1 year ago - Pushed at: almost 3 years ago - Stars: 9 - Forks: 2

SirRacha/Geospatial_Mapping_In_Python

A walkthrough of tutorials I made for working with geospatial data in Python. Includes my evaluations of Python geospatial libraries, tools and packages.

Language: Jupyter Notebook - Size: 118 MB - Last synced at: 6 months ago - Pushed at: over 5 years ago - Stars: 9 - Forks: 4

lfenzo/Impostor.jl

The highly versatile synthetic data generator

Language: Julia - Size: 1.14 MB - Last synced at: 4 months ago - Pushed at: 12 months ago - Stars: 7 - Forks: 0

dmyersturnbull/typed-dfs

Make Pandas DataFrames enforce definitions, self-organize, and correctly serialize in 18 formats.

Language: Python - Size: 1.27 MB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 7 - Forks: 0

openweathermap/deker-shell

Interactive management shell for Deker

Language: Python - Size: 134 KB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 7 - Forks: 0

m-clark/R-I-Basics

Getting started with using R more intently.

Size: 32.1 MB - Last synced at: 1 day ago - Pushed at: about 5 years ago - Stars: 7 - Forks: 2

cytomining/CytoDataFrame

An in-memory data analysis format for single-cell profiles alongside their corresponding images and segmentation masks.

Language: Python - Size: 72.5 MB - Last synced at: 12 days ago - Pushed at: 13 days ago - Stars: 6 - Forks: 2

mdbinger/Fantasy-Sports-Projections

Personal project to scrape MLB & NBA stats and analyze best performers to use for fantasy baseball and basketball drafts

Language: Jupyter Notebook - Size: 4.24 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 6 - Forks: 0

sbl-sdsc/df-parallel

Comparison of Dataframe libraries for parallel processing of large tabular files on CPU and GPU.

Language: Jupyter Notebook - Size: 3.33 MB - Last synced at: 7 months ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 3

justinhchae/pd-helper

A helpful package to streamline Pandas DataFrame optimization.

Language: Python - Size: 95.7 KB - Last synced at: about 1 month ago - Pushed at: almost 4 years ago - Stars: 6 - Forks: 0

gyuho/dataframe

Package dataframe implements data frame.

Language: Go - Size: 261 KB - Last synced at: 3 months ago - Pushed at: about 8 years ago - Stars: 6 - Forks: 0

vlad-bystrov/spark-user-feedback

Language: Scala - Size: 8.79 KB - Last synced at: 6 months ago - Pushed at: over 8 years ago - Stars: 6 - Forks: 6

openweathermap/deker-tools

Shared functions library for Deker components

Language: Python - Size: 232 KB - Last synced at: 4 days ago - Pushed at: almost 2 years ago - Stars: 5 - Forks: 0

pdiegel/FloridaPropertyData

A Python-based tool for retrieving and processing property data for specific counties in Florida using Parcel ID numbers. Simplifies data retrieval and offers customization options for real estate agents, investors, and government officials.

Language: Python - Size: 736 MB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 5 - Forks: 0

dlr-eoc/ukis-h3cellstore

High-level Rust and Python libraries to store H3 cells in ClickHouse databases

Language: Rust - Size: 1.76 MB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 2

blopezpi/mid-project-bdmlpt1021

COVID-19

Language: Jupyter Notebook - Size: 702 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 2

sahith/Link-Prediction-for-Citation-Networks-using-Apache-Spark

Link Prediction is about predicting the future connections in a graph. In this project, Link Prediction is about predicting whether two authors will be collaborating for their future paper or not given the graph of authors who collaborated for atleast one paper together.

Language: Scala - Size: 6.41 MB - Last synced at: over 2 years ago - Pushed at: almost 6 years ago - Stars: 5 - Forks: 1

enso-org/dataframes

A library for working with tabular data in Luna.

Language: C++ - Size: 2.96 MB - Last synced at: 7 days ago - Pushed at: over 6 years ago - Stars: 5 - Forks: 5

ryan-tobin/rustframes

A blazing fast, memory-safe alternative to NumPy + Pandas, written in Rust

Language: Rust - Size: 285 KB - Last synced at: 14 days ago - Pushed at: about 2 months ago - Stars: 4 - Forks: 0

navid-m/parallax

Pandas-like, performant dataframes library for data science

Language: D - Size: 209 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 4 - Forks: 0

jayeshbhandarkar/Web-Based-IPL-Team-Prediction

IPL Fantasy Cricket Dream 11 Team Predictor is a Flask Web Application that predicts the best fantasy cricket team based on player's previous records.

Language: HTML - Size: 5.95 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 4 - Forks: 1