data-modeling | Topic | Ecosyste.ms: Repos

Topic: "data-modeling"

dbt-labs/dbt-core

dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications.

Language: Python - Size: 47 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 10,956 - Forks: 1,745

quarylabs/quary

Open-source BI for engineers

Language: Rust - Size: 105 MB - Last synced at: 12 days ago - Pushed at: 4 months ago - Stars: 2,308 - Forks: 57

data-engineering-community/data-engineering-wiki

The best place to learn data engineering. Built and maintained by the data engineering community.

Language: CSS - Size: 7.82 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 1,695 - Forks: 198

san089/Udacity-Data-Engineering-Projects

Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.

Language: Python - Size: 2.03 MB - Last synced at: 18 days ago - Pushed at: almost 3 years ago - Stars: 1,620 - Forks: 527

dbt-labs/metricflow

MetricFlow allows you to define, build, and maintain metrics in code.

Language: Python - Size: 35.5 MB - Last synced at: 2 days ago - Pushed at: 4 days ago - Stars: 1,224 - Forks: 104

bruin-data/bruin

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

Language: Go - Size: 146 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 947 - Forks: 41

alanchn31/Data-Engineering-Projects

Personal Data Engineering Projects

Language: Jupyter Notebook - Size: 2.92 MB - Last synced at: 24 days ago - Pushed at: over 2 years ago - Stars: 934 - Forks: 207

mswjs/data

Data modeling and relation library for testing JavaScript applications.

Language: TypeScript - Size: 893 KB - Last synced at: 25 days ago - Pushed at: 9 months ago - Stars: 879 - Forks: 55

fal-ai/dbt-fal 📦

do more with dbt. dbt-fal helps you run Python alongside dbt, so you can send Slack alerts, detect anomalies and build machine learning models.

Language: Python - Size: 5.13 MB - Last synced at: 8 days ago - Pushed at: about 1 year ago - Stars: 853 - Forks: 77

structr/structr

Structr is an integrated low-code development and runtime environment that uses a graph database.

Language: Java - Size: 403 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 801 - Forks: 157

monarch-initiative/ontogpt

LLM-based ontological extraction tools, including SPIRES

Language: Jupyter Notebook - Size: 80.6 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 689 - Forks: 96

Python library and web service for Open Source Software Health and Sustainability metrics & data collection. You can find our documentation and new contributor information easily here: https://oss-augur.readthedocs.io/en/main/

Language: Python - Size: 168 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 636 - Forks: 888

sujeet-agrahari/awesome-database-design

:zap: A collection of resources and tutorials to design a better database schema.

Size: 43 KB - Last synced at: about 1 month ago - Pushed at: 11 months ago - Stars: 580 - Forks: 65

ananas-analytics/ananas-desktop

A hackable data integration & analysis tool to enable non technical users to edit data processing jobs and visualise data on demand.

Language: Java - Size: 35.9 MB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 578 - Forks: 43

hofstadter-io/hof

Framework that joins data models, schemas, code generation, and a task engine. Language and technology agnostic.

Language: Go - Size: 8.7 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 552 - Forks: 40

morenoh149/postgresDBSamples

Sample databases for postgres

Language: PLpgSQL - Size: 43.6 MB - Last synced at: 24 days ago - Pushed at: over 1 year ago - Stars: 526 - Forks: 213

3rd/tsdiagram

Create diagrams and plan your code with TypeScript.

Language: TypeScript - Size: 398 KB - Last synced at: 25 days ago - Pushed at: 3 months ago - Stars: 459 - Forks: 20

dry-rb/dry-struct

Typed struct and value objects

Language: Ruby - Size: 781 KB - Last synced at: 4 days ago - Pushed at: 3 months ago - Stars: 424 - Forks: 62

linkml/linkml

Linked Open Data Modeling Language

Language: Python - Size: 103 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 377 - Forks: 122

tellery/tellery

Tellery lets you build metrics using SQL and bring them to your team. As easy as using a document. As powerful as a data modeling tool.

Language: TypeScript - Size: 6.39 MB - Last synced at: 25 days ago - Pushed at: 28 days ago - Stars: 356 - Forks: 26

ActivitySchema/ActivitySchema

Repository for the ActivitySchema spec and supporting materials

Size: 51.8 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 339 - Forks: 27

Flor91/Data-engineering-nanodegree

Projects done in the Data Engineering Nanodegree by Udacity.com

Language: Jupyter Notebook - Size: 20.4 MB - Last synced at: 22 days ago - Pushed at: almost 6 years ago - Stars: 273 - Forks: 180

ignoreintuition/jSchema

A simple, easy to use data modeling framework for JavaScript

Language: JavaScript - Size: 2.28 MB - Last synced at: 2 months ago - Pushed at: about 7 years ago - Stars: 266 - Forks: 19

aws-samples/amazon-dynamodb-design-patterns

This repo contains sample data models to demonstrate design patterns for Amazon DynamoDB.

Size: 2.7 MB - Last synced at: 12 days ago - Pushed at: over 4 years ago - Stars: 236 - Forks: 46

173TECH/sayn

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

Language: Python - Size: 4.28 MB - Last synced at: about 18 hours ago - Pushed at: 2 months ago - Stars: 121 - Forks: 15

Wittline/uber-expenses-tracking

The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.

Language: Jupyter Notebook - Size: 28.2 MB - Last synced at: 2 months ago - Pushed at: almost 3 years ago - Stars: 121 - Forks: 36

p2p-ld/numpydantic

Type annotations for specifying, validating, and serializing arrays with arbitrary backends in Pydantic (and beyond)

Language: Python - Size: 913 KB - Last synced at: 13 days ago - Pushed at: about 1 month ago - Stars: 108 - Forks: 1

finos/legend-studio

Legend Studio

Language: TypeScript - Size: 76.5 MB - Last synced at: 4 days ago - Pushed at: 6 days ago - Stars: 99 - Forks: 120

mattiasthalen/adventure-works

Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principles on Adventure Works. Features programmatic model generation, event-enhanced Puppini bridges, and temporal resolution across DAS/DAB/DAR layers.

Language: Python - Size: 18.4 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 95 - Forks: 8

GClunies/reflekt

Define, govern, and model event data for warehouse-first product analytics.

Language: Python - Size: 5.84 MB - Last synced at: 30 days ago - Pushed at: 12 months ago - Stars: 83 - Forks: 4

mara/mara-schema

Mapping of DWH database tables to business entities, attributes & metrics in Python, with automatic creation of flattened tables

Language: Python - Size: 3.87 MB - Last synced at: 26 days ago - Pushed at: over 1 year ago - Stars: 74 - Forks: 4

oslabs-beta/GraphQL-Blueprint

GraphQL Blueprint: a software developer tool for engineers that want to quickly generate React/Express, Apollo and GraphQL boilerplate code using a data modeling interface. Watch your queries, mutations, and schema update in realtime with our code preview feature and finally, export it when you're ready to begin building the rest of your app!

Language: JavaScript - Size: 22.6 MB - Last synced at: about 2 months ago - Pushed at: almost 4 years ago - Stars: 74 - Forks: 8

XiangyunHuang/data-analysis-in-action

:book: R 语言数据分析实战（写作中） Data Analysis in Action Using R

Language: TeX - Size: 594 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 73 - Forks: 18

malloydata/malloy-composer

Malloy Composer is a simple application to build dashboards or run ad-hoc queries using an existing Malloy model

Language: TypeScript - Size: 34.6 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 65 - Forks: 10

huzgd/ezdml

Lightweight data modeling and design tool (超轻量级的数据建模表结构设计工具)

Language: Pascal - Size: 9.01 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 59 - Forks: 8

kroudir/Data-Engineer-Nanodegree-Projects-Udacity

Projects done in the Data Engineer Nanodegree Program by Udacity.com

Language: Jupyter Notebook - Size: 1.9 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 57 - Forks: 31

sunilsoni/Cassandra-Data-Modeling

Basic Rules of Cassandra Data Modeling

Size: 72 MB - Last synced at: 2 months ago - Pushed at: over 7 years ago - Stars: 57 - Forks: 37

linkml/linkml-model

Link Modeling Language (LinkML) model

Language: Python - Size: 13.1 MB - Last synced at: 23 days ago - Pushed at: 26 days ago - Stars: 53 - Forks: 20

linkml/schema-automator

Automated assistance for the schema development lifecycle

Language: Python - Size: 8.8 MB - Last synced at: 2 days ago - Pushed at: 28 days ago - Stars: 48 - Forks: 18

dataforgelabs/dataforge-core

DataForge helps data teams write functional transformation pipelines by leveraging software engineering principles

Language: PLpgSQL - Size: 750 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 48 - Forks: 1

IreliaTable/irelia

A modern relational spreadsheet 🌈

Language: TypeScript - Size: 20.3 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 45 - Forks: 8

thefabric-io/eventsourcing

An efficient and robust Event Sourcing library for Go, designed for scalability and ease of use. Tailored for PostgreSQL, this library provides essential functionalities for storing and retrieving a sequence of events as the source of truth for the state of your application's aggregates. 🚀

Language: Go - Size: 77.1 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 44 - Forks: 3

Encapsule-Annex/jsgraph

Deprecated: Use the @encapsule/arccore package that includes the graph library

Language: JavaScript - Size: 378 KB - Last synced at: about 1 year ago - Pushed at: almost 7 years ago - Stars: 42 - Forks: 5

HarshCasper/HelpingHand

Leveraging Intelligent Processing Tools and Algorithms to help the Visually Impaired see and navigate 💥✨

Language: Dart - Size: 130 MB - Last synced at: 2 months ago - Pushed at: almost 4 years ago - Stars: 35 - Forks: 15

Fozan-Talat/divvy-bikeshare-de-project

An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using dbt and finally , a dashboard to visualize the data using looker studio, the pipeline is orchestrated using prefect

Language: Python - Size: 620 KB - Last synced at: 11 months ago - Pushed at: about 2 years ago - Stars: 34 - Forks: 5

nicosuave/awesome-sqlmesh

A curated list of awesome SQLMesh resources

Size: 25.4 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 33 - Forks: 1

razevedo1994/razv-data-engineering

Portfolio of projects and studies conducted in data engineering.

Language: Jupyter Notebook - Size: 70.2 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 33 - Forks: 3

Sinhaaz/Accenture-Data-Analytics-and-Visualization-Virtual-Internship

Accenture Data Analytics & Visualization Internship

Size: 3.9 MB - Last synced at: 27 days ago - Pushed at: about 2 years ago - Stars: 33 - Forks: 12

chenqingspring/rules-based-modeling-engine

一款基于规则的可视化模型构建引擎。支持指标定义，规则定义，多数据源接入，RESTful API 查询

Size: 149 KB - Last synced at: 10 days ago - Pushed at: about 3 years ago - Stars: 30 - Forks: 0

firebolt-db/dbt-firebolt

The dbt adapter for Firebolt

Language: Python - Size: 18.1 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 29 - Forks: 11

Systemorph/IFRS17CalculationEngine

Systemorph IFRS 17 Calculation Engine

Language: Jupyter Notebook - Size: 8.17 MB - Last synced at: 8 months ago - Pushed at: about 1 year ago - Stars: 28 - Forks: 5

malloydata/malloy-py

Python package for executing Malloy

Language: JavaScript - Size: 2.35 MB - Last synced at: 27 days ago - Pushed at: 4 months ago - Stars: 27 - Forks: 8

rayyan17/jobAnalytics_and_search

JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.

Language: Python - Size: 1.12 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 27 - Forks: 2

biocaddie/WG3-MetadataSpecifications

WG3 Metadata Specification

Language: Python - Size: 11.3 MB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 26 - Forks: 13

ozkary/data-engineering-mta-turnstile

Data Engineering - Metropolitan Transportation Authority (MTA) Subway Data Analysis

Language: Jupyter Notebook - Size: 12.9 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 25 - Forks: 4

cleverage/eav-manager

Blazing fast data modeling and enrichment

Language: JavaScript - Size: 2.12 MB - Last synced at: 18 days ago - Pushed at: over 4 years ago - Stars: 24 - Forks: 11

chayansraj/Data-Pipeline-with-dbt-using-Airflow-on-GCP

This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.

Language: Python - Size: 15 MB - Last synced at: 14 days ago - Pushed at: 15 days ago - Stars: 23 - Forks: 5

rnd-forests/skyline-query

Simple implementation of spatial skyline query algorithms

Language: Java - Size: 5.72 MB - Last synced at: 3 months ago - Pushed at: almost 3 years ago - Stars: 23 - Forks: 7

malloydata/malloy-vscode-extension

The Malloy Visual Studio Code extension facilitates building Malloy data models, querying and transforming data, and creating simple visualizations and dashboards

Language: TypeScript - Size: 16.6 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 22 - Forks: 15

Rpita623/Detecting-Credit-Card-Fraud

Using R and machine learning to build a classifier that can detect credit card fraudulent transactions.

Language: R - Size: 7.74 MB - Last synced at: 3 months ago - Pushed at: over 3 years ago - Stars: 22 - Forks: 9

marchinho11/hnhm

Toolkit for Agile-driven data modeling and data loading using highly Normalized hybrid Model

Language: Python - Size: 334 KB - Last synced at: 7 days ago - Pushed at: 6 months ago - Stars: 21 - Forks: 3

archiewood/analytics_monorepo

A monorepo combining data modelling in dbt with data viz using Evidence

Language: Dockerfile - Size: 815 KB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 21 - Forks: 4

linuxacademy/content-dynamodb-datamodeling

Amazon DynamoDB Data Modeling Course

Language: Python - Size: 2.96 MB - Last synced at: about 2 months ago - Pushed at: 12 months ago - Stars: 19 - Forks: 30

Knowledge-Graph-Hub/kg-microbe

Language: Jupyter Notebook - Size: 529 MB - Last synced at: 28 days ago - Pushed at: about 1 month ago - Stars: 18 - Forks: 3

SAP-archive/data-warehouse-cloud-modeling 📦

This repository aims to onboard new users into Modeling in SAP Data Warehouse Cloud in the most practical manner. For that you will build a real working data model, which will embrace specific features and functions.

Size: 47.2 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 18 - Forks: 6

malloydata/malloy-samples

Malloy model examples and associated datasets

Language: TypeScript - Size: 75.7 MB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 17 - Forks: 14

dfhawthorne/Data_Model_Resource_Book

Data models built on "The Data Model Resource Book Vol. 1" by Len Silverton

Language: PLSQL - Size: 801 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 17 - Forks: 4

zkan/swu-ds525

DS525

Language: Jupyter Notebook - Size: 11.6 MB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 16 - Forks: 7

nichtich/tkz-orm

Object-Role Modeling diagrams in TeX

Language: TeX - Size: 2.23 MB - Last synced at: 2 months ago - Pushed at: over 9 years ago - Stars: 15 - Forks: 3

leav-solutions/leav-engine

NoCode Platform, turn your data into application

Language: TypeScript - Size: 138 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 14 - Forks: 6

snowplow/dbt-snowplow-mobile

A fully incremental model, that transforms raw mobile event data generated by the Snowplow mobile trackers into a series of derived tables of varying levels of aggregation.

Language: Shell - Size: 1.67 MB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 14 - Forks: 5

hackolade/OpenAPI

Hackolade plugin for OpenAPI 3 API documentation

Language: JavaScript - Size: 4.96 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 14 - Forks: 10

DISSINET/InkVisitor

An open-source, browser-based front-end application for the collection of complex structured data from textual resources in history and the social sciences into a RethinkDB database for further analysis.

Language: Jupyter Notebook - Size: 238 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 13 - Forks: 2

saboye/Data-Modeling-with-Postgres

A project to design a fact and dimension star schema for optimizing queries on a flight booking database using PostgreSQL, a relational database management system. This schema is well-suited for a flight booking database, as it allows for efficient querying of data such as booking dates, flight routes, and passenger information.

Language: PLpgSQL - Size: 24.3 MB - Last synced at: 27 days ago - Pushed at: almost 4 years ago - Stars: 10 - Forks: 3

sradevski/aida

Unified data modeling

Language: JavaScript - Size: 2.94 MB - Last synced at: 4 days ago - Pushed at: almost 6 years ago - Stars: 10 - Forks: 0

mahmoudparsian/data-warehousing

This repository is a place for the Data Warehousing course at the Information Systems & Analytics department, Santa Clara University.

Language: Jupyter Notebook - Size: 538 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 9 - Forks: 2

zizmorcore/github-actions-models 📦

Unofficial Rust data models for GitHub Actions

Language: Rust - Size: 184 KB - Last synced at: 7 days ago - Pushed at: 27 days ago - Stars: 9 - Forks: 5

snowplow/dbt-snowplow-media-player

A fully incremental model, that transforms media player event data generated by the Snowplow JavaScript tracker into derived tables for easier querying

Language: Shell - Size: 1.88 MB - Last synced at: about 2 months ago - Pushed at: 6 months ago - Stars: 9 - Forks: 3

tuankhoin/SEIQHCDRO-Interactive-Model

Interactive website that takes different scenarios to predict COVID outcomes in different areas. Featured on Forbes Under 30 Vietnam 2021.

Language: Python - Size: 849 KB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 9 - Forks: 3

malloydata/malloy-cli

A command-line interface for executing Malloy and SQL

Language: TypeScript - Size: 5.11 MB - Last synced at: 5 days ago - Pushed at: about 1 month ago - Stars: 8 - Forks: 5

virajbhutada/power-BI-resources

Comprehensive Power BI resources covering interview questions, group training materials, project portfolio ideas, and a cheat sheet for quick reference. Elevate your Power BI skills with curated content designed to enhance your proficiency and boost project success.

Size: 62.9 MB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 8 - Forks: 2

marklogic/entity-services 📦

Data modeling and code scaffolding for data integration in MarkLogic

Language: XQuery - Size: 6.75 MB - Last synced at: about 1 year ago - Pushed at: almost 6 years ago - Stars: 8 - Forks: 10

metaheed/kolle

Business model representation automation

Language: Shell - Size: 154 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 7 - Forks: 1

BeameryEdge/queryCraft

A Multi-Database JavaScript query builder

Language: TypeScript - Size: 606 KB - Last synced at: 21 days ago - Pushed at: over 3 years ago - Stars: 7 - Forks: 1

cognitedata/pygen

The Cognite Python Data Modeling SDK Generator

Language: Python - Size: 20.3 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 6 - Forks: 0

MEDomics-UdeS/MEDomicsLab

Language: JavaScript - Size: 392 MB - Last synced at: 12 days ago - Pushed at: 13 days ago - Stars: 6 - Forks: 4

virajbhutada/US-healthcare-analysis-powerBI

Unlock insights into the U.S. healthcare landscape from 2019 to 2020. Our PowerBI-driven analysis delves into hospital performance, patient outcomes, and payer-provider dynamics. Dive into detailed reports and visualizations for informed decision-making, empowering healthcare stakeholders, and shaping the industry's future.

Size: 41.8 MB - Last synced at: 4 months ago - Pushed at: 9 months ago - Stars: 6 - Forks: 3

cefriel/competence-kg

A tutorial on Knowledge Graphs discussing how to model the employee competences within a company

Language: Jupyter Notebook - Size: 561 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 2

memgonzales/pisa-2018-analysis

Jupyter notebook presenting the process of data preparation, research question formulation, data analysis, and data modeling with the goal of extracting insights from the 2018 PISA Dataset

Language: Jupyter Notebook - Size: 3.02 MB - Last synced at: 4 days ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 0