An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: medallion-architecture

anandanraju/LedgerLink_Data_Warehouse_Project_CRM_and_ERP

This Data Warehouse project is built on a Medallion Architecture design to manage and process information from CRM and ERP systems.

Size: 3.91 KB - Last synced at: 23 minutes ago - Pushed at: about 1 hour ago - Stars: 0 - Forks: 0

jlee9503/data-warehouse

Data Engineering project using MS SQL. Implemented ETL process. Data pipeline.

Language: TSQL - Size: 1.01 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 0 - Forks: 0

yrehim7/data_warehouse_project

A complete, easy-to-follow guide on building a modern data warehouse with SQL Server. Learn how to design ETL processes, create effective data models, and leverage analytics for better insights.

Language: TSQL - Size: 1.54 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0

MicrosoftCloudEssentials-LearningHub/MS-Fabric-Essentials-Workshop

Fabric Basic Workshop, these guides will elaborate on the standard architecture or features commonly used across industries.

Language: Jupyter Notebook - Size: 542 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 1 - Forks: 0

DataWithBaraa/sql-data-warehouse-project

A comprehensive guide to building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics.

Language: TSQL - Size: 20.5 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 124 - Forks: 111

Priya200227/sql-data-warehouse-project

Building a modern warehouse with SQL Server , including ETL processes , data modeling and analytics.

Language: TSQL - Size: 1.06 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 1 - Forks: 0

samuel-wahinya/VelociMart-Business-Intelligence-Report

This project showcases how i helped VelociMart shift from Excel-based reporting to a robust data infrastructure using SQL Server and Tableau. Built around Sales, Customers, and Products Data Marts, it follows the Medallion Architecture (Bronze → Silver → Gold) to deliver clean, analysis-ready views for effective business insights.

Language: TSQL - Size: 2.22 MB - Last synced at: 4 days ago - Pushed at: 9 days ago - Stars: 0 - Forks: 0

santoshshinde2012/delta-live-table-databricks-sample-use-case

Building Data Pipelines with Delta Live Tables: A Metadata-Driven Approach

Language: Jupyter Notebook - Size: 426 KB - Last synced at: 4 days ago - Pushed at: 13 days ago - Stars: 0 - Forks: 0

letfontenelle/data-pipeline-azure-medallion-architecture

This project focuses on building a data pipeline to analyze large sensor datasets collected from water bodies across European countries. By leveraging Azure Services, the pipeline ingests, processes, and visualizes data to gain insights into water quality trends and determinands.

Language: Jupyter Notebook - Size: 9.77 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 0 - Forks: 0

chriscrcodes/talk-to-your-factory

'Talk to Your Factory' demo leveraging Edge (Azure IoT Operations), Cloud (Microsoft Fabric), and a Factory Agent (Azure OpenAI), to streamline factory operations. It allows real-time, natural language communication with factory systems, helping operators quickly identify issues, boost efficiency, and minimize downtime.

Language: Python - Size: 25.2 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 17 - Forks: 6

CharlesEmil/sql-data-warehouse-project

Building a modern data warehouse with SQL Server, Including ETL processes, data modeling and analytics.

Language: TSQL - Size: 1.82 MB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 0 - Forks: 0

vmrchs/medallion-architecture-pipeline

This Brewery Data Pipeline demonstrates a practical implementation of the medallion architecture (bronze, silver, gold) for data processing. It extracts brewery information from the Open Brewery DB API, transforms the data through multiple stages, and prepares it for analysis.

Language: Python - Size: 12.7 KB - Last synced at: 25 days ago - Pushed at: 25 days ago - Stars: 0 - Forks: 0

MekWiset/Medallion_DataLakehouse

Building a Data Lakehouse using the Medallion architecture.

Language: Jupyter Notebook - Size: 887 KB - Last synced at: 8 days ago - Pushed at: 8 months ago - Stars: 1 - Forks: 3

MatDabS/SQL---DataWarehouse

Modern data warehouse with SQL Server. Includes initialization, ETL processes, data modeling and later analysis.

Language: TSQL - Size: 1.09 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

jibbs1703/Tickit-Data-Pipeline

This repository demonstrates the creation of a robust data pipeline using an Orchestrator, on-prem and cloud resources. It collects data from on-premises SQL and NoSQL database and loads it into a SQL database in the cloud.

Language: Python - Size: 50.8 KB - Last synced at: about 16 hours ago - Pushed at: about 17 hours ago - Stars: 0 - Forks: 0

Narius2030/MOLISA-Data-Warehouse

Extract data from many databases of Labor, Invalids and Social Affairs sectors and convert to appropriate structure and format, then upload to shared data warehouse and data mart. Thanks to that, people of state agencies can easily retrieve and analyze data based on the compiled data warehouse.

Language: PLpgSQL - Size: 8.9 MB - Last synced at: 19 days ago - Pushed at: 8 months ago - Stars: 3 - Forks: 0

mattiasthalen/arcane-insight

Arcane Insight is a data analytics project designed to harness the power of SQLMesh & DuckDB to collect, transform, and analyze data from Blizzard’s Hearthstone API. Focused on card statistics and attributes, this project reveals detailed insights into card mechanics, strengths, and trends to support BI and strategic analysis.

Language: Python - Size: 741 KB - Last synced at: 12 days ago - Pushed at: 3 months ago - Stars: 33 - Forks: 1

edisedis777/Airflow-DBT-DuckDB-Medallion

This project establishes a cost-effective data platform leveraging Airflow for orchestration, dbt for transformations, and DuckDB for ad-hoc analysis.

Language: Python - Size: 71.3 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

shinie19/sql-data-warehouse-project

Build a modern Data Warehouse from scratch with SQL Server, including ETL processes, data modeling and analytics.

Language: TSQL - Size: 677 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

hq969/Olympics-dataset-analysis

The Olympic Dataset Analysis project involves exploring and analyzing historical Olympic Games data, including athletes, countries, medals, sports, and event performance. Using data analytics and visualization techniques, this project uncovers patterns in Olympic history, top-performing countries, and athlete achievements.

Language: Jupyter Notebook - Size: 5.73 MB - Last synced at: 4 days ago - Pushed at: about 2 months ago - Stars: 2 - Forks: 0

Rudra-G-23/SQL-Data-Warehouse-Project

This repo provides a step-by-step approach to building a modern data warehouse using PostgreSQL. It covers the ETL (Extract, Transform, Load) process, data modeling, exploratory data analysis (EDA), and advanced data analysis techniques.

Language: PLpgSQL - Size: 9.32 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

joshjones-jp/Lab_JP_Medallion-Lakehouse-Architecture

Language: HTML - Size: 70.3 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

nxion/sql-data-warehouse-project

Building a modern data warehouse with MS SQL server, ETL processes, data modeling and analyitics.

Size: 806 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Mariann95/SQL_Data_Warehouse_And_Analytics_Project

Building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics. This repository also contains a collection of SQL scripts demonstrating various analytical techniques, such as changes over time, cumulative, performance, data segmentation, part-to-whole analysis.

Language: TSQL - Size: 2.45 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

dev-vivekkumarverma/pyspark-databricks

spark, databricks, kafka, batch and stream-processing

Language: Jupyter Notebook - Size: 11.4 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

girfansyah/warehouse

Language: TSQL - Size: 320 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

santoshshinde2012/medallion-architecture-databrics

Medallion Architecture: Principles and Practical Exploration

Language: Jupyter Notebook - Size: 18.8 MB - Last synced at: 4 days ago - Pushed at: 2 months ago - Stars: 0 - Forks: 1

DataBells/data_warehouse_sql

Domain: E-commerce; Building a data warehouse with sql including ETL, modeling and analytics

Language: PLpgSQL - Size: 4.07 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

Narius2030/DataLake-Solution-IMCP

This project involved the development and implementation of a Data Lake architecture to support an AI model capable of generating image captions. The architecture was designed to efficiently ingest, process, and centralized store large volumes of image and text data.

Language: Python - Size: 193 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

najmaelboutaheri/Patents_analysis

This repository contains code and resources for analyzing patents using Apache Spark, Python, and AWS services. The objective of this project is to extract insights and trends from patent data to inform business decisions and intellectual property strategies.

Language: Jupyter Notebook - Size: 7.79 MB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

buneshka/Data-Pipeline-for-Customer-Account-Analysis

This project demonstrates the end-to-end process of building a data pipeline using Azure Synapse Analytics, Azure Data Factory (ADF), Databricks, and Delta Lake to ingest, clean, transform, and store data.

Language: Jupyter Notebook - Size: 11.7 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

ocramz/podium

Language: Python - Size: 1000 Bytes - Last synced at: 5 days ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

sachin413/End-to-End-Azure-Data-Engineering-Project

This repository contains a comprehensive end-to-end Azure Data Engineering solution, covering the entire data lifecycle from ingestion to reporting. The project utilizes various Azure services and tools to achieve efficient data handling, transformation, and reporting.

Language: Python - Size: 824 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

puffdapaz/IPEApython

Além de explorar boas práticas em python, o propósito é de aplicar conceitos de Arquitetura Medallion, programação orientada a objetos e ETL, utilizando dados públicos sociais dos municípios brasileiros. Este repositório utiliza ainda DuckDB e Streamlit para exibição dos resultados

Language: Python - Size: 20.3 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

duyanh711/RobustDataPipelineForModernDataEngineering

In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our cloud provider.

Size: 13.7 KB - Last synced at: about 2 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

demiguel122/lakehouse_ELT_e-commerce

This project implements a Lakehouse Medallion Architecture using modern Data Stack tools such as Fivetran, Snowflake and dbt. The ficticious organization is an e-commerce company.

Language: Python - Size: 148 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

AjNavneet/E2E_RideAnalytics_AzureDataFactory_Databricks

Implemented enhanced analytics for trip transactions and ride-based data from SQL Server using Medallion Architecture with Azure Data Factory and Databricks.

Language: Jupyter Notebook - Size: 685 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

shahinyusifli/dw-subscriptions

Data Warehouse with ELT pipelines

Language: Python - Size: 583 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

sinhaGuild/micro-lh

Language: TSQL - Size: 1.95 KB - Last synced at: 9 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0