GitHub topics: medallion-architecture
anandanraju/LedgerLink_Data_Warehouse_Project_CRM_and_ERP
This Data Warehouse project is built on a Medallion Architecture design to manage and process information from CRM and ERP systems.
Size: 3.91 KB - Last synced at: 23 minutes ago - Pushed at: about 1 hour ago - Stars: 0 - Forks: 0

jlee9503/data-warehouse
Data Engineering project using MS SQL. Implemented ETL process. Data pipeline.
Language: TSQL - Size: 1.01 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 0 - Forks: 0

yrehim7/data_warehouse_project
A complete, easy-to-follow guide on building a modern data warehouse with SQL Server. Learn how to design ETL processes, create effective data models, and leverage analytics for better insights.
Language: TSQL - Size: 1.54 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0

MicrosoftCloudEssentials-LearningHub/MS-Fabric-Essentials-Workshop
Fabric Basic Workshop, these guides will elaborate on the standard architecture or features commonly used across industries.
Language: Jupyter Notebook - Size: 542 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 1 - Forks: 0

DataWithBaraa/sql-data-warehouse-project
A comprehensive guide to building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics.
Language: TSQL - Size: 20.5 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 124 - Forks: 111

Priya200227/sql-data-warehouse-project
Building a modern warehouse with SQL Server , including ETL processes , data modeling and analytics.
Language: TSQL - Size: 1.06 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 1 - Forks: 0

samuel-wahinya/VelociMart-Business-Intelligence-Report
This project showcases how i helped VelociMart shift from Excel-based reporting to a robust data infrastructure using SQL Server and Tableau. Built around Sales, Customers, and Products Data Marts, it follows the Medallion Architecture (Bronze → Silver → Gold) to deliver clean, analysis-ready views for effective business insights.
Language: TSQL - Size: 2.22 MB - Last synced at: 4 days ago - Pushed at: 9 days ago - Stars: 0 - Forks: 0

santoshshinde2012/delta-live-table-databricks-sample-use-case
Building Data Pipelines with Delta Live Tables: A Metadata-Driven Approach
Language: Jupyter Notebook - Size: 426 KB - Last synced at: 4 days ago - Pushed at: 13 days ago - Stars: 0 - Forks: 0

letfontenelle/data-pipeline-azure-medallion-architecture
This project focuses on building a data pipeline to analyze large sensor datasets collected from water bodies across European countries. By leveraging Azure Services, the pipeline ingests, processes, and visualizes data to gain insights into water quality trends and determinands.
Language: Jupyter Notebook - Size: 9.77 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 0 - Forks: 0

chriscrcodes/talk-to-your-factory
'Talk to Your Factory' demo leveraging Edge (Azure IoT Operations), Cloud (Microsoft Fabric), and a Factory Agent (Azure OpenAI), to streamline factory operations. It allows real-time, natural language communication with factory systems, helping operators quickly identify issues, boost efficiency, and minimize downtime.
Language: Python - Size: 25.2 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 17 - Forks: 6

CharlesEmil/sql-data-warehouse-project
Building a modern data warehouse with SQL Server, Including ETL processes, data modeling and analytics.
Language: TSQL - Size: 1.82 MB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 0 - Forks: 0

vmrchs/medallion-architecture-pipeline
This Brewery Data Pipeline demonstrates a practical implementation of the medallion architecture (bronze, silver, gold) for data processing. It extracts brewery information from the Open Brewery DB API, transforms the data through multiple stages, and prepares it for analysis.
Language: Python - Size: 12.7 KB - Last synced at: 25 days ago - Pushed at: 25 days ago - Stars: 0 - Forks: 0

MekWiset/Medallion_DataLakehouse
Building a Data Lakehouse using the Medallion architecture.
Language: Jupyter Notebook - Size: 887 KB - Last synced at: 8 days ago - Pushed at: 8 months ago - Stars: 1 - Forks: 3

MatDabS/SQL---DataWarehouse
Modern data warehouse with SQL Server. Includes initialization, ETL processes, data modeling and later analysis.
Language: TSQL - Size: 1.09 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

jibbs1703/Tickit-Data-Pipeline
This repository demonstrates the creation of a robust data pipeline using an Orchestrator, on-prem and cloud resources. It collects data from on-premises SQL and NoSQL database and loads it into a SQL database in the cloud.
Language: Python - Size: 50.8 KB - Last synced at: about 16 hours ago - Pushed at: about 17 hours ago - Stars: 0 - Forks: 0

Narius2030/MOLISA-Data-Warehouse
Extract data from many databases of Labor, Invalids and Social Affairs sectors and convert to appropriate structure and format, then upload to shared data warehouse and data mart. Thanks to that, people of state agencies can easily retrieve and analyze data based on the compiled data warehouse.
Language: PLpgSQL - Size: 8.9 MB - Last synced at: 19 days ago - Pushed at: 8 months ago - Stars: 3 - Forks: 0

mattiasthalen/arcane-insight
Arcane Insight is a data analytics project designed to harness the power of SQLMesh & DuckDB to collect, transform, and analyze data from Blizzard’s Hearthstone API. Focused on card statistics and attributes, this project reveals detailed insights into card mechanics, strengths, and trends to support BI and strategic analysis.
Language: Python - Size: 741 KB - Last synced at: 12 days ago - Pushed at: 3 months ago - Stars: 33 - Forks: 1

edisedis777/Airflow-DBT-DuckDB-Medallion
This project establishes a cost-effective data platform leveraging Airflow for orchestration, dbt for transformations, and DuckDB for ad-hoc analysis.
Language: Python - Size: 71.3 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

shinie19/sql-data-warehouse-project
Build a modern Data Warehouse from scratch with SQL Server, including ETL processes, data modeling and analytics.
Language: TSQL - Size: 677 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

hq969/Olympics-dataset-analysis
The Olympic Dataset Analysis project involves exploring and analyzing historical Olympic Games data, including athletes, countries, medals, sports, and event performance. Using data analytics and visualization techniques, this project uncovers patterns in Olympic history, top-performing countries, and athlete achievements.
Language: Jupyter Notebook - Size: 5.73 MB - Last synced at: 4 days ago - Pushed at: about 2 months ago - Stars: 2 - Forks: 0

Rudra-G-23/SQL-Data-Warehouse-Project
This repo provides a step-by-step approach to building a modern data warehouse using PostgreSQL. It covers the ETL (Extract, Transform, Load) process, data modeling, exploratory data analysis (EDA), and advanced data analysis techniques.
Language: PLpgSQL - Size: 9.32 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

joshjones-jp/Lab_JP_Medallion-Lakehouse-Architecture
Language: HTML - Size: 70.3 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

nxion/sql-data-warehouse-project
Building a modern data warehouse with MS SQL server, ETL processes, data modeling and analyitics.
Size: 806 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

Mariann95/SQL_Data_Warehouse_And_Analytics_Project
Building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics. This repository also contains a collection of SQL scripts demonstrating various analytical techniques, such as changes over time, cumulative, performance, data segmentation, part-to-whole analysis.
Language: TSQL - Size: 2.45 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

dev-vivekkumarverma/pyspark-databricks
spark, databricks, kafka, batch and stream-processing
Language: Jupyter Notebook - Size: 11.4 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

girfansyah/warehouse
Language: TSQL - Size: 320 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

santoshshinde2012/medallion-architecture-databrics
Medallion Architecture: Principles and Practical Exploration
Language: Jupyter Notebook - Size: 18.8 MB - Last synced at: 4 days ago - Pushed at: 2 months ago - Stars: 0 - Forks: 1

DataBells/data_warehouse_sql
Domain: E-commerce; Building a data warehouse with sql including ETL, modeling and analytics
Language: PLpgSQL - Size: 4.07 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

Narius2030/DataLake-Solution-IMCP
This project involved the development and implementation of a Data Lake architecture to support an AI model capable of generating image captions. The architecture was designed to efficiently ingest, process, and centralized store large volumes of image and text data.
Language: Python - Size: 193 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

najmaelboutaheri/Patents_analysis
This repository contains code and resources for analyzing patents using Apache Spark, Python, and AWS services. The objective of this project is to extract insights and trends from patent data to inform business decisions and intellectual property strategies.
Language: Jupyter Notebook - Size: 7.79 MB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

buneshka/Data-Pipeline-for-Customer-Account-Analysis
This project demonstrates the end-to-end process of building a data pipeline using Azure Synapse Analytics, Azure Data Factory (ADF), Databricks, and Delta Lake to ingest, clean, transform, and store data.
Language: Jupyter Notebook - Size: 11.7 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

ocramz/podium
Language: Python - Size: 1000 Bytes - Last synced at: 5 days ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

sachin413/End-to-End-Azure-Data-Engineering-Project
This repository contains a comprehensive end-to-end Azure Data Engineering solution, covering the entire data lifecycle from ingestion to reporting. The project utilizes various Azure services and tools to achieve efficient data handling, transformation, and reporting.
Language: Python - Size: 824 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

puffdapaz/IPEApython
Além de explorar boas práticas em python, o propósito é de aplicar conceitos de Arquitetura Medallion, programação orientada a objetos e ETL, utilizando dados públicos sociais dos municípios brasileiros. Este repositório utiliza ainda DuckDB e Streamlit para exibição dos resultados
Language: Python - Size: 20.3 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

duyanh711/RobustDataPipelineForModernDataEngineering
In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our cloud provider.
Size: 13.7 KB - Last synced at: about 2 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

demiguel122/lakehouse_ELT_e-commerce
This project implements a Lakehouse Medallion Architecture using modern Data Stack tools such as Fivetran, Snowflake and dbt. The ficticious organization is an e-commerce company.
Language: Python - Size: 148 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

AjNavneet/E2E_RideAnalytics_AzureDataFactory_Databricks
Implemented enhanced analytics for trip transactions and ride-based data from SQL Server using Medallion Architecture with Azure Data Factory and Databricks.
Language: Jupyter Notebook - Size: 685 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

shahinyusifli/dw-subscriptions
Data Warehouse with ELT pipelines
Language: Python - Size: 583 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

sinhaGuild/micro-lh
Language: TSQL - Size: 1.95 KB - Last synced at: 9 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0
