GitHub topics: azure-synapse-analytics

Repositories

DHANA5982/Azure-Powered-Lakehouse-and-ETL-Framework

End-to-end data pipeline transforming Olist e-commerce data through Azure cloud services. Implements medallion architecture (Bronze-Silver-Gold) with multi-source ingestion, Spark-based processing, and OLTP-to-OLAP optimization for analytics-ready datasets.

Language: Jupyter Notebook - Size: 43.7 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 2 - Forks: 0

ronalddatcher/Project_Synapse

🧠 Build a cutting-edge AI agent with Project Synapse that enables strategic thought and multi-turn collaborative dialogue for innovation and discovery.

Size: 1.31 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 1 - Forks: 0

Richardbeko/Azure-End-to-End-Sales-Data-Analytics-Pipeline

🌥️ Build a complete Azure data pipeline for seamless migration, ETL, and analytics from on-premise databases to the cloud, leveraging Power BI for insights.

Size: 1.29 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0

Abdelrahman13-coder/Data-Integration-Pipelines-for-NYC-Payroll-Data-Analytics

Size: 3.97 MB - Last synced at: 2 days ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

hackolade/Synapse

Hackolade(https://hackolade.com) plugin for Azure Synapse (SQL Data Warehouse) and Parallel Data Warehouse

Language: JavaScript - Size: 13.3 MB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 1 - Forks: 11

UshanAlwis98/Adventure-Works

This project addresses a critical business need by building a comprehensive data pipeline on Azure. The goal is to extract customer and sales data from an on-premises SQL database, transform it in the cloud, and generate actionable insights through a Power BI dashboard.

Language: Jupyter Notebook - Size: 235 KB - Last synced at: 9 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

gargmukul91066/Adventure-Works-Azure-Data-Engineering-Project

Azure End To End Data Engineering Project

Language: Jupyter Notebook - Size: 4.04 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

microsoft/Purview-Machine-Learning-Lineage-Solution-Accelerator

Solution accelerator to help build Machine Learning Lineage

Language: Jupyter Notebook - Size: 5.22 MB - Last synced at: 13 days ago - Pushed at: over 2 years ago - Stars: 35 - Forks: 35

microsoft/Purview-Custom-Connector-Solution-Accelerator

Solution Accelerator to help build Purview custom connectors

Language: Jupyter Notebook - Size: 5.2 MB - Last synced at: 13 days ago - Pushed at: over 1 year ago - Stars: 45 - Forks: 18

neha-dev-dot/Adventure-Works

This project demonstrates a complete, real-world implementation of a modern data engineering pipeline using the Azure cloud ecosystem. Built around the AdventureWorks dataset, the pipeline follows the Medallion Architecture (Bronze → Silver → Gold), enabling structured data refinement from raw ingestion to business-ready insights.

Language: Jupyter Notebook - Size: 15.4 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

kevchant/GitHub-SynapseServerlessSQLPool

Template to perform CI/CD for Azure Synapse serverless SQL Pools using GitHub Actions

Language: TSQL - Size: 22.5 KB - Last synced at: 27 days ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

kevchant/GitHub-SynpaseServerlessSQLPool-dacpac

Template to create dacpac for serverless SQL Pool based on an existing database and deploy it

Size: 6.84 KB - Last synced at: 3 days ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

kevchant/GitHub-AzureSynapseLinkforSQLServer2022

A complete CI/CD solution for Azure Synapse Link for SQL Server 2022 using GitHub Actions

Language: TSQL - Size: 121 KB - Last synced at: 3 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

kevchant/AzureDevOps-SynpaseServerlessSQLPool-dacpac

Allows you to create a dacpac for an Azure Synapse Analytics serverless SQL Pool using Azure DevOps

Size: 24.4 KB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

kevchant/AzureDevOps-ServerlessSQLPool-HomemadeDBProject

Homemade database project for Azure Synapse serverless SQL Pool. For use with Azure DevOps.

Language: TSQL - Size: 11.7 KB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

jotstolu/Azure-Data-WareHouse-Project-Using-Azure-Synapse-Analytics

This Project involves building an e-commerce order data warehouse on Azure Synapse Analytic, leveraging the power of Azure Data Lake Storage Gen2, Synapse Pipelines, Data Flows, and Serverless SQL Pools.

Size: 7.81 KB - Last synced at: 10 days ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

wilson-mok/demo

In this repository, you will find varies demo and presentations I have delivered throughout the year. This includes the link to the video, the source codes and the data files.

Language: Jupyter Notebook - Size: 178 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 13 - Forks: 21

xom9s/sports

Repository for backend infrastructure of a project

Language: Python - Size: 73.2 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

TungPhamDuy/azure-data-warehouse-implementation

A comprehensive data warehousing project on Azure, utilizing Azure Synapse Analytics to build a scalable and performant data warehouse. Focuses on star schema design, ELT processes, and optimizing data for business intelligence and analytics on bikeshare data.

Language: TSQL - Size: 620 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

kevchant/AzureDevOps-SynapseServerlessSQLPool

Template to perform CI/CD for Azure Synapse serverless SQL Pools using Azure DevOps

Language: TSQL - Size: 33.2 KB - Last synced at: 5 months ago - Pushed at: about 1 year ago - Stars: 29 - Forks: 12

Azure-Samples/Synapse

Samples for Azure Synapse Analytics

Language: Jupyter Notebook - Size: 110 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 379 - Forks: 351

airscholar/FootballDataEngineering

An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Azure Data Lake. Other processing takes place on Azure Data Factory, Azure Synapse and Tableau.

Language: Python - Size: 469 KB - Last synced at: 7 months ago - Pushed at: about 2 years ago - Stars: 23 - Forks: 19

adithyavk9/DataEngineeringProjectAdventureWorks

An end to end data engineering project built on Azure

Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

kstrassheim/datawarehouse-crawler

This is a content and schema crawler tool to receive, update and import various kinds of data into a Onprem or Cloud based SQLServer or Azure-Synapse-Analysis (Azure Datawarehouse SQLServer). As source it supports SQLServer Tables, ODATA Endpoints, CSV Files or Excel Files. For multiple sources it can run in parallel mode where it would make a thread for each connection. The speciality of this crawler is that it creates the target tables by himself using the additional info from source.json. In case of Azure-Synapse-Analysis it would estimate the distribution type and keys. The syncing works completely without SQL Transactions by using a consistency correction algorithm for very frequent fact tables. There are 5 Syncing Algorithms (see Manual/Insert) which can be selected as well as one Update Algorithm.

Language: C# - Size: 4.17 MB - Last synced at: 7 months ago - Pushed at: over 3 years ago - Stars: 4 - Forks: 0

zBalachandar/Sales-Data-Analytics-Azure-Data-Engineering-End-to-End-Project-13

This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2017LT Database.

Language: Jupyter Notebook - Size: 23.3 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 9 - Forks: 4

Dimitrov-S-Dev/resume

Dimitrov-S-Dev Resume/ Portfolio

Language: CSS - Size: 23.1 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

SayamAlt/Azure-Synapse-Analytics-Course

This repository contains all scripts and notebooks created in the Azure Synapse Analytics course.course.

Language: TSQL - Size: 7.08 MB - Last synced at: 8 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

Adarsh-Hota/CDC_SCD-1_Pipeline

Real-time data ingestion and transformation pipeline for AirBnB using Azure Data Factory, Synapse, CosmosDB, and ADLS for automated CDC and analytical reporting.

Language: Python - Size: 360 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

microsoft/Azure-Synapse-Content-Recommendations-Solution-Accelerator

This is a solution accelerator for creating personalized content recommendations based on user activity.

Language: Jupyter Notebook - Size: 1.05 MB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 12 - Forks: 19

Sivaprasad-V/Tokyo-Olympics-Azure-Data-Engineering-Project

Azure End To End Data Engineering Project

Language: Jupyter Notebook - Size: 358 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

gudashashank/tokyo-olympics-analysis

An Azure cloud-based data analytics solution that processes and visualizes the 2021 Tokyo Olympics dataset. This end-to-end pipeline leverages Azure Data Factory for data ingestion, Data Lake Storage Gen2 for secure storage, Databricks for data transformation, Synapse Analytics for SQL querying, and Power BI for interactive visualization

Size: 1.18 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

Adarsh-Hota/ETL_fintech-data-migration

Data Migration with Azure Synapse, PySpark, and Delta Tables

Language: Jupyter Notebook - Size: 605 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

ShawonSimon/SuperStore-Sales-Data-Engineering

A comprehensive data engineering solution that transforms sales data from PostgreSQL into a star schema, moves it to Azure Synapse Analytics via Blob Storage, and creates Power BI dashboards for business insights.

Language: Python - Size: 2.65 MB - Last synced at: 7 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

fdmsantos/terraform-azurerm-synapse

Dynamic Terraform Module to create Azure Synapse Workspace and all Related Resources

Language: HCL - Size: 57.6 KB - Last synced at: 5 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 1

chayansraj/Microsoft-Azure-Medallion-Data-pipeline

In this project we are going to create an end-to-end data platform right from Data Ingestion, Data Transformation, Data Loading and Reporting.

Language: Jupyter Notebook - Size: 11.5 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 7 - Forks: 6

bennyaustin/pyspark-utils

Reusable Python classes that extend open source PySpark capabilities. Examples of implementation is available under notebooks of repo https://github.com/bennyaustin/synapse-dataplatform

Language: Python - Size: 36.1 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 9 - Forks: 4

lamiaaali/DEPI-Graduation-Project

SkinCare Sentiment Analysis Reviews

Language: Jupyter Notebook - Size: 7.72 MB - Last synced at: 5 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 2

brsavii/data-engineering-project

Development of a Data Pipeline using Azure Synapse

Language: Python - Size: 4.68 MB - Last synced at: 14 days ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

kevchant/AzureDevOps-AzureSynapseSQLPool

Template to perform CI/CD for Azure Synapse dedicated SQL Pools using Azure DevOps

Language: TSQL - Size: 41 KB - Last synced at: 5 months ago - Pushed at: about 1 year ago - Stars: 14 - Forks: 10

kevchant/GitHub-SynapseDedicatedSQLPool

Template to perform CI/CD for Azure Synapse dedicated SQL Pools using GitHub Actions

Language: TSQL - Size: 27.3 KB - Last synced at: 7 months ago - Pushed at: about 1 year ago - Stars: 5 - Forks: 2

kevchant/AzureDevOps-AzureSynapseLinkforSQLServer2022

CI/CD for Azure Synapse Link for SQL Server 2022

Language: TSQL - Size: 111 KB - Last synced at: 7 months ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 1

bennyaustin/synapse-dataplatform

A modern data platform implemented on Azure Synapse Analytics using ELT Framework - https://github.com/bennyaustin/elt-framework. Data platform infrastructure provisioned using https://github.com/bennyaustin/iac-synapse-dataplatform

Language: TSQL - Size: 1.79 MB - Last synced at: 11 months ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 6

qanhnn12/Data-Integration-Pipelines-for-NYC-Payroll-Data-Analytics

Project 4: Udacity Nanodegree Program - Data Engineering with Microsoft Azure

Language: TSQL - Size: 3.63 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

alexanderbean/E2E-Data-Engineering-in-Azure

End-to-end ETL pipeline in the Microsoft Azure cloud - (Jun '24 - Jul '24)

Language: Python - Size: 1.95 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

sandeep-khr/Tokyo-Olympics-Data-Insights-using-Azure

Size: 343 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

zBalachandar/Tokyo-Olympic-Data-Analytics-Azure-End-To-End-Data-Engineering-Project-12

Tokyo-olympic-azure-data-engineering-end-to-end-project

Language: HTML - Size: 44.5 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

gicastel/synapse-dwh-exps

Language: Shell - Size: 36.1 KB - Last synced at: over 1 year ago - Pushed at: about 5 years ago - Stars: 1 - Forks: 0

AdamPaternostro/Azure-SQL-DW-Synapse-Test-Case-Runner

Cross platform tool for running test cases in a serial or concurrently and log the results to a set of tables to see the results.

Language: C# - Size: 267 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 4

epomatti/az-synapse

Creating and loading data to Azure Synapse

Language: HCL - Size: 31.3 KB - Last synced at: 8 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 1

fvarga01/Azure-Talking-Points

Annotated Microsoft Azure documentation links used throughout day to day technical conversations.

Size: 10.8 MB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 10 - Forks: 2

Jcardif/SerengetiDataLab

An E2E solution of the Data Resources on Azure using the Snapshot Serengeti dataset. This E2E solution focuses Azure Synapse Analytics, Power Bi & the Azure Data Factory.

Language: Bicep - Size: 13 MB - Last synced at: 8 months ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 8

UdbhavSrivastava/Tokyo-Olympics-2020-DataPipeline

A cutting-edge data project leverages Azure's suite of services to seamlessly transform raw data from GitHub into actionable insights. Using Azure Data Factory for data ingestion, Databricks for PySpark transformations, Synapse Analytics for advanced analysis, and Power BI for intuitive visualization, this project navigates complex data workflows..

Language: Jupyter Notebook - Size: 173 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

mihirkudale/Olympic-data-analysis-azure-data-engineering-project

Language: Jupyter Notebook - Size: 143 KB - Last synced at: 8 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

sakethmukkanti/Machinery-Moniter-Iot-Streaming-With-Azure

An application developed to give real-time insights on machine health using Iot sensors by tracking and monitoring parameters such as temperature, pressure, current and humidity.

Language: Jupyter Notebook - Size: 210 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

dogucanelci/Azure_e2e_data_engineering_project_1

Language: Jupyter Notebook - Size: 11.6 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

aessing/demo-azuresynapse

This repository includes the demos and codes I use to play around with Azure Synapse Anayltics

Size: 80 MB - Last synced at: 5 months ago - Pushed at: about 3 years ago - Stars: 5 - Forks: 5

sakethmukkanti/Movielens-Dataset-Analysis-Azure-Data-Engineering-Project

Created a movie recommendation system on Azure utilizing Spark SQL for analyzing the MovieLens dataset.

Language: Jupyter Notebook - Size: 1.6 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

soferreira/openai-synapse-analytics

This sample shows how to leverage Azure OpenAI in Azure Synapse Analytics

Size: 448 KB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 4 - Forks: 3

christophermschmidt/monitor

Open Log Analytics queries and samples on querying different Azure resources and services. Includes sample Power BI reports

Language: PowerShell - Size: 3.51 MB - Last synced at: 11 months ago - Pushed at: over 3 years ago - Stars: 12 - Forks: 6

AnthonyByansi/BI-Hub-Insights-Analytics-and-Strategies

Your guide to navigating the world of Business Intelligence (BI)

Language: Shell - Size: 364 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

Shashi42/Azure-End-to-End-Sales-Data-Analytics-Pipeline

This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2022LT Database.

Language: Jupyter Notebook - Size: 501 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

gupta-aayushkr/NYC-Taxi-Project

An end-to-end data engineering project using Azure Synapse Analytics to analyze and transform NYC taxi data.

Language: TSQL - Size: 40 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

Heisenberghj7/AzureSynapseAnaytics-Pipeline

🧑‍💻☁️This GitHub repository documents a data pipeline solution designed and implemented as a freelance project for VisualDispatch, a prominent American logistics company. The primary objective was to develop a robust pipeline that transforms data seamlessly from Azure SQL to Azure Synapse Analytics.

Size: 171 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

microsoft/MCW-Modern-cloud-apps 📦

MCW Modern cloud apps

Language: JavaScript - Size: 403 MB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 110 - Forks: 140

pranoybej/terraform-azurerm-synapse-analytics

Language: HCL - Size: 29.3 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

nnellans/azure-synapse-analytics

CI/CD for Azure Synapse Analytics

Size: 34.2 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

lauranonato/data-analytics-engineer-project-olympics

end to end data analytics engineering project usind azure and databricks

Language: Jupyter Notebook - Size: 521 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

teddy-murigi/AzureSynapseWorkflows

This project leverages Azure Synapse Analytics service to create pipelines to copy data from a local SQL server table and a local CSV file into Azure Data Lake Gen 2. Subsequently, serverless SQL pools are employed to cleanse and transform this data, rendering it into a state suitable for analytical/reporting use in serverless Data Warehouse views.

Language: TSQL - Size: 58.6 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0