azure-data-factory | Topic | Ecosyste.ms: Repos

Topic: "azure-data-factory"

Azure-Player/azure.datafactory.tools

Tools for deploying Data Factory (v2) in Microsoft Azure

Language: PowerShell - Size: 1020 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 242 - Forks: 80

microsoft/MCW-Big-data-analytics-and-visualization 📦

MCW Big data analytics and visualization

Language: JavaScript - Size: 148 MB - Last synced at: about 1 year ago - Pushed at: almost 3 years ago - Stars: 189 - Forks: 186

microsoft/data-factory-testing-framework

A stand-alone test framework that allows to write unit tests for Data Factory pipelines on Microsoft Fabric, Azure Data Factory and Azure Synapse Analytics.

Language: Python - Size: 3.85 MB - Last synced at: 5 days ago - Pushed at: about 1 month ago - Stars: 108 - Forks: 33

Mmodarre/AzureDataFactoryHOL

Azure Data Factory Hands On Lab - Step by Step - A Comprehensive Azure Data Factory and Mapping Data Flow step by step tutorial

Size: 97.9 MB - Last synced at: 7 months ago - Pushed at: about 4 years ago - Stars: 68 - Forks: 63

furmangg/automating-azure-analysis-services

Code samples for a SQL Saturday presentation on the topic of Automating Azure Analysis Services

Language: JavaScript - Size: 987 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 62 - Forks: 27

tomaztk/Azure-Databricks

Azure Databricks - Advent of 2020 Blogposts

Language: Jupyter Notebook - Size: 44.9 MB - Last synced at: 3 months ago - Pushed at: almost 3 years ago - Stars: 60 - Forks: 49

justBlindbaek/PowerBIMonitor

A complete solution to extract the Power BI audit log, Power BI tenant metadata and Microsoft Graph data. Using Azure Data Factory or Integration Pipelines in Azure Synapse Analytics

Language: TSQL - Size: 176 KB - Last synced at: 4 days ago - Pushed at: almost 2 years ago - Stars: 59 - Forks: 19

Jayvardhan-Reddy/Azure-Certification-DP-200

Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution

Size: 4.42 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 57 - Forks: 46

AdamPaternostro/Azure-Data-Factory-CI-CD-Source-Control

How do to CI/CD with Azure Data Factory

Language: PowerShell - Size: 2.31 MB - Last synced at: 3 months ago - Pushed at: over 4 years ago - Stars: 41 - Forks: 35

justBlindbaek/TraditionalModernDW

Simple cloud only DWH solution architecture.

Language: TSQL - Size: 108 KB - Last synced at: 4 days ago - Pushed at: over 2 years ago - Stars: 40 - Forks: 7

rlevchenko/terraform-azure-data

Terraform script to deploy almost all Azure Data Services

Language: HCL - Size: 26.4 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 35 - Forks: 26

liprec/vsts-publish-adf

This extension adds Azure Data Factory release tasks to Azure Pipelines.

Language: PowerShell - Size: 3.78 MB - Last synced at: about 1 year ago - Pushed at: about 3 years ago - Stars: 27 - Forks: 13

AnalyticJeremy/ADF_BigQuery

How to authenticate to Google Big Query when connecting from Azure Data Factory v2

Language: PowerShell - Size: 300 KB - Last synced at: 8 days ago - Pushed at: over 4 years ago - Stars: 26 - Forks: 8

gbrueckl/Azure.DataFactory.LocalEnvironment

This code allows you to load any existing Azure Data Factory project file (*.dfproj) and perform further actions like "Export to ARM Template" or to debug custom C# activities

Language: C# - Size: 9.39 MB - Last synced at: 15 days ago - Pushed at: about 6 years ago - Stars: 26 - Forks: 18

airscholar/FootballDataEngineering

An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Azure Data Lake. Other processing takes place on Azure Data Factory, Azure Synapse and Tableau.

Language: Python - Size: 469 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 23 - Forks: 19

Jayvardhan-Reddy/Azure-Certification-DP-201

Road to Azure Data Engineer Part-II: DP-201 - Designing an Azure Data Solution

Size: 3.59 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 17 - Forks: 15

wilson-mok/demo

In this repository, you will find varies demo and presentations I have delivered throughout the year. This includes the link to the video, the source codes and the data files.

Language: Jupyter Notebook - Size: 178 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 13 - Forks: 21

areed1192/trading-system

A python application that leverages Microsoft Azure to build a fully functional trading system.

Language: Python - Size: 101 KB - Last synced at: 3 months ago - Pushed at: about 2 years ago - Stars: 13 - Forks: 2

ROBROICH/AZURE_SYNAPSE_AND_SAP_SFLIGHT_DEMO

Azure Synapse and SAP SFLIGHT demo application integration scenario

Size: 4.08 MB - Last synced at: 3 months ago - Pushed at: about 4 years ago - Stars: 13 - Forks: 2

dataplat/AzureDataPipelineTools

A collection of Azure Function to make building Azure Data Factory pipeline simpler and easier.

Language: C# - Size: 212 KB - Last synced at: about 2 months ago - Pushed at: almost 4 years ago - Stars: 12 - Forks: 5

furmangg/automating-azure-sql-dw

Code samples for an Ignite conference presentation on the topic of Automating Azure SQL Data Warehouse

Language: PowerShell - Size: 4.91 MB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 12 - Forks: 5

fabioms-br/azure-data-factory

Aprender Gerencimento de Dados ETL/ELT

Size: 80.1 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 11 - Forks: 1

AnthonyByansi/Azure-Data-Fundamentals-Guide

A comprehensive guide to understanding and implementing data management and analytics solutions in the Azure ecosystem using Azure Data Fundamentals.

Language: Mermaid - Size: 74.2 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 10 - Forks: 3

fvarga01/Azure-Talking-Points

Annotated Microsoft Azure documentation links used throughout day to day technical conversations.

Size: 10.8 MB - Last synced at: 10 months ago - Pushed at: over 3 years ago - Stars: 10 - Forks: 2

AdamPaternostro/Azure-App-Insights-Distrubuted-Tracing

How to use Application Insights to do distributed tracing through a Web App, REST API, Function App, Service Bus, Databricks and Data Factory.

Language: C# - Size: 1.63 MB - Last synced at: 3 months ago - Pushed at: about 6 years ago - Stars: 10 - Forks: 1

zBalachandar/Sales-Data-Analytics-Azure-Data-Engineering-End-to-End-Project-13

This project builds an End-to-End Azure Data Engineering Pipeline, performing ETL and Analytics Reporting on the AdventureWorks2017LT Database.

Language: Jupyter Notebook - Size: 23.3 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 9 - Forks: 4

Jcardif/SerengetiDataLab

An E2E solution of the Data Resources on Azure using the Snapshot Serengeti dataset. This E2E solution focuses Azure Synapse Analytics, Power Bi & the Azure Data Factory.

Language: Bicep - Size: 13 MB - Last synced at: 3 months ago - Pushed at: almost 2 years ago - Stars: 9 - Forks: 8

MSBrett/ccm_datafactory

An example of how to use Azure Data Factory to retrieve usage data from the Azure Management API and store the results in Azure Data Lake.

Language: PowerShell - Size: 278 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 8 - Forks: 3

AdamPaternostro/Azure-Big-Data-and-Machine-Learning-Architecture

A ready to use architecture for processing data and performing machine learning in Azure

Language: C# - Size: 10.7 MB - Last synced at: 8 days ago - Pushed at: almost 5 years ago - Stars: 8 - Forks: 3

arcus-azure/arcus.testing

In short: Arcus Testing is a set of libraries that makes tests more fun to write!

Language: C# - Size: 1.28 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 7 - Forks: 3

chayansraj/Microsoft-Azure-Medallion-Data-pipeline

In this project we are going to create an end-to-end data platform right from Data Ingestion, Data Transformation, Data Loading and Reporting.

Language: Jupyter Notebook - Size: 11.5 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 7 - Forks: 6

bennyaustin/synapse-dataplatform

A modern data platform implemented on Azure Synapse Analytics using ELT Framework - https://github.com/bennyaustin/elt-framework. Data platform infrastructure provisioned using https://github.com/bennyaustin/iac-synapse-dataplatform

Language: TSQL - Size: 1.79 MB - Last synced at: 7 months ago - Pushed at: 10 months ago - Stars: 7 - Forks: 6

jomit/iot-central

Sample code + scripts to develop Azure IoT Central Solutions

Language: C# - Size: 2.33 MB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 3

tomkerkhove/gdpr-with-azure 📦

Scenarios on how you can be GDPR compliant by using Azure services

Language: C# - Size: 1.19 MB - Last synced at: 8 days ago - Pushed at: over 6 years ago - Stars: 6 - Forks: 2

PujitH-V/ETL_with_Pyspark_-_SparkSQL

A sample project designed to demonstrate ETL process using Pyspark & Spark SQL API in Apache Spark.

Language: HTML - Size: 305 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 5 - Forks: 4

using-system/ProcessMyMedia

Build your Azure Media Services workflow in .NET Core

Language: C# - Size: 71.7 MB - Last synced at: 5 days ago - Pushed at: over 6 years ago - Stars: 5 - Forks: 0

MadeiraData/microsoft-data-engineers-club

Open-source Repository of Useful Scripts and Solutions for Microsoft Data Engineers

Language: Jupyter Notebook - Size: 1.28 MB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 4 - Forks: 2

aessing/demo-mdwh

Modern Dataware House Demos with Azure Databricks, Azure Data Factory & Azure Dedicated SQL pool (formerly SQL DW)

Size: 48.3 MB - Last synced at: about 2 months ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 2

StratusOn/S3-to-Blob

A simple solution for monitoring an AWS S3 bucket and keep track of its contents. Upon detecting a new object being uploaded into the S3 bucket, it will be copied into an Azure Storage account (blob-only or general purpose, v1 or v2).

Language: C# - Size: 36.1 KB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 4 - Forks: 4

Watts-Energy/Watts.Azure

A collection of utilities for working with Azure Batch, Azure Data Factory, Azure Table Storage and Azure Blob Storage.

Language: C# - Size: 281 KB - Last synced at: over 2 years ago - Pushed at: about 7 years ago - Stars: 4 - Forks: 1

AnkitKr0711/E_Commerce-Sales

Building a pipeline that can handle incremental load of data from on-premises and cloud service to Azure Data Lake

Language: Jupyter Notebook - Size: 4.13 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

azuregig/work_with_OrdnanceSurvey_data

Sample Azure Data Factory pipeline for ingesting Data Packages directly from the Download API of the Ordnance Survey Data Hub into Azure Storage.

Size: 2.21 MB - Last synced at: almost 2 years ago - Pushed at: almost 3 years ago - Stars: 3 - Forks: 3

dciborow/AzureML-Scheduler-on-ADF

(DEPRICATED)Create Scheduler using Data Factory v2 to run (DEPRICATED) Azure Machine Learning Experimentation

Language: PowerShell - Size: 405 KB - Last synced at: 8 months ago - Pushed at: over 7 years ago - Stars: 3 - Forks: 1

nnellans/azure-data-factory

CI/CD for Azure Data Factory

Language: PowerShell - Size: 124 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 2 - Forks: 0

dogucanelci/Azure_e2e_data_engineering_project_1

Language: Jupyter Notebook - Size: 11.6 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

ingenii-solutions/azure-data-factory-self-hosted-runtime

Azure Data Factory - Self Hosted Integration Runtime Windows Container

Language: Shell - Size: 66.9 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

at-gmbh/terraform-template-azure-data-lake

With the code in this repository you create an infrastructure on Azure. You will create a data lake (ADLS Gen2) to store data, a databricks environment to process data with Spark and a data factory to orchestrate etl jobs.

Language: HCL - Size: 82 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 1

aymane-maghouti/HR-Data-Pipeline-Azure

This project is a comprehensive data engineering solution that extracts HR data from a GitHub repository, performs data transformations using Azure services, and creates an interactive HR dashboard using Power BI. The goal is to enable HR professionals and decision-makers to gain insights from the HR data for better workforce management.

Language: Jupyter Notebook - Size: 3 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

bramvdklinkenberg/adf-airflow-data-project

Data engineering project using Azure Data Factory and Apache Airflow

Language: Python - Size: 45.9 KB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 0

mirko-leccese/Clean-Azure-Copy-Activity-Mapping

Python script that cleans the JSON document used by an Azure Data Factory or Azure Synapse Copy Activity to specify the source-sink mapping.

Language: Python - Size: 6.84 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

kasperulvedal/Azure-Data-Factory-Stuff

Size: 361 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

adithyavk9/DataEngineeringProjectAdventureWorks

An end to end data engineering project built on Azure

Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

enricogoerlitz/explore-azure-databricks

End-to-end backend and data hub architecture on Azure, integrating Databricks and a suite of Azure services for seamless data processing, analytics, and deployment.

Language: Jupyter Notebook - Size: 16.8 MB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

sanketrs/implementation-of-modern-data-engineering-architecture-with-fabric_analytics

Building a next-generation hybrid data pipeline architecture that combines the power of Microsoft Fabric, Azure Cloud, and Power BI. This pipeline is engineered to tackle the challenges of real-time data ingestion, multi-layered processing, and analytics, delivering business-critical insights.

Language: Python - Size: 32.2 KB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

SayamAlt/Amazon-Products-API-ETL-and-ML-pipeline

In this project, I've created an end-to-end ETL pipeline and subsequently developed a machine learning model to predict the price of Amazon products based on several product-related features.

Language: Python - Size: 2.95 MB - Last synced at: 3 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

lamiaaali/DEPI-Graduation-Project

SkinCare Sentiment Analysis Reviews

Language: Jupyter Notebook - Size: 7.72 MB - Last synced at: 19 days ago - Pushed at: 8 months ago - Stars: 1 - Forks: 2

alexanderbean/E2E-Data-Engineering-in-Azure

End-to-end ETL pipeline in the Microsoft Azure cloud - (Jun '24 - Jul '24)

Language: Python - Size: 1.95 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0

zBalachandar/Tokyo-Olympic-Data-Analytics-Azure-End-To-End-Data-Engineering-Project-12

Tokyo-olympic-azure-data-engineering-end-to-end-project

Language: HTML - Size: 44.5 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0

aqiftekhar/ADFPipelineCognitiveSearch

Implemented Azure AI Search, Azure Data Factory Pipelines and Change Data Capture using C# and Azure.

Language: C# - Size: 37.1 KB - Last synced at: 3 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0

gavin-crowley/End-to-End-Azure-DE-Project

:computer: Migration of On-Prem database to Azure cloud, then transformation and reporting of data

Language: Jupyter Notebook - Size: 7.87 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

vrup0408/IPL-Data-Analytics

We have dataset of IPL from 2008 to 2020 and we have to visualize analytics on Power BI dashboard. We have to upload that dataset into data lake. After that we have to process that data through pipeline and produce modeled data in warehouse. So, that we will be able to analyze the data in Power BI through pre-defined dashboards.

Size: 3.62 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

AnthonyByansi/BI-Hub-Insights-Analytics-and-Strategies

Your guide to navigating the world of Business Intelligence (BI)

Language: Shell - Size: 364 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

Amrit-Hub/DP-203-Data-Engineer-Associate-Questions

This repo contains "Azure Data Engineer Associate" Questions and related docs.

Size: 29.8 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 1

manjunathg88/adf-teams-channel-notification

This Azure Data Factory (ADF) pipeline will be automatically triggered whenever a CSV file is dropped in a specific location within the Storage Account Container. The pipeline reads the contents of the CSV file, converts it into an HTML table, and then sends a notification containing the newly created table to the designated Microsoft Teams channel

Size: 13.7 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

giufalcao/Formula-1

A data pipeline project build on databricks and azure to demostrate lifecycle of a cloud data project.

Language: Python - Size: 5.21 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

manaswipatil/Tokyo-Olympics-Data-Analytics-in-Azure

Azure pipeline for data analytics on Tokyo Olympics data

Size: 507 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

venkatakamaiah46/Azure

POC projects working on Cloud Platforms

Language: HTML - Size: 208 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

desaikun1996/Netflix-Data-Warehousing-and-Analysis

Processed and Ingested Netflix Movies and TV Shows content in Azure Cosmos DB using AWS and Azure Cloud services. Further visualized the final data using PowerBI.

Size: 0 Bytes - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

da-ta-Engineer/SnowflakeDataOps

This repository showcases my expertise in data engineering and DataOps technologies, with a focus on Snowflake, a cloud-based data warehousing platform. It includes a collection of projects, tools, and resources that demonstrate my skills and knowledge in this domain.

Language: HCL - Size: 36.1 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

juliengan/Stock-Analysis

Stock Analysis Pipeline

Language: Jupyter Notebook - Size: 1.72 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

tsart/xls2adf

Excel file loader for Azure Data Factory

Language: TypeScript - Size: 880 KB - Last synced at: 13 days ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

carlospbellorin/Data-Factory

Main data factory repository.

Size: 32.2 KB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

NicolaNardino/Azure.Serverless

How to build serverless and event-driven cloud-native applications with Azure in Java.

Language: Java - Size: 60.5 KB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 0

liliankotvan/Azure-ADF-RefreshPBI

Azure Data Factory template to refresh Power BI Dataset

Size: 8.79 KB - Last synced at: over 2 years ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

TA-Geoforce/AzureBootcamp2019

The presentation of T.A. Geoforce on Athens Azure Bootcamp 2019

Size: 58.5 MB - Last synced at: over 2 years ago - Pushed at: about 6 years ago - Stars: 1 - Forks: 0

syedhassaanahmed/azure-data-manager

Cloud services for defining, ingesting, transforming, analyzing and showcasing big data

Language: C# - Size: 759 KB - Last synced at: 4 months ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 2

StratusOn/ADF-Copy-FileShare-to-Blob-With-SharedKey-Auth

A simple ADF pipeline that demonstrates copying files from an Azure Files share to an Azure Blob container, followed by archiving the source files and then deleting what has been successfully copied.

Language: C# - Size: 60.5 KB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 0

AdamPaternostro/Azure-DataFactory-REST-Call

This Node.js script shows how to call a Data Factory on demand via REST

Language: JavaScript - Size: 3.91 KB - Last synced at: 3 months ago - Pushed at: about 8 years ago - Stars: 1 - Forks: 0

s-yazhini/Hexa-DE-Main-Project

Data engineering main project 1

Language: Jupyter Notebook - Size: 15.5 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 0 - Forks: 0

srimantapal205/Subject-Wise-Question---Answer

This branch focuses on building Data Engineering Interview Question and Answer

Size: 482 KB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 0 - Forks: 0

xom9s/sports

Repository for backend infrastructure of a project

Language: Python - Size: 73.2 KB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 0 - Forks: 0

Jcnok/Microsoft_AI_for_Tech-Azure_Databricks

Resolução dos desafios de projetos realizados durante o Bootcamp Microsoft Azure Databricks - 2025

Language: Jupyter Notebook - Size: 389 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

malbiruk/salesflow-data-pipeline

End-to-end data engineering pipeline using Azure Blob, Data Factory, dbt, Snowflake, and Streamlit for interactive business analytics. (WIP)

Language: Python - Size: 238 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

mananghetia/Healthcare-RCM

Language: Jupyter Notebook - Size: 0 Bytes - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

theatashaikh/end-to-end-azure-data-engineering-and-analytics-project

End-to-End Azure Data Engineering Project: Tokyo Olympics 2021 Analysis A complete data pipeline built on Microsoft Azure to ingest, process, and analyze Olympic data.

Size: 373 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

margual56/adf-cli

A simple program to interact with ADF from the CLI

Language: Go - Size: 89.8 KB - Last synced at: 7 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 1

fvarga01/sample-code

Sample code script snippets.

Language: PowerShell - Size: 106 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

MohssineSERRAJI/azure-data-lake

A lightweight toolkit for Azure Data Lake Storage Gen2 operations, featuring AzCopy commands and Databricks integration examples. Includes sample data and notebooks for quick experimentation with data lake architectures.

Language: Jupyter Notebook - Size: 449 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

zBalachandar/zBalachandar

Config files for my GitHub profile.

Size: 38.1 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

shudhanshurp/News_Recommendation_System

This repository presents a News Recommendation System using Azure Data Factory, Azure Databricks, and Azure Data Lake to create a data pipeline for ML models. It uses BERT for content-based filtering, Neural Collaborative Filtering for user behaviors, and a hybrid model that combines both to enhance news recommendations.

Language: Jupyter Notebook - Size: 55.9 MB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

Adarsh-Hota/CDC_SCD-1_Pipeline

Real-time data ingestion and transformation pipeline for AirBnB using Azure Data Factory, Synapse, CosmosDB, and ADLS for automated CDC and analytical reporting.

Language: Python - Size: 360 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

dhirendra-pachchigar/Weather-Analytics-Azure-Data-Engineering

A complete end-to-end ETL pipeline to fetch real-time and historical weather data from APIs, transform, and load it into an Azure SQL database using Data Factory, Databricks, Key Vaults, and Data Lake for analytics and reporting.

Size: 0 Bytes - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

Sivaprasad-V/Tokyo-Olympics-Azure-Data-Engineering-Project

Azure End To End Data Engineering Project

Language: Jupyter Notebook - Size: 358 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

Sivaprasad-V/NYC-TAXI-Azure-Data-Engineering-Project

Azure End To End Data Engineering Project

Language: Jupyter Notebook - Size: 17.4 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

Sivaprasad-V/Adventure-Works-Azure-Data-Engineering-Project

Azure End To End Data Engineering Project

Language: Jupyter Notebook - Size: 2.92 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

gudashashank/tokyo-olympics-analysis

An Azure cloud-based data analytics solution that processes and visualizes the 2021 Tokyo Olympics dataset. This end-to-end pipeline leverages Azure Data Factory for data ingestion, Data Lake Storage Gen2 for secure storage, Databricks for data transformation, Synapse Analytics for SQL querying, and Power BI for interactive visualization

Size: 1.18 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0