Topic: "adlsgen2"
procter-gamble-oss/octopufs
OctopuFS library helps managing cloud storage, ADLSgen2 specifically. It allows you to operate on files (moving, copying, setting ACLs) in very efficient manner. Designed to work on databricks, but should work on any other platform as well.
Language: Scala - Size: 1.35 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 8
oleewere/fluent-plugin-azurestorage-gen2
Fluentd output plugin for Azure Datalake Storage Gen2 (append support)
Language: Ruby - Size: 95.7 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 8 - Forks: 4
jlsilva01/adls-azure
Procedimento para criação de um Azure Data Lake Storage usando Terraform, através de uma assinatura MS Learn Sandbox
Language: HCL - Size: 27.3 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 7 - Forks: 2
paolosalvatori/blob-private-endpoint
This sample demonstrates how to create a Linux Virtual Machine in a virtual network that privately accesses a blob storage account using an Azure Private Endpoint.
Language: Shell - Size: 2.22 MB - Last synced at: about 1 month ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 2
ayush9892/Supply-Chain-ETL
Data Engineering Project on Supply Chain ETL. Creating a dynamic ADF pipeline to ingest both Full Load and Incremental Load data from SQL Server and then transform these datasets based on medallion architecture using Databricks.
Language: Jupyter Notebook - Size: 1.57 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 2 - Forks: 0
shubhammirajkar/tokyo_olympics_de_project
Explore the Tokyo Olympics data journey! We ingested a GitHub CSV into Azure via Data Factory, stored it in Data Lake Storage Gen2, performed transformations in Databricks, conducted advanced analytics in Azure Synapse, and visualized insights in Synapse or Power BI.
Language: Jupyter Notebook - Size: 1.17 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0
venkatakamaiah46/Azure
POC projects working on Cloud Platforms
Language: HTML - Size: 208 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0
iBalajiShanmugam/covid19-adf
COVID19-ADF is a project that leverages Azure services to collect, analyze, and visualize COVID-19 data. With seamless data integration and advanced analytics, it provides valuable insights into the pandemic's impact, enabling informed decision-making in the fight against COVID-19.
Size: 1.65 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0
sankamuk/ADLSGen2Admin
Azure ADLS Gen2 CLI Tool
Language: PowerShell - Size: 10.7 KB - Last synced at: 3 months ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 1
easonlai/sas_access_to_adls_databricks
Using SAS to authenticate and access to ADLS Gen 2 from Azure Databricks
Language: Jupyter Notebook - Size: 84 KB - Last synced at: 3 months ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 1
jeromedayrit/rg-salescars-adeproject
A data pipeline project that processes car sales data using the Medallion Architecture (Bronze, Silver, Gold) to deliver clean, reliable insights for reporting
Size: 0 Bytes - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0
keval72/Tokyo-Olympics-Data-Analytics-Using-Azure
Explore the Tokyo Olympics data journey! We ingested a CSV from GitHub into Azure using Data Factory, stored it in Data Lake Storage Gen2, performed transformations in Databricks, conducted advanced analytics in Azure Synapse, and visualized insights using Synapse or Power BI.
Language: Jupyter Notebook - Size: 1.08 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0
GsrSanthosh/Azure-End-to-End-Data-Engineering-Project
This is an End to End Azure Data Engineering project copying data from Rest API to Azure cloud.
Language: Python - Size: 1.62 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0
ds-fau-ck/Near-Real-Time-AirBnB-Data-Pipeline-with-CDC-Implementation-on-Azure
AirBnB CDC Ingestion Pipeline: Near Real-Time Change Data Capture (CDC) Pipeline on Azure for Seamless Integration of Continuous Data Streams
Language: Python - Size: 11.5 MB - Last synced at: 2 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0
fnu-ankit/meta-data-driven-data-migration
Azure data migration project to migrate data from on-prem SQL Server to Azure cloud using meta-data driven approach.
Size: 13.7 KB - Last synced at: 3 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0
ayush9892/SynapseSQLPool-DynamicView
Creating a pipeline that will automatically create View of data in Synapse, whenever data arrives in ADLS Gen2.
Size: 8.79 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
iBalajiShanmugam/formual1
"Explore Formula 1 data analytics with this project. Leveraging the Ergast API, it utilizes Databricks Spark for ingestion, transformation, and analysis. ADLS acts as the storage layer, while Power BI visualizes the ADLS presentation layer. Uncover insights in the world of Formula 1 through powerful data analytics."
Language: Python - Size: 33.2 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0
epomatti/az-datalake
Azure Data Lake Gen2 with azcopy
Language: HCL - Size: 3.91 KB - Last synced at: 3 months ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0
just-modeling/jupyterhub-k8s-apache-spark
Deploy apache spark in client mode on Kubernetes cluster, integrate with Jupyter notebook through Jupyterhub server.
Language: Shell - Size: 612 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0
