dotnet/spark

.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.

Language: C# - Size: 4.84 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 2,057 - Forks: 326

microsoft/data-accelerator

Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.

Language: C# - Size: 401 MB - Last synced at: 9 days ago - Pushed at: about 1 month ago - Stars: 302 - Forks: 91

UnoSD/SparkSharp

C# Livy client to submit Spark jobs to HDInsight and other Spark clusters

Language: C# - Size: 63.5 KB - Last synced at: 15 days ago - Pushed at: over 7 years ago - Stars: 10 - Forks: 4

microsoft/AzureSMR 📦

AzureSMR is no longer being actively developed. For ongoing support of Azure in R, see: https://github.com/Azure/AzureR

Language: R - Size: 12.4 MB - Last synced at: 4 days ago - Pushed at: almost 6 years ago - Stars: 60 - Forks: 39

anirudhgupta22/Microsoft-Azure-HDInsight

Short documentation on Microsoft's Azure HDInsight

Size: 2.02 MB - Last synced at: 11 months ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0

microsoft/MCW-Big-data-analytics-and-visualization 📦

MCW Big data analytics and visualization

Language: JavaScript - Size: 148 MB - Last synced at: 12 months ago - Pushed at: almost 3 years ago - Stars: 189 - Forks: 186

windson/ReviewsByDate

Get date wise number of reviews in the descending order using HDInsight

Language: C# - Size: 45.5 MB - Last synced at: about 1 year ago - Pushed at: about 8 years ago - Stars: 1 - Forks: 0

windson/HDInsight-TopN-Reviews-MapReduce

TopN Products by category using HDInsight Streaming MapReduce

Language: C# - Size: 53.2 MB - Last synced at: about 1 year ago - Pushed at: about 8 years ago - Stars: 1 - Forks: 0

windson/HDInsight-Top-N-OverPriced-Products-MapReduce

Top N OverPriced Products Using HDInsight streaming MapReduce Job

Language: C# - Size: 77.1 MB - Last synced at: about 1 year ago - Pushed at: about 8 years ago - Stars: 1 - Forks: 0

bdsines/azure-terraform

Language: HCL - Size: 18.6 KB - Last synced at: about 1 year ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

cs-uche/adf-pandemic-analytics

Pandemic Analytics with Data Factory

Language: PowerShell - Size: 2.06 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

hdinsight/hdinsight-kafka-tools

HDInsight Kafka Tools

Language: Python - Size: 1.41 MB - Last synced at: 12 months ago - Pushed at: over 1 year ago - Stars: 21 - Forks: 20

murggu/azure-hdinsight-aks-terraform

An example repo for provisioning a complete HDInsight on AKS environment.

Language: HCL - Size: 5.86 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

anjijava16/Azure-Cloud-utils

Azure Analytics (azure_cloud_utils)

Size: 213 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

Datatamer/terraform-azure-hdinsight-hbase

Terraform module for terraform-azure-hdinsight-hbase

Language: HCL - Size: 132 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 1

iBalajiShanmugam/covid19-adf

COVID19-ADF is a project that leverages Azure services to collect, analyze, and visualize COVID-19 data. With seamless data integration and advanced analytics, it provides valuable insights into the pandemic's impact, enabling informed decision-making in the fight against COVID-19.

Size: 1.65 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

khoinguyen19k8/adf-covid19

Data pipeline that processes Covid19 data in Azure Data Factory. CI/CD with Azure Devops.

Language: PowerShell - Size: 1.35 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

angadsingh/airflow-ditto

An airflow DAG transformation framework

Language: Python - Size: 6.51 MB - Last synced at: 13 days ago - Pushed at: almost 5 years ago - Stars: 5 - Forks: 1

caiomsouza/microsoft-big-data-scientist-and-ai

Microsoft Big Data, Data Scientist, and AI

Size: 9.46 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 11 - Forks: 3

kcheeeung/hive-testbench Fork of hortonworks/hive-testbench

TPC-DS benchmark for experimenting with Apache Hive at any data scale

Language: Python - Size: 35.3 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 2

AfonsoFeliciano/Azure-Data-Factory-for-Data-Engineers

Repositório do curso de Azure Data Factory for Data Engineers - Project Covid 19

Language: Python - Size: 1.69 MB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

mpfishe2/store-data-generator

This is a grocery store data generator for emulating batch and real-time POS transactions and sending them to either Azure Event Hubs or Apache Kafka (test with Azure HDInsight Kafka)

Language: Python - Size: 20.5 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 4

SyncfusionSuccinctlyE-Books/HDInsight-Succinctly

This is the companion repo for HDInsight Succinctly by James Beresford. Published by Syncfusion.

Language: C# - Size: 77.1 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 9 - Forks: 8

kcheeeung/hive-benchmark

Automated TPC-DS and TPC-H benchmark for Apache Hive LLAP

Language: Python - Size: 35.5 MB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 5 - Forks: 8

AdamPaternostro/Azure-Databricks-HDInsight-Hive-Metastore

How to share an HDInsight Hive Metastore with Azure Databricks

Size: 3.91 KB - Last synced at: about 1 month ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 1

proazr/hdinsight-script-actions

Custom HDInsight Script Actions

Language: Shell - Size: 4.88 KB - Last synced at: 9 days ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

angadsingh/airflow-hdinsight

HDInsight provider for Airflow

Language: Python - Size: 64.5 KB - Last synced at: 9 days ago - Pushed at: 12 months ago - Stars: 5 - Forks: 2

rfim/HDInsight-CodeLab

HDInsight code lab and crash course for using Apache Spark, Apache Storm, Apache Hadoop-HBase. ~ 📖 ~

Language: PowerShell - Size: 13.9 MB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0

syedhassaanahmed/azure-kafka-spark-adls

Azure ARM template to deploy Kafka and Spark clusters in same VNet with ADLS

Language: Shell - Size: 8.79 KB - Last synced at: about 1 month ago - Pushed at: about 7 years ago - Stars: 5 - Forks: 0

zjplab/Processing-Big-data-with-Hadoop-in-Azure-HdInsight

Microsoft edx course DAT202.1x

Size: 0 Bytes - Last synced at: almost 2 years ago - Pushed at: about 8 years ago - Stars: 1 - Forks: 1

AdamPaternostro/Azure-HDInsight-ARM-Template

Creates an HDInsight cluster that has an external Hive metastore and access to Azure Data Lake Store

Size: 63.5 KB - Last synced at: about 1 month ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 0

AdamPaternostro/Azure-HDI-DistCP

Creates a HDInsight cluster then runs distcp remotely to copy data between blob and/or data lake (ADLS)

Language: Shell - Size: 27.3 KB - Last synced at: about 1 month ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0

AdamPaternostro/Azure-Spark-Livy-Application-Insights-External-Dependency

Use Spark with Livy along with Application Insights. Learn to host your external dependencies in data lake.

Language: Java - Size: 4.2 MB - Last synced at: about 1 month ago - Pushed at: almost 8 years ago - Stars: 1 - Forks: 0

mpfishe2/dotnet-hdinsight-kafka-simulated-producer-consumer

A .NET Producer and Consumer Framework for a Kafka cluster on Azure HDInsight

Size: 0 Bytes - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0

AdamPaternostro/Azure-Get-Base64-From-PFX

Gets a base 64 encoding from a PFX. Useful for when you have a service principle in Azure and need to put the base 64 in an ARM template

Language: PowerShell - Size: 1000 Bytes - Last synced at: about 1 month ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0

hpgrahsl/kafka-azure-gab2017

Code samples for my Apache Kafka on Azure HDInsight talk at Global Azure Bootcamp 2017

Language: Java - Size: 477 KB - Last synced at: 2 months ago - Pushed at: almost 8 years ago - Stars: 0 - Forks: 0

AdamPaternostro/Azure-Spark-Livy

Run a job in Spark 2.x with HDInsight and submit the job through Livy

Language: Scala - Size: 168 KB - Last synced at: about 1 month ago - Pushed at: almost 8 years ago - Stars: 0 - Forks: 1

emres/HDInsightOMS Fork of hdinsight/HDInsightOMS

MS Azure HDInsight and OMS integration for monitoring

Language: Shell - Size: 19.5 KB - Last synced at: about 2 years ago - Pushed at: almost 8 years ago - Stars: 0 - Forks: 0