Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub / magrathj 13 repositories

Lead Data Engineering working on big data platforms to provide insight through data

magrathj/strava_app

Web app to display strava user data

Language: Python - Size: 512 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 0 - Forks: 0

magrathj/Synapse-Warehouse

Example of Synapse data warehouse which pulls data from Azure SQL DB

Language: HCL - Size: 35.2 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

magrathj/ARM-project 📦

Assembly language course work for programming micro-controllers

Language: HTML - Size: 166 KB - Last synced: about 1 year ago - Pushed: almost 5 years ago - Stars: 0 - Forks: 0

magrathj/NYC-Taxi-Analysis

Big data project to analyse 1.1 billion taxi trips in NYC and create a forecasting model

Language: Python - Size: 852 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 4 - Forks: 1

magrathj/Pyspark-Docker-Image-With-Azure-Gen2-Connection

Building a docker image with Pyspark and Azure Gen2 storage connector so enable local testing your lake

Language: Python - Size: 1.28 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 3 - Forks: 3

magrathj/fire Fork of aamend/fire

Framework to provide schemas and constraints for Delta Live Table code

Size: 1.23 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

magrathj/Data-Integration-Pipelines-for-NYC-Payroll-Data-Analytics

The City of New York would like to develop a Data Analytics platform

Language: HCL - Size: 51.8 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

magrathj/Azure-Modern-Data-Warehouse

Building an Azure Data Warehouse for Bike Share Data Analytics. Project to load data from Postgres DB in Azure into Azure Synapse.

Language: Python - Size: 9.85 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 1

magrathj/Data-Modeling-with-Cassandra

Create a build and load process for a single VM with Cassandra

Language: Jupyter Notebook - Size: 306 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

magrathj/Data-Modeling-with-Postgres

Create a build and load process for a single VM with Postgres

Language: Jupyter Notebook - Size: 15.6 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

magrathj/Azure-FlaskWebApp Fork of udacity/cd1756-Azure-Applications-project

Deploy An Article CMS To Azure

Size: 1.35 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

magrathj/azure-web-form

Size: 0 Bytes - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

magrathj/dbt-snowflake

dbt snowflake set up demo

Size: 2.93 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

magrathj/snowflake_ci_cd

Language: HCL - Size: 1.95 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

magrathj/arduino_iot_device

arduino uno with GPS and Bluetooth

Language: C++ - Size: 18.6 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

magrathj/arduino_devops

Arduino github actions workflow to validate changes

Language: C++ - Size: 19.5 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

magrathj/Github-Network-Analysis-Web-App

Python app that uses oauth to query github api and returns a network graph of the users repos

Language: Python - Size: 123 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

magrathj/delta-live-tables-poc

PoC to test out Delta Live Tables with CI/CD pipeline deployments

Language: Python - Size: 21.5 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

magrathj/automated-gcp-databricks-deployments

Automated deployments with Databricks GCP

Language: HCL - Size: 2.93 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 1

magrathj/databricks-dbt-gcp

Using dbt on GCP Databricks

Language: Dockerfile - Size: 10.7 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

magrathj/migrate Fork of databrickslabs/migrate

Scripts to help customers with one-off migrations between Databricks workspaces.

Size: 931 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

magrathj/delta-migrations

Pyspark package to handle schema migrations in larger scale projects where incremental changes to tables are required.

Language: Python - Size: 43 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0

magrathj/event-driven-hackathon

using event driving architecture for geo-location based promotios

Language: HCL - Size: 43.9 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

magrathj/delta-migrations-template

Language: Python - Size: 7.81 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

magrathj/pyspark-style-guide Fork of palantir/pyspark-style-guide

This is a guide to PySpark code style presenting common situations and the associated best practices based on the most frequent recurring topics across the PySpark repos we've encountered.

Size: 34.2 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

magrathj/snowflake-warehouse

Snowflake warehouse which uses weather and restaurants (YELP) datasets

Size: 417 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

magrathj/terraform-kubernetes-multi-cloud Fork of hajowieland/terraform-kubernetes-multi-cloud

Terraform to create Kubernetes clusters on multiple public cloud platforms (Aliyun, AWS, Azure, DO, GCP, OCI)

Size: 170 KB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0

magrathj/Age-and-Gender-Recognition-App

Deploying Age and Gender Recognition Model to an Edge App

Language: Python - Size: 4.89 MB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 1 - Forks: 0

magrathj/DataOps Fork of microsoft/DataOps

Example code for doing DataOps

Size: 367 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

magrathj/bdd-pyspark Fork of DanteLore/bdd-pyspark

Simple demo using "behave" and "pyspark" libraries to test data transformations in a human-readable way

Size: 25.4 KB - Last synced: about 1 year ago - Pushed: about 5 years ago - Stars: 1 - Forks: 0

magrathj/Deploying-Databricks-Notebooks-CI-CD

Using docker to deploy packages and notebooks using docker to an Azure Databricks workspace

Language: Python - Size: 7.81 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 1

magrathj/Azure-Devops-ML-Flask-WebApp

Machine learning web app with CI/CD component using agile framework to build out the project.

Language: Python - Size: 1.52 MB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

magrathj/Azure-Devops-Terraform-CI-CD-App-Service

Building out an Azure CI/CD pipeline to create disposable test environments and run automated tests on a published Web App

Language: JavaScript - Size: 10.4 MB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 1

magrathj/Pyspark-Databricks-VSCode-Development-Workflow

Pyspark development between VSCode and Databricks

Language: Python - Size: 89.8 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

magrathj/Wild-West-Hackathon-Databricks-Data-Science

Wild West Hackathon v2 - using databricks, mflow and azure devops to build automated deployment of fraud detection machine learning models

Language: HTML - Size: 1.14 MB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

magrathj/Wild-West-Hackathon-Databricks-Structured-Streaming

Databricks & Blueprint Hackathon - using databricks, spark structured streaming, delta, and azure devops to build automated deployment of notebooks and jobs.

Language: Python - Size: 312 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 1

magrathj/IBM-Recommendation-Engine

Building out a recommendation engine with IBM Studio for the Udacity Data Science Nano-degree Program

Language: HTML - Size: 458 KB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0

magrathj/Github-Web-Crawler-Web-App

Web-app which a user logs provides credentials, and the app will use the token to crawl through followers related to the users profile. Then it will store the results in neo4j and display it to the user in a network graph

Language: Haskell - Size: 214 KB - Last synced: about 1 year ago - Pushed: almost 5 years ago - Stars: 0 - Forks: 0

magrathj/Strava-Shiny-Web-App

App to monitor Hamish's running progress

Language: CSS - Size: 371 KB - Last synced: about 1 year ago - Pushed: almost 5 years ago - Stars: 0 - Forks: 0

magrathj/Starbucks-AB-Testing-Analysis

Using Starbucks dataset, the project assess whether a feature changed had an incremental impact on the response

Language: Jupyter Notebook - Size: 1.44 MB - Last synced: about 1 year ago - Pushed: almost 5 years ago - Stars: 0 - Forks: 0

magrathj/Disaster-Response-NLP-Pipeline

Building a ML pipeline using the figure eight Corporate messaging dataset

Language: Jupyter Notebook - Size: 25.4 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 1 - Forks: 1

magrathj/IoT-Edge-ML-App

Python Flask Dockerized App with Intels Openvino Inference Engine

Language: Jupyter Notebook - Size: 73.4 MB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0

magrathj/K-means-Clustering-of-Flood-Claims-Analysis

Using clustering to investigate National Flood Programs Claims dataset

Language: HTML - Size: 1.2 MB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0

magrathj/Deep-Learning-Model-to-Classify-Driver-Trips

The first part of this project looks to classify the trips into which route they took using a Keras CNN model to classify the timeseries features.

Language: HTML - Size: 3.48 MB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0

magrathj/Monte-Carlo-Simulations-of-Airbnb-Analysis

Analysis into Airbnb dataset as Part of the Udacity Nanodegree course works

Language: Jupyter Notebook - Size: 13.1 MB - Last synced: about 1 year ago - Pushed: almost 5 years ago - Stars: 0 - Forks: 0

magrathj/Azure-Container-MLFlow-Model-Registry

Project looks to create a stand-alone MLflow model registry which sits on its own Azure Container Registry, using an image, connected to a blob storage (artifact store) and internal sqlite db (registry store).

Language: Shell - Size: 85 KB - Last synced: about 1 year ago - Pushed: about 2 years ago - Stars: 0 - Forks: 0

magrathj/Spark-Capstone-Project-Flood-Claims-Analysis

Using spark to analyse 12GB of flood policies and claims, and create a predictive model

Language: Jupyter Notebook - Size: 106 MB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0

magrathj/Azure-Devops-Deploying-Web-Service-With-Load-Balancing

For this project, I have written a Packer template and a Terraform template to deploy a customizable, scalable web server in Azure.

Language: HCL - Size: 549 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 3

magrathj/Databricks-MLflow-MLOps-AzureML

Using databricks mlflow model registry with azureml to build out an mlops pipeline

Language: Python - Size: 8.79 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

magrathj/Data-Science-Challenge

This challenge looks at using linux, docker, postgres and python to analyse interesting trends in transcational banking data.

Language: Jupyter Notebook - Size: 580 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 1

magrathj/Twitter-firehose-API---ETL-Pipeline

Building an ETL pipeline in Azure databricks to extract, transform and load data from the Twitter firehose API

Language: HTML - Size: 808 KB - Last synced: about 1 year ago - Pushed: about 4 years ago - Stars: 0 - Forks: 0

magrathj/shinyforms Fork of daattali/shinyforms

Easily create questionnaire-type forms with Shiny

Language: R - Size: 64.5 KB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 0 - Forks: 0