hackolade/Redshift

Hackolade(https://hackolade.com) plugin for Amazon Redhift

Language: JavaScript - Size: 12.5 MB - Last synced at: 14 days ago - Pushed at: 15 days ago - Stars: 0 - Forks: 7

aws/amazon-redshift-python-driver

Redshift Python Connector. It supports Python Database API Specification v2.0.

Language: Python - Size: 994 KB - Last synced at: 7 days ago - Pushed at: 23 days ago - Stars: 214 - Forks: 79

hangum/TadpoleForDBTools

Language: Java - Size: 191 MB - Last synced at: about 20 hours ago - Pushed at: about 5 years ago - Stars: 542 - Forks: 146

aws-samples/amazon-redshift-serverless-rsql-etl-framework

Amazon Redshift Serverless RSQL ETL Framework

Language: TypeScript - Size: 1.13 MB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 10 - Forks: 2

helicalinsight/helicalinsight

Helical Insight software is world’s first Open Source Business Intelligence framework which helps you to make sense out of your data and make well informed decisions.

Language: Java - Size: 181 MB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 312 - Forks: 105

sasha-alias/sqltabs

Rich SQL client for Postgresql, MySQL, MS SQL, Amazon Redshift, Google Firebase (Firestore)

Language: JavaScript - Size: 3.65 MB - Last synced at: 2 months ago - Pushed at: over 2 years ago - Stars: 804 - Forks: 57

vaxdata22/Customer-Churn-Data-Analytics-ETL-Pipeline-by-Airflow-on-EC2

This is an end-to-end AWS Cloud ETL project. This orchestration uses Apache Airflow on AWS EC2 as well as AWS Glue. It demonstrates how to build ETL pipeline that would perform data transform using Glue job/crawler as well as loading into a Redshift table. It also shows how to connect Amazon Athena to Glue Data Catalog, and Power BI to Redshift.

Language: Python - Size: 7.2 MB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

vaxdata22/Zillow-Rapid-API-end-to-end-ETL-data-pipeline-by-Airflow-on-EC2

This is an end-to-end AWS Cloud ETL project. This data pipeline orchestration uses Apache Airflow on AWS EC2 as well as AWS Lambda. It demonstrates how to build ETL data pipeline that would perform data transformation using Lambda function as well as loading into a Redshift cluster table. The data would then be visualized using Amazon QuickSight.

Language: Python - Size: 3.4 MB - Last synced at: 4 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

mattjcamp/dbr

Facade for common database connections like SQL Server, Amazon Redshift, PostgresSQL and SQLite databases

Language: R - Size: 9.22 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

Wolf-nord/Customer-Churn-Data-Analytics-ETL-Pipeline-by-Airflow-on-EC2

This is an end-to-end AWS Cloud ETL project. This orchestration uses Apache Airflow on AWS EC2 as well as AWS Glue. It demonstrates how to build ETL pipeline that would perform data transform using Glue job/crawler as well as loading into a Redshift table. It also shows how to connect Amazon Athena to Glue Data Catalog, and Power BI to Redshift.

Language: Python - Size: 7.17 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

Tejesvani/IoT-Data-Streaming-and-Analytics

The Smart City Data Streaming Pipeline processes real-time data from IoT devices using Apache Kafka for ingestion and Apache Spark for processing. Data is stored in AWS S3 and analyzed with Glue, Athena, and Redshift. It enhances traffic management, predictive analytics, and urban planning, making cities smarter and more efficient.

Language: Python - Size: 18.6 KB - Last synced at: 2 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

aws-samples/aws-dbs-refarch-rdbms 📦

Reference Architectures for Relational Databases on AWS

Language: HTML - Size: 1.81 MB - Last synced at: about 2 months ago - Pushed at: over 4 years ago - Stars: 27 - Forks: 8

nathadriele/redshift-to-s3-unload-dag

This Airflow DAG automates the process of extracting data from an Amazon Redshift database and unloading it to Amazon S3 in Parquet format. It runs daily, exporting data from the previous day based on a specified query.

Language: Python - Size: 44.9 KB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 7 - Forks: 0

siconge/Tencent-HQ-BIM-Data-Pipeline-with-AWS

This project delivers an end-to-end data pipeline solution designed to employ a comprehensive ETL process to move BIM data from Autodesk Revit model of Tencent Global Headquarters into cloud storage for processing and and analytics. The pipeline leverages tools and services such as Apache Airflow, Amazon S3, AWS Glue, and Amazon Redshift.

Language: Python - Size: 10.2 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

minhduc29/leetcode-contest-analytics

A data engineering project to extract, transform, and load LeetCode contest ranking and contest problems data

Language: Python - Size: 5.66 MB - Last synced at: 4 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

MaxGanzII/redshift-observatory.ch

Comprehensive, unified and coherent replacement system tables for Amazon Redshift, from a single author.

Size: 5.86 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0

lc-rezende/amazon-redshift-snippets

A useful collection of code snippets that I've created and used in my projects.

Size: 4.88 KB - Last synced at: 3 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

Cris-Neumann/Data-Lakehouse-with-Amazon-S3-and-Redshift

Canalización desde MongoDB hacia un Data Lake de Amazon S3, creación de Data Warehouse en Amazon Redshift y visualización en Tableau.

Language: Python - Size: 237 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Ditectrev/Amazon-Web-Services-Certified-AWS-Certified-Database-DBS-C01-Practice-Tests-Exams-Questions-Answers

⛳️ PASS: Amazon Web Services Certified (AWS Certified) Database Specialty (DBS-C01) by learning based on our Questions & Answers (Q&A) Practice Tests Exams.

Size: 3.81 MB - Last synced at: 3 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 5

servian/amazon-redshift-checklist

This checklist aims to be an exhaustive list of all elements you should consider when using Amazon Redshift.

Size: 81.1 KB - Last synced at: 3 months ago - Pushed at: almost 5 years ago - Stars: 15 - Forks: 6

ANKIT21111/SparNordETL

ETL Pipeline for Spar Nord Bank for the analysis of refilling frequency of the ATM's all over the europe

Language: Jupyter Notebook - Size: 4.59 MB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

shipyardapp/amazonredshift-blueprints

Simplified blueprints for building data pipelines with Amazon Redshift.

Language: Python - Size: 39.1 KB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

polakowo/yelp-3nf

3NF-normalize Yelp data on S3 with Spark and load it into Redshift - automate the whole thing with Apache Airflow

Language: Jupyter Notebook - Size: 1.82 MB - Last synced at: 3 months ago - Pushed at: almost 6 years ago - Stars: 12 - Forks: 3

Susanhuynh/aws_etl_from_s3_to_redshift

Building an ETL pipeline for a database hosted on Redshift. Extracting data from S3 to staging tables on Redshift . Transforming data by executing SQL statements that create the analytics tables from these staging tables by start schema. Loading star schema tables to Redshift

Language: Jupyter Notebook - Size: 472 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

noppaz/docker-rsql

Docker image for Amazon Redshift RSQL

Language: Dockerfile - Size: 4.88 KB - Last synced at: over 1 year ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 1

lauravoicu/Udacity-Data-Engineering

Repository for projects developed in Udacity's Data Engineering Nanodegree.

Language: Jupyter Notebook - Size: 61.5 KB - Last synced at: over 1 year ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0

Sampsonyu/Data_Warehouse_with_Amazon_Redshift

Data Warehouse with Amazon Redshift

Language: Python - Size: 38.1 KB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0

engraulleite/AWS-Cloud-Data-Warehouse-with-IaC

Creating a Data Warehouse in AWS Cloud with all infrastructure created by code (IaC) through Terraform

Language: HCL - Size: 36.1 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

miztiik/redshift-demo

Simple getting started 1-node redshift cluster stack

Language: Python - Size: 1.95 MB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 6 - Forks: 7

mfaraji/monalisa

A Query Portal for Amazon redshift

Language: Python - Size: 44.9 KB - Last synced at: almost 2 years ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0

Faisal-AlDhuwayhi/Data-Pipelines-with-Airflow

Building Data Pipelines for a data warehouse with Airflow and AWS

Language: Python - Size: 85.9 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

Wathon/Data-Warehouse-with-AWS

Udacity Data Engineering Nano Degree Project, ETL for Data Warehouse using S3 and Amazon Redshift.

Language: Python - Size: 26.4 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 5 - Forks: 2

Faisal-AlDhuwayhi/Data-Warehouse

Building Data Warehouse and ETL pipelines using Amazon S3 and Redshift

Language: Python - Size: 4.88 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

gavinjwl/clickstream-on-aws

Language: Python - Size: 801 KB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 0

nasseredine/udacity-dend-p2

Data Warehouse on AWS with Amazon Redshift

Language: Python - Size: 303 KB - Last synced at: 4 months ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

CarlosUziel/sparkify_redshift

A project from the Data Engineer Nanodegree Program at Udacity to practice Data Warehouses and ETL pipelines on AWS.

Language: Jupyter Notebook - Size: 1.27 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

alicjamazur/data-engineering-case

ETL Redshift-based workflow automated with AWS Step Funtions.

Language: Python - Size: 109 MB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 6

the-timoye/DWH

Language: Python - Size: 27.3 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

lenguyenthedat/aws-redshift-to-rds

A simple command-line tool to copy tables from Amazon Redshift to Amazon RDS (PostgreSQL).

Language: Haskell - Size: 16.6 KB - Last synced at: 3 months ago - Pushed at: over 8 years ago - Stars: 10 - Forks: 5

donjude/data-pipelines-with-airflow

This data pipeline is an ETL process with Apache Airflow that loads data from Amazon S3 bucket, stage the data workload and insert into Amazon Redshift Datawarehouse

Language: Python - Size: 660 KB - Last synced at: over 2 years ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 0

AbdullahMu/Data-Pipelines-with-Airflow

Schedule, automate, and monitor data pipelines using Apache Airflow. Run data quality checks, track data lineage, and work with data pipelines in production.

Language: Python - Size: 52.7 KB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 1

MrBenA/Udacity_Capstone-ETL_Pipeline

Udacity Data Engineering Capstone project

Language: Python - Size: 685 KB - Last synced at: 7 days ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

airflow-plugins/redshift_plugin

Language: Python - Size: 31.3 KB - Last synced at: over 2 years ago - Pushed at: about 5 years ago - Stars: 22 - Forks: 25

jpsalado92/Udacity-DEND_DataWarehouse-AWSRedshift

Full code for UDACITY's Data Engineer Nano Degree project. Build a Data Warehouse in AWS with Amazon Redshift.

Language: Python - Size: 3.93 MB - Last synced at: over 2 years ago - Pushed at: about 5 years ago - Stars: 0 - Forks: 1

mateensa/SyPy

This git project contains programming excercises written in python for almost everything ranging from Solving Problems using Algorithms and Data structures, webscrapping, managing connectivity to db, ml and plotting graphs

Language: Jupyter Notebook - Size: 26.5 MB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 3 - Forks: 4

mayur29/mayur29-Udacity-Data-engineering-nanodegree-

This contains all the projects from Udacity Nanodegree

Language: Jupyter Notebook - Size: 1.56 MB - Last synced at: over 2 years ago - Pushed at: about 5 years ago - Stars: 0 - Forks: 0

MarcoXM/data-engineer

Language: Jupyter Notebook - Size: 732 KB - Last synced at: over 2 years ago - Pushed at: about 5 years ago - Stars: 0 - Forks: 0

HemantNegi/django-redshift

Redshift ORM and Migration support for django

Language: Python - Size: 819 KB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 2 - Forks: 1

mateensa/Redshift_Querys

few important querys required most of time by dev. or dba

Language: PLpgSQL - Size: 8.79 KB - Last synced at: about 2 years ago - Pushed at: almost 8 years ago - Stars: 2 - Forks: 0

acgray/beam-sdks-java-io-redshift

Redshift sink for Apache Beam

Language: Java - Size: 4.88 KB - Last synced at: 10 days ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0