GitHub | Ecosyste.ms: Repos

quiltdata/quilt-package-metadata-athena

A comprehensive tutorial outlining

Language: Jupyter Notebook - Size: 609 KB - Last synced: about 8 hours ago - Pushed: about 13 hours ago - Stars: 0 - Forks: 0

getredash/redash

Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.

Language: Python - Size: 25 MB - Last synced: about 8 hours ago - Pushed: about 23 hours ago - Stars: 25,085 - Forks: 4,264

AJ2O/awsdemo-airquality

A prototype application using S3 and Athena to analyze air quality data across the US.

Language: HCL - Size: 27.3 KB - Last synced: about 20 hours ago - Pushed: about 3 years ago - Stars: 0 - Forks: 0

dekart-xyz/dekart

WebGL-powered map analytics for BigQuery and Snowflake. Lightweight alternative to CARTO and Foursquare Studio for data scientists, analysts and engineers.

Language: JavaScript - Size: 32.6 MB - Last synced: 2 days ago - Pushed: 2 days ago - Stars: 169 - Forks: 25

ev2900/Iceberg_EMR_Athena

Resources from an virtual tech talk / workshop - Set Up and Use Apache Iceberg Tables on Your Data Lake

Language: Jupyter Notebook - Size: 12.3 MB - Last synced: 4 days ago - Pushed: 4 days ago - Stars: 1 - Forks: 1

rhatiro/Curso_EBAC-Profissao_Cientista_de_Dados

Exercícios do curso "Profissao: Cientista de Dados", sendo realizado pela EBAC - Escola Britânica de Artes Criativas e Tecnologia.

Language: Python - Size: 500 MB - Last synced: 6 days ago - Pushed: 6 days ago - Stars: 7 - Forks: 4

dbt-athena/dbt-athena

The athena adapter plugin for dbt (https://getdbt.com)

Language: Python - Size: 1.01 MB - Last synced: about 8 hours ago - Pushed: about 12 hours ago - Stars: 191 - Forks: 84

lynnlangit/aws-for-bioinformatics

AWS for Bioinformatics Researchers

Language: Jupyter Notebook - Size: 118 MB - Last synced: 7 days ago - Pushed: 7 days ago - Stars: 108 - Forks: 28

eic/athena

DD4hep Geometry Description of the ATHENA Experiment (mirror of the development repository)

Language: C++ - Size: 6.71 MB - Last synced: 10 days ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

laughingman7743/PyAthena

PyAthena is a Python DB API 2.0 (PEP 249) client for Amazon Athena.

Language: Python - Size: 2.36 MB - Last synced: 10 days ago - Pushed: 10 days ago - Stars: 448 - Forks: 102

nodestream-proj/nodestream

A Fast, Declarative, and Extensible ETL Framework for Graph Databases.

Language: Python - Size: 13.8 MB - Last synced: 2 days ago - Pushed: 2 days ago - Stars: 31 - Forks: 9

developmentseed/little-owl

🦉 - A companion to AWS Athena

Language: JavaScript - Size: 55.7 KB - Last synced: 12 days ago - Pushed: over 6 years ago - Stars: 5 - Forks: 2

ponceto/xcpc-emulator

Xcpc - Amstrad CPC emulator for Linux, BSD, Unix [this repository is a mirror]

Language: C - Size: 1.67 MB - Last synced: 14 days ago - Pushed: 14 days ago - Stars: 23 - Forks: 2

localstack-samples/sample-query-data-s3-athena-glue Fork of aws-samples/query-data-in-s3-with-amazon-athena-and-aws-sdk-for-dotnet

Leverage Amazon Athena to run standard SQL to analyze a large amount of data in Amazon S3 buckets deployed using CloudFormation on LocalStack

Language: Makefile - Size: 4.03 MB - Last synced: 15 days ago - Pushed: 15 days ago - Stars: 6 - Forks: 3

wolfeidau/aws-billing-store

This project automates setup of Cost and Usage Reports (CUR) in a billing account with an Athena table enabling querying of the latest data for each month.

Language: Go - Size: 219 KB - Last synced: 15 days ago - Pushed: 15 days ago - Stars: 9 - Forks: 0

ls1intum/Athena-CoFee

A system to support (semi-)automated assessment of textual exercises

Language: Python - Size: 16.2 MB - Last synced: 17 days ago - Pushed: 17 days ago - Stars: 20 - Forks: 2

aws-samples/web-analytics-on-aws

This web analytics demo shows how to collect web logs with API Gateway and store them into S3 through Amazon Kinesis. Then this project shows how to analyze web logs with Amazon Athena.

Language: Python - Size: 305 KB - Last synced: 19 days ago - Pushed: 19 days ago - Stars: 13 - Forks: 2

uber/athenadriver

A fully-featured AWS Athena database driver (+ athenareader https://github.com/uber/athenadriver/tree/master/athenareader)

Language: Go - Size: 2.95 MB - Last synced: 12 days ago - Pushed: 3 months ago - Stars: 139 - Forks: 31

shnartho/stock-analysis-real-time

stock-analysis-real-time

Language: Python - Size: 3.26 MB - Last synced: 23 days ago - Pushed: 23 days ago - Stars: 0 - Forks: 0

justwatchcom/sql_exporter

Flexible SQL Exporter for Prometheus.

Language: Go - Size: 18.2 MB - Last synced: 19 days ago - Pushed: about 1 month ago - Stars: 358 - Forks: 101

heuermh/sea-eagle

Command line tools for AWS Athena

Language: Java - Size: 60.5 KB - Last synced: 19 days ago - Pushed: 26 days ago - Stars: 0 - Forks: 0

vickyjkwan/sqlanalyzer

A SQL parser and analyzer for sql flavors including MySQL, PostgreSQL, BigQuery Standard SQL, Presto SQL and Hive SQL.

Language: Jupyter Notebook - Size: 474 KB - Last synced: 17 days ago - Pushed: 12 months ago - Stars: 8 - Forks: 1

DyfanJones/RAthena

Connect R to Athena using Boto3 SDK (DBI Interface)

Language: R - Size: 1.9 MB - Last synced: 28 days ago - Pushed: 3 months ago - Stars: 35 - Forks: 6

DyfanJones/noctua

Connect R to Athena using paws SDK (DBI Interface)

Language: R - Size: 1.9 MB - Last synced: 10 days ago - Pushed: about 1 month ago - Stars: 45 - Forks: 5

wolfeidau/cloudfront-simple-analytics

simple analytics service for CloudFront

Language: Go - Size: 0 Bytes - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 0 - Forks: 0

Jerome3590/MetabulatR_VCU_BNFO_Hackathon

VCU Bioinformatics Hackathon

Language: R - Size: 2.82 MB - Last synced: about 1 month ago - Pushed: about 2 years ago - Stars: 1 - Forks: 0

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Language: Python - Size: 13.9 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 3,791 - Forks: 664

helecloud/athena-step-function

Creates a step function that runs and tracks Athena Queries.

Size: 4.88 KB - Last synced: about 1 month ago - Pushed: almost 4 years ago - Stars: 3 - Forks: 0

Signiant/aws-ecs-lb-athena-table

Checks each load balancer used by an ECS service to ensure logging is enabled and creates an Athena table for these logs

Language: Python - Size: 17.6 KB - Last synced: about 1 month ago - Pushed: over 6 years ago - Stars: 3 - Forks: 1

cloudquery/cq-source-simple-analytics 📦

A CloudQuery source plugin for Simple Analytics that loads Simple Analytics data into PostgreSQL, BigQuery, Athena, and many other destinations

Language: Go - Size: 70.3 KB - Last synced: about 1 month ago - Pushed: about 1 year ago - Stars: 3 - Forks: 2

awslabs/athena-glue-service-logs 📦

Glue scripts for converting AWS Service Logs for use in Athena

Language: Python - Size: 381 KB - Last synced: 12 days ago - Pushed: 4 months ago - Stars: 139 - Forks: 43

yennanliu/spark_emr_dev

Collection of code for submitting Spark/Hadoop/Hive/Pig tasks to EMR (AWS Elastic MapReduce) | #DE

Language: Scala - Size: 3.72 MB - Last synced: about 1 month ago - Pushed: over 4 years ago - Stars: 3 - Forks: 1

awslabs/voice-powered-analytics

Workshop to build voice enabled integration with data analytics

Language: Python - Size: 66.7 MB - Last synced: 12 days ago - Pushed: about 4 years ago - Stars: 115 - Forks: 43

o2team/athena

O2前端流程工具

Language: JavaScript - Size: 3.66 MB - Last synced: 9 days ago - Pushed: over 5 years ago - Stars: 981 - Forks: 145

yahoo/bandar-log

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Language: Scala - Size: 924 KB - Last synced: about 1 month ago - Pushed: over 1 year ago - Stars: 21 - Forks: 18

udondan/cdk-athena 📦

AWS CDK L3 construct for managing Athena WorkGroups and named queries

Language: TypeScript - Size: 387 KB - Last synced: 11 days ago - Pushed: about 1 month ago - Stars: 6 - Forks: 4

athena-oss/athena

An automation platform with a plugin architecture that allows you to easily create and share services.

Language: Shell - Size: 2.78 MB - Last synced: about 1 month ago - Pushed: almost 7 years ago - Stars: 90 - Forks: 26

Optum/cloudig

Cloud governance reports from native services in a clear and readable digest

Language: Go - Size: 1.62 MB - Last synced: about 1 month ago - Pushed: 7 months ago - Stars: 27 - Forks: 4

1010real/athena-sample

A sample to use aws athena service in go

Language: Go - Size: 3.91 KB - Last synced: about 2 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

wix-incubator/quix

Quix Notebook Manager

Language: TypeScript - Size: 12.6 MB - Last synced: about 1 month ago - Pushed: 6 months ago - Stars: 267 - Forks: 38

yezz123/Athena

Test your Security Skills, and Clean Code Development as a Pythonist, Hacker & Warrior 🥷🏻

Language: Python - Size: 2.83 MB - Last synced: 20 days ago - Pushed: 21 days ago - Stars: 44 - Forks: 22

ritikdhame/Automated-Telecom-Customer-Churn-Analysis

AWS Glue & Airflow automate weekly churn analysis pipeline (S3, Redshift) for telco (1M+ customers) with actionable Tableau dashboard (user segmentation, churn reasons, geographical distribution).

Language: Python - Size: 2.15 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0

nazish555/AWS-Data_Engineering-Spotify_Data

This project showcases a data transformation pipeline utilizing AWS Glue and Amazon Athena to process Spotify data from CSV files. It involves loading, transforming, and storing data in an S3 datawarehouse, enabling seamless querying through Amazon Athena.

Language: Python - Size: 158 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0

BernardoGMP/Credit_Analysis_and_Exploration_SQL

This project uses SQL (Structured Query Language) in the AWS (Amazon Web Services) platform to explore the data and extract useful insights. The services utilized to process the data were Amazon S3 (to create the bucket and store the data) and Amazon Athena (to write and run the queries).

Language: Jupyter Notebook - Size: 399 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0

avegao/aws-athena-node-client

NodeJS AWS Athena client

Language: TypeScript - Size: 492 KB - Last synced: 1 day ago - Pushed: about 2 months ago - Stars: 5 - Forks: 0

knime/knime-cloud

KNIME® Cloud Connectors

Language: Java - Size: 1.18 MB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 4 - Forks: 6

speee/go-athena Fork of segmentio/go-athena

Golang database/sql driver for AWS Athena

Language: Go - Size: 152 KB - Last synced: about 1 month ago - Pushed: over 2 years ago - Stars: 20 - Forks: 3

ThiagoPanini/datadelivery

A Terraform module that provides an efficient way to activate pieces and services in an AWS account in order to enable users to explore preselected public datasets.

Language: HCL - Size: 287 MB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 1 - Forks: 0

lynnlangit/Hello-AWS-Data-Services

AWS Data/MLServices sample code & notes for my LinkedIn Learning courses

Language: Jupyter Notebook - Size: 96 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 172 - Forks: 95

LakshMundhada/Real-Time-Fraudulent-Transaction-Analytics-Pipeline

A Big Data project leveraging AWS services and Apache frameworks to identify and visualize fraudulent credit card transaction patterns, providing actionable insights to mitigate financial fraud.

Language: Python - Size: 33.5 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0

camposvinicius/aws-etl

This is an ETL application on AWS with general open sales and customer data that you can find here: https://github.com/camposvinicius/data/blob/main/AdventureWorks.zip, it's a zipped file with some .csvs inside that we will apply transformations.

Language: Smarty - Size: 168 KB - Last synced: 3 months ago - Pushed: over 2 years ago - Stars: 15 - Forks: 3

aws-samples/rds-snapshot-export-to-s3-pipeline

RDS Snapshot Export to S3 Pipeline

Language: TypeScript - Size: 241 KB - Last synced: 3 months ago - Pushed: 11 months ago - Stars: 111 - Forks: 45

nabilseid/athenaSQL

SQL builder for AWS Athena, inspired by sparkSQL

Language: Python - Size: 159 KB - Last synced: 22 days ago - Pushed: 3 months ago - Stars: 4 - Forks: 0

aws-samples/aws-data-foundations-framework

The Data Foundations Framework accelerates deployment of a modern data platform using AWS native services and best practices.

Language: Python - Size: 20.5 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 2 - Forks: 0

broccolini/athena

A simple and elegant theme for Jekyll and GitHub Pages.

Language: HTML - Size: 31.3 KB - Last synced: 2 months ago - Pushed: over 4 years ago - Stars: 130 - Forks: 56

VivekaAryan/Reddit-Data-Pipeline

This project offers a robust data pipeline solution designed to efficiently extract, transform, and load (ETL) Reddit data into a Redshift data warehouse. Leveraging a blend of industry-standard tools and services, the pipeline ensures seamless data processing and integration.

Language: Python - Size: 405 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0

stevenhurwitt/reddit-streaming

streaming eight subreddits from reddit api using kafka producer & spark structured streaming.

Language: Jupyter Notebook - Size: 275 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 18 - Forks: 1

dacort/athena-sqlite

A SQLite driver for S3 and Amazon Athena 😳

Language: Python - Size: 85 KB - Last synced: 3 months ago - Pushed: over 4 years ago - Stars: 95 - Forks: 5

watzon/paste69

Simple CURL-able pastebin

Language: Crystal - Size: 462 KB - Last synced: 12 days ago - Pushed: 4 months ago - Stars: 11 - Forks: 1

AnnatarHe-Athena/webapp

the athena project web client

Language: TypeScript - Size: 5.32 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 2

abetomo/Convert-Athena-QueryResults-to-Array

Convert AWS Athena QueryResults to Array.

Language: PHP - Size: 147 KB - Last synced: 19 days ago - Pushed: about 1 month ago - Stars: 4 - Forks: 2

aws-samples/aws-incident-response-playbooks-workshop

Language: Python - Size: 1.5 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 74 - Forks: 25

vdfor/umi-plugin-athena

umi athena plugin

Language: TypeScript - Size: 201 KB - Last synced: 4 months ago - Pushed: about 2 years ago - Stars: 0 - Forks: 0

epomatti/aws-rds-athena

Querying RDS in a private VPC from Athena

Language: HCL - Size: 11.7 KB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 0 - Forks: 0

Dorianteffo/uber-eats-airflow-spark-glue-athena

Ingest CSV files and load them to S3, upload Spark script to S3, run the Spark code on EMR cluster, which will pull the raw UberEats data from S3, clean the data, and load them back to S3 in the proper schema. All of this orchestrated with Airflow

Language: Python - Size: 418 KB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 1 - Forks: 0

satterly/athena-cli Fork of guardian/athena-cli

Presto-like CLI tool for AWS Athena

Language: Python - Size: 97.7 KB - Last synced: 10 days ago - Pushed: 11 months ago - Stars: 9 - Forks: 1

provectus/data-quality-gate

Data Quality Gate based on AWS

Language: Python - Size: 24 MB - Last synced: about 2 months ago - Pushed: 6 months ago - Stars: 55 - Forks: 3

hariketsheth/Article_Repository_Management_System

In this Tech Savvy era, with lot of advancements in the field of AI, ML, IoT and Deep Learning - People are randomly posting out random, partial and incomplete data on internet. ARMS proposes a Reviewed Article System in which article is published only after review. With added features for visually impaired, ARMS is ready to be implemented

Language: PHP - Size: 15.2 MB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 17 - Forks: 14

JohannesKonings/examples-aws-dynamodb-analytics-cdk

Example how to Analyze DynamoDB data with Athena in different ways created with AWS CDK

Language: TypeScript - Size: 541 KB - Last synced: 20 days ago - Pushed: 3 months ago - Stars: 7 - Forks: 2

Atavic/Athena 📦

Athena / Hera beaconing systems target Microsoft from Windows XP to Windows 10

Size: 68.4 KB - Last synced: 4 months ago - Pushed: about 7 years ago - Stars: 0 - Forks: 1

rublaman/data-engineering-portfolio

This portfolio presents a compilation of data engineering projects that highlight the knowledge and use of tools in an optimal way for data flow. The repository demonstrates a commitment to developing robust solutions using diverse technologies, addressing practical challenges in the field.

Language: Jupyter Notebook - Size: 1.67 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 1 - Forks: 0

pranav-patil/aws-kinesis-analytics

AWS Kinesis Analytics gather metrics from various computers (cpu, memory), perform aggregation on Kinesis stream data using Kinesis Analytics (with flink) and store the stream data into AWS S3 bucket which is used by Amazon Athena for running various Analytics queries and rending charts using Grafana.

Language: Java - Size: 1.29 MB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 0 - Forks: 0

HariSekhon/SQL-scripts

100+ SQL Scripts - PostgreSQL, MySQL, Google BigQuery, MariaDB, AWS Athena. DevOps / DBA / Analytics / performance engineering. Google BigQuery ML machine learning classification.

Language: Shell - Size: 435 KB - Last synced: 4 months ago - Pushed: 10 months ago - Stars: 331 - Forks: 95

duyet/athena-rs

Managing schema for AWS Athena as Code in GitOps-style

Language: Rust - Size: 110 KB - Last synced: 16 days ago - Pushed: 16 days ago - Stars: 7 - Forks: 0

fraugster/parquet-go

Go package to read and write parquet files. parquet is a file format to store nested data structures in a flat columnar data format. It can be used in the Hadoop ecosystem and with tools such as Presto and AWS Athena.

Language: Go - Size: 1.2 MB - Last synced: 4 months ago - Pushed: over 1 year ago - Stars: 274 - Forks: 50

Firdous2307/aws-analytics-pipeline-viz

Utilizing AWS S3, Glue, Athena, and QuickSight for data exploration and visualization.

Language: Shell - Size: 1.94 MB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 0 - Forks: 0

JennaFar/elastic-data-factory

Elastic Data Factory

Language: Python - Size: 185 KB - Last synced: 4 months ago - Pushed: 7 months ago - Stars: 0 - Forks: 0

AntoineGagne/parthenon-hs

Tool to convert Athena terms into JSON values

Language: Haskell - Size: 64.5 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 3 - Forks: 0

AntoineGagne/parthenon

A library to parse Athena structures into Erlang terms

Language: Erlang - Size: 39.1 KB - Last synced: 29 days ago - Pushed: 6 months ago - Stars: 2 - Forks: 0

AthenaTheBot/Dashboard

Dashboard and website of Athena.

Language: JavaScript - Size: 2.2 MB - Last synced: 5 months ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

h1994st/Athena

Wisdom can save your time. Athena is a set of scripts to automatically install and configure necessary tools.

Language: Shell - Size: 14.6 KB - Last synced: 5 months ago - Pushed: over 2 years ago - Stars: 4 - Forks: 0

abideenml/RealTime-StarRatingPrediction-with-AWSKinesis

This repository contains an End to End Real time 🕰️ Machine Learning Pipeline to predict star ⭐️ rating of product reviews. This project uses AWS Sagemaker, Kinesis, Lambda, S3, Redshift, Athena, and Step functions. Deployment of multiple models for AB testing and Bandit testing is also included.

Language: Jupyter Notebook - Size: 15.1 MB - Last synced: 5 months ago - Pushed: 6 months ago - Stars: 0 - Forks: 0

sahays/serverless-analytics

AWS Serverless Analytics using Amazon S3, Athena, Glue, and QuickSight

Language: Python - Size: 16.1 MB - Last synced: 3 months ago - Pushed: over 4 years ago - Stars: 5 - Forks: 5

MinaBasem/San-Francisco-Fire-Incidents-Streaming

An Ariflow, Kafka, AWS and Python data streaming project for Fire incidents in San Francisco

Language: Python - Size: 14.6 KB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 0 - Forks: 0

r0kenton5/AZUKI-DRAINER

✅The most functional and the cheapest—available now with an exclusive discount on Telegram. Message us to get yours.

Size: 2.93 KB - Last synced: 6 months ago - Pushed: 6 months ago - Stars: 0 - Forks: 0

aws-samples/amazon-eks-use-sbom-to-find-container-image-with-vulnerable-software

This repo hosts Terraform code for generating and analyzing Software Bill of Materials (SBOM) for Amazon ECR images. It helps identify Amazon EKS images with vulnerable software components using Amazon Athena.

Language: HCL - Size: 1.58 MB - Last synced: 4 months ago - Pushed: 7 months ago - Stars: 11 - Forks: 2

chrisreedio/athena-scraper

Fetches Athena Health's OpenAPI specs

Language: Python - Size: 12.7 KB - Last synced: 6 months ago - Pushed: 6 months ago - Stars: 1 - Forks: 0

gakas14/AWS-Serverless-Data-Lake

This workshop is to build a serverless data lake architecture using Amazon Kinesis Firehose for streaming data ingestion, AWS Glue for Data Integration (ETL, Catalogue Management), Amazon S3 for data lake storage, Amazon Athena for SQL big data analytics.

Language: Jupyter Notebook - Size: 56.6 KB - Last synced: 6 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0