GitHub topics: aws-kinesis-firehose
aws-samples/aws-analytics-immersion-day
Describes the concepts of lambda architecture and the actual deployment process with an example of building a serverless business intelligence systems using Amazon Kinesis, S3, Athena, OpenSearch Service, and QuickSight.
Language: Python - Size: 12.9 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 13 - Forks: 8
aws-samples/aws-dms-cdc-data-pipeline
Data Pipeline for CDC data from MySQL DB to Amazon OpenSearch Service through Amazon Kinesis using Amazon Data Migration Service(DMS).
Language: Python - Size: 1.06 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 28 - Forks: 7
GhayathAlobaidi/Data-Pipeline--Twitter-Analysis
Use AWS to stream and analyze the sentiment of live tweets from Twitter based on a certain keyword.
Language: Python - Size: 183 KB - Last synced at: 3 months ago - Pushed at: over 3 years ago - Stars: 10 - Forks: 6
AWS-Big-Data-Projects/front-line-concussion-monitoring-system-using-AWS-IoT-and-serverless-data-lakes
A simple, practical, and affordable system for measuring head trauma within the sports environment, subject to the absence of trained medical personnel made using Amazon Kinesis Data Streams, Kinesis Data Analytics, Kinesis Data Firehose, and AWS Lambda
Language: Shell - Size: 30.3 KB - Last synced at: 2 days ago - Pushed at: over 4 years ago - Stars: 12 - Forks: 0
zhudotexe/FIREBALL-data-processing
The data preprocessing code for FIREBALL
Language: Python - Size: 1.67 MB - Last synced at: 23 days ago - Pushed at: almost 2 years ago - Stars: 9 - Forks: 4
StatAziz/Ames-Weather-Data-ETL-Pipeline
This project is about building a serverless ETL pipeline using open-meteo weather API.
Language: Jupyter Notebook - Size: 24.2 MB - Last synced at: 30 days ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0
AWS-Big-Data-Projects/Analyzing-Twitter-in-real-time-with-Kinesis-Lambda-Comprehend-and-ElasticSearch
Analyzing Twitter in real time with Kinesis, Lambda, Comprehend and ElasticSearch
Language: Python - Size: 11.7 KB - Last synced at: 2 days ago - Pushed at: over 4 years ago - Stars: 15 - Forks: 10
aws-samples/streaming-data-pipeline-from-kafka-to-s3-using-aws-kinesis-firehose
Streaming data pipeline to continuously load data from an Amazon MSK or MSK Serverless cluster to Amazon S3 using Amazon Kinesis Data Firehose.
Language: Python - Size: 394 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 3 - Forks: 0
adautoneto/firehose-recover-errors
Recover AWS Kinesis Firehose errors by running the COPY command to each of the manifests file in the S3 errors folders
Language: Python - Size: 1.95 KB - Last synced at: 10 months ago - Pushed at: about 5 years ago - Stars: 0 - Forks: 0
bicarbon8/automated-functional-testing
Automated Functional Testing (AFT) packages supporting nodejs based Functional Testing
Language: TypeScript - Size: 22.8 MB - Last synced at: 6 days ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0
psy-pri/aws-realtime-tweets-streaming
❄️ Stream real-time data into Snowflake with Amazon Kinesis Firehose
Language: Python - Size: 8.79 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 1
ksmin23/streaming-data-pipeline-from-kafka-to-s3-using-aws-kinesis-firehose
Streaming data pipeline to continuously load data from an Amazon MSK or MSK Serverless cluster to Amazon S3 using Amazon Kinesis Data Firehose.
Language: Python - Size: 393 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
Guz-Ali/AWS-Streaming-Data-to-ML-Model-Pipeline
A complete AWS pipeline that collects, compiles, preprocesses streaming data and trains an ML model
Language: Python - Size: 44.5 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
epomatti/aws-cloudwatch-subscriptions
Subscribing to CloudWatch Logs with various destinations
Language: HCL - Size: 215 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
hervenivon/aws-experiments-data-ingestion-and-analytics
Ingestion of bid requests through Amazon Kinesis Firehose and Kinesis Data Analytics. Data lake storage with Amazon S3. Restitution with Amazon QuickSight and CloudWatch. 📉
Language: TypeScript - Size: 6.56 MB - Last synced at: 1 day ago - Pushed at: over 2 years ago - Stars: 26 - Forks: 5
Anirudha-N/Text_Analysis_using_AWS
Let's analyze twitter sentiments.This project uses Twitter API and AWS kinesis,AWS kinesis Firehose,Comprehend,Lambda,S3 and DynamoDB
Language: JavaScript - Size: 619 KB - Last synced at: over 1 year ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 1
Rafat97/aws-kinesis-firehose-lambda-s3
AWS kinesis data stream, kinesis data firehose, a transformer with lambda and store into s3 bucket
Language: TypeScript - Size: 182 KB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0
chrisammon3000/aws-json-dataset
Lightweight and simple Python package to quickly send JSON data to various AWS services.
Language: Python - Size: 123 KB - Last synced at: 20 days ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 2
SagarFall2022/BigData
Realtime data pipeline
Language: Jupyter Notebook - Size: 1.35 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0
rochitasundar/TwitterSentimentAnalysis-BigDataProject
Scrapped tweets using twitter API (for keyword ‘Netflix’) on an AWS EC2 instance, ingested data into S3 via kinesis firehose. Used Spark ML on databricks to build a pipeline for sentiment classification model and Athena & QuickSight to build a dashboard
Language: Jupyter Notebook - Size: 8.79 MB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 4 - Forks: 0
s12v/awsbeats
AWS Kinesis plugin for Filebeat
Language: Go - Size: 99.6 KB - Last synced at: 20 days ago - Pushed at: about 1 month ago - Stars: 61 - Forks: 26
amazon-archives/aws-vpc-flow-log-appender 📦
Sample code to append additional information (e.g. Security Group IDs and geolocation data) to VPC Flow Logs for analysis in Elasticsearch.
Language: JavaScript - Size: 116 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 83 - Forks: 42
mirusresearch/firehoser 📦
A wrapper around AWS Kinesis Firehose with retry logic and custom queuing behavior. Requires node >= 6.0.0
Language: JavaScript - Size: 109 KB - Last synced at: 3 days ago - Pushed at: almost 3 years ago - Stars: 22 - Forks: 5
AWS-Big-Data-Projects/Log-Analytics-Solution-With-AWS
Collect, process, and analyze log data using Amazon Kinesis and Elasticsearch Service
Size: 6.84 KB - Last synced at: 2 days ago - Pushed at: over 4 years ago - Stars: 11 - Forks: 1
markoshlima/crimes-map
This Big Data project consists of obtaining data on vehicle theft in the city of São Paulo and consolidating it in a counting and heat map, in order to show areas with a higher index of this type of crime. All applicable in AWS Resources.
Language: Scala - Size: 13.7 MB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0
WithDD97/Twitter-sentiment-analysis-Elon-Musk
Big data Text Classification: 4M records
Language: Jupyter Notebook - Size: 6.07 MB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0
productiveAnalytics/aws-cdk-constructs-sandbox
Cloud Development Kit (AWS CDK) using TypeScript, Python and Java
Language: Java - Size: 5.49 MB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0
aws-cloudformation/aws-cloudformation-resource-providers-kinesisfirehose
The CloudFormation Resource Provider Package For Amazon Kinesis Data Firehose
Language: Java - Size: 311 KB - Last synced at: 2 months ago - Pushed at: almost 4 years ago - Stars: 2 - Forks: 2
ggarciabas/mlops_aws_punkapi
Machine Learning Engineer - MLOps!
Language: Jupyter Notebook - Size: 13.9 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0
jonathannocek/twitter-analysis
Streaming and real-time analysis of Twitter data through an AWS data stream
Language: Python - Size: 3.93 MB - Last synced at: 11 months ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 2
ZachTRice/aws-apache-to-json
AWS Kinesis Firehose: Apache Log to JSON
Language: JavaScript - Size: 63.5 KB - Last synced at: 2 months ago - Pushed at: almost 6 years ago - Stars: 2 - Forks: 0
ptimson/firehose-mock
An embedded Java mock for AWS Kinesis Firehose
Language: Java - Size: 39.1 KB - Last synced at: 5 months ago - Pushed at: about 7 years ago - Stars: 2 - Forks: 2
