aws-samples/aws-last-mile-delivery-hyperlocal

AWS Last Mile Delivery Hyperlocal

Language: TypeScript - Size: 8.5 MB - Last synced at: 10 days ago - Pushed at: about 1 month ago - Stars: 36 - Forks: 11

saidsef/aws-kinesis-local

Build for local AWS Kinesis

Language: Dockerfile - Size: 109 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 16 - Forks: 4

aws-samples/aws-analytics-immersion-day

Describes the concepts of lambda architecture and the actual deployment process with an example of building a serverless business intelligence systems using Amazon Kinesis, S3, Athena, OpenSearch Service, and QuickSight.

Language: Python - Size: 12.9 MB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 11 - Forks: 7

Cloudblack/ETL_Data_Pipeline

클라우드(S3) 기반으로 데이터를 변환 압축해 API를 제공하는 데이터 파이프라인

Language: Python - Size: 2.56 MB - Last synced at: 23 days ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

ShubhanshuJha/aws-utils

Utility code for AWS Services. Sample use case could be querying data from KDS. This project is open to receive contribution.

Language: Python - Size: 8.79 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

Scout24/rds-log-cat 📦

Shipping AWS RDS logs from s3 into a kinesis stream

Language: Python - Size: 60.5 KB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 2 - Forks: 1

Nextdoor/bender 📦

Bender - Serverless ETL Framework

Language: Java - Size: 1.48 MB - Last synced at: about 2 months ago - Pushed at: 6 months ago - Stars: 184 - Forks: 21

sdabhi23/streaming-data-pipeline

A streaming data pipeline leveraging managed services from AWS & the serverless architecture

Language: Python - Size: 105 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

xdevplatform/twitter-aws-samples

Sample scripts for Twitter data processing and storage on AWS

Language: Python - Size: 20.5 KB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 10 - Forks: 3

amyth-singh/pinterest-data-pipeline

Pinterest's experiment analytics data pipeline which runs thousands of experiments per day and crunches billions of datapoints to provide valuable insights to improve the product.

Language: Python - Size: 466 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

nnthanh101/sentiment-analysis

Voice of the Customer (VoC) to enhance customer experience with serverless architecture and sentiment analysis, using Amazon Kinesis, Amazon Athena, Amazon QuickSight, Amazon Comprehend, and ChatGPT-LLMs for sentiment analysis.

Language: JavaScript - Size: 7.78 MB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 24 - Forks: 5

data-integrations/kinesis-sink 📦

Kinesis Batch Sink Plugin

Language: Java - Size: 64.5 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 1

dinsaw/kines

Friendly CLI for Amazon Kinesis Data Streams

Language: Python - Size: 7.8 MB - Last synced at: 7 days ago - Pushed at: over 3 years ago - Stars: 56 - Forks: 4

marrem/raspi-aws-kinesis-streamer

Streaming video to the aws-kinesis service from a Raspberry Pi 3(+) with a camera module

Language: Shell - Size: 487 KB - Last synced at: 4 months ago - Pushed at: almost 5 years ago - Stars: 4 - Forks: 1

GhostCat12/pinterest-data-pipeline854

Pinterest data pipeline - designing an end-to-end pipeline utilising AWS cloud technologies and Databricks for analysing real-time and historical pinterest-emulated data.

Language: Jupyter Notebook - Size: 1.05 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

vsouza/spark-kinesis-redshift

Example project for consuming AWS Kinesis streamming and save data on Amazon Redshift using Apache Spark

Language: Python - Size: 89.8 KB - Last synced at: about 2 months ago - Pushed at: about 6 years ago - Stars: 11 - Forks: 6

lucasvsme/poc-spring-aws-kinesis-multistream

Publishing and consuming records from multiple Kinesis streams using the Kinesis Client Library (KCL 2.x)

Language: Java - Size: 183 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

Cool-fire/aws-infra-scaler

📠🦺 CLI tool to scale up/down AWS infrastructure based on a YAML configuration file. This easy to use tool can be helpful while testing the AWS infrastructure scaling.

Language: Go - Size: 23.4 KB - Last synced at: 6 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

epomatti/aws-cloudwatch-subscriptions

Subscribing to CloudWatch Logs with various destinations

Language: HCL - Size: 215 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0

IsaacMwendwa/Streaming-Data-with-AWS-Kinesis-and-Lambda

Working with real-time data - Streaming Data with Amazon Kinesis and AWS Lambda

Size: 3.91 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0

Clever/amazon-kinesis-client-go

Amazon Kinesis Client for Go

Language: Go - Size: 7.88 MB - Last synced at: 2 months ago - Pushed at: 9 months ago - Stars: 16 - Forks: 8

TLexYuW/aws-kds-kdf-http-endpoint-demo

AWS Kensis Destionation - Http Endpoint Demo

Language: Python - Size: 1.95 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

averemee-si/oraadr-kafka

Oracle Database Automatic Diagnostic Repository messages (alert.log & listener.log) to Apache Kafka or Amazon Kinesis transfer

Language: Java - Size: 36.1 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 2

nidhijmr/AccurateTracking

Mobile App for real-time location and travel history tracking. Detects anomaly in case of deviation from original route

Language: Java - Size: 1000 KB - Last synced at: 10 months ago - Pushed at: almost 6 years ago - Stars: 1 - Forks: 5

jyotint/consentsystem

Simple Consent System implementation using AWS services and Python 3.

Language: Python - Size: 2.4 MB - Last synced at: 10 months ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

skyscrapers/terraform-kinesis

Terraform module to create a kinesis stream

Language: HCL - Size: 7.81 KB - Last synced at: 11 months ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 2

skyscrapers/terraform-cloudwatch

Terraform module that configures pre-defined cloudwatch alerts for the provided resources and pushes them to SNS

Language: HCL - Size: 23.4 KB - Last synced at: 11 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 1

Anirudha-N/Text_Analysis_using_AWS

Let's analyze twitter sentiments.This project uses Twitter API and AWS kinesis,AWS kinesis Firehose,Comprehend,Lambda,S3 and DynamoDB

Language: JavaScript - Size: 619 KB - Last synced at: 11 months ago - Pushed at: about 5 years ago - Stars: 0 - Forks: 1

oieduardorabelo/construindo-arquiteruras-orientadas-a-eventos-serverless-land

🇧🇷 Tradução completa do Building Event Driven Architectures do Serverless Land.

Size: 23.4 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 2

ksmin23/image-insights

automatic image tagger and image tag analysis

Language: Python - Size: 13.4 MB - Last synced at: 12 months ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 2

Rafat97/aws-kinesis-data-stream-lambda-s3

AWS kinesis data stream consume with lambda and store into s3 bucket

Language: TypeScript - Size: 183 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

Rafat97/aws-kinesis-firehose-lambda-s3

AWS kinesis data stream, kinesis data firehose, a transformer with lambda and store into s3 bucket

Language: TypeScript - Size: 181 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

aws-samples/sns-xray-active-tracing-blog-source-code

This sample application demonstrates Amazon SNS with AWS X-Ray active tracing

Language: Python - Size: 2.54 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

dimonge/shopify-integration-aws-stack

Shopify Order Integration stack

Language: JavaScript - Size: 169 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

eldimious/real_time_streaming_analytics

we look at how we can use managed services such as Amazon Kinesis to handle our incoming data analytics streams from our sources while AWS handles the undifferentiated heavy lifting of managing the infrastructure

Language: HCL - Size: 521 KB - Last synced at: about 2 months ago - Pushed at: almost 2 years ago - Stars: 6 - Forks: 0

EdgarOrtegaRamirez/aws-kcl.cr

AWS Kinesis Consumer Library written in Crystal

Language: Crystal - Size: 10.8 MB - Last synced at: about 1 year ago - Pushed at: about 6 years ago - Stars: 4 - Forks: 0

daletskyi/KinesisProducerNet

KinesisProducerNet is a .NET port of Amazon Kinesis Producer Library targeting .NET Standard

Language: C# - Size: 23 MB - Last synced at: 14 days ago - Pushed at: over 4 years ago - Stars: 7 - Forks: 4

AWS-Big-Data-Projects/Iot-and-Big-Data-Application-using-aws-and-apache-kafka

Iot,Big Data Analytics using Apache-kafka,spark and other aws services

Language: Python - Size: 18.6 KB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 13 - Forks: 2

NeutrinoCorp/quark 📦

:zap: A Reliable and fully customizable event router for Event-Driven systems written in Go.

Language: Go - Size: 245 KB - Last synced at: 11 months ago - Pushed at: about 3 years ago - Stars: 3 - Forks: 2

vijpandaturtle/speaker-emotion-detection-spark

Language: Jupyter Notebook - Size: 271 KB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

infrablocks/terraform-aws-kinesis-video-stream

Terraform Module for AWS Kinesis video stream

Language: Ruby - Size: 192 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 2 - Forks: 2

datnguyenzzz/AWSCronJobScheduler

Cron job scheduler for AWS

Language: Java - Size: 2.17 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

exasol/kinesis-connector-extension

Exasol Kinesis Extension for accessing Amazon Kinesis Data Streams

Language: Scala - Size: 276 KB - Last synced at: about 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

cowcoa/aws-data-collection

Collect client behavior data from around the world via HTTP(S) requests and store them in AWS S3 bucket.

Language: Shell - Size: 854 KB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 6 - Forks: 6

AWS-Big-Data-Projects/HeartRate-Monitoring-using-AWS-IOT-and-AWS-KINESIS

you run a script to mimic multiple sensors publishing messages on an IoT MQTT topic, with one message published every second. The events get sent to AWS IoT, where an IoT rule is configured. The IoT rule captures all messages and sends them to Firehose. From there, Firehose writes the messages in batches to objects stored in S3. In S3, you set up a table in Athena and use QuickSight to analyze the IoT data.

Language: Python - Size: 15.6 KB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 10 - Forks: 0

AWS-Big-Data-Projects/aws-serverless-data-lake-workshop

This workshop is meant to give customers a hands-on experience with mentioned AWS services. Serverless Data Lake workshop helps customers build a cloud-native and future-proof serverless data lake architecture. It allows hands-on time with AWS big data and analytics services including Amazon Kinesis Services for streaming data ingestion

Language: Jupyter Notebook - Size: 31 MB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 12 - Forks: 5

miaaaalu/Streaming-data-from-Amazon-S3-to-Amazon-Kinesis

Language: Python - Size: 118 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 1

mearns/read-kinesis

A command-line tool and JS library for reading from Amazon Kinesis data streams.

Language: JavaScript - Size: 890 KB - Last synced at: 10 days ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

productiveAnalytics/aws-cdk-constructs-sandbox

Cloud Development Kit (AWS CDK) using TypeScript, Python and Java

Language: Java - Size: 5.49 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

sematext/cloudwatch-sematext-aws-lambda-log-shipper

Code sample for tutorial about creating a centralized logging system for AWS Lambda with Sematext Logsene.

Language: JavaScript - Size: 51.8 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 1

TrainingByPackt/Serverless-Architectures-with-AWS

Discover how you can migrate from traditional deployments to serverless architectures with AWS

Language: JavaScript - Size: 8.61 MB - Last synced at: over 1 year ago - Pushed at: over 5 years ago - Stars: 12 - Forks: 13

xianchen2/Financal_Data_Ingestion

Financial data ingestion and analysis with AWS Kinesis and Athena

Language: Jupyter Notebook - Size: 6.34 MB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

PhilRanzato/terraform-module-kinesis

A Terraform module to provision Amazon Kinesis

Language: HCL - Size: 16.6 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 2

PhilRanzato/kinesis-application

Python script that produces logs observed by the Amazon Kinesis Agent

Language: Python - Size: 19.5 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

slatawa/Data-Streaming-Using-Aws-Kinesis-Lambda-S3

A production grade data pipeline that streams real time data of an online retailer website into AWS S3 data lake. The pipeline uses AWS Kinesis to receive real time streaming data and a lambda consumer which puts data into S3 data-lake.

Language: Python - Size: 690 KB - Last synced at: about 1 year ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

zaheershk/aws-labs

Sample projects to explore various AWS service-offerings and Architecture approaches

Language: C# - Size: 897 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

manashmandal/kinesis-flink-hello-world

AWS Kinesis and Apache Flink Example

Language: Java - Size: 60.5 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

dorianbg/aws-kinesis-lambda-localstack

Demo of running AWS Lambda and AWS Kineses locally using Localstack

Language: Python - Size: 5.84 MB - Last synced at: over 1 year ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 0

mgorav/apache-camel-aws-eis

Spring Boot + Apache Camel EIA using AWS S3, REST APIs, AWS Kinesis, Apache Kafka --> Data Engineering EIA --> Data Engineering As Routes --> Router Pattern

Language: Java - Size: 4.77 MB - Last synced at: 5 months ago - Pushed at: about 5 years ago - Stars: 3 - Forks: 2

deliverr/data-kinesis-s3-recovery

Recovers Kinesis Firehose source records from S3, replaying them into the stream

Language: Python - Size: 10.7 KB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 1

KyleRoss/kinesis-events

AWS Kinesis event parser and handler for Lambda consumers

Language: JavaScript - Size: 30.3 KB - Last synced at: about 2 months ago - Pushed at: over 4 years ago - Stars: 5 - Forks: 0

scriptbuzz/aws-datalake-poc-video

AWS hosted enterprise Data Lake with both batch and realtime data pipelines.

Size: 349 KB - Last synced at: about 1 year ago - Pushed at: almost 4 years ago - Stars: 1 - Forks: 0

avaibh/Smart-Door-Authentication-System

Amazon Kinesis Stream, Amazon Rekoginition, Serverless

Language: JavaScript - Size: 1.12 MB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 1

amitabh27/Rakathon

Team - Brogrammers. AIRA - Software Solution for Next Generation E-commerce.

Language: JavaScript - Size: 1.77 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

adautoneto/firehose-recover-errors

Recover AWS Kinesis Firehose errors by running the COPY command to each of the manifests file in the S3 errors folders

Language: Python - Size: 1.95 KB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

ZachTRice/aws-apache-to-json

AWS Kinesis Firehose: Apache Log to JSON

Language: JavaScript - Size: 63.5 KB - Last synced at: about 1 year ago - Pushed at: about 5 years ago - Stars: 2 - Forks: 0

productiveAnalytics/aws-kinesis-streams

AWS Kinesis Streams

Language: Shell - Size: 5.86 KB - Last synced at: about 1 year ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

pravin-raha/nifi-processors

Custom nifi kinesis get processor

Language: Java - Size: 8.79 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

averemee-si/oraaud-kafka

Oracle audit files to Apache Kafka/Amazon MKS/Amazon Kinesis transfer

Language: Java - Size: 47.9 KB - Last synced at: over 1 year ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 1

chaliy/play-datapipeline-kinesis

Application demoes data pipline Producer > AWS Kinesis > AWS Lambda > AWS DynamoDb

Language: JavaScript - Size: 285 KB - Last synced at: about 1 year ago - Pushed at: over 7 years ago - Stars: 2 - Forks: 4

daharon/Gateway-Kinesis-Lambda-Test

Testing AWS API Gateway -> Kinesis Stream Fanout -> Lambda Functions -> Persistence Layer

Language: Kotlin - Size: 37.1 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

sajithpro/kinesis-producer

Wrapper around AWS Kinesis Producer with retry and queue logic.

Size: 1000 Bytes - Last synced at: 23 days ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0

bigdot-app/BigDOT-backend

Backend web server for BigDOT

Language: JavaScript - Size: 34.2 KB - Last synced at: 10 months ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0

ebahsini/mp-serverless-kinesis-demo

Example of a useful serverless log analysis, reporting, and alerting pattern with the Serverless Framework on AWS. Leverages Kinesis and Elasticache (redis) service coupled with SES, SNS, and S3

Language: JavaScript - Size: 1.55 MB - Last synced at: over 1 year ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0

faygun/KinesisExample

I tried work with kinesis. There are put record and read stream process in this repository. I hope, it will be helpful.

Language: C# - Size: 5.86 KB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

Aminoid/garfield

AWS framework to stream, classify, index and store data

Language: Python - Size: 1.71 MB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

jw3/openshift-kinesalite

Kinesis on OpenShift with Kinesalite

Size: 3.91 KB - Last synced at: over 1 year ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0

conroywhitney/serverless-slack-backend

Backend for Slack tribute using the Serverless Framework on AWS

Language: JavaScript - Size: 66.4 KB - Last synced at: over 1 year ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0

chasingmaxwell/kinesis-poc

Proof of concept which demonstrates posting a record to an AWS Kinesis stream.

Language: PHP - Size: 5.86 KB - Last synced at: about 2 months ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0