GitHub topics: kinesis-stream | Ecosyste.ms: Repos

davidwin3/tracker-web-extensions

Kinesis Log Tracker

Language: TypeScript - Size: 492 KB - Last synced at: about 24 hours ago - Pushed at: 1 day ago - Stars: 1 - Forks: 2

aramalipoor/aws-cost-saver

A tiny CLI tool to help save costs in development environments when you're asleep and don't need them!

Language: TypeScript - Size: 1.08 MB - Last synced at: 4 days ago - Pushed at: about 2 months ago - Stars: 311 - Forks: 9

goamegah/real-time-urban-traffic-intelligence

End-To-End Real-Time Urban Traffic Intelligence Streaming Solution

Language: Scala - Size: 3.55 MB - Last synced at: 27 days ago - Pushed at: 27 days ago - Stars: 0 - Forks: 0

aditya-K93/localstack

test localstack setup with Scala 3 and Cats effect

Language: Scala - Size: 33.2 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

aws-samples/web-analytics-on-aws

This web analytics demo shows how to collect web logs with API Gateway and store them into S3 through Amazon Kinesis. Then this project shows how to analyze web logs with Amazon Athena.

Language: Python - Size: 1.47 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 17 - Forks: 4

disneystreaming/pg2k4j

Postgresql To Kinesis For Java

Language: Java - Size: 925 KB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 79 - Forks: 26

aws-samples/serverless-streaming-data-application

Code companion to AWS Compute Series on building a serverless backend for a streaming application. Questions? Contact @jbesw.

Language: JavaScript - Size: 469 KB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 45 - Forks: 20

maciek1839/aws-playground

AWS introduction by examples

Language: Shell - Size: 3 MB - Last synced at: about 17 hours ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

tbsklg/iot-kinesis-lambda

This project demonstrates a serverless event processing pipeline using AWS.

Language: HCL - Size: 23.4 KB - Last synced at: 4 days ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

segence-docker/kafka-connect

Kafka Connect Docker image containing AWS Kinesis and S3 plugins

Language: Makefile - Size: 11.7 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

isystk/react-video-chat

React.js(Next.js)で作成したビデオ&チャットアプリケーションです。チャット機能は、AWS Lambda の WebSocket機能を利用しています。ビデオ通話には、AWS Kinesis Video Streamを利用しています。

Language: TypeScript - Size: 2.71 MB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

Kaushik-Puttaswamy/Crypto-Data-Processing-and-Analysis-Pipeline

This project processes real-time cryptocurrency transactions using AWS Glue, Kinesis, DynamoDB, and Apache Hudi for ETL and analytics. The data is analyzed with Athena and visualized in QuickSight for insights.

Language: Python - Size: 4.53 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

bufferapp/restream

Replay Firehose Streams in Kinesis Streams!

Language: Python - Size: 6.84 KB - Last synced at: 27 days ago - Pushed at: almost 5 years ago - Stars: 8 - Forks: 2

alexcasalboni/kinesis-streams-fan-out-kinesis-analytics

Amazon Kinesis Streams fan-out via Kinesis Analytics (powered by the Serverless Framework)

Language: JavaScript - Size: 22.5 KB - Last synced at: 3 days ago - Pushed at: over 5 years ago - Stars: 105 - Forks: 17

aws-samples/amazon-kinesis-load-testing-with-locust

Easy Amazon Kinesis load testing with Locust - a modern load testing framework

Language: TypeScript - Size: 1.55 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 8 - Forks: 5

faizpuad/DataEngineeringProject-AWSRealtimeCreditCardTrxPipeline

Real-time OLTP system for credit card fraud detection using AWS API Gateway, Kinesis, and RDS PostgreSQL. Features a scalable, serverless pipeline for secure and low-latency transaction processing

Language: TypeScript - Size: 11.7 MB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

sndyuk/logback-more-appenders

Extra appenders for Logback.

Language: Java - Size: 204 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 125 - Forks: 57

dinsaw/kines

Friendly CLI for Amazon Kinesis Data Streams

Language: Python - Size: 7.8 MB - Last synced at: 24 days ago - Pushed at: over 4 years ago - Stars: 57 - Forks: 4

averemee-si/oralog

Ingestion tool for various database logs

Language: Java - Size: 126 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 1

Arun-kc/streaming-data-amazon-kinesis

A simple producer-consumer streaming pipeline was created using AWS Kinesis and Jupyter notebook. Purely educational purpose.

Language: Jupyter Notebook - Size: 3.91 KB - Last synced at: 2 months ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

Clever/amazon-kinesis-client-go

Amazon Kinesis Client for Go

Language: Go - Size: 7.89 MB - Last synced at: 16 days ago - Pushed at: 22 days ago - Stars: 16 - Forks: 8

aws-samples/redshift-streaming-ingestion-patterns

This is a collecton of CDK projects to show how to load data from streaming services into Amazon Redshift.

Language: Python - Size: 146 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 9 - Forks: 0

DieGit0/data_realtime_-_batch_analytics

Data Streaming and Batch processing using AWS Services

Language: Python - Size: 13.3 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

ShikhaYadav123/Amazon-Prime-Day-Sales-Data-Projection-Real-Time-Data-Streaming

Real Time Data Ingestion, Change Data Capture, In Transit Data Manipulation using DynamoDB, DynamoDB Stream, Kinesis Stream, Kinesis Firehose, Lambda Resources

Language: Python - Size: 1.87 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

redclawtech/vernemq_kinesis

VerneMQ plugin that aggregates and sends MQTT messages to AWS Kinesis.

Language: Erlang - Size: 17.6 KB - Last synced at: 12 months ago - Pushed at: about 7 years ago - Stars: 6 - Forks: 1

kalyani33/food-delivery-real-time-data-analysis

Language: Python - Size: 22.5 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

devasthali-os/eventstream-pipeline-example1

demo for eventstream pipeline

Language: Java - Size: 10.7 KB - Last synced at: 10 months ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0

devasthali-os/elasticC2-kinesis-connection

Language: Scala - Size: 612 KB - Last synced at: 10 months ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0

taupirho/read-write-kinesis-stream

A small example of reading and writing an AWS kinesis stream with python lambdas

Language: Python - Size: 21.5 KB - Last synced at: 11 months ago - Pushed at: almost 7 years ago - Stars: 12 - Forks: 12

phaniteja5789/Event-Driven-Data-Processing-and-Workflow-Orchestration-on-AWS

Language: Python - Size: 1.27 MB - Last synced at: 2 days ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

lifion/lifion-kinesis

A native Node.js producer and consumer library for Amazon Kinesis Data Streams

Language: JavaScript - Size: 3.32 MB - Last synced at: 9 days ago - Pushed at: 8 months ago - Stars: 86 - Forks: 18

miztiik/sensitive-data-filter-instream

Scrub Sensitive Data from Event Streams - Kinesis

Language: Python - Size: 155 KB - Last synced at: about 1 year ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 1

miztiik/kinesis-tumbling-window-analytics

Streaming analytics using Kinesis Data Analytics using SQL

Language: Python - Size: 563 KB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 4

careem/kinesis-client-library Fork of ksamykandil/kinesis-client-library

Kinesis Client Library - Rust

Language: Rust - Size: 171 KB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

ShubhanshuJha/aws-utils

Utility code for AWS Services. Sample use case could be querying data from KDS. This project is open to receive contribution.

Language: Python - Size: 8.79 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

ZeroTwoDataRW/Ecommerce-DE-On-AWS

An end-to-end AWS data engineering pipeline that orchestrates data ingestion, processing, and storage using Kinesis, S3, Redshift, Lambda, DynamoDB

Language: Python - Size: 81.1 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

sdabhi23/streaming-data-pipeline

A streaming data pipeline leveraging managed services from AWS & the serverless architecture

Language: Python - Size: 105 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

ksamykandil/kinesis-client-library

Kinesis Client Library - Rust

Language: Rust - Size: 34.2 KB - Last synced at: about 1 year ago - Pushed at: over 6 years ago - Stars: 4 - Forks: 2

500px/kinesis-stream

Scala based wrapper for Kinesis Consumer Library which exposes the stream as an Akka Streams Source

Language: Scala - Size: 119 KB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 10 - Forks: 7

VermaDeepali/AWS

All about aws-services

Language: JavaScript - Size: 34.2 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

meni432/redis-article

Embracing Modern Data Solutions: Transitioning from Apache Flink to Redis and AWS Lambda with SQS and Kinesis

Language: JavaScript - Size: 71.4 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

HarishKM7/Terraform-AWS-Kinesis-Lambda-S3-Architecture-Pattern

Terraform implementation of a commonly-used AWS architecture pattern of streaming data to a Kinesis data stream & writing the streamed data to S3 using a Lambda function.

Language: HCL - Size: 1.95 KB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

marigroc/pinterest-data-pipeline53

Creation of the almost-real time data processing pipeline for the Pintrest posts.

Language: Jupyter Notebook - Size: 2 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

aws-samples/kinesis-auto-scaling

A lightweight system to automatically scale Kinesis Data Streams up and down based on throughput.

Language: Go - Size: 20.1 MB - Last synced at: 11 months ago - Pushed at: over 1 year ago - Stars: 29 - Forks: 10

thinow/aws-kinesis-consumer

Consume an AWS Kinesis Data Stream to look over the records from a terminal.

Language: Python - Size: 146 KB - Last synced at: 27 days ago - Pushed at: over 1 year ago - Stars: 24 - Forks: 0

neerajadsul/DataEngineering

Projects and coding completed for Data Engineering immersive program at AiCore.

Language: Jupyter Notebook - Size: 2.61 MB - Last synced at: 3 days ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

Versent/kinesis-tail

Tool which provides tail for Kinesis

Language: Go - Size: 84 KB - Last synced at: 23 days ago - Pushed at: over 1 year ago - Stars: 20 - Forks: 10

DwarakJ/StockAnalysis

Simple Stock analysis app which sends email when a certain threshold is reached

Language: Python - Size: 64.9 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

abideenml/RealTime-StarRatingPrediction-with-AWSKinesis

This repository contains an End to End Real time 🕰️ Machine Learning Pipeline to predict star ⭐️ rating of product reviews. This project uses AWS Sagemaker, Kinesis, Lambda, S3, Redshift, Athena, and Step functions. Deployment of multiple models for AB testing and Bandit testing is also included.

Language: Jupyter Notebook - Size: 15.1 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

ArekZajac/pinterest-data-pipeline

A unified data pipeline that aggregates, refines, and analyses vast datasets, delivering real-time business intelligence and supporting data-driven decisions.

Language: Jupyter Notebook - Size: 1.54 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

shirou/prometheus_remote_kinesis 📦

prometheus remote write integration for AWS kinesis

Language: Go - Size: 52.7 KB - Last synced at: 11 months ago - Pushed at: almost 2 years ago - Stars: 9 - Forks: 7

coryodaniel/docker-kinesis-agent

AWS Kinesis Agent on Debian Slim 9

Language: Makefile - Size: 2.93 KB - Last synced at: about 1 month ago - Pushed at: over 5 years ago - Stars: 8 - Forks: 2

crossroad0201/aws-kcl-example

Kinesis consumer application sample implementation using AWS Kinesis Client Library 1.x(v2).

Language: Java - Size: 68.4 KB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 11 - Forks: 5

alexandremcastro/Data-Lake-Serverless-AWS

Projeto de Big Data, implementando um Data Lake completo em nuvem (Cloud), Serverless, no ecossistema da AWS, utilizando as principais ferramentas (Cloud9, Kinesis, DynamoDB, IAM, S3, Lambda, Glue, Athena).

Size: 5.63 MB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

gerardodavidlopezcastillo/Cloud9KinesisAthena_Public

Streaming data analysis using AWS tools such as Cloud9 to generate events in the cloud, using boto3 to send records to Kinesis Data Firehose to connect to the S3 bucket destination, saving files in .parquet format. With the help of Glue, a data catalog will be created to enable real-time querying of all records with Athena.

Language: Python - Size: 1.3 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

shaunmcglinchey/serverless-streaming-analytics

WIP Serverless Streaming Analytics data pipeline composed of AWS Kinesis Data Streams, AWS Kinesis Data Analytics (Flink), AWS S3, AWS Lambda, Snowflake and Python components. Provisioned using Terraform.

Language: HCL - Size: 12.7 KB - Last synced at: 4 months ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 1

hi-space/jetson-nano-dev

Real-time streaming (AWS kvs) & object detection & semantic segmentation using RealSense D435i on Jetson Nano

Language: Python - Size: 276 MB - Last synced at: 3 months ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

cobalt12345/web-rendez-vous

WebRTC with Amplify

Language: JavaScript - Size: 5.82 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

leonardohss0/data-streaming-with-kinesis

Keywords: Python, AWS Kinesis, AWS Firehose, AWS Lambda, Snowflake, AWS S3, AWS Athena

Language: Python - Size: 363 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

ROki1988/k-iter

AWS Kinesis Stream Subscriber for CLI

Language: Rust - Size: 79.1 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 2

chosh31/websocket-slack

web socket-slack

Language: JavaScript - Size: 19.5 KB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

chosh31/streamsets-kinesis

Language: Dockerfile - Size: 5.02 MB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

AnuradhaIyer/SilverSnug Fork of nidhijmr/SilverSnug

SilverSnug - A Technology Companion for the Elderly

Language: Java - Size: 137 KB - Last synced at: almost 2 years ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0

AnuradhaIyer/AlzheimersCaregiver Fork of nidhijmr/AlzheimersCaregiver

Android app which will help patients with Alzheimer and dementia

Language: Java - Size: 854 KB - Last synced at: almost 2 years ago - Pushed at: almost 7 years ago - Stars: 1 - Forks: 1

brunossilveira/trecker

Trecker system

Language: Ruby - Size: 58.6 KB - Last synced at: almost 2 years ago - Pushed at: almost 8 years ago - Stars: 0 - Forks: 0

beachstrider/towerview-web

Monitor CCTV camera live streaming

Language: TypeScript - Size: 417 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 4 - Forks: 0

Pierozi/DyKi 📦

DyKi : Scan DynamoDB items to dispatch into Kinesis Stream

Language: JavaScript - Size: 12.7 KB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

mesillo/lambdazio

Local Node.js AWS Kinesis->Lambda (stupid) debug tool.

Language: JavaScript - Size: 104 KB - Last synced at: almost 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

gs-costa/nearRealTime

Exciting AWS project that combines a streamlined pipeline for near real-time updates. The architecture is powered by essential AWS services like IAM, VPC, RDS, DMS, Kinesis, S3, and Redshift

Language: Python - Size: 38.1 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 1 - Forks: 0

rodrigodelmonte/terraform-aws-kinesis-stream

Terraform module which creates Kinesis stream on AWS

Language: HCL - Size: 85.9 KB - Last synced at: about 1 year ago - Pushed at: almost 4 years ago - Stars: 7 - Forks: 8

HsiehShuJeng/dynamodb-streaming-datalake

A demo of DynamoDB CDC into data lake with AWS CDK v2

Language: TypeScript - Size: 263 KB - Last synced at: about 2 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

msfidelis/awswaf-production-automation

Complete provisioning and automation management for AWS WAF V1 Rules - Regional Mode

Language: HCL - Size: 50.8 KB - Last synced at: about 1 month ago - Pushed at: almost 4 years ago - Stars: 7 - Forks: 0

aws-samples/amazon-qldb-financialwallet-crud-aws-samples-v2

Development code to show simple CRUD operations on Amazon QLDB and setup Amazon Kinesis Data streams. The solution uses AWS Lambda Amazon API Gateway Amazon QLDB Amazon DynamoDB and Amazon Kinesis Data Streams

Language: JavaScript - Size: 18.6 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 8 - Forks: 6

sazzrahman/kinesis-dstream

kinesis data streaming pipelines

Language: Python - Size: 8.79 KB - Last synced at: 2 days ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

agvar/Prediction_Text

The project predicts the sentiment ( positive or negative) on real-time tweets using Tweepy, AWS Kinesis Streaming, S3, Django REST Framework

Language: Jupyter Notebook - Size: 16.3 MB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

sufiankaki/tweets2kinesis

Stream tweets using Twitter API v2 using Tweepy to Amazon Kinesis Data Stream

Language: Python - Size: 4.88 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

juliocesarscheidt/lambda-image-recognition-kinesis

Language: Go - Size: 537 KB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

ErickYataco/lambda-monitoring-cost

Experiment to create a module to extract relevant metrics (Duration, Billed Duration and Memory Size) from “REPORT” log entry reported through CloudWatch and store them into InfluxDB 2.

Language: HCL - Size: 96.7 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 4 - Forks: 1

eduardo3g/twitter

A serverless Twitter built with some cool stuff, such as the Serverless Framework, AppSync (GraphQL), Lambda, DynamoDB, Cognito, Kinesis Firehose, and Algolia ☁️

Language: JavaScript - Size: 1.54 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 40 - Forks: 6

sharstream/aws-batch

iot experiment

Language: JavaScript - Size: 764 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

amazon-archives/aws-rapid-prototyping-with-java 📦

Language: Java - Size: 36.1 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 9 - Forks: 6

kojiromike/kinesis-client-library-for-python-image

A base image for the kinesis client library for python

Language: Dockerfile - Size: 36.1 KB - Last synced at: about 1 year ago - Pushed at: over 6 years ago - Stars: 2 - Forks: 3

kyopark2014/iot-analytics-for-thermometer

It shows IoT analytics infrastructure to gather sensor information using M5Stack, AWS IoT Edukit.

Language: C - Size: 274 MB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 8 - Forks: 0

gakas14/AWS-Serverless-Data-Lake

This workshop is to build a serverless data lake architecture using Amazon Kinesis Firehose for streaming data ingestion, AWS Glue for Data Integration (ETL, Catalogue Management), Amazon S3 for data lake storage, Amazon Athena for SQL big data analytics.

Language: Jupyter Notebook - Size: 56.6 KB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0