Topic: "aws-msk"
averemee-si/oracdc
Oracle database CDC (Change Data Capture)
Language: Java - Size: 6.5 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 118 - Forks: 41
aws-solutions/clickstream-analytics-on-aws
Build clickstream analytics on AWS for your mobile and web applications
Language: TypeScript - Size: 72.3 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 71 - Forks: 22
terraform-aws-modules/terraform-aws-msk-kafka-cluster
Terraform module to create AWS MSK (Managed Streaming for Kafka) resources 🇺🇦
Language: HCL - Size: 92.8 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 58 - Forks: 64
angelabad/terraform-aws-msk-cluster
Terraform module which creates Msk Kafka Cluster on AWS
Language: HCL - Size: 94.7 KB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 30 - Forks: 35
aws-samples/amazon-msk-java-app-cdk
This project provides and example of end to end data processing application created using the combination of Amazon Managed Streaming for Apache Kafka (Amazon MSK), AWS Fargate, AWS Lambda and Amazon DynamoDB. Business logic is implemented in Java and Typescript. The build and deployment of the application is fully automated using AWS CDK.
Language: Java - Size: 331 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 27 - Forks: 17
ahmadalibagheri/terraform-aws-msk
Create terraform module for deploying AWS MSK cluster
Language: HCL - Size: 65.4 KB - Last synced at: 14 days ago - Pushed at: about 3 years ago - Stars: 17 - Forks: 2
aws-samples/aws-glue-streaming-ingestion-from-kafka-to-apache-iceberg
This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (MSK) and MSK Serverless into Apache Iceberg table in S3 with AWS Glue Streaming.
Language: Python - Size: 522 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 10 - Forks: 0
aws-samples/transactional-datalake-using-amazon-msk-serverless-and-apache-iceberg-on-aws-glue
Stream CDC into an Amazon S3 data lake in Apache Iceberg format with AWS Glue Streaming using Amazon MSK Serverless and MSK Connect (Debezium)
Language: Python - Size: 604 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 8 - Forks: 0
pecigonzalo/terraform-provider-kafka
Terraform Kafka Provider
Language: Go - Size: 268 KB - Last synced at: about 11 hours ago - Pushed at: 4 months ago - Stars: 8 - Forks: 4
wingkwong/aws-playground
My AWS Playground
Language: Python - Size: 348 KB - Last synced at: 19 days ago - Pushed at: 10 months ago - Stars: 6 - Forks: 0
lukevers/serverless-offline-msk
A serverless offline plugin that enables AWS MSK events
Language: TypeScript - Size: 1.48 MB - Last synced at: 6 days ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 2
erviveksoni/aws_msk_mm2
Step by step guidance on how to setup MirrorMaker2 on AWS to perform data replication between 2 AWS MSK clusters
Size: 867 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 5 - Forks: 1
tedilabs/terraform-aws-messaging
🌳 A sustainable Terraform Package which creates resources for Messaging Services (EventBridge, MSK, SNS, SQS) on AWS
Language: HCL - Size: 115 KB - Last synced at: 2 days ago - Pushed at: about 1 month ago - Stars: 4 - Forks: 1
aws-cloudformation/aws-cloudformation-resource-providers-kafkaconnect
The CloudFormation Resource Provider Package For Amazon MSK Connect
Language: Java - Size: 280 KB - Last synced at: 10 days ago - Pushed at: 7 months ago - Stars: 3 - Forks: 6
aws-samples/streaming-data-pipeline-from-kafka-to-s3-using-aws-kinesis-firehose
Streaming data pipeline to continuously load data from an Amazon MSK or MSK Serverless cluster to Amazon S3 using Amazon Kinesis Data Firehose.
Language: Python - Size: 394 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 3 - Forks: 0
aaronchong888/AWS-MSK-Connect-Workshop
AWS MSK Connect workshop helps first time users explore and get started to deploy fully managed Apache Kafka Connect workloads using Amazon MSK Connect.
Size: 5.8 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 0
clouddrove/terraform-aws-msk
Terraform module to create kafka resource on AWS. AWS MSK (Managed Streaming for Apache Kafka) is a fully managed service that simplifies the deployment, management, and operation of Apache Kafka clusters. Apache Kafka is an open-source distributed streaming platform used for building real-time streaming data p
Language: HCL - Size: 137 KB - Last synced at: 3 days ago - Pushed at: 8 days ago - Stars: 2 - Forks: 2
bajaj-varun/aws-test
Use-Case: Airline on-time performance
Language: Java - Size: 76.2 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 5
Sebelino/strimzi-charts
Strimzi-related Helm charts.
Size: 20.5 KB - Last synced at: 11 months ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0
cevoaustralia/data-lake-demo
Data lake demo using change data capture (CDC) on AWS
Language: PLpgSQL - Size: 215 KB - Last synced at: about 1 year ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 3
aws-samples/aws-iot-msk-rule-cloudformation-example
CloudFormation templates to create AWS IoT Rule with Amazon MSK cluster integration.
Size: 58.6 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 4
averemee-si/oraadr-kafka
Oracle Database Automatic Diagnostic Repository messages (alert.log & listener.log) to Apache Kafka or Amazon Kinesis transfer
Language: Java - Size: 43 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 2
thinktik/aws-managed-services-best-usage-sample
使用AWS托管服务的最佳实践样例
Language: Java - Size: 222 KB - Last synced at: 21 days ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0
compose-x/ecs_composex-msk_cluster
x-msk_cluster ECS Compose-X extension package
Language: Python - Size: 594 KB - Last synced at: 6 days ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0
amyth-singh/pinterest-data-pipeline
Pinterest's experiment analytics data pipeline which runs thousands of experiments per day and crunches billions of datapoints to provide valuable insights to improve the product.
Language: Python - Size: 466 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
ksmin23/streaming-data-pipeline-from-kafka-to-s3-using-aws-kinesis-firehose
Streaming data pipeline to continuously load data from an Amazon MSK or MSK Serverless cluster to Amazon S3 using Amazon Kinesis Data Firehose.
Language: Python - Size: 393 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
Adith-Rai/Reddit-Stock-Sentiment-Analyzer
A Cloud based Reddit stock sentiment analyzer that analyzes overall sentiment from a configurable selection of stock subreddits for each stock. The architecture utilizes AWS MSK (Kafka), AWS EMR (PySpark) and AWS Lambda (Python 3) for maximum scalability and the OpenAI API for sentiment analysis through prompt engineering.
Language: Python - Size: 1.46 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0
GhostCat12/pinterest-data-pipeline854
Pinterest data pipeline - designing an end-to-end pipeline utilising AWS cloud technologies and Databricks for analysing real-time and historical pinterest-emulated data.
Language: Jupyter Notebook - Size: 1.05 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
ksmin23/transactional-datalake-using-amazon-msk-iceberg-on-aws-glue
Stream CDC into an Amazon S3 data lake in Apache Iceberg format with AWS Glue Streaming and MSK Connect (Debezium)
Language: Python - Size: 679 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
Charanaicore/pinterest-data-pipeline
Pinterest's experiment analytics data pipeline which runs thousands of experiments per day and crunches billions of datapoints to provide valuable insights to improve the product.
Language: Python - Size: 470 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
sve2-2021ss/mom-ammer
Demo event analytics platform based on Apache Kafka (Confluent).
Language: Python - Size: 2.7 MB - Last synced at: almost 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0
averemee-si/oraaud-kafka
Oracle audit files to Apache Kafka/Amazon MKS/Amazon Kinesis transfer
Language: Java - Size: 47.9 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 1
joan-domingo/kafka-demo
Spring boot demo app. Polls an external service and produces kafka topics which are sent to a kafka cluster (AWS-MSK). This topic is later consumed from the same demo app and returned when calling the REST API endpoint.
Language: Java - Size: 81.1 KB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 1
