GitHub topics: kafka-consumer

Repositories

loicgreffier/spring-boot-kafka-quickstarts

Code samples around Spring Boot and Kafka.

Language: Java - Size: 49.5 MB - Last synced at: about 8 hours ago - Pushed at: about 9 hours ago - Stars: 17 - Forks: 6

Jayanta-karmakar/kafka-spring-boot-integration

This repository contains a Spring Boot project integration with Apache Kafka. It showcases the setup for producing and consuming messages using Kafka.

Language: Java - Size: 34.2 KB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 0 - Forks: 0

karafka/karafka-web

Web UI for monitoring and managing Karafka consumers

Language: Ruby - Size: 6.64 MB - Last synced at: 1 day ago - Pushed at: 2 days ago - Stars: 54 - Forks: 8

confluentinc/librdkafka

The Apache Kafka C/C++ library

Language: C - Size: 34.2 MB - Last synced at: 2 days ago - Pushed at: 3 days ago - Stars: 577 - Forks: 3,193

fgrosse/kafkactl

kafkactl is a command line tool to interact with an Apache Kafka cluster.

Language: Go - Size: 1.87 MB - Last synced at: 3 days ago - Pushed at: 4 days ago - Stars: 8 - Forks: 2

MAIF/yozefu

An interactive terminal user interface (TUI) application for exploring data of a kafka cluster.

Language: Rust - Size: 3.07 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 121 - Forks: 3

simPod/PhpKafka

PHP Kafka boilerplate wrapper around RdKafka

Language: PHP - Size: 168 KB - Last synced at: 2 days ago - Pushed at: 5 days ago - Stars: 5 - Forks: 0

Green-Pulse/AI-Analytics-Service

The AI Analytics Service is responsible for analyzing environmental data and predicting PM2.5 air pollution levels using a pre-trained ML model

Language: Java - Size: 57.6 KB - Last synced at: 4 days ago - Pushed at: 7 days ago - Stars: 0 - Forks: 0

Green-Pulse/User-Management-Service

This microservice is responsible for user operations and interacting with Keycloak Admin REST API

Language: Java - Size: 74.2 KB - Last synced at: 4 days ago - Pushed at: 7 days ago - Stars: 0 - Forks: 0

Green-Pulse/Notification-Service

The Notification Service is responsible for delivering alerts and updates to users via various channels

Language: Java - Size: 58.6 KB - Last synced at: 4 days ago - Pushed at: 7 days ago - Stars: 0 - Forks: 0

karafka/karafka

Ruby and Rails efficient Kafka processing framework

Language: Ruby - Size: 6.32 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 2,146 - Forks: 184

iresil/FowlFlightForensics

A Kafka-based CSV parser for bird-related airplane accidents

Language: Java - Size: 5.23 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 2 - Forks: 0

confluentinc/vscode

Confluent for Visual Studio Code

Language: TypeScript - Size: 44.3 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 23 - Forks: 8

karafka/karafka-testing

Library which provides helpers for easier Karafka consumers tests

Language: Ruby - Size: 377 KB - Last synced at: 1 day ago - Pushed at: 7 days ago - Stars: 23 - Forks: 11

MobileTeleSystems/data-rentgen

NextGen DataMotion Lineage

Language: Python - Size: 1.89 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 5 - Forks: 0

studiowebux/ledger

typescript experiment to build a ledger for learning, a bit inspired on the UTXO model

Language: TypeScript - Size: 99.6 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 0 - Forks: 0

xitonix/trubka

A CLI tool for Kafka

Language: Go - Size: 821 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 333 - Forks: 19

AhmetFurkanDEMIR/Data-Engineering-Project-with-HDFS-and-Kafka

Data Engineering Project with Hadoop HDFS and Kafka

Language: Python - Size: 3.46 MB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 102 - Forks: 25

gdvalishvili1/eventrix

Kafka consumer for golang with partition-ordered concurrent processing and event handling

Language: Go - Size: 32.2 KB - Last synced at: 2 days ago - Pushed at: 8 days ago - Stars: 6 - Forks: 0

source-c/clj-kafka-x

Clojure client for Apache Kafka

Language: Clojure - Size: 63.5 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 6 - Forks: 3

nomisRev/kotlin-kafka

Kafka bindings for Kotlin `suspend`, and Kafka streaming operators for KotlinX Flow.

Language: Kotlin - Size: 2.45 MB - Last synced at: about 7 hours ago - Pushed at: about 8 hours ago - Stars: 110 - Forks: 10

satya-ajayy/TxProcessor

Application designed to seamlessly consume, transform, and process transactions data from kafka topics.

Language: Go - Size: 30.3 KB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 0 - Forks: 0

zendesk/racecar

Racecar: a simple framework for Kafka consumers in Ruby

Language: Ruby - Size: 743 KB - Last synced at: 8 days ago - Pushed at: about 1 month ago - Stars: 495 - Forks: 96

ccamel/go-graphql-subscription-example

☝️ go-graphql subscription over Kafka/Redis/NSQ example

Language: Go - Size: 1.12 MB - Last synced at: 9 days ago - Pushed at: 12 days ago - Stars: 42 - Forks: 5

strimzi/strimzi-kafka-bridge

An HTTP bridge for Apache Kafka®

Language: Java - Size: 2.59 MB - Last synced at: 8 days ago - Pushed at: 18 days ago - Stars: 304 - Forks: 125

aliahmadcse/kafka-deck

Slides and Kafka Demo Project for Kafka Session

Language: Java - Size: 6.16 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 0 - Forks: 0

exasol/kafka-connector-extension

Exasol Kafka Extension for accessing Apache Kafka

Language: Scala - Size: 749 KB - Last synced at: 11 days ago - Pushed at: 14 days ago - Stars: 4 - Forks: 7

masesgroup/KNet

KNet is a comprehensive .NET suite for Apache Kafka™ providing all features: Producer, Consumer, Admin, Streams, Connect, backends (ZooKeeper and Kafka)

Language: C# - Size: 134 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 45 - Forks: 6

line/decaton

High throughput asynchronous task processing on Apache Kafka

Language: Java - Size: 12.4 MB - Last synced at: 13 days ago - Pushed at: 14 days ago - Stars: 344 - Forks: 53

jorgermduarte/poc-csharp-kafka-project

Language: C# - Size: 230 KB - Last synced at: 4 days ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

zeromicro/cds

Data syncing in golang for ClickHouse.

Language: Go - Size: 7.01 MB - Last synced at: 13 days ago - Pushed at: over 1 year ago - Stars: 970 - Forks: 139

hifly81/kafka-examples

Practical examples with Apache Kafka®

Language: Java - Size: 120 MB - Last synced at: 14 days ago - Pushed at: about 1 month ago - Stars: 76 - Forks: 15

pedrodeoliveira/fastapi-kafka-consumer

A Python RESTful API using FastAPI with a Kafka Consumer

Language: Python - Size: 6.84 KB - Last synced at: 2 days ago - Pushed at: about 4 years ago - Stars: 155 - Forks: 29

floydspace/effect-kafka

📨 Effectful Kafka

Language: TypeScript - Size: 643 KB - Last synced at: 1 day ago - Pushed at: 3 months ago - Stars: 13 - Forks: 2

zerodha/kaf-relay

Replicate and sync Kafka topics between clusters in realtime. Supports topic re-mapping, healthchecks, and hot failovers for high availability.

Language: Go - Size: 343 KB - Last synced at: 3 days ago - Pushed at: about 1 month ago - Stars: 72 - Forks: 6

Trendyol/otel-kafka-konsumer

open telemetry wrapper for kafka-go and kafka-konsumer

Language: Go - Size: 370 KB - Last synced at: 15 days ago - Pushed at: 3 months ago - Stars: 27 - Forks: 0

PouyaPouryaie/springboot-kafka

This project demonstrates a simple kafka producer and consumer alongside another feature like error-handling, integration test with testcontainer and more

Language: Java - Size: 227 KB - Last synced at: 8 days ago - Pushed at: about 1 month ago - Stars: 6 - Forks: 0

limmer-laboratories/kafka-bundle

A symfony bundle for working with Kafka

Language: PHP - Size: 38.1 KB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 2 - Forks: 0

weiboad/kafka-php 📦

kafka php client

Language: PHP - Size: 926 KB - Last synced at: 4 days ago - Pushed at: about 3 years ago - Stars: 1,440 - Forks: 450

piomin/sample-spring-boot-saga-eventing

Demo presenting how to use Spring Cloud Stream and Spring Cloud Function with Apache Kafka broker to implement SAGA pattern in event-driven communication.

Language: Java - Size: 56.6 KB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 23 - Forks: 14

NAGARAJ08/kafka-replay

A CLI tool to fetch Kafka messages within a specified time range

Language: Python - Size: 7.81 KB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 0 - Forks: 0

osodevops/CCAAK-Exam-Questions

Confluent Kafka questions to practice for CCAAK

Size: 32.2 KB - Last synced at: 7 days ago - Pushed at: about 2 months ago - Stars: 12 - Forks: 2

ararog/health_up_worker

A kafka based message consumer which do LLM model interaction with Pydantic.AI

Language: Python - Size: 115 KB - Last synced at: 23 days ago - Pushed at: 23 days ago - Stars: 0 - Forks: 0

zillow/zkafka

An efficient and scalable library for stateless Kafka message processing written in Go

Language: Go - Size: 329 KB - Last synced at: 23 days ago - Pushed at: about 1 month ago - Stars: 61 - Forks: 1

tashi-2004/Apache-Airflow-Kafka-Spark-DeltaLake-Real-Time-Stream-Pipeline

This project implements a real-time data pipeline using Apache Airflow, Kafka, Apache Spark, and Delta Lake. It supports both batch (Coldpath) and real-time (Hotpath) data ingestion, processing, and storage. Airflow is used for orchestrating the data workflows.

Language: Python - Size: 12.4 MB - Last synced at: 18 days ago - Pushed at: 26 days ago - Stars: 0 - Forks: 0

siddharthgupta5/Real-Time-Stock-Price-Tracker-using-Kafka

A real time stock prices tracker using Kafka

Language: Python - Size: 0 Bytes - Last synced at: 27 days ago - Pushed at: 28 days ago - Stars: 0 - Forks: 0

hoangtien2k3/microservice-webflux

Microservice-webflux with spring boot, reactor-core, Liquibase database migration, docker, apache kafka.

Language: Java - Size: 126 KB - Last synced at: 11 days ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 4

tennyros/kafka-module-services

Kafka-producer-consumer workflow in spring-boot-multi-module project

Language: Java - Size: 97.7 KB - Last synced at: 28 days ago - Pushed at: 28 days ago - Stars: 0 - Forks: 0

omarsmak/kafka-consumer-lag-monitoring

Client tool that exports the consumer lag of Kafka consumer groups to Prometheus or your terminal

Language: Kotlin - Size: 372 KB - Last synced at: 16 days ago - Pushed at: 5 months ago - Stars: 52 - Forks: 13

piomin/sample-spring-boot-kafka

Sample Spring Boot apps that sends and receives messages from Kafka using the Spring Kafka project

Language: Java - Size: 31.3 KB - Last synced at: 19 days ago - Pushed at: 29 days ago - Stars: 6 - Forks: 6

san089/Optimizing-Public-Transportation

A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.

Language: Python - Size: 496 KB - Last synced at: 18 days ago - Pushed at: over 1 year ago - Stars: 30 - Forks: 14

minhi0449/kafka

Apache Kafka와 Spring Boot를 활용한 실시간 메시지 스트리밍 아키텍처 구현 및 학습

Language: Java - Size: 1.08 MB - Last synced at: 24 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

pmdevers/MinimalKafka

MinimalKafka is a simple and efficient Kafka consumer library designed to work seamlessly with .NET 8.0. It allows for minimalistic and straightforward message consumption similar to minimal APIs.

Language: C# - Size: 13.1 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 1

aws-redhat-gameday/coffeeshop-app

Coffeeshop app services (frontend+backend)

Language: Java - Size: 891 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

joowani/kq

Kafka-based Job Queue for Python

Language: Python - Size: 108 KB - Last synced at: 9 days ago - Pushed at: about 3 years ago - Stars: 572 - Forks: 23

fatihunlu/KafkaExamples

A collection of hands-on examples and demos for understanding Kafka concepts. Created to accompany my Medium articles.

Language: C# - Size: 15.6 KB - Last synced at: 15 days ago - Pushed at: 2 months ago - Stars: 2 - Forks: 0

miltiadiss/CEID_NE4348-Big-Data-Management-Systems

This project implements a real-time data pipeline with Kafka, Spark, and MongoDB. It generates vehicle data using UXSIM, streams it to a Kafka broker, processes it with Spark, and stores raw and processed data in MongoDB. Queries analyze vehicle counts, speeds, and routes over specified periods.

Language: Python - Size: 4.88 MB - Last synced at: 23 days ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

LearningJournal/ApacheKafkaTutorials

Example Code for Kafka Tutorials @ Learning Journal

Language: Java - Size: 20.5 KB - Last synced at: 12 days ago - Pushed at: over 7 years ago - Stars: 177 - Forks: 220

agungdwiprasetyo/backend-microservices

Monorepo for backend microservices golang

Language: Go - Size: 849 KB - Last synced at: 7 days ago - Pushed at: about 2 years ago - Stars: 69 - Forks: 18

vipinsharma29/kafka-springboot-microservices

kafka-springboot-microservices

Language: Java - Size: 31.3 KB - Last synced at: 18 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

HariSekhon/Nagios-Plugin-Kafka

Kafka Scala API CLI / Advanced Nagios Plugin, with Kerberos support (uses Kafka 0.9+ native Java API)

Language: Shell - Size: 816 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 11 - Forks: 6

khorshuheng/kafka-protobuf-console

CLI tool to produce/consume Protobuf message to/from Kafka

Language: Go - Size: 25.4 KB - Last synced at: 9 days ago - Pushed at: over 5 years ago - Stars: 18 - Forks: 3

MildredZarv/hola-kafka

Kafka Producer-Consumer Demo with Avro Serialization and Spring Boot (Dockerized)

Language: Java - Size: 54.7 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

chetanghadiya007/kafka_zookeeper_nodejs

Scalable Application Using Kafka, Zookeeper, and Node.js

Language: JavaScript - Size: 2.93 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

LearningJournal/Kafka-Streams-Real-time-Stream-Processing

This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.

Language: Java - Size: 5.25 MB - Last synced at: 9 days ago - Pushed at: over 4 years ago - Stars: 164 - Forks: 163

JavaCoDED78/data-store-service

This application receives data from Data analyser service

Language: Java - Size: 76.2 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

maciek1839/kafka-producer-consumer

Kafka producer and consumer samples

Language: Java - Size: 3.54 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 1

jonathan-foucher/nodejs-kafka-avro-example

An example of kafka avro producer and consumer with nodejs

Language: JavaScript - Size: 32.2 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

tashi-2004/FMA-A-Dataset-For-Music-Analysis

Scripts for music feature analysis, model training, and real-time recommendation using Apache Kafka. Extract features, store them in MongoDB, and process the data with Apache Spark. A web interface is also included.

Language: Python - Size: 2.66 MB - Last synced at: 18 days ago - Pushed at: 2 months ago - Stars: 3 - Forks: 1

JavaCoDED78/data-analyser-service

This application receives data from Data producer service

Language: Java - Size: 95.7 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

vipinsharma29/Kafka-idempotent-producer-consumer

Kafka-idempotent-producer-consumer

Language: Java - Size: 20.5 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

noornj/kafka-labs

Size: 0 Bytes - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

lpsm-dev/twitter-realtime-processing-covid

✔️ Twitter Realtime Processing about Covid-19 + Docker + Docker Compose + Apache Kafka + Elastic Stack (Elasticsearch + Kibana)

Language: Python - Size: 362 KB - Last synced at: 3 days ago - Pushed at: 17 days ago - Stars: 8 - Forks: 0

NiladriChatterje/game-store-stripe-nodemailer

e-commerce platform

Language: TypeScript - Size: 813 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

jacintogomez/Financial-Market-Daily-Population

Populate database daily with live market information from FMP and EOD financial APIs

Language: Python - Size: 246 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

asem25/TechRadar

Tech Radar: Сервис для управления технологическим стеком и визуализации в формате техрадара

Language: Java - Size: 59.6 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

OSSMafia/fastapi-kafka

A Kafka wrapper class around FastAPI to create consumers as endpoints.

Language: Python - Size: 27.3 KB - Last synced at: 11 days ago - Pushed at: 8 months ago - Stars: 3 - Forks: 1

edsonwade/kafka-demo-course

Apache Kafka is a distributed streaming platform that is used for building real-time data pipelines and streaming applications.

Language: Java - Size: 150 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

trueifnotfalse/lumen-kafka

Lumen Kafka

Language: PHP - Size: 7.81 KB - Last synced at: 24 days ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 1

likhithkp/kafka-coffee-brew-system

A simple Kafka-based coffee order system using Go. The producer sends coffee orders to Kafka, and the consumer processes and logs them.

Language: Go - Size: 10.7 KB - Last synced at: about 3 hours ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

gitmehedi/techstacks

All kinds of R&D projects which are needed for my future implementation

Size: 47.2 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 3 - Forks: 0

josephC45/spark_microservice_for_typeahead_application

Spark service ingesting Kafka stream from Typeahead Application that aggregates words on occurrences and sinks to HBase.

Language: Java - Size: 43 KB - Last synced at: 15 days ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

H-Rusch/TimeTrials-Webservice

Spring Boot 3 webservice for saving and viewing times for time trials in Mario Kart 8 Deluxe

Language: Java - Size: 237 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

AkashBhuiyan/kafka-spring-boot

This is a Spring Boot-based Kafka Producer & Consumer Demo, designed to demonstrate event-driven architecture using Apache Kafka.

Language: Java - Size: 22.5 KB - Last synced at: 15 days ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

Axnjr/KafkaInRust

Kafka topic producer and consumer example in Rust with Web-Sockets and Axum Web Server.

Language: Rust - Size: 18.6 KB - Last synced at: 10 days ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

mikeroyal/Apache-Kafka-Guide

Apache Kafka Guide

Size: 203 KB - Last synced at: 10 days ago - Pushed at: over 3 years ago - Stars: 31 - Forks: 6

quackscience/duckdb-extension-kafquack

Experimental DuckDB Kafka Consumer Extension

Language: C++ - Size: 22.5 KB - Last synced at: 14 days ago - Pushed at: 4 months ago - Stars: 9 - Forks: 0

mookid8000/Topos

:cyclone: .NET Event Processing library

Language: C# - Size: 5.19 MB - Last synced at: 19 days ago - Pushed at: 2 months ago - Stars: 23 - Forks: 5

mukul273/springboot-kafka-tutorial

springboot kafka tutorial

Language: Java - Size: 3.22 MB - Last synced at: 11 days ago - Pushed at: 12 months ago - Stars: 1 - Forks: 0

iamkushvanth/Real-Time-Data-Analysis-Using-Kafka

In this project, you will execute an End-To-End Data Engineering Project on Real-Time Stock Market Data using Kafka. We are going to use different technologies such as Python, Amazon Web Services (AWS), Apache Kafka, Glue, Athena, and SQL.

Language: Jupyter Notebook - Size: 2.46 MB - Last synced at: about 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

eo-cqrs/eo-kafka

EO Kafka Producers and consumers for working with Apache Kafka message broker

Language: Java - Size: 1.38 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 29 - Forks: 3

tashi-2004/Apache-Kafka-and-Frequent-Item-sets

This Bash script automates the setup and execution of a data processing pipeline using Apache Kafka and Python scripts, ensuring fault tolerance and streamlined management of Kafka-based data pipelines.

Language: Python - Size: 146 KB - Last synced at: 18 days ago - Pushed at: 2 months ago - Stars: 3 - Forks: 0

s1ddh-rth/fake-kafka

A simulated Kafka data pipeline that generates fake customer and order data, processes it through Kafka, and stores it in PostgreSQL for real-time analysis with PySpark. Includes Kafdrop UI for monitoring. 🚀

Language: Python - Size: 4.88 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

idsulik/kafka-concepts-visualizer

Interactive visualization tool that helps developers understand Apache Kafka core concepts through animations. See how messages flow through topics and partitions, how consumer groups work, and how partition rebalancing happens when scaling consumers up or down.

Language: JavaScript - Size: 5.86 KB - Last synced at: 24 days ago - Pushed at: 4 months ago - Stars: 2 - Forks: 0