kafka-consumer | Topic | Ecosyste.ms: Repos

Topic: "kafka-consumer"

karafka/karafka

Ruby and Rails efficient Kafka processing framework

Language: Ruby - Size: 6.32 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 2,146 - Forks: 184

weiboad/kafka-php 📦

kafka php client

Language: PHP - Size: 926 KB - Last synced at: 4 days ago - Pushed at: about 3 years ago - Stars: 1,440 - Forks: 450

zeromicro/cds

Data syncing in golang for ClickHouse.

Language: Go - Size: 7.01 MB - Last synced at: 12 days ago - Pushed at: over 1 year ago - Stars: 970 - Forks: 139

confluentinc/parallel-consumer

Parallel Apache Kafka client wrapper with per message ACK, client side queueing, a simpler consumer/producer API with key concurrency and extendable non-blocking IO processing.

Language: Java - Size: 3.35 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 660 - Forks: 113

confluentinc/librdkafka

The Apache Kafka C/C++ library

Language: C - Size: 34.2 MB - Last synced at: 1 day ago - Pushed at: 2 days ago - Stars: 577 - Forks: 3,193

joowani/kq

Kafka-based Job Queue for Python

Language: Python - Size: 108 KB - Last synced at: 9 days ago - Pushed at: about 3 years ago - Stars: 572 - Forks: 23

zendesk/racecar

Racecar: a simple framework for Kafka consumers in Ruby

Language: Ruby - Size: 743 KB - Last synced at: 8 days ago - Pushed at: about 1 month ago - Stars: 495 - Forks: 96

SourceLabOrg/kafka-webview

Full-featured web-based Apache Kafka consumer UI

Language: Java - Size: 3.53 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 394 - Forks: 83

line/decaton

High throughput asynchronous task processing on Apache Kafka

Language: Java - Size: 12.4 MB - Last synced at: 12 days ago - Pushed at: 13 days ago - Stars: 344 - Forks: 53

xitonix/trubka

A CLI tool for Kafka

Language: Go - Size: 821 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 333 - Forks: 19

strimzi/strimzi-kafka-bridge

An HTTP bridge for Apache Kafka®

Language: Java - Size: 2.59 MB - Last synced at: 7 days ago - Pushed at: 17 days ago - Stars: 304 - Forks: 125

Qihoo360/qbusbridge

The Apache Kafka Client SDK

Language: C++ - Size: 611 KB - Last synced at: 16 days ago - Pushed at: 12 months ago - Stars: 290 - Forks: 73

mre/kafka-influxdb

High performance Kafka consumer for InfluxDB. Supports collectd message formats.

Language: Python - Size: 1.56 MB - Last synced at: 12 days ago - Pushed at: over 2 years ago - Stars: 215 - Forks: 53

LearningJournal/ApacheKafkaTutorials

Example Code for Kafka Tutorials @ Learning Journal

Language: Java - Size: 20.5 KB - Last synced at: 12 days ago - Pushed at: over 7 years ago - Stars: 177 - Forks: 220

LearningJournal/Kafka-Streams-Real-time-Stream-Processing

This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.

Language: Java - Size: 5.25 MB - Last synced at: 8 days ago - Pushed at: over 4 years ago - Stars: 164 - Forks: 163

pedrodeoliveira/fastapi-kafka-consumer

A Python RESTful API using FastAPI with a Kafka Consumer

Language: Python - Size: 6.84 KB - Last synced at: 2 days ago - Pushed at: about 4 years ago - Stars: 155 - Forks: 29

MAIF/yozefu

An interactive terminal user interface (TUI) application for exploring data of a kafka cluster.

Language: Rust - Size: 3.07 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 121 - Forks: 3

mmolimar/kukulcan

A REPL for Apache Kafka

Language: Scala - Size: 2.74 MB - Last synced at: 4 months ago - Pushed at: about 4 years ago - Stars: 115 - Forks: 7

nomisRev/kotlin-kafka

Kafka bindings for Kotlin `suspend`, and Kafka streaming operators for KotlinX Flow.

Language: Kotlin - Size: 2.45 MB - Last synced at: 16 days ago - Pushed at: about 1 month ago - Stars: 109 - Forks: 10

AhmetFurkanDEMIR/Data-Engineering-Project-with-HDFS-and-Kafka

Data Engineering Project with Hadoop HDFS and Kafka

Language: Python - Size: 3.46 MB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 102 - Forks: 25

danielsobrado/CCDAK-Exam-Questions

Confluent Kafka questions to practice for CCDAK

Size: 335 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 90 - Forks: 32

hifly81/kafka-examples

Practical examples with Apache Kafka®

Language: Java - Size: 120 MB - Last synced at: 14 days ago - Pushed at: about 1 month ago - Stars: 76 - Forks: 15

zerodha/kaf-relay

Replicate and sync Kafka topics between clusters in realtime. Supports topic re-mapping, healthchecks, and hot failovers for high availability.

Language: Go - Size: 343 KB - Last synced at: 3 days ago - Pushed at: about 1 month ago - Stars: 72 - Forks: 6

agungdwiprasetyo/backend-microservices

Monorepo for backend microservices golang

Language: Go - Size: 849 KB - Last synced at: 7 days ago - Pushed at: about 2 years ago - Stars: 69 - Forks: 18

kattlo/kattlo-cli 📦

Kattlo CLI Project

Language: Java - Size: 1.16 MB - Last synced at: 3 months ago - Pushed at: about 3 years ago - Stars: 66 - Forks: 4

zillow/zkafka

An efficient and scalable library for stateless Kafka message processing written in Go

Language: Go - Size: 329 KB - Last synced at: 22 days ago - Pushed at: about 1 month ago - Stars: 61 - Forks: 1

andrewinci/Insulator 📦

A client UI to inspect Kafka topics, consume, produce and much more

Language: Kotlin - Size: 29.6 MB - Last synced at: 18 days ago - Pushed at: about 2 years ago - Stars: 56 - Forks: 9

karafka/karafka-web

Web UI for monitoring and managing Karafka consumers

Language: Ruby - Size: 6.64 MB - Last synced at: about 19 hours ago - Pushed at: 1 day ago - Stars: 54 - Forks: 8

omarsmak/kafka-consumer-lag-monitoring

Client tool that exports the consumer lag of Kafka consumer groups to Prometheus or your terminal

Language: Kotlin - Size: 372 KB - Last synced at: 16 days ago - Pushed at: 5 months ago - Stars: 52 - Forks: 13

QuickSign/kafka-encryption

Kafka End to End Encryption

Language: Java - Size: 199 KB - Last synced at: 9 months ago - Pushed at: over 1 year ago - Stars: 52 - Forks: 10

rohit-mehra/eye_of_sauron

Stream processing using kafka-python to track people (user input images of target) in the wild over multiple video streams.

Language: Python - Size: 134 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 48 - Forks: 26

yogeshsr/kafka-protobuf-console-consumer

Language: Go - Size: 88.4 MB - Last synced at: 10 months ago - Pushed at: almost 5 years ago - Stars: 47 - Forks: 6

masesgroup/KNet

KNet is a comprehensive .NET suite for Apache Kafka™ providing all features: Producer, Consumer, Admin, Streams, Connect, backends (ZooKeeper and Kafka)

Language: C# - Size: 134 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 45 - Forks: 6

srigumm/eCupcakesFactoryOnContainers

"eCupcakesFactoryOnContainers" is based on a simplified "Microservices" architecture and docker containers. Core intent of this reference application is to provide reference implementation for .Net developers to easily get started with containerized microservices using .Net Core and Kafka.

Language: JavaScript - Size: 7.49 MB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 44 - Forks: 29

tryfix/kstream

Apache Kafka Streams for Golang

Language: Go - Size: 213 KB - Last synced at: 10 months ago - Pushed at: over 1 year ago - Stars: 43 - Forks: 17

oslabs-beta/Hyperionn

An open-source visualization tool for monitoring Kafka cluster metrics

Language: JavaScript - Size: 28.2 MB - Last synced at: 13 days ago - Pushed at: over 2 years ago - Stars: 43 - Forks: 2

ccamel/go-graphql-subscription-example

☝️ go-graphql subscription over Kafka/Redis/NSQ example

Language: Go - Size: 1.12 MB - Last synced at: 8 days ago - Pushed at: 12 days ago - Stars: 42 - Forks: 5

oslabs-beta/Kafka-Kare

🦋 Kafka Kare is a Kafka visualization and error handling web app with plug and play functionality. 🚀

Language: JavaScript - Size: 116 MB - Last synced at: 13 days ago - Pushed at: about 1 year ago - Stars: 42 - Forks: 10

that-coder/kafka-example

Example Node.js kafka setup

Language: JavaScript - Size: 40 KB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 42 - Forks: 27

hakdogan/kafka-with-microservices

This repository is a tutorial for JUG Istanbul's Apache Kafka meetup that showing how Apache Kafka can be used in inter-microservices communication

Language: Java - Size: 1.03 MB - Last synced at: 8 days ago - Pushed at: over 4 years ago - Stars: 39 - Forks: 13

akmamun/kafka-python-camera-stream

Distributed Streaming with Apache Kafka and Python OpenCV

Language: Python - Size: 2.93 KB - Last synced at: 7 days ago - Pushed at: about 6 years ago - Stars: 38 - Forks: 19

streamthoughts/kafka-clients-kotlin

This projects gives Kotlin bindings and several extensions for Apache Kafka Clients.

Language: Kotlin - Size: 158 KB - Last synced at: over 1 year ago - Pushed at: about 3 years ago - Stars: 35 - Forks: 8

MetaArivu/Kafka-quickstart

Kafka Examples focusing on Producer, Consumer, KStreams, KTable, Global KTable using Spring, Kafka Cluster Setup & Monitoring. Implementing Event Sourcing and CQRS Design Pattern using Kafka

Language: Java - Size: 187 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 34 - Forks: 16

ly16/Real-Time-Stock-Analyzer

Bigdata Pipeline

Language: Shell - Size: 14.1 MB - Last synced at: 9 months ago - Pushed at: over 7 years ago - Stars: 34 - Forks: 12

RTBHOUSE/kafka-workers

Kafka Workers is a client library which unifies records consuming from Kafka and processing them by user-defined WorkerTasks.

Language: Java - Size: 1.71 MB - Last synced at: 6 months ago - Pushed at: over 2 years ago - Stars: 32 - Forks: 12

mikeroyal/Apache-Kafka-Guide

Apache Kafka Guide

Size: 203 KB - Last synced at: 10 days ago - Pushed at: over 3 years ago - Stars: 31 - Forks: 6

layonez/kafka-example

Example project for Spring Boot + Apache Kafka + Docker-compose solution

Language: Java - Size: 54.7 KB - Last synced at: almost 2 years ago - Pushed at: almost 5 years ago - Stars: 31 - Forks: 33

san089/Optimizing-Public-Transportation

A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.

Language: Python - Size: 496 KB - Last synced at: 18 days ago - Pushed at: over 1 year ago - Stars: 30 - Forks: 14

victoramsantos/saga-pattern-example

A Saga Pattern implementation with Kafka, MongoDb and Python.

Language: Python - Size: 74.2 KB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 30 - Forks: 14

eo-cqrs/eo-kafka

EO Kafka Producers and consumers for working with Apache Kafka message broker

Language: Java - Size: 1.38 MB - Last synced at: 9 days ago - Pushed at: 10 days ago - Stars: 29 - Forks: 3

bbejeck/KafkaStreamsInAction2ndEdition

Source code repository for the 2nd Edition of Kafka Streams in Action

Language: Java - Size: 844 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 29 - Forks: 11

saabeilin/kafkian

An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka

Language: Python - Size: 137 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 27 - Forks: 3

Trendyol/otel-kafka-konsumer

open telemetry wrapper for kafka-go and kafka-konsumer

Language: Go - Size: 370 KB - Last synced at: 15 days ago - Pushed at: 3 months ago - Stars: 27 - Forks: 0

vepo/imersao-kafka

Curso básico sobre Apache Kafka

Language: Java - Size: 117 MB - Last synced at: 14 days ago - Pushed at: 7 months ago - Stars: 27 - Forks: 5

contactsunny/SimpleKafkaExampleSpringBoot

A simple Spring Boot (Java) app which demonstrates Apache Kafka's producer and consumer APIs.

Language: Java - Size: 17.6 KB - Last synced at: 12 months ago - Pushed at: over 6 years ago - Stars: 27 - Forks: 29

luszczynski/kafka-cheat-sheet

Kafka Cheat Sheet

Size: 25.4 KB - Last synced at: about 1 year ago - Pushed at: almost 4 years ago - Stars: 26 - Forks: 12

confluentinc/vscode

Confluent for Visual Studio Code

Language: TypeScript - Size: 44.3 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 23 - Forks: 8

karafka/karafka-testing

Library which provides helpers for easier Karafka consumers tests

Language: Ruby - Size: 377 KB - Last synced at: about 21 hours ago - Pushed at: 7 days ago - Stars: 23 - Forks: 11

piomin/sample-spring-boot-saga-eventing

Demo presenting how to use Spring Cloud Stream and Spring Cloud Function with Apache Kafka broker to implement SAGA pattern in event-driven communication.

Language: Java - Size: 56.6 KB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 23 - Forks: 14

mookid8000/Topos

:cyclone: .NET Event Processing library

Language: C# - Size: 5.19 MB - Last synced at: 19 days ago - Pushed at: 2 months ago - Stars: 23 - Forks: 5

juan-csv/Architecture-for-real-time-video-streaming-analytics

Video processing (webcam) in real time using Kafka and Spark.

Language: Python - Size: 67.4 MB - Last synced at: about 1 year ago - Pushed at: over 4 years ago - Stars: 22 - Forks: 7

ppatierno/kafka-go-examples

Kafka examples using Go language

Language: Go - Size: 22.5 KB - Last synced at: 19 days ago - Pushed at: over 6 years ago - Stars: 22 - Forks: 7

clj-kafka/franzy

A set of Clojure libraries to work with Apache Kafka (producer, consumer, rebalancing, administration, and validation).

Language: Clojure - Size: 332 KB - Last synced at: 4 months ago - Pushed at: almost 7 years ago - Stars: 22 - Forks: 5

guilhermegarcia86/kafka-series

Language: Java - Size: 533 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 20 - Forks: 16

viartemev/ktor-kafka-example

Ktor web server with Kakfa producer and consumer

Language: Kotlin - Size: 61.5 KB - Last synced at: 19 days ago - Pushed at: over 5 years ago - Stars: 18 - Forks: 2

khorshuheng/kafka-protobuf-console

CLI tool to produce/consume Protobuf message to/from Kafka

Language: Go - Size: 25.4 KB - Last synced at: 9 days ago - Pushed at: over 5 years ago - Stars: 18 - Forks: 3

loicgreffier/spring-boot-kafka-quickstarts

Code samples around Spring Boot and Kafka.

Language: Java - Size: 49.5 MB - Last synced at: 13 minutes ago - Pushed at: about 1 hour ago - Stars: 17 - Forks: 6

mdmuhtasimfuadfahim/kafka-pub-sub

A package that enables applications to publish, consume and process high volumes of records streams in a fast and durable way.

Language: JavaScript - Size: 261 KB - Last synced at: 26 days ago - Pushed at: over 1 year ago - Stars: 17 - Forks: 4

simplesteph/kafka-0.11-examples

Code snippets that demonstrate how to leverage the new Kafka 0.11 APIs

Language: Scala - Size: 5.86 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 17 - Forks: 7

SpringBootCourses/data-analyser-microservice

This is data analyser microservice for YouTube course.

Language: Java - Size: 54.7 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 16 - Forks: 0

Wazzabeee/pyspark-etl-twitter

Implementation of an ETL process for real-time sentiment analysis of tweets with Docker, Apache Kafka, Spark Streaming, MongoDB and Delta Lake

Language: Python - Size: 3.37 MB - Last synced at: 12 days ago - Pushed at: almost 2 years ago - Stars: 16 - Forks: 4

nayekabhishek1/awesome-kafka

A curated list about Apache Kafka

Size: 24.4 KB - Last synced at: 4 days ago - Pushed at: over 2 years ago - Stars: 16 - Forks: 7

zekeriyyaa/PySpark-Structured-Streaming-ROS-Kafka-ApacheSpark-Cassandra

A structured streaming was applied to the robot data from ROS-Gazebo simulation environment using Apache Spark. Data is collected in Kafka, analyzed by Apache Spark and stored in Cassandra.

Language: Python - Size: 652 KB - Last synced at: 11 days ago - Pushed at: about 3 years ago - Stars: 16 - Forks: 6

hardikSinghBehl/kafka-java-spring-boot-poc

Kafka integration with Java Spring-boot with one application serving as a producer and the other consuming the messages

Language: Java - Size: 78.1 KB - Last synced at: 12 days ago - Pushed at: about 3 years ago - Stars: 15 - Forks: 9

contactsunny/spring-kafka-test

A Spring (Java) project with the spring-kafka library added. This project could be used as a POC for the various features provided by the library.

Language: Java - Size: 20.5 KB - Last synced at: 12 months ago - Pushed at: about 7 years ago - Stars: 15 - Forks: 10

Deenbe/blaster

Web hooks for message queues

Language: Go - Size: 202 KB - Last synced at: 7 months ago - Pushed at: about 2 years ago - Stars: 14 - Forks: 2

luizcalaca/node-kafka-microservices

Node.js + Kafka + Microservices

Language: JavaScript - Size: 59.6 KB - Last synced at: 20 days ago - Pushed at: over 2 years ago - Stars: 14 - Forks: 3

AhmetFurkanDEMIR/SQL-Server-Kafka-Example

SQL Server Kafka Example

Language: Java - Size: 20.5 KB - Last synced at: 6 days ago - Pushed at: almost 3 years ago - Stars: 14 - Forks: 0

Deeptiman/go-cache-kubernetes

The web application is a Data Caching Service designed and implemented using microservices architecture.

Language: Go - Size: 239 KB - Last synced at: 4 days ago - Pushed at: almost 4 years ago - Stars: 14 - Forks: 9

isopropylcyanide/SpringBatch-KafkaDB

A small demo that leverages Spring batch's capabilities to do job processing and Apache Kafka's stream processing. A simple CSV file gets used up in a batch job which then writes it to a Kafka queue (and H2 database) for further processing.

Language: Java - Size: 27.3 KB - Last synced at: 14 days ago - Pushed at: over 6 years ago - Stars: 14 - Forks: 14

floydspace/effect-kafka

📨 Effectful Kafka

Language: TypeScript - Size: 643 KB - Last synced at: 1 day ago - Pushed at: 3 months ago - Stars: 13 - Forks: 2

Dev-Force/node-kafka-alerts

Easily deployable (Docker), extensible (clean architecture), template-based, plug and play micro-service. Real-time (Kafka) and batch processing (using a database) of messages which allows devs to send notifications using third party tools (like twilio/sendgrid). Uses concepts from Event-Sourcing and CQRS.

Language: TypeScript - Size: 1.16 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 13 - Forks: 1