kafka-consumer | Topic | Ecosyste.ms: Repos

Topic: "kafka-consumer"

karafka/karafka

Ruby and Rails efficient Kafka processing framework

Language: Ruby - Size: 6.6 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 2,185 - Forks: 186

weiboad/kafka-php 📦

kafka php client

Language: PHP - Size: 926 KB - Last synced at: 3 days ago - Pushed at: over 3 years ago - Stars: 1,437 - Forks: 447

zeromicro/cds

Data syncing in golang for ClickHouse.

Language: Go - Size: 7.01 MB - Last synced at: 9 days ago - Pushed at: 3 months ago - Stars: 977 - Forks: 141

confluentinc/librdkafka

The Apache Kafka C/C++ library

Language: C - Size: 37.5 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 757 - Forks: 3,219

joowani/kq

Kafka-based Job Queue for Python

Language: Python - Size: 108 KB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 571 - Forks: 23

zendesk/racecar

Racecar: a simple framework for Kafka consumers in Ruby

Language: Ruby - Size: 749 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 500 - Forks: 96

SourceLabOrg/kafka-webview

Full-featured web-based Apache Kafka consumer UI

Language: Java - Size: 3.53 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 393 - Forks: 83

line/decaton

High throughput asynchronous task processing on Apache Kafka

Language: Java - Size: 14 MB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 353 - Forks: 56

xitonix/trubka

A CLI tool for Kafka

Language: Go - Size: 821 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 333 - Forks: 19

strimzi/strimzi-kafka-bridge

An HTTP bridge for Apache Kafka®

Language: Java - Size: 2.64 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 316 - Forks: 128

Qihoo360/qbusbridge

The Apache Kafka Client SDK

Language: C++ - Size: 611 KB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 291 - Forks: 73

mre/kafka-influxdb

High performance Kafka consumer for InfluxDB. Supports collectd message formats.

Language: Python - Size: 1.56 MB - Last synced at: 11 days ago - Pushed at: almost 3 years ago - Stars: 217 - Forks: 53

confluentinc/parallel-consumer

Parallel Apache Kafka client wrapper with per message ACK, client side queueing, a simpler consumer/producer API with key concurrency and extendable non-blocking IO processing.

Language: Java - Size: 3.64 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 207 - Forks: 152

LearningJournal/ApacheKafkaTutorials

Example Code for Kafka Tutorials @ Learning Journal

Language: Java - Size: 20.5 KB - Last synced at: 4 months ago - Pushed at: over 7 years ago - Stars: 177 - Forks: 220

LearningJournal/Kafka-Streams-Real-time-Stream-Processing

This is the central repository for all materials related to Kafka Streams : Real-time Stream Processing! Book by Prashant Pandey.

Language: Java - Size: 5.25 MB - Last synced at: 5 months ago - Pushed at: about 5 years ago - Stars: 164 - Forks: 163

pedrodeoliveira/fastapi-kafka-consumer

A Python RESTful API using FastAPI with a Kafka Consumer

Language: Python - Size: 6.84 KB - Last synced at: 2 months ago - Pushed at: over 4 years ago - Stars: 156 - Forks: 30

danielsobrado/CCDAK-Exam-Questions

Confluent Kafka questions to practice for CCDAK

Size: 539 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 146 - Forks: 57

mmolimar/kukulcan

A REPL for Apache Kafka

Language: Scala - Size: 2.74 MB - Last synced at: 28 days ago - Pushed at: over 4 years ago - Stars: 116 - Forks: 7

nomisRev/kotlin-kafka

Kafka bindings for Kotlin `suspend`, and Kafka streaming operators for KotlinX Flow.

Language: Kotlin - Size: 2.51 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 115 - Forks: 11

AhmetFurkanDEMIR/Data-Engineering-Project-with-HDFS-and-Kafka

Data Engineering Project with Hadoop HDFS and Kafka

Language: Python - Size: 3.46 MB - Last synced at: 5 months ago - Pushed at: almost 2 years ago - Stars: 102 - Forks: 25

hifly81/kafka-examples

Practical examples with Apache Kafka®

Language: Java - Size: 120 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 78 - Forks: 16

zerodha/kaf-relay

Replicate and sync Kafka topics between clusters in realtime. Supports topic re-mapping, healthchecks, and hot failovers for high availability.

Language: Go - Size: 343 KB - Last synced at: 10 days ago - Pushed at: 6 months ago - Stars: 75 - Forks: 7

agungdwiprasetyo/backend-microservices

Monorepo for backend microservices golang

Language: Go - Size: 849 KB - Last synced at: 5 months ago - Pushed at: over 2 years ago - Stars: 69 - Forks: 18

zillow/zkafka

An efficient and scalable library for stateless Kafka message processing written in Go

Language: Go - Size: 299 KB - Last synced at: about 2 months ago - Pushed at: 2 months ago - Stars: 66 - Forks: 1

kattlo/kattlo-cli 📦

Kattlo CLI Project

Language: Java - Size: 1.16 MB - Last synced at: 8 months ago - Pushed at: over 3 years ago - Stars: 66 - Forks: 4

rohit-mehra/eye_of_sauron

Stream processing using kafka-python to track people (user input images of target) in the wild over multiple video streams.

Language: Python - Size: 134 MB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 59 - Forks: 28

karafka/karafka-web

Web UI for monitoring and managing Karafka consumers

Language: Ruby - Size: 7.87 MB - Last synced at: 1 day ago - Pushed at: 2 days ago - Stars: 56 - Forks: 11

andrewinci/Insulator 📦

A client UI to inspect Kafka topics, consume, produce and much more

Language: Kotlin - Size: 29.6 MB - Last synced at: 5 months ago - Pushed at: over 2 years ago - Stars: 56 - Forks: 9

hoangtien2k3/shopapp-backend

Source backend for website/mobile about electro, e-commerce using Java, using multi-language (EN, VI), and today's popular technologies

Language: Java - Size: 4.84 MB - Last synced at: 2 days ago - Pushed at: 8 days ago - Stars: 55 - Forks: 1

QuickSign/kafka-encryption

Kafka End to End Encryption

Language: Java - Size: 199 KB - Last synced at: 2 months ago - Pushed at: about 2 years ago - Stars: 53 - Forks: 9

omarsmak/kafka-consumer-lag-monitoring

Client tool that exports the consumer lag of Kafka consumer groups to Prometheus or your terminal

Language: Kotlin - Size: 372 KB - Last synced at: 5 months ago - Pushed at: 10 months ago - Stars: 52 - Forks: 13

yogeshsr/kafka-protobuf-console-consumer

Language: Go - Size: 88.4 MB - Last synced at: about 1 year ago - Pushed at: over 5 years ago - Stars: 47 - Forks: 6

masesgroup/KNet

KNet is a comprehensive .NET suite for Apache Kafka™ providing all features: Producer, Consumer, Admin, Streams, Connect, backends (Kafka/ZooKeeper and KRaft)

Language: C# - Size: 153 MB - Last synced at: 3 days ago - Pushed at: 7 days ago - Stars: 45 - Forks: 6

srigumm/eCupcakesFactoryOnContainers

"eCupcakesFactoryOnContainers" is based on a simplified "Microservices" architecture and docker containers. Core intent of this reference application is to provide reference implementation for .Net developers to easily get started with containerized microservices using .Net Core and Kafka.

Language: JavaScript - Size: 7.49 MB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 44 - Forks: 29

tryfix/kstream

Apache Kafka Streams for Golang

Language: Go - Size: 213 KB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 43 - Forks: 17

oslabs-beta/Hyperionn

An open-source visualization tool for monitoring Kafka cluster metrics

Language: JavaScript - Size: 28.2 MB - Last synced at: 4 months ago - Pushed at: almost 3 years ago - Stars: 43 - Forks: 2

ccamel/go-graphql-subscription-example

☝️ go-graphql subscription over Kafka/Redis/NSQ example

Language: Go - Size: 1.09 MB - Last synced at: 25 days ago - Pushed at: 25 days ago - Stars: 42 - Forks: 5

oslabs-beta/Kafka-Kare

🦋 Kafka Kare is a Kafka visualization and error handling web app with plug and play functionality. 🚀

Language: JavaScript - Size: 116 MB - Last synced at: 4 months ago - Pushed at: over 1 year ago - Stars: 42 - Forks: 10

that-coder/kafka-example

Example Node.js kafka setup

Language: JavaScript - Size: 40 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 42 - Forks: 27

streamthoughts/kafka-clients-kotlin

This projects gives Kotlin bindings and several extensions for Apache Kafka Clients.

Language: Kotlin - Size: 158 KB - Last synced at: 2 months ago - Pushed at: over 3 years ago - Stars: 41 - Forks: 7

hakdogan/kafka-with-microservices

This repository is a tutorial for JUG Istanbul's Apache Kafka meetup that showing how Apache Kafka can be used in inter-microservices communication

Language: Java - Size: 1.03 MB - Last synced at: 8 days ago - Pushed at: about 5 years ago - Stars: 40 - Forks: 13

akmamun/kafka-python-camera-stream

Distributed Streaming with Apache Kafka and Python OpenCV

Language: Python - Size: 2.93 KB - Last synced at: about 2 months ago - Pushed at: over 6 years ago - Stars: 38 - Forks: 19

MetaArivu/Kafka-quickstart

Kafka Examples focusing on Producer, Consumer, KStreams, KTable, Global KTable using Spring, Kafka Cluster Setup & Monitoring. Implementing Event Sourcing and CQRS Design Pattern using Kafka

Language: Java - Size: 187 MB - Last synced at: over 2 years ago - Pushed at: over 3 years ago - Stars: 34 - Forks: 16

ly16/Real-Time-Stock-Analyzer

Bigdata Pipeline

Language: Shell - Size: 14.1 MB - Last synced at: about 1 year ago - Pushed at: almost 8 years ago - Stars: 34 - Forks: 12

san089/Optimizing-Public-Transportation

A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.

Language: Python - Size: 496 KB - Last synced at: 3 months ago - Pushed at: about 2 years ago - Stars: 31 - Forks: 15

RTBHOUSE/kafka-workers

Kafka Workers is a client library which unifies records consuming from Kafka and processing them by user-defined WorkerTasks.

Language: Java - Size: 1.71 MB - Last synced at: about 1 month ago - Pushed at: almost 3 years ago - Stars: 31 - Forks: 12

mikeroyal/Apache-Kafka-Guide

Apache Kafka Guide

Size: 203 KB - Last synced at: 3 days ago - Pushed at: almost 4 years ago - Stars: 31 - Forks: 7

layonez/kafka-example

Example project for Spring Boot + Apache Kafka + Docker-compose solution

Language: Java - Size: 54.7 KB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 31 - Forks: 33

victoramsantos/saga-pattern-example

A Saga Pattern implementation with Kafka, MongoDb and Python.

Language: Python - Size: 74.2 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 30 - Forks: 14

bbejeck/KafkaStreamsInAction2ndEdition

Source code repository for the 2nd Edition of Kafka Streams in Action

Language: Java - Size: 844 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 29 - Forks: 11

eo-cqrs/eo-kafka

EO Kafka Producers and consumers for working with Apache Kafka message broker

Language: Java - Size: 1.39 MB - Last synced at: 3 days ago - Pushed at: 24 days ago - Stars: 28 - Forks: 3

confluentinc/vscode

Confluent for Visual Studio Code

Language: TypeScript - Size: 55.9 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 27 - Forks: 14

saabeilin/kafkian

An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka

Language: Python - Size: 138 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 27 - Forks: 3

Trendyol/otel-kafka-konsumer

open telemetry wrapper for kafka-go and kafka-konsumer

Language: Go - Size: 370 KB - Last synced at: 5 months ago - Pushed at: 7 months ago - Stars: 27 - Forks: 0

vepo/imersao-kafka

Curso básico sobre Apache Kafka

Language: Java - Size: 117 MB - Last synced at: 5 months ago - Pushed at: 12 months ago - Stars: 27 - Forks: 5

contactsunny/SimpleKafkaExampleSpringBoot

A simple Spring Boot (Java) app which demonstrates Apache Kafka's producer and consumer APIs.

Language: Java - Size: 17.6 KB - Last synced at: over 1 year ago - Pushed at: almost 7 years ago - Stars: 27 - Forks: 29

luszczynski/kafka-cheat-sheet

Kafka Cheat Sheet

Size: 25.4 KB - Last synced at: over 1 year ago - Pushed at: about 4 years ago - Stars: 26 - Forks: 12

piomin/sample-spring-boot-saga-eventing

Demo presenting how to use Spring Cloud Stream and Spring Cloud Function with Apache Kafka broker to implement SAGA pattern in event-driven communication.

Language: Java - Size: 72.3 KB - Last synced at: 17 days ago - Pushed at: 18 days ago - Stars: 24 - Forks: 14

karafka/karafka-testing

Library which provides helpers for easier Karafka consumers tests

Language: Ruby - Size: 418 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 24 - Forks: 11

floydspace/effect-kafka

📨 Effectful Kafka

Language: TypeScript - Size: 510 KB - Last synced at: 13 days ago - Pushed at: about 2 months ago - Stars: 24 - Forks: 3

mookid8000/Topos

:cyclone: .NET Event Processing library

Language: C# - Size: 5.19 MB - Last synced at: 5 months ago - Pushed at: 7 months ago - Stars: 23 - Forks: 5

juan-csv/Architecture-for-real-time-video-streaming-analytics

Video processing (webcam) in real time using Kafka and Spark.

Language: Python - Size: 67.4 MB - Last synced at: over 1 year ago - Pushed at: almost 5 years ago - Stars: 22 - Forks: 7

ppatierno/kafka-go-examples

Kafka examples using Go language

Language: Go - Size: 22.5 KB - Last synced at: 5 months ago - Pushed at: over 6 years ago - Stars: 22 - Forks: 7

clj-kafka/franzy

A set of Clojure libraries to work with Apache Kafka (producer, consumer, rebalancing, administration, and validation).

Language: Clojure - Size: 332 KB - Last synced at: about 1 month ago - Pushed at: over 7 years ago - Stars: 22 - Forks: 5

loicgreffier/spring-boot-kafka-quickstarts

Code samples around Spring Boot and Kafka.

Language: Java - Size: 49.8 MB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 21 - Forks: 8

guilhermegarcia86/kafka-series

Language: Java - Size: 533 KB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 20 - Forks: 16

zekeriyyaa/PySpark-Structured-Streaming-ROS-Kafka-ApacheSpark-Cassandra

A structured streaming was applied to the robot data from ROS-Gazebo simulation environment using Apache Spark. Data is collected in Kafka, analyzed by Apache Spark and stored in Cassandra.

Language: Python - Size: 652 KB - Last synced at: 2 months ago - Pushed at: over 3 years ago - Stars: 19 - Forks: 6

viartemev/ktor-kafka-example

Ktor web server with Kakfa producer and consumer

Language: Kotlin - Size: 61.5 KB - Last synced at: 5 months ago - Pushed at: over 5 years ago - Stars: 18 - Forks: 2

khorshuheng/kafka-protobuf-console

CLI tool to produce/consume Protobuf message to/from Kafka

Language: Go - Size: 25.4 KB - Last synced at: 5 months ago - Pushed at: almost 6 years ago - Stars: 18 - Forks: 3

osodevops/CCAAK-Exam-Questions

Confluent Kafka questions to practice for CCAAK

Size: 32.2 KB - Last synced at: 11 days ago - Pushed at: 6 months ago - Stars: 17 - Forks: 4

mdmuhtasimfuadfahim/kafka-pub-sub

A package that enables applications to publish, consume and process high volumes of records streams in a fast and durable way.

Language: JavaScript - Size: 261 KB - Last synced at: 22 days ago - Pushed at: almost 2 years ago - Stars: 17 - Forks: 4

nayekabhishek1/awesome-kafka

A curated list about Apache Kafka

Size: 24.4 KB - Last synced at: 10 days ago - Pushed at: about 3 years ago - Stars: 17 - Forks: 7

simplesteph/kafka-0.11-examples

Code snippets that demonstrate how to leverage the new Kafka 0.11 APIs

Language: Scala - Size: 5.86 KB - Last synced at: over 2 years ago - Pushed at: about 8 years ago - Stars: 17 - Forks: 7

SpringBootCourses/data-analyser-microservice

This is data analyser microservice for YouTube course.

Language: Java - Size: 54.7 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 16 - Forks: 0

Wazzabeee/pyspark-etl-twitter

Implementation of an ETL process for real-time sentiment analysis of tweets with Docker, Apache Kafka, Spark Streaming, MongoDB and Delta Lake

Language: Python - Size: 3.37 MB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 16 - Forks: 4

hardikSinghBehl/kafka-java-spring-boot-poc

Kafka integration with Java Spring-boot with one application serving as a producer and the other consuming the messages

Language: Java - Size: 78.1 KB - Last synced at: 5 months ago - Pushed at: over 3 years ago - Stars: 15 - Forks: 9

contactsunny/spring-kafka-test

A Spring (Java) project with the spring-kafka library added. This project could be used as a POC for the various features provided by the library.

Language: Java - Size: 20.5 KB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 15 - Forks: 10

Deenbe/blaster

Web hooks for message queues

Language: Go - Size: 202 KB - Last synced at: 11 months ago - Pushed at: over 2 years ago - Stars: 14 - Forks: 2

luizcalaca/node-kafka-microservices

Node.js + Kafka + Microservices

Language: JavaScript - Size: 59.6 KB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 14 - Forks: 3

AhmetFurkanDEMIR/SQL-Server-Kafka-Example

SQL Server Kafka Example

Language: Java - Size: 20.5 KB - Last synced at: 5 months ago - Pushed at: over 3 years ago - Stars: 14 - Forks: 0

Deeptiman/go-cache-kubernetes

The web application is a Data Caching Service designed and implemented using microservices architecture.

Language: Go - Size: 239 KB - Last synced at: 2 months ago - Pushed at: about 4 years ago - Stars: 14 - Forks: 9

isopropylcyanide/SpringBatch-KafkaDB

A small demo that leverages Spring batch's capabilities to do job processing and Apache Kafka's stream processing. A simple CSV file gets used up in a batch job which then writes it to a Kafka queue (and H2 database) for further processing.

Language: Java - Size: 27.3 KB - Last synced at: 4 months ago - Pushed at: about 7 years ago - Stars: 14 - Forks: 14

Dev-Force/node-kafka-alerts

Easily deployable (Docker), extensible (clean architecture), template-based, plug and play micro-service. Real-time (Kafka) and batch processing (using a database) of messages which allows devs to send notifications using third party tools (like twilio/sendgrid). Uses concepts from Event-Sourcing and CQRS.

Language: TypeScript - Size: 1.16 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 13 - Forks: 1