GitHub topics: kafka-python

Repositories

shiningflash/kafka-python-messaging-engine

A Python-based Kafka messaging engine with Avro serialization, Schema Registry integration, and Redpanda support for real-time data streaming.

Language: Python - Size: 33.2 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 0 - Forks: 0

anshumanpattnaik/kafka-manager

A Python library for managing Kafka Producers, Consumers and Topics

Language: Python - Size: 5.52 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

jrzaurin/ml-pipeline

Using Kafka-Python to illustrate a ML production pipeline

Language: Jupyter Notebook - Size: 19.8 MB - Last synced at: about 2 months ago - Pushed at: over 2 years ago - Stars: 109 - Forks: 51

nfo94/infraestrutura-kafka-pd

Language: Python - Size: 923 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

dheerajcl/Distributed_Logging_System

Language: Python - Size: 1.89 MB - Last synced at: about 2 months ago - Pushed at: 7 months ago - Stars: 5 - Forks: 3

stereosky/community-highlights Fork of quixio/community-highlights

Collecting highlights from the Quix community and social media in the form of interesting questions, comments, challenges, solutions and insights

Language: Python - Size: 2.14 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

DebanjanSarkar/pyspark-maestro

This repo contains implementations of PySpark for real-world use cases for batch data processing, streaming data processing sourced from Kafka, sockets, etc., spark optimizations, business specific bigdata processing scenario solutions, and machine learning use cases.

Language: Jupyter Notebook - Size: 66.1 MB - Last synced at: 2 months ago - Pushed at: 11 months ago - Stars: 2 - Forks: 1

quantumbagel/DroneTracker

A drone-following script for NC State's AERPAW drones.

Language: Python - Size: 282 KB - Last synced at: 2 months ago - Pushed at: 10 months ago - Stars: 2 - Forks: 1

quixio/community-highlights

Collecting highlights from the Quix community and social media in the form of interesting questions, comments, challenges, solutions and insights

Language: Python - Size: 2.14 MB - Last synced at: about 15 hours ago - Pushed at: 9 months ago - Stars: 1 - Forks: 1

GraphtyLove/kafka-python-demo

Small example on how to use Kafka with python and docker.

Language: Python - Size: 2.93 KB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

madhushesharam/messageSimulator-kafka

message simulator for Kafka using kafka-python

Language: Python - Size: 32.2 KB - Last synced at: 11 months ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

MonsieurBorges/kafka-docker

Deploy Apache Kafka using docker-compose

Language: Python - Size: 28.3 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 1

nserban/zabbix-kafka-consumers-monitor

Monitor Kafka Consumer groups (consumers and lag) in Zabbix

Language: Python - Size: 14.6 KB - Last synced at: about 2 months ago - Pushed at: over 7 years ago - Stars: 13 - Forks: 11

BrenoAV/Kafka-Climate-Demo

A simple application to obtain the max temperature of the day and notify if the temperature is high. Producer to send the data from the API to a broker and obtain the data for analysis using a Consumer (Kafka).

Language: Python - Size: 428 KB - Last synced at: 7 days ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

redhat-aqe/kafka-logging-handler

Python Logging Handler for Kafka

Language: Python - Size: 77.1 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 27 - Forks: 16

CharlesJonah/citi_bikes_analytics

Language: Python - Size: 5.86 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

supergloo/kafka-examples

Now, you may not believe this based on the repo name, but this repo contains Kafka examples. Amazing right!? Have fun out there folks

Language: Java - Size: 74.2 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 3

dezka/kafka_offset_migrator

Migrate consumer group offset state to another consumer group.

Language: Python - Size: 9.77 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

AbhimanyuHK/Kafka-python

Language: Python - Size: 1000 Bytes - Last synced at: 4 days ago - Pushed at: over 7 years ago - Stars: 2 - Forks: 0

rupeshtiwari/kafka-producer-consumer-in-python

using kafka-python doing pub sub

Language: Python - Size: 2.93 KB - Last synced at: 8 days ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 1

ayoub3bidi/kafka-on-the-shore

Playing around with kafka.

Language: Python - Size: 12.7 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

AX414/tcc-bcc

O repositório do meu Trabalho de Conclusão de Curso de meu curso de Bacharelado em Ciência da Computação. O projeto envolve o protocolo MQTT, o broker Mosquitto, o Apache Kafka e um portal web que coloca uma arquitetura e protocolo da camada de aplicação que desenvolvi em prática. (Atualmente em desenvolvimento).

Language: PHP - Size: 6.85 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

kirtizn/Kafka_producer_consumer

Kafka Producer and consumer code to read csv file

Language: Jupyter Notebook - Size: 4.26 MB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 2

bug-data/Big_Data_Second_Project

Second project for Big Data course held at Roma Tre University

Language: TeX - Size: 30.3 MB - Last synced at: almost 2 years ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 0

jinnyy/study-kafka

Learn Kafka with Python

Language: Jupyter Notebook - Size: 12.7 KB - Last synced at: almost 2 years ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 0

muhk01/docker_kafka_python_client

kafka in docker and kafka-python example

Language: Python - Size: 10.7 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

endre90/ros2_kafka_bridge

Examples on how to bridge ros2 and kafka messages.

Language: Python - Size: 7.81 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 2 - Forks: 1

ferencberes/twitter-crawler

Simple Twitter crawler based on Twython

Language: Python - Size: 546 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 17 - Forks: 9

myersr/simpleKafka-PythonServer

Repo for a simple base python http server using Flask and Kafka-Python

Language: Python - Size: 41 KB - Last synced at: over 2 years ago - Pushed at: about 7 years ago - Stars: 3 - Forks: 1

116davinder/apache-kafka-consumer-group-metric-collector 📦

It will collect metric about given consumer groups and reports latest_offset, committed_offset, and lag.

Language: Python - Size: 106 KB - Last synced at: over 2 years ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 0

ksator/kafka_hello_world 📦

Kakfa hello-world. How to deploy Kakfa, how to use the command line tool Kafkacat, how to produce and consume messages with Python.

Language: Python - Size: 78.1 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 2

konradmalik/kafka-docker-internal-external 📦

Contenarized Kafka that allows both, internal (container-container) and external (machine-container) traffic.

Language: Python - Size: 5.86 KB - Last synced at: over 2 years ago - Pushed at: about 5 years ago - Stars: 0 - Forks: 0

niravkapoor/color-recognition

Detect the fruit/color name from the uploaded image.

Language: Python - Size: 9.09 MB - Last synced at: over 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

EphraimX/how-to-reduce-your-costs-in-stateful-processing

This application demonstrates how to reduce costs in stateful processing.

Language: Python - Size: 5.72 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

Linho1150/kafka-python-produce-consumer

Language: Jupyter Notebook - Size: 7.81 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

create-speech-to-text-pipeline/pipeline

A tool that can be deployed to process posting and receiving text and audio files from and into a data lake, apply transformation in a distributed manner, and load it into a warehouse in a suitable format to train a speech-to-text model

Language: Jupyter Notebook - Size: 5.01 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 8

san089/SF-Crime-Statistics

A Kafka and Spark Streaming Integration project : SF Crime Statistics with Spark Streaming

Language: Python - Size: 3.42 MB - Last synced at: about 2 months ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 5

MBKraus/dockerized_data_science_playground

Multi-docker container data science / engineering playground (w/ Kafka, Airflow, MLFlow, Tensorflow-Keras / SKLearn) for simulating a microservices-oriented architecture

Language: Dockerfile - Size: 16.6 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 6

juliocesarscheidt/oci-streams

Language: HCL - Size: 4 MB - Last synced at: 3 months ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

sunayanajindal/AI_and_IoT_Application_Platform Fork of Shaon96/Distributed_AI_and_IoT_Based_Application_Platform

Language: CSS - Size: 6 MB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

nabeelbassam/Food-Ordering-with-Kafka-Python

Simple food ordering using Kafka & Python

Language: Python - Size: 7.81 KB - Last synced at: about 1 year ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

endre90/ros1_kafka_bridge

Examples on how to bridge ros and kafka messages.

Language: Python - Size: 9.77 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 2 - Forks: 1

niyazed/kafka-face-detection

Face detection using Kafka | OpenCV | Centerface | Flask

Language: Python - Size: 12.9 MB - Last synced at: over 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 4

rajib1007/Project_3 Fork of Trupti2502/Stock-Analysis

This project is basically for collecting enormous data and analyzing it. It includes live streaming of data from FOREX trading API and Electric Vehicle stocks API. The data is fetched and processed using Kafka Streaming and Spark streaming. Throughout this project stocks of Forex data and Electric Vehicle parts making companies data were analyzed.

Language: Jupyter Notebook - Size: 36.5 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

Related Keywords

kafka-python 51 kafka 36 python 17 kafka-consumer 8 python3 8 kafka-producer 7 docker 6 docker-compose 4 spark-streaming 4 zookeeper 4 data-engineering 3 kafka-producer-consumer 3 consumer 3 flask 3 postgresql 3 data-pipeline 3 event-driven-architecture 3 pyspark 3 data-intensive-applications 2 etl 2 opencv-python 2 spark-sql 2 spark 2 producer 2 python-kafka 2 real-time-data-pipeline 2 real-time-data-processing 2 realtime-data 2 realtime-etl 2 kafka-streams 2 stream-processing 2 stream-processor 2 streaming-etl 2 streaming-pipeline 2 streaming 2 logging 2 bridge 2 avro 2 confluent-kafka 2 kafka-topic 2 iot 2 apache-kafka 2 mlflow 2 event-driven 2 euclidean-algorithm 1 university-project 1 image-processing 1 roma-tre-university 1 opencv 1 data-streaming 1 stateful 1 stateless 1 amazon-msk 1 amazon-s3-storage 1 apache-airflow 1 apache-spark 1 crontab 1 ros2 1 internal 1 ros2-kafka-bridge 1 twitter-crawler 1 twitter-search 1 twython 1 flask-kafka 1 flask-kafka-example 1 flask-server 1 kafka-examples 1 consumer-metrics 1 splunk 1 kafkacat 1 external 1 kafka-js 1 hacktoberfest 1 jupyter-notebook 1 matplotlib 1 restapi 1 ubuntu2104 1 avro-kafka 1 kafka-avro 1 wwcode 1 wwcode-dublin 1 centos 1 javascript 1 nginx 1 tweepy 1 twitter 1 twitter-api 1 worker 1 bigdata 1 reactjs 1 airflow 1 data-science 1 datascience 1 keras 1 mlflow-tracking-server 1 scikit-learn 1 sklearn 1 tensorflow 1 oracle 1 terraform 1