GitHub topics: redpanda

Repositories

timeplus-io/proton

High-performance, low-footprint SQL database written in C++. Process millions of rows per second from Kafka/Pulsar, Iceberg, or ClickHouse, and seamlessly write results back. Supports powerful features like JOIN, CDC, UPSERT, and LOOKUP, enabling real-time analytics and ETL at scale.

Language: C++ - Size: 466 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 1,770 - Forks: 81

mvrpl/windows-apps

Scoop manifests for install apps for Windows

Language: PowerShell - Size: 233 KB - Last synced at: 4 days ago - Pushed at: 5 days ago - Stars: 2 - Forks: 1

redpanda-data/cloud-docs

Redpanda Cloud documentation

Language: JavaScript - Size: 7.53 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 2 - Forks: 3

redpanda-data/redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

Language: C++ - Size: 107 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 10,229 - Forks: 617

twmb/franz-go

franz-go contains a feature complete, pure Go library for interacting with Kafka from 0.8.0 through 3.8+. Producing, consuming, transacting, administrating, etc.

Language: Go - Size: 5.35 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 2,073 - Forks: 218

redpanda-data/docs

Open source content for the Redpanda documentation

Language: JavaScript - Size: 25.2 MB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 6 - Forks: 41

redpanda-data/deployment-automation

Cluster configuration best practices

Language: HCL - Size: 450 KB - Last synced at: 3 days ago - Pushed at: about 1 month ago - Stars: 66 - Forks: 49

flossypurse/batch-record-deletion Fork of Tomperez98/resonate-redpanda

Example app showcasing RedPanda + Resonate

Language: Python - Size: 190 KB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 0 - Forks: 0

iamazy/kafkas

async kafka client in pure Rust

Language: Rust - Size: 252 KB - Last synced at: 12 days ago - Pushed at: about 1 year ago - Stars: 16 - Forks: 0

Bogdanp/Franz

A desktop client for Apache Kafka.

Language: Racket - Size: 9.92 MB - Last synced at: 18 days ago - Pushed at: about 2 months ago - Stars: 141 - Forks: 2

hrbrmstr/skygrep

A real-time Bluesky Jetstream firehose consumer that filters and forwards posts to Kafka topics based on configurable rules.

Language: TypeScript - Size: 22.5 KB - Last synced at: 8 days ago - Pushed at: 24 days ago - Stars: 0 - Forks: 0

cludden/benthos-plugin-temporal

a Temporal integration for benthos/redpanda-connect/bento

Language: Go - Size: 162 KB - Last synced at: 15 days ago - Pushed at: 10 months ago - Stars: 2 - Forks: 0

1plam/kafka-oxide

An ergonomic Rust wrapper for Apache Kafka and Redpanda.

Language: Rust - Size: 17.6 KB - Last synced at: 14 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

flolu/kafka

Realtime BTC and ETH Wallet Tracker with Node.js and Kafka

Language: TypeScript - Size: 290 KB - Last synced at: 19 days ago - Pushed at: over 2 years ago - Stars: 25 - Forks: 13

chandler767/FakeNewsStream

A real-time streaming application designed to detect and display potentially fake news articles

Language: Go - Size: 30 MB - Last synced at: 28 days ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

Paulescu/incremental-ml-training-and-serving

Incremental ML learning in the real-world

Language: Python - Size: 246 KB - Last synced at: 10 days ago - Pushed at: about 2 months ago - Stars: 64 - Forks: 11

redpanda-data/redpanda-examples

A collection of examples to demonstrate how to interact with Redpanda from various clients and languages.

Language: Go - Size: 168 KB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 2

sdairs/bluebird

Pushes the Bluesky Firehose to various data services

Language: TypeScript - Size: 395 KB - Last synced at: 13 days ago - Pushed at: 3 months ago - Stars: 8 - Forks: 3

mkbeh/xkafka

library for working with Kafka, using franz-go and integration with OpenTelemetry for tracing and metrics. Producing, consuming, transacting, etc.

Language: Go - Size: 51.8 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

AlexandrosKyriakakis/apistresstesting

Thesis 📝: Performance Investigation of Various Microservice Architectures

Language: Python - Size: 6.15 MB - Last synced at: 5 days ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

4thel00z/task-manager

Bash task worker written in Go. Uses redpanda for queues and sqlite for storage. Very fast, and low mem footprint.

Language: Go - Size: 66.4 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

hhromic/kadumper

Kafka Avro dumping utility written in Go.

Language: Go - Size: 89.8 KB - Last synced at: 11 days ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

soorajpazeekal/logistics-real-time-poc

A Data engineering based Proof of Concept demonstrating cutting-edge logistics solutions for a US-based Grocery Delivery Platform

Language: Jupyter Notebook - Size: 30.3 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 2 - Forks: 4

AbdelilahOu/Redpanda-go

Set up mysql cdc with debezium connect and redpanda

Language: Go - Size: 44.9 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 0 - Forks: 0

marketcalls/sketchmaker

Self Hostable - Digital Creative Machine for your Teams

Language: HTML - Size: 72.8 MB - Last synced at: 22 days ago - Pushed at: about 2 months ago - Stars: 29 - Forks: 8

milenkovicm/testcontainers-redpanda-rs

Rust Redpanda Testcontainer

Language: Rust - Size: 64.5 KB - Last synced at: 13 days ago - Pushed at: about 2 months ago - Stars: 6 - Forks: 2

marvin-hansen/iggy-streaming-system

Sample streaming project for iggy.rs

Language: Rust - Size: 105 MB - Last synced at: 29 days ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0

silverton-io/buz

Serverless multi-protocol + multi-destination event collection system.

Language: Go - Size: 30.1 MB - Last synced at: 11 days ago - Pushed at: 5 months ago - Stars: 202 - Forks: 26

quackscience/duckdb-extension-kafquack

Experimental DuckDB Kafka Consumer Extension

Language: C++ - Size: 22.5 KB - Last synced at: 16 days ago - Pushed at: 4 months ago - Stars: 9 - Forks: 0

s0rg/clickhouse-kafka-compose

Example docker-compose with clickhouse and kafka or redpanda as event sources

Language: Python - Size: 17.6 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

MaxHalford/taxi-demo-rp-mz-rv-rd-st

🚕 Self-contained demo using Redpanda, Materialize, River, Redis, and Streamlit to predict taxi trip durations

Language: Python - Size: 1.25 MB - Last synced at: 24 days ago - Pushed at: about 2 years ago - Stars: 47 - Forks: 3

sha3sha3/UE-EasyKafka

EasyKafka is a Kafka/Redpanda client sub-system for unreal engine. It supports producing and consuming records through blueprint and C++.

Language: C++ - Size: 23.8 MB - Last synced at: 15 days ago - Pushed at: about 1 year ago - Stars: 40 - Forks: 8

rafaelrok/ms-order-pattern-saga-orchestrator

Projeto de microservices no padrão Saga de maneira de gerenciar a consistência de dados entre microservices em cenários de transação distribuída1. Uma saga é uma sequência de transações que atualiza cada serviço e publica uma mensagem ou evento para disparar a próxima etapa de transação utilizando o kafka.

Language: Java - Size: 5.82 MB - Last synced at: 22 days ago - Pushed at: 11 months ago - Stars: 3 - Forks: 2

deemkeen/clusterlite

A lightweight distributed database system combining SQLite and Kafka for event-driven replication across multiple nodes

Language: Go - Size: 24.4 KB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

hassonor/nrt-e2e-data-warehouses

Language: Python - Size: 1.31 MB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

singlestore-labs/singlestore-workshop-data-intensive-app

This repo provides a starting point for building applications using SingleStore, Redpanda (by Vectorized), and the Go language. SingleStore is a scale-out relational database built for data-intensive workloads. Redpanda is a Kafka API compatible streaming platform for mission-critical workloads created by the team at Vectorized.

Language: Go - Size: 663 KB - Last synced at: 8 days ago - Pushed at: about 1 year ago - Stars: 23 - Forks: 5

singlestore-labs/singlestore-logistics-sim

Scalable package delivery logistics simulator built using SingleStore and Vectorized Redpanda

Language: Go - Size: 1.74 MB - Last synced at: 8 days ago - Pushed at: about 1 year ago - Stars: 34 - Forks: 10

NgunyiGachie/Greenhouse-Data-Streaming

Language: Python - Size: 1.95 KB - Last synced at: 24 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

Ren294/Covid-Data-Process

This project integrates real-time data processing and analytics using Apache NiFi, Kafka, Spark, Hive, and AWS services for comprehensive COVID-19 data insights.

Language: Shell - Size: 6.22 MB - Last synced at: 14 days ago - Pushed at: 7 months ago - Stars: 6 - Forks: 0

NgunyiGachie/real_time_energy_logger

Language: Python - Size: 31.3 KB - Last synced at: 17 days ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

hardikSinghBehl/just-another-testcontainer-integration

Backend application using Testcontainers for Integration Testing AWS S3, Azure Blob Storage, Kafka, MySQL, Egress calls including Chaos testing and Redis.

Language: Java - Size: 144 KB - Last synced at: 14 days ago - Pushed at: over 1 year ago - Stars: 18 - Forks: 3

bobbyiliev/materialize-emulator-subscribe-poc

Language: Python - Size: 12.7 KB - Last synced at: 8 days ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

Hy0g0/Crypto-Data

This project aim to build a reliable application that can handle a lot of crypto data then display it in dashboard

Language: Python - Size: 116 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

MaterializeInc/mz-hack-day-2022 📦

Official repo for the Materialize + Redpanda + dbt Hack Day 2022, including a sample project to get everyone started!

Language: Python - Size: 228 KB - Last synced at: 3 days ago - Pushed at: over 2 years ago - Stars: 62 - Forks: 42

php-kafka/php-simple-kafka-lib

PHP Kafka producer / consumer library with PHP Avro support, based on php-simple-kafka-client

Language: PHP - Size: 41 KB - Last synced at: 1 day ago - Pushed at: over 3 years ago - Stars: 10 - Forks: 1

danthelion/twitter-trending

A small example visualizing live Twitter trending data using Redpanda and Materialize

Language: Dockerfile - Size: 2.18 MB - Last synced at: 5 months ago - Pushed at: about 3 years ago - Stars: 2 - Forks: 1

voutilad/redpanda-pytorch-demo

Putting a PyTorch ML model into production with Redpanda Connect

Language: Dockerfile - Size: 645 KB - Last synced at: 21 days ago - Pushed at: 7 months ago - Stars: 4 - Forks: 0

dipjyotimetia/EventShark

kafka event streaming

Language: Go - Size: 238 KB - Last synced at: about 2 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

lithiferous/market-data-technical-indicators

Compute technical indicators from market data streams. Run lightweight Kafka producer/consumer to calculate aggregate statistics (i.e. EWMA).

Language: Rust - Size: 797 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 2 - Forks: 0

redpanda-data/redpanda-edge-agent

Lightweight internet of things agent that forwards events from the edge

Language: Go - Size: 6.89 MB - Last synced at: 3 days ago - Pushed at: about 1 year ago - Stars: 28 - Forks: 10

voutilad/rpcn-cdc

A demo of using Debezium CDC with Redpanda Connect.

Language: Shell - Size: 7.81 KB - Last synced at: about 2 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 1

ChukwuemekaAham/data-engineering-zoomcamp

Datatalks Club Free Data Engineering Zoomcamp Project

Language: Jupyter Notebook - Size: 4.63 MB - Last synced at: about 2 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

unexist/showcase-logging-tracing-quarkus

Showcase for logging and tracing [MIRROR]

Language: Java - Size: 577 KB - Last synced at: 2 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 2

BlorisL/php-redpanda-test

A simple test with PHP, Redpanda and Docker to send/receive messages.

Language: PHP - Size: 12.7 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

ivpal/CDC-Realtime-Search

Project demonstrates realtime index updates via change data capture

Language: Kotlin - Size: 117 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 0

mneedham/pinot-wiki

Language: Python - Size: 222 KB - Last synced at: 12 days ago - Pushed at: almost 2 years ago - Stars: 20 - Forks: 10

gordonmurray/debezium_redpanda

Docker compose for trying out Debezium, RedPanda and RedPanda Console UI

Size: 92.8 KB - Last synced at: 7 days ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

NexInfinite/redpandapics

A rest api for red panda pics

Language: Rust - Size: 236 MB - Last synced at: 12 months ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 0

fintechless/ftl-msa-redpanda-in

Fintechless MicroService - Redpanda Incoming (Fintechless is the Serverless Platform for Financial Institutions and Fintechs)

Size: 6.84 KB - Last synced at: 12 months ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

fintechless/ftl-msa-redpanda-out

Fintechless MicroService - Redpanda Outgoing (Fintechless is the Serverless Platform for Financial Institutions and Fintechs)

Size: 6.84 KB - Last synced at: 12 months ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

ArthurChf/Cryptoviz

A cryptocurrency statistics dashboard

Language: Python - Size: 3.95 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

kameshsampath/grpc-todo-app

A demo to show how to get started with building Data Streaming API using https://grpc.de) and https://redpanda.com, and how to add analytics using https://snowflake.com e.g. a https://streamlit.io dashboard.

Language: Go - Size: 119 KB - Last synced at: about 19 hours ago - Pushed at: about 1 year ago - Stars: 5 - Forks: 0

polyseam/deno-kafka-demo

integrating Deno and KafkaJS for educational purposes

Language: TypeScript - Size: 15.6 KB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

kameshsampath/rp-k3d

Scripts to provision Kubernetes(k3s) cluster using https://k3d.io and deploy https://redpanda.com cluster on to it

Language: Shell - Size: 91.8 KB - Last synced at: 25 days ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

tlepple/data_origination_workshop

Hands-on workshop with Iceberg, Redpanda, Debezium and Kafka-Connect

Language: Shell - Size: 3.78 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 11 - Forks: 1

kuro337/scalamono

Scala Monorepo Tooling for Kafka, Opensearch, Spark, Redpanda, Hadoop - and Lang Reference.

Language: Scala - Size: 56.6 KB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

ivpal/Prefixy

Project demonstrates how to get and update autocomplete suggestions

Language: Java - Size: 577 KB - Last synced at: 18 days ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

sanogotech/federated-queries-redpanda-and-trino Fork of redpanda-data-blog/2022-federated-queries-redpanda-and-trino

federated-queries-redpanda-and-trino

Language: Python - Size: 388 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

rifa8/streaming-platform

Learning streaming data

Language: Python - Size: 19.2 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

smhmayboudi/cdc-example

Language: Dockerfile - Size: 15.6 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

kameshsampath/rp-dev-gke

Terraform scripts to setup Redpanda dev cluster setup on GKE

Language: HCL - Size: 24.4 KB - Last synced at: 25 days ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

kameshsampath/go-datastreaming-quickstart

A demo quickstart to build an simple datastreaming API application with https://echo.labstack.com and https://readpanda.com

Language: Go - Size: 15.6 KB - Last synced at: 25 days ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

voutilad/redpanda-flight-rs

An Apache Arrow Flight proxy for Redpanda

Language: Rust - Size: 225 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 1

gordonmurray/terraform_rds_debezium_kafka_ksqldb

Create an environment on AWS using Terraform and Ansible to show a Change Data Capture (CDC) process working end to end from MariaDB on RDS to Redis on Elasticache, using Debezium and ksqlDB.

Language: HCL - Size: 11 MB - Last synced at: 7 days ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

RiadBensalem/Real-Time-News-Article-Analysis-with-NER

A real-time data processing pipeline that ingests news articles, extracts named entities, and performs analytics on the extracted information. The project is in the area of data engineering, real-time streaming, NER, and distributed computing.

Language: Python - Size: 646 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

kariuki-george/carea-backend

Powers carea

Language: TypeScript - Size: 16.8 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

memgraph/ecommerce-recommender-demo

E-Commerce recommender demo with real-time data and a graph database

Language: Python - Size: 25.4 KB - Last synced at: 9 months ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 0

eddumelendez/spring-boot-redpanda-testcontainers-reusable-mode

Language: Java - Size: 74.2 KB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

amrizal94/amrBitwyre

This repo aims to simulate sending messages encrypted with the PGP public key and sent to redpanda as a pipe line between the publisher and the consumer, then the consumer can verify the message taken from redpanda

Language: Go - Size: 9.77 KB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

NthMetal/gbraidfinder

Advanced Raidfinder for Granblue Fantasy. 【グランブルファンタジー】のTwitter救援をまとめ

Language: TypeScript - Size: 14 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 20 - Forks: 2

marcelmaatkamp/AisMarineCadastreDataInMetabase

Ingest raw AIS data from marinecadastre.gov in metabase via redpanda

Language: Java - Size: 56 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

php-kafka/php-simple-kafka-client

PHP Kafka extension, supports also Redpanda

Language: C - Size: 169 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 20 - Forks: 6

piotrkpc/k8s-redpanda 📦

Kubernetes operator for Redpanda

Language: Go - Size: 40 KB - Last synced at: 10 months ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

Related Keywords

redpanda 94 kafka 48 docker 15 python 13 golang 8 streaming 8 go 7 docker-compose 7 debezium 7 materialize 6 redpanda-console 6 stream-processing 6 sql 6 terraform 5 streaming-data 5 aws 5 rust 5 kubernetes 4 microservices 4 spring-boot 4 postgresql 4 spark 4 clickhouse 4 redis 4 java 4 redpanda-connect 4 avro 4 kafka-producer 3 duckdb 3 kafka-client 3 apache-kafka 3 typescript 3 testcontainers 3 kafka-consumer 3 real-time 3 nestjs 3 producer 3 grafana 3 metabase 3 dbt 3 php 3 pyspark 3 postgres 3 consumer 3 ml 2 messaging 2 data 2 example 2 flask 2 schema-registry 2 sqlite 2 minio 2 kafkajs 2 serverless 2 platform 2 fintech 2 pulsar 2 kafka-connect 2 elasticsearch 2 quarkus 2 kibana 2 pandas 2 cdc 2 etl 2 huggingface 2 spark-streaming 2 big-data 2 demo 2 vectorized 2 singlestore 2 quickstart 2 database 2 api-rest 2 streamlit 2 antora 2 deno 2 bluesky 2 realtime 2 iceberg 2 client 2 docs 2 analytics 2 ansible 2 nodejs 2 cpp 2 confluent 2 grpc-client 1 demo-app 1 vuejs 1 vue3 1 mongodb 1 flink-alternative 1 high-performance 1 pictures 1 fun 1 animals 1 mariadb 1 adonisjs 1 changedatacapture 1 ksql 1