TomasMikula/libretto

Declarative concurrency and stream processing library for Scala

Language: Scala - Size: 15.9 MB - Last synced at: about 1 hour ago - Pushed at: about 2 hours ago - Stars: 211 - Forks: 7

vectordotdev/vector

A high-performance observability data pipeline.

Language: Rust - Size: 116 MB - Last synced at: about 1 hour ago - Pushed at: 2 days ago - Stars: 19,483 - Forks: 1,738

iferdel/sensor-data-streaming-pubsub

Hybrid IIoT system using PubSub as backbone by means of Go/RabbitMQ, PostgreSQL with TimeScaleDB extension for storage, Alloy and Loki for logs, and Grafana for real-time visualization. Interaction via a CLI tool, which communicates with an HTTP REST API server. Deployed on Kubernetes through GitOps.

Language: Go - Size: 57.9 MB - Last synced at: about 7 hours ago - Pushed at: about 8 hours ago - Stars: 4 - Forks: 0

leesf/hudi-resources

汇总Apache Hudi相关资料

Size: 23.7 MB - Last synced at: about 11 hours ago - Pushed at: about 12 hours ago - Stars: 551 - Forks: 161

miroslavpejic85/mirotalkbro

📡 MiroTalk WebRTC Live Broadcast allows to broadcast live video, audio and screen stream to all connected users (viewers).

Language: JavaScript - Size: 1.37 MB - Last synced at: about 24 hours ago - Pushed at: 1 day ago - Stars: 172 - Forks: 44

kalmyk/fox-wamp

Web Application Message Async Server and WAMP/MQTT bridge

Language: JavaScript - Size: 1.04 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 13 - Forks: 6

redpanda-data/connect

Fancy stream processing made operationally mundane

Language: Go - Size: 34 MB - Last synced at: about 22 hours ago - Pushed at: 2 days ago - Stars: 8,350 - Forks: 866

systemaccounting/mxfactorial

a payment application intended for deployment by the united states treasury that replaces banking with accounting

Language: Rust - Size: 6.83 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 53 - Forks: 26

jzinxkra/Tradewatch

A modular trade monitoring & alerting system built with Python. Analyzes market activity and detects unusual behavior. Real-time cryptocurrency trade analytics platform

Language: Python - Size: 6.84 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 0 - Forks: 0

Point72/csp-bot

Reactive chat bot framework

Language: Python - Size: 317 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 8 - Forks: 2

memgraph/mage

MAGE - Memgraph Advanced Graph Extensions :crystal_ball:

Language: C++ - Size: 21.8 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 284 - Forks: 28

numaproj/numaflow

Kubernetes-native platform to run massively parallel data/streaming jobs

Language: Go - Size: 38.8 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 1,864 - Forks: 131

gretelai/gretel-python-client

The Gretel Python Client allows you to interact with the Gretel REST API.

Language: Python - Size: 31.3 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 55 - Forks: 19

naclsn/sel

A versatile command line tool, with a functional approach.

Language: Rust - Size: 916 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 1 - Forks: 0

apache/streampipes

Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.

Language: Java - Size: 311 MB - Last synced at: 1 day ago - Pushed at: 3 days ago - Stars: 642 - Forks: 196

AxisCommunications/media-stream-library-js

JavaScript library to handle media streams on the command line (Node.js) and in the browser.

Language: TypeScript - Size: 872 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 310 - Forks: 104

gazette/core

Build platforms that flexibly mix SQL, batch, and stream processing paradigms

Language: Go - Size: 4.81 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 747 - Forks: 53

Point72/csp-gateway

Streaming application framework built on csp

Language: Python - Size: 7.66 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 16 - Forks: 3

Point72/csp-adapter-symphony

A csp adapter for symphony

Language: Python - Size: 146 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 8 - Forks: 3

google-ai-edge/mediapipe

Cross-platform, customizable ML solutions for live and streaming media.

Language: C++ - Size: 576 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 29,601 - Forks: 5,339

aartikis/RTEC

RTEC is an Event Calculus implementation optimised for stream reasoning

Language: Prolog - Size: 11.7 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 88 - Forks: 16

AICoE/log-anomaly-detector 📦

Log Anomaly Detection - Machine learning to detect abnormal events logs

Language: Jupyter Notebook - Size: 18.7 MB - Last synced at: 2 days ago - Pushed at: about 2 years ago - Stars: 327 - Forks: 132

Point72/csp

csp is a high performance reactive stream processing library, written in C++ and Python

Language: Python - Size: 4.76 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 287 - Forks: 49

bytewax/bytewax

Python Stream Processing

Language: Python - Size: 12 MB - Last synced at: 4 days ago - Pushed at: about 2 months ago - Stars: 1,726 - Forks: 79

madd86/awesome-system-design

A curated list of awesome System Design (A.K.A. Distributed Systems) resources.

Size: 1.71 MB - Last synced at: 4 days ago - Pushed at: 11 months ago - Stars: 10,233 - Forks: 1,148

quixio/quix-streams

Python Streaming DataFrames for Kafka

Language: Python - Size: 8.49 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 1,364 - Forks: 76

spring-cloud/spring-cloud-stream

Framework for building Event-Driven Microservices

Language: Java - Size: 17.7 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 1,021 - Forks: 624

confluentinc/flink-table-api-python-examples

Python Examples for running Apache Flink® Table API on Confluent Cloud

Language: Python - Size: 24.4 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 12 - Forks: 4

O2-Czech-Republic/proxima-platform

The Proxima platform.

Language: Java - Size: 9.31 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 21 - Forks: 7

zhisheng17/flink-learning

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

Language: Java - Size: 41.6 MB - Last synced at: 5 days ago - Pushed at: 2 months ago - Stars: 14,760 - Forks: 3,938

bakdata/streams-bootstrap

Utility functions and base classes for Kafka Streams applications

Language: Java - Size: 17.2 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 32 - Forks: 3

sanmai/pipeline

Build streaming pipelines in PHP. The missing pipe operator. General-purpose collection pipeline. Since 2017.

Language: PHP - Size: 629 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 65 - Forks: 6

confluentinc/flink-table-api-java-examples

Java Examples for running Apache Flink® Table API on Confluent Cloud

Language: Java - Size: 134 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 11 - Forks: 6

online-ml/river

🌊 Online machine learning in Python

Language: Python - Size: 315 MB - Last synced at: 5 days ago - Pushed at: 15 days ago - Stars: 5,319 - Forks: 573

risingwavelabs/risingwave

Stream processing and management platform.

Language: Rust - Size: 160 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 7,719 - Forks: 633

pipeless-ai/pipeless

An open-source computer vision framework to build and deploy apps in minutes

Language: Rust - Size: 142 MB - Last synced at: 5 days ago - Pushed at: about 1 year ago - Stars: 752 - Forks: 38

fluent/fluent-bit

Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows

Language: C - Size: 104 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 6,837 - Forks: 1,675

infinyon/fluvio

🦀 event stream processing for developers to stream and process data in motion to power responsive data intensive applications.

Language: Rust - Size: 34.1 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 4,916 - Forks: 514

manuzhang/awesome-streaming

a curated list of awesome streaming frameworks, applications, etc

Size: 2.7 MB - Last synced at: 5 days ago - Pushed at: about 2 months ago - Stars: 2,809 - Forks: 305

ThreeDotsLabs/watermill

Building event-driven applications the easy way in Go.

Language: Go - Size: 25.4 MB - Last synced at: 5 days ago - Pushed at: 9 days ago - Stars: 8,342 - Forks: 432

confluentinc/ksql

The database purpose-built for stream processing applications.

Language: Java - Size: 206 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 194 - Forks: 1,043

neo4j-contrib/neo4j-streams

Neo4j Kafka Connector

Language: Kotlin - Size: 3.76 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 173 - Forks: 72

siddhi-io/siddhi

Stream Processing and Complex Event Processing Engine

Language: Java - Size: 33.6 MB - Last synced at: 3 days ago - Pushed at: 25 days ago - Stars: 1,546 - Forks: 530

yomorun/yomo

🦖 Stateful Serverless Framework for Geo-distributed Edge AI Infra. with function calling support, write once, run on any model.

Language: Go - Size: 66 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 1,750 - Forks: 131

whitaker-io/machine

Machine is a workflow/pipeline library for processing data

Language: Go - Size: 1.41 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 162 - Forks: 12

MaterializeInc/materialize

Real-time Data Integration and Transformation: use SQL to transform, deliver, and act on fast-changing data.

Language: Rust - Size: 258 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 5,969 - Forks: 472

redpanda-data/redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

Language: C++ - Size: 108 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 10,290 - Forks: 626

ArroyoSystems/arroyo

Distributed stream processing engine in Rust

Language: Rust - Size: 15.1 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 4,310 - Forks: 266

getsentry/arroyo

A library to build streaming applications that consume from and produce to Kafka.

Language: Python - Size: 1.56 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 50 - Forks: 7

apache/hudi

Upserts, Deletes And Incremental Processing on Big Data.

Language: Java - Size: 1.74 GB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 5,756 - Forks: 2,396

DSIN-INSA-Strasbourg/Hermes

Change Data Capture (CDC) tool from any source(s) to any target

Language: Python - Size: 569 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 3 - Forks: 1

PeerDB-io/peerdb

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

Language: Go - Size: 13.9 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 2,508 - Forks: 116

pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Language: Python - Size: 132 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 24,595 - Forks: 363

ag2ai/faststream

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

Language: Python - Size: 453 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 3,874 - Forks: 225

heyoka/faxe

Language: Erlang - Size: 2.66 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 20 - Forks: 1

volga-project/volga

Real-time data processing/feature engineering in Python. Tailored for modern AI/ML systems.

Language: Python - Size: 11.1 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 57 - Forks: 4

hazelcast/hazelcast

Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.

Language: Java - Size: 394 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 6,314 - Forks: 1,859

samber/awesome-olap

A curated list of awesome Online Analytical Processing databases, frameworks, ressources and other awesomeness.

Size: 49.8 KB - Last synced at: 4 days ago - Pushed at: 4 months ago - Stars: 69 - Forks: 6

oxnr/awesome-bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

Size: 843 KB - Last synced at: 7 days ago - Pushed at: 3 months ago - Stars: 13,594 - Forks: 2,569

csp-community/csp-bot-commands

Miscellaneous commands for csp-bot

Language: Python - Size: 31.3 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 1 - Forks: 1

csp-community/csp-adapter-discord

A csp adapter for discord

Language: Python - Size: 43.9 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 3 - Forks: 1

memgraph/memgraph

Open-source graph database, tuned for dynamic analytics environments. Easy to adopt, scale and own.

Language: C++ - Size: 42.4 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 2,821 - Forks: 148

TouK/nussknacker

Low-code tool for automating actions on real time data | Stream processing for the users.

Language: Scala - Size: 181 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 687 - Forks: 95

reugn/go-streams

A lightweight stream processing library for Go

Language: Go - Size: 587 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 2,028 - Forks: 164

uhop/stream-json

The micro-library of Node.js stream components for creating custom JSON processing pipelines with a minimal memory footprint. It can parse JSON files far exceeding available memory streaming individual primitives using a SAX-inspired API.

Language: JavaScript - Size: 899 KB - Last synced at: 8 days ago - Pushed at: 3 months ago - Stars: 1,047 - Forks: 48

synacker/daggy

Daggy - Data Aggregation Utility and C/C++ developer library for data streams catching

Language: C++ - Size: 7.31 MB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 154 - Forks: 15

certeu/morio

Connect - Stream - Observe - Respond | Morio provides the plumbing for your observability needs

Language: JavaScript - Size: 27.5 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 26 - Forks: 3

Claviz/xlstream

Turns XLSX into a readable stream.

Language: TypeScript - Size: 709 KB - Last synced at: 7 days ago - Pushed at: 9 months ago - Stars: 172 - Forks: 17

OCHA-DAP/hdx-python-utilities

A range of helpful utilities for Python developers including streaming tabular data, date parsing, JSON and YAML handling, dictionary and list utilities

Language: Python - Size: 1.43 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 10 - Forks: 6

Kurento/kurento

Kurento WebRTC Media Server

Language: C - Size: 132 MB - Last synced at: 9 days ago - Pushed at: about 2 months ago - Stars: 354 - Forks: 63

IBMStreams/streamsx.websocket

[Incubation] C++ WebSocket toolkit for IBM Streams

Language: C++ - Size: 7.84 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 1 - Forks: 0

IBMStreams/streamsx.documentation

Streams documentation project for writing development guides and documentation

Language: HTML - Size: 70.6 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 8 - Forks: 24

IBMStreams/streamsx.dps

The IBMStreams/streamsx.dps GitHub repository is home to the Streams toolkit named DPS (Distributed Process Store)

Language: C++ - Size: 87.9 MB - Last synced at: 10 days ago - Pushed at: 11 days ago - Stars: 4 - Forks: 9

IBMStreams/streamsx.sttgateway

This toolkit does Speech To Text transcription using an external provider such as the IBM Watson STT cloud service.

Language: C++ - Size: 19.6 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 1

cross-platform/dspatcher

Cross-Platform Graphical Tool for DSPatch

Language: C++ - Size: 5.05 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 61 - Forks: 17

cross-platform/dspatchables

DSPatch Component Repository

Language: C++ - Size: 6.93 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 26 - Forks: 6

pbernet/akka_streams_tutorial

A collection of runnable and self-contained examples inspired by various akka-streams (pekko-streams), Alpakka (Pekko connectors) and akka-http (pekko-http) docs, tutorials and blogs

Language: Scala - Size: 66.5 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 33 - Forks: 12

Axual/ksml

Kafka Streams for Low Code Environments

Language: Java - Size: 2.13 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 25 - Forks: 11

Hapag-Lloyd/fluent-bit-multiline

Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows.

Language: Dockerfile - Size: 124 KB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 2 - Forks: 0

creek-service/creek-kafka

Creek Kafka support

Language: Java - Size: 2.29 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 5 - Forks: 0

javascriptdata/danfojs

Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.

Language: TypeScript - Size: 79 MB - Last synced at: 7 days ago - Pushed at: about 1 month ago - Stars: 4,909 - Forks: 216

cross-platform/dspatch

The Refreshingly Simple Cross-Platform C++ Dataflow / Patching / Pipelining / Graph Processing / Stream Processing / Reactive Programming Framework

Language: C++ - Size: 6.21 MB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 238 - Forks: 43

koralium/flowtide

Streaming integration engine

Language: C# - Size: 70.5 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 47 - Forks: 4

GridProtectionAlliance/openPDC

Open Source Phasor Data Concentrator

Language: C# - Size: 2.47 GB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 135 - Forks: 56

mp911de/redis-stream-demo

Demo for Redis Streams

Language: Java - Size: 159 KB - Last synced at: 11 days ago - Pushed at: almost 5 years ago - Stars: 34 - Forks: 13

SvenvDam/linea

A type-safe and composable stream processing library for Go

Language: Go - Size: 156 KB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 0 - Forks: 0

psila-ai/callysto

Stream processing & Service framework.

Language: Rust - Size: 3.67 MB - Last synced at: 8 days ago - Pushed at: about 1 year ago - Stars: 147 - Forks: 8

AwesomeWebProjects/react-player

One audio player built with ReactJS, Web Audio API and Web Worker API

Language: JavaScript - Size: 20.8 MB - Last synced at: 7 days ago - Pushed at: over 1 year ago - Stars: 106 - Forks: 20

Narius2030/MLOps-Image-Captioning

An end-to-end MLOps pipeline to develop, train, and deploy an Image Caption model that automatically generates captions for images based on diverse datasets

Language: Python - Size: 2.56 MB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 1 - Forks: 0

au7hority/csp-bot-commands

Miscellaneous commands for csp-bot

Language: Python - Size: 28.3 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 0 - Forks: 0

talariadb/talaria

TalariaDB is a distributed, highly available, and low latency time-series database for Presto

Language: Go - Size: 12.8 MB - Last synced at: 12 days ago - Pushed at: over 1 year ago - Stars: 220 - Forks: 31

halaxa/json-machine

Efficient, easy-to-use, and fast PHP JSON stream parser

Language: PHP - Size: 1.52 MB - Last synced at: 16 days ago - Pushed at: 17 days ago - Stars: 1,187 - Forks: 66

FutureSDR/FutureSDR

An Async SDR Runtime for Heterogeneous Architectures

Language: Rust - Size: 26.6 MB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 363 - Forks: 59

will-white/dahua-companion

Small, simple, and fast event driven Dahua (Amcrest) doorbell processor for home automation integration

Language: Go - Size: 21.1 MB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 0 - Forks: 0

deniskrumko/ksqldb-ui

Free and simple way to interact with ksqlDB using UI

Language: Python - Size: 608 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 2 - Forks: 1

kurrent-io/KurrentDB-Client-Java

KurrentDB Java Client

Language: Java - Size: 9.35 MB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 64 - Forks: 23

gunnarmorling/streaming-examples

Example projects and demos around data streaming , stream processing, change data capture, and more.

Language: Java - Size: 28.3 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 6 - Forks: 0

infoslack/awesome-kafka

A list about Apache Kafka

Size: 96.7 KB - Last synced at: 11 days ago - Pushed at: about 2 months ago - Stars: 581 - Forks: 163

robinhood/faust

Python Stream Processing

Language: Python - Size: 8.3 MB - Last synced at: 18 days ago - Pushed at: 10 months ago - Stars: 6,787 - Forks: 534

maki-nage/makinage

Stream Processing Made Easy

Language: Python - Size: 227 KB - Last synced at: 3 days ago - Pushed at: about 3 years ago - Stars: 41 - Forks: 1