Topic: "stream-processing"
wso2/product-sp
An open source, cloud-native streaming data integration and analytics product optimized for agile digital businesses
Language: Python - Size: 121 MB - Last synced at: 14 days ago - Pushed at: over 3 years ago - Stars: 120 - Forks: 132
n0-computer/quic-rpc
A streaming rpc system based on quic
Language: Rust - Size: 1.09 MB - Last synced at: 1 day ago - Pushed at: 20 days ago - Stars: 116 - Forks: 14
wso2/product-streaming-integrator
A stream processing runtime that allows connecting any streaming data source to any destination and act on it
Language: Python - Size: 152 MB - Last synced at: about 19 hours ago - Pushed at: about 20 hours ago - Stars: 113 - Forks: 52
streamnative/pulsar-spark
Spark Connector to read and write with Pulsar
Language: Scala - Size: 711 KB - Last synced at: 11 days ago - Pushed at: 5 months ago - Stars: 113 - Forks: 50
zefhub/zef
Toolkit for graph-relational data across space and time
Language: Python - Size: 10.4 MB - Last synced at: 17 days ago - Pushed at: 8 months ago - Stars: 113 - Forks: 2
bitbouncer/kspp
A high performance/ real-time C++ Kafka streams framework (C++17)
Language: C++ - Size: 3.5 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 112 - Forks: 24
Hurence/logisland
Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.
Language: Java - Size: 120 MB - Last synced at: 16 days ago - Pushed at: over 1 year ago - Stars: 109 - Forks: 29
AwesomeWebProjects/react-player
One audio player built with ReactJS, Web Audio API and Web Worker API
Language: JavaScript - Size: 20.8 MB - Last synced at: about 20 hours ago - Pushed at: over 1 year ago - Stars: 107 - Forks: 20
trK54Ylmz/kafka-spark-streaming-example
Simple examle for Spark Streaming over Kafka topic
Language: Java - Size: 292 KB - Last synced at: 22 days ago - Pushed at: over 4 years ago - Stars: 106 - Forks: 78
Banno/kafka4s
Functional programming with Kafka and Scala
Language: Scala - Size: 3.25 MB - Last synced at: 5 days ago - Pushed at: 6 days ago - Stars: 95 - Forks: 18
pravega/flink-connectors
Apache Flink connectors for Pravega.
Language: Java - Size: 1.84 MB - Last synced at: 14 days ago - Pushed at: about 1 year ago - Stars: 94 - Forks: 67
bytedance/Elkeid-HUB
Elkeid HUB is a rule/event processing engine maintained by the Elkeid Team that supports streaming/offline (not yet supported by the community edition) data processing. The original intention is to solve complex data/event processing and external system linkage requirements through standardized rules.
Language: Python - Size: 147 MB - Last synced at: 10 days ago - Pushed at: almost 2 years ago - Stars: 94 - Forks: 25
ParaGroup/WindFlow
A C++17 Data Stream Processing Parallel Library for Multicores and GPUs
Language: C++ - Size: 48.9 MB - Last synced at: 11 days ago - Pushed at: about 2 months ago - Stars: 81 - Forks: 19
arcosuc3m/grppi
Generic Reusable Parallel Patterns Interface
Language: C++ - Size: 14.5 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 80 - Forks: 20
blockchain-etl/blockchain-etl-streaming
Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes
Language: Python - Size: 64.5 KB - Last synced at: 1 day ago - Pushed at: over 3 years ago - Stars: 80 - Forks: 22
florimondmanca/kafka-fraud-detector 📦
🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python
Language: Python - Size: 18.6 KB - Last synced at: 12 months ago - Pushed at: almost 6 years ago - Stars: 80 - Forks: 48
aartikis/RTEC
RTEC is an Event Calculus implementation optimised for stream reasoning
Language: Prolog - Size: 13 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 78 - Forks: 15
v12technology/fluxtion
core fluxtion static event processor generator tool and runtime components
Language: Java - Size: 39 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 77 - Forks: 8
Spinoco/fs2-kafka
Kafka client for functional streams for scala (fs2)
Language: Scala - Size: 260 KB - Last synced at: 19 days ago - Pushed at: over 1 year ago - Stars: 77 - Forks: 14
TU-Berlin-DIMA/scotty-window-processor
This repository provides Scotty, a framework for efficient window aggregations for out-of-order Stream Processing.
Language: Java - Size: 553 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 75 - Forks: 23
decodableco/examples
🌟 Examples of use cases that utilize Decodable, as well as demos for related open-source projects such as Apache Flink, Debezium, and Postgres.
Language: Java - Size: 19.9 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 71 - Forks: 34
lsds/LightSaber
Multi-core Window-Based Stream Processing Engine
Language: C++ - Size: 1.55 MB - Last synced at: 16 days ago - Pushed at: over 3 years ago - Stars: 71 - Forks: 18
scramjetorg/transform-hub
Scramjet Transform Hub (STH) is a runtime supervisor that can run data processing programs called Sequences and manage local resources on any Linux server, Docker on small edge servers, and even large-scale Kubernetes clusters in the cloud or datacenters. It connects to Scramjet Spaces in Scramjet Cloud Platform.
Language: TypeScript - Size: 16.9 MB - Last synced at: 3 days ago - Pushed at: 3 months ago - Stars: 69 - Forks: 8
rmoff/ksqldb-go
A Golang client for ksqlDB
Language: Go - Size: 6.83 MB - Last synced at: 5 months ago - Pushed at: over 3 years ago - Stars: 69 - Forks: 11
samber/awesome-olap
A curated list of awesome Online Analytical Processing databases, frameworks, ressources and other awesomeness.
Size: 49.8 KB - Last synced at: 3 days ago - Pushed at: 4 months ago - Stars: 67 - Forks: 6
maxim2266/csvplus
csvplus extends the standard Go encoding/csv package with fluent interface, lazy stream operations, indices and joins.
Language: Go - Size: 85.9 KB - Last synced at: 2 days ago - Pushed at: almost 4 years ago - Stars: 67 - Forks: 3
vaerohq/vaero
Complete log pipeline solution in Python. Runs fast in Go.
Language: Go - Size: 196 KB - Last synced at: 10 months ago - Pushed at: almost 2 years ago - Stars: 66 - Forks: 1
blendle/pg2kafka 📦
Ship changes in Postgres 🐘 to Kafka 📖
Language: Go - Size: 114 KB - Last synced at: about 2 months ago - Pushed at: almost 4 years ago - Stars: 66 - Forks: 5
devnw/stream
stream is a concurrency pattern implementation using Go generics. a.k.a. my accidentally awesome library
Language: Go - Size: 275 KB - Last synced at: 10 months ago - Pushed at: 12 months ago - Stars: 65 - Forks: 3
project-flogo/stream
Elegant stream processing pipeline written entirely in Golang
Language: Go - Size: 194 KB - Last synced at: 8 days ago - Pushed at: almost 2 years ago - Stars: 65 - Forks: 33
thibauts/styx
Simple, high-performance event streaming broker
Language: Go - Size: 422 KB - Last synced at: 19 days ago - Pushed at: about 4 years ago - Stars: 65 - Forks: 3
kurrent-io/KurrentDB-Client-Java
KurrentDB Java Client
Language: Java - Size: 9.33 MB - Last synced at: 13 days ago - Pushed at: 23 days ago - Stars: 64 - Forks: 24
sanmai/pipeline
Build streaming pipelines in PHP. The missing pipe operator. General-purpose collection pipeline. Since 2017.
Language: PHP - Size: 615 KB - Last synced at: 15 days ago - Pushed at: 5 months ago - Stars: 64 - Forks: 5
djarza/football-events
Event-Driven microservices with Kafka Streams
Language: Java - Size: 2.81 MB - Last synced at: 28 days ago - Pushed at: almost 4 years ago - Stars: 64 - Forks: 26
online-ml/watermill.rs
🦀 Online statistics in Rust
Language: Rust - Size: 106 KB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 63 - Forks: 4
twalthr/flink-api-examples
Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.
Language: Java - Size: 31.3 KB - Last synced at: 19 days ago - Pushed at: over 1 year ago - Stars: 63 - Forks: 20
TamarLabs/ReDe
A Redis dehydrator module
Language: C - Size: 14.8 MB - Last synced at: over 1 year ago - Pushed at: about 5 years ago - Stars: 63 - Forks: 11
cross-platform/dspatcher
Cross-Platform Graphical Tool for DSPatch
Language: C++ - Size: 5.05 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 60 - Forks: 17
lpgauth/swirl
High-Performance Erlang Stream Processor
Language: Erlang - Size: 4.17 MB - Last synced at: 23 days ago - Pushed at: 7 months ago - Stars: 58 - Forks: 9
rodrigo-arenas/kafkaml-anomaly-detection
Project for real-time anomaly detection using Kafka and python
Language: Python - Size: 9.69 MB - Last synced at: 24 days ago - Pushed at: over 2 years ago - Stars: 58 - Forks: 20
mikeroyal/Apache-Flink-Guide
Apache Flink Guide
Size: 171 KB - Last synced at: 25 days ago - Pushed at: over 3 years ago - Stars: 58 - Forks: 7
itsubaki/gostream
Stream Processing library for Go
Language: Go - Size: 234 KB - Last synced at: 23 days ago - Pushed at: over 1 year ago - Stars: 56 - Forks: 8
gretelai/gretel-python-client
The Gretel Python Client allows you to interact with the Gretel REST API.
Language: Python - Size: 31 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 54 - Forks: 19
UnixJunkie/parany
Parallelize _anything_ //
Language: OCaml - Size: 230 KB - Last synced at: 19 days ago - Pushed at: over 1 year ago - Stars: 54 - Forks: 8
nextbreakpoint/flink-controller
Flink Controller implements a Kubernetes Custom Controller (aka Kubernetes Operator) for Apache Flink
Language: Kotlin - Size: 8.19 MB - Last synced at: 23 days ago - Pushed at: 4 months ago - Stars: 53 - Forks: 9
formcept/whiteboard
FORMCEPT Whiteboard used by developers for developers
Language: Jupyter Notebook - Size: 24.9 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 53 - Forks: 0
intellistream/StreamProcessing_ReadingList
stream processing reading list
Size: 65.4 KB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 52 - Forks: 8
luisbelloch/data_processing_course
Some class materials for a data processing course using PySpark
Language: Python - Size: 563 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 51 - Forks: 24
systemaccounting/mxfactorial
a payment application intended for deployment by the united states treasury that replaces banking with accounting
Language: Rust - Size: 6.93 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 50 - Forks: 26
getsentry/arroyo
A library to build streaming applications that consume from and produce to Kafka.
Language: Python - Size: 1.53 MB - Last synced at: 10 days ago - Pushed at: 13 days ago - Stars: 50 - Forks: 7
volga-project/volga
Real-time data processing/feature engineering in Python. Tailored for modern AI/ML systems.
Language: Python - Size: 11 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 49 - Forks: 4
cau-se/theodolite
Theodolite is a framework for benchmarking the horizontal and vertical scalability of cloud-native applications.
Language: Java - Size: 5.38 MB - Last synced at: 12 days ago - Pushed at: about 2 months ago - Stars: 49 - Forks: 8
rohit-mehra/eye_of_sauron
Stream processing using kafka-python to track people (user input images of target) in the wild over multiple video streams.
Language: Python - Size: 134 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 48 - Forks: 26
koralium/flowtide
Streaming integration engine
Language: C# - Size: 70 MB - Last synced at: 4 days ago - Pushed at: 5 days ago - Stars: 47 - Forks: 4
MaxHalford/taxi-demo-rp-mz-rv-rd-st
🚕 Self-contained demo using Redpanda, Materialize, River, Redis, and Streamlit to predict taxi trip durations
Language: Python - Size: 1.25 MB - Last synced at: 24 days ago - Pushed at: about 2 years ago - Stars: 47 - Forks: 3
Klarrio/open-stream-processing-benchmark
This repository contains the code base for the Open Stream Processing Benchmark.
Language: Jupyter Notebook - Size: 5.97 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 45 - Forks: 12
benthosdev/benthos-captain
A Kubernetes Operator to orchestrate Benthos pipelines
Language: Go - Size: 687 KB - Last synced at: 8 days ago - Pushed at: 10 months ago - Stars: 44 - Forks: 13
IBMStreams/streamsx.health
(Incubation) Streams Healthcare Analytics Platform - To enable and inspire the next generation healthcare solutions
Language: Java - Size: 61.1 MB - Last synced at: 14 days ago - Pushed at: over 4 years ago - Stars: 43 - Forks: 34
IBMStreams/samples
This repository contains open-source sample applications for IBM Streams.
Language: Java - Size: 251 MB - Last synced at: 14 days ago - Pushed at: over 2 years ago - Stars: 41 - Forks: 73
maki-nage/makinage
Stream Processing Made Easy
Language: Python - Size: 227 KB - Last synced at: 8 days ago - Pushed at: almost 3 years ago - Stars: 40 - Forks: 1
houmo-ai/mediapipe_plus
The purpose of this project is to apply mediapipe to more AI chips.
Language: C++ - Size: 2.51 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 40 - Forks: 17
salesforce/storm-dynamic-spout 📦
A framework for building spouts for Apache Storm and a Kafka based spout for dynamically skipping messages to be processed later.
Language: Java - Size: 1.86 MB - Last synced at: 14 days ago - Pushed at: over 3 years ago - Stars: 40 - Forks: 13
Xtra-Computing/briskstream
A Multicore, NUMA Optimised Data Stream Processing System
Language: Java - Size: 7.96 MB - Last synced at: 10 days ago - Pushed at: over 2 years ago - Stars: 38 - Forks: 12
lsds/Saber
Window-Based Hybrid CPU/GPU Stream Processing Engine
Language: Java - Size: 67.6 MB - Last synced at: 27 days ago - Pushed at: over 2 years ago - Stars: 38 - Forks: 13
tradewelltech/beavers
Python stream processing for analytics
Language: Python - Size: 591 KB - Last synced at: about 20 hours ago - Pushed at: about 1 month ago - Stars: 37 - Forks: 2
openfun/ralph
:gear: Ralph, the ultimate Learning Record Store (and more!) for your learning analytics
Language: Python - Size: 14.3 MB - Last synced at: 1 day ago - Pushed at: 7 months ago - Stars: 37 - Forks: 14
confluentinc/ksql-recipes-try-it-at-home 📦
Files needed to try out KSQL Recipes for yourself
Language: Shell - Size: 57.1 MB - Last synced at: 11 months ago - Pushed at: about 3 years ago - Stars: 36 - Forks: 25
numaproj/numalogic-prometheus
AIOps for metrics in Prometheus
Language: Python - Size: 1.38 MB - Last synced at: 6 days ago - Pushed at: 8 months ago - Stars: 35 - Forks: 10
dmitriz/stream-handbook Fork of Raynos/stream-handbook
How to write node programs with streams
Language: JavaScript - Size: 174 KB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 35 - Forks: 5
alibaba/table-computing
Table-Computing (Simplified as TC) is a high performance and low latency computing framework, 10x faster than Flink for complicated use cases, distributed and light weighted, relational operation, simple to use, write less and do more.
Language: Java - Size: 341 KB - Last synced at: 11 months ago - Pushed at: about 2 years ago - Stars: 35 - Forks: 5
gophersgang/go-rivers
Collection of stream processing / multiplexing / networking libs in Go
Language: Go - Size: 37.1 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 35 - Forks: 6
doganulus/reelay
A header-only C++ library for system-level verification and declarative testing of real-time systems with Python bindings.
Language: C++ - Size: 2.98 MB - Last synced at: 18 days ago - Pushed at: about 1 year ago - Stars: 34 - Forks: 6
mp911de/redis-stream-demo
Demo for Redis Streams
Language: Java - Size: 159 KB - Last synced at: 24 days ago - Pushed at: almost 5 years ago - Stars: 33 - Forks: 13
bakdata/streams-bootstrap
Utility functions and base classes for Kafka Streams applications
Language: Java - Size: 16.4 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 32 - Forks: 3
Menziess/slipstream-async
Slipstream provides a data-flow model to simplify development of stateful streaming applications.
Language: Python - Size: 722 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 32 - Forks: 0
bebee4java/ides
智能数据探索服务(Intelligent Data Exploration Service)，一站式Data + AI数据解决方案！
Language: Scala - Size: 6.34 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 32 - Forks: 22
neocoretechs/h264j
Pure Java implementation of H264 decoder to replace Xuggler
Language: Java - Size: 197 KB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 32 - Forks: 10
RTBHOUSE/kafka-workers
Kafka Workers is a client library which unifies records consuming from Kafka and processing them by user-defined WorkerTasks.
Language: Java - Size: 1.71 MB - Last synced at: 6 months ago - Pushed at: over 2 years ago - Stars: 32 - Forks: 12
pbernet/akka_streams_tutorial
A collection of runnable and self-contained examples inspired by various akka-streams (pekko-streams), Alpakka (Pekko connectors) and akka-http (pekko-http) docs, tutorials and blogs
Language: Scala - Size: 66.3 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 31 - Forks: 11
thecodemonkey/kafka-microservices
A series of tiny examples around Kafka and event driven microservices using Spring Framework written in Kotlin & Java.
Language: Kotlin - Size: 3.02 MB - Last synced at: 17 days ago - Pushed at: almost 4 years ago - Stars: 31 - Forks: 11
xtaci/sp
Stream Processors on Kafka in Golang
Language: Go - Size: 1.19 MB - Last synced at: 9 days ago - Pushed at: about 8 years ago - Stars: 30 - Forks: 5
streamreasoning/rsp4j
RSP4J a library for RDF Stream Processing
Language: Java - Size: 5.52 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 29 - Forks: 13
IBMStreams/streamsx.messaging
This toolkit is focused on interacting with popular messaging systems such as Kafka, JMS, XMS, and MQTT. After release v5.4.2 the complete toolkit will be deprecated. See the README.md file for hints to alternative toolkits.
Language: Java - Size: 4.07 MB - Last synced at: 14 days ago - Pushed at: over 1 year ago - Stars: 29 - Forks: 32
IBMStreams/streamsx.topology
Develop streaming applications for IBM Streams in Python, Java & Scala.
Language: Java - Size: 50.4 MB - Last synced at: 10 days ago - Pushed at: over 2 years ago - Stars: 29 - Forks: 43
GMAP/DSPBench
a suite of benchmark applications for distributed data stream processing systems
Language: Java - Size: 250 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 28 - Forks: 3
sustainable-computing-io/kepler-model-server
Model Server for Kepler
Language: Python - Size: 36.6 MB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 27 - Forks: 26
RedisGears/redisgears-py
RedisGears python client
Language: Python - Size: 72.3 KB - Last synced at: 20 days ago - Pushed at: almost 2 years ago - Stars: 27 - Forks: 11
amitayh/event-sourcing-kafka-streams
Demo code from my talk @ Codemotion Milan 2018 - "Building event sourced systems with Kafka Streams"
Language: Scala - Size: 801 KB - Last synced at: about 1 year ago - Pushed at: about 6 years ago - Stars: 27 - Forks: 12
certeu/morio
Connect - Stream - Observe - Respond | Morio provides the plumbing for your observability needs
Language: JavaScript - Size: 27.5 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 26 - Forks: 3
cross-platform/dspatchables
DSPatch Component Repository
Language: C++ - Size: 6.93 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 26 - Forks: 6
glink-incubator/glink
A Spatial Extension of Apache Flink
Language: Java - Size: 304 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 26 - Forks: 4
swimos/traffic
Massively real-time traffic streaming application
Language: TypeScript - Size: 240 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 26 - Forks: 8
apache/streampipes-extensions 📦
Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams. This repository contains ready-to-use pipeline elements and adapters for StreamPipes Connect
Language: Java - Size: 49.1 MB - Last synced at: 5 days ago - Pushed at: over 2 years ago - Stars: 26 - Forks: 19
amient/affinity
Library and a Framework for building fast, scalable, fault-tolerant Data APIs based on Akka, Avro, ZooKeeper and Kafka
Language: Scala - Size: 4.96 MB - Last synced at: 11 months ago - Pushed at: over 4 years ago - Stars: 26 - Forks: 4
mathsaey/skitter
A Domain Specific Language for Distributed, Reactive Workflows
Language: Elixir - Size: 1.8 MB - Last synced at: about 4 hours ago - Pushed at: 27 days ago - Stars: 25 - Forks: 3
liflab/beepbeep-3
An event stream processor anyone can use
Language: Java - Size: 41 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 25 - Forks: 16
GigahexHQ/jetprobe
🚀 Validation DSL for data pipelines
Language: Scala - Size: 1.23 MB - Last synced at: almost 2 years ago - Pushed at: almost 7 years ago - Stars: 25 - Forks: 3
thriving-dev/kafka-streams-cassandra-state-store
'Drop-in' Kafka Streams State Store implementation that persists data to Apache Cassandra / ScyllaDB
Language: Java - Size: 1.26 MB - Last synced at: 13 days ago - Pushed at: 14 days ago - Stars: 24 - Forks: 5
tealtools/awesome-apache-pulsar
A curated list of resources about Apache Pulsar.
Size: 367 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 24 - Forks: 1
PerfectlySoft/Perfect-Kafka
An Express Swift Client of Apache Kafka 0.8, the Stream Processing Platform
Language: Swift - Size: 51.8 KB - Last synced at: 15 days ago - Pushed at: about 7 years ago - Stars: 24 - Forks: 7
