Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub topics: stream-processing
infinyon/fluvio
Lean and mean distributed stream processing system written in rust and web assembly.
Language: Rust - Size: 22.9 MB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 2,284 - Forks: 166
slaff/mqtt-codec Fork of errordeveloper/mqtt-codec
Powerful MQTT stream parser and serialiser
Language: C - Size: 77.1 KB - Last synced: about 1 hour ago - Pushed: over 2 years ago - Stars: 0 - Forks: 2
google/mediapipe
Cross-platform, customizable ML solutions for live and streaming media.
Language: C++ - Size: 573 MB - Last synced: 1 day ago - Pushed: 2 days ago - Stars: 25,510 - Forks: 4,967
smooks/smooks
Extensible data integration Java framework for building XML and non-XML fragment-based applications
Language: Java - Size: 27.7 MB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 385 - Forks: 355
0x647A/pipe-my-data
I'm documenting my learning of Data Engineering here.
Language: Python - Size: 105 KB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 0 - Forks: 0
MaterializeInc/materialize
The data warehouse for operational workloads.
Language: Rust - Size: 186 MB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 5,579 - Forks: 452
v12technology/fluxtion
core fluxtion static event processor generator tool and runtime components
Language: Java - Size: 38.4 MB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 77 - Forks: 8
oxnr/awesome-bigdata
A curated list of awesome big data frameworks, ressources and other awesomeness.
Size: 964 KB - Last synced: about 3 hours ago - Pushed: 12 days ago - Stars: 12,810 - Forks: 2,532
timeplus-io/proton
A streaming SQL engine, a fast and lightweight alternative to ksqlDB and Apache Flink, 🚀 powered by ClickHouse.
Language: C++ - Size: 458 MB - Last synced: 1 day ago - Pushed: 3 days ago - Stars: 1,289 - Forks: 45
MaxHalford/tuna
:fish: A streaming ETL for fish
Language: Go - Size: 75.2 KB - Last synced: about 7 hours ago - Pushed: over 5 years ago - Stars: 13 - Forks: 1
GridProtectionAlliance/gsf
Grid Solutions Framework
Language: C# - Size: 246 MB - Last synced: about 8 hours ago - Pushed: 8 days ago - Stars: 160 - Forks: 68
benthosdev/benthos
Fancy stream processing made operationally mundane
Language: Go - Size: 28.4 MB - Last synced: about 9 hours ago - Pushed: 1 day ago - Stars: 7,600 - Forks: 735
anovv/volga
Feature Engine for real-time AI/ML
Language: Python - Size: 197 KB - Last synced: about 15 hours ago - Pushed: about 16 hours ago - Stars: 32 - Forks: 3
spring-cloud/spring-cloud-stream
Framework for building Event-Driven Microservices
Language: Java - Size: 17 MB - Last synced: about 20 hours ago - Pushed: about 21 hours ago - Stars: 961 - Forks: 594
quixio/quix-streams
Quix Streams - A library for data streaming and Python Stream Processing
Language: Python - Size: 4.79 MB - Last synced: about 14 hours ago - Pushed: about 18 hours ago - Stars: 596 - Forks: 25
creek-service/creek-kafka
Creek Kafka support
Language: Java - Size: 2.23 MB - Last synced: about 21 hours ago - Pushed: about 21 hours ago - Stars: 4 - Forks: 0
AxisCommunications/media-stream-library-js
JavaScript library to handle media streams on the command line (Node.js) and in the browser.
Language: TypeScript - Size: 871 MB - Last synced: about 22 hours ago - Pushed: about 23 hours ago - Stars: 284 - Forks: 101
bytewax/bytewax
Python Stream Processing
Language: Python - Size: 10.1 MB - Last synced: about 22 hours ago - Pushed: about 23 hours ago - Stars: 1,151 - Forks: 52
getsentry/arroyo
A library to build streaming applications that consume from and produce to Kafka.
Language: Python - Size: 1.31 MB - Last synced: about 24 hours ago - Pushed: 1 day ago - Stars: 36 - Forks: 6
EventStore/EventStoreDB-Client-Java
Official Asynchronous Java 8+ Client Library for EventStoreDB 20.6+
Language: Java - Size: 5.48 MB - Last synced: 1 day ago - Pushed: 2 days ago - Stars: 59 - Forks: 19
apache/streampipes
Apache StreamPipes - A self-service (Industrial) IoT toolbox to enable non-technical users to connect, analyze and explore IoT data streams.
Language: Java - Size: 307 MB - Last synced: about 19 hours ago - Pushed: about 20 hours ago - Stars: 543 - Forks: 168
gretelai/gretel-python-client
The Gretel Python Client allows you to interact with the Gretel REST API.
Language: Python - Size: 30.2 MB - Last synced: about 15 hours ago - Pushed: 1 day ago - Stars: 43 - Forks: 18
online-ml/river
🌊 Online machine learning in Python
Language: Python - Size: 276 MB - Last synced: about 7 hours ago - Pushed: 2 days ago - Stars: 4,777 - Forks: 528
PeerDB-io/peerdb
Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
Language: Go - Size: 10.3 MB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 1,632 - Forks: 49
apache/hudi
Upserts, Deletes And Incremental Processing on Big Data.
Language: Java - Size: 1.1 GB - Last synced: 3 days ago - Pushed: 3 days ago - Stars: 5,077 - Forks: 2,345
meroxa/turbine-go
Turbine Library for Go
Language: Go - Size: 6.29 MB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 16 - Forks: 3
risingwavelabs/risingwave
SQL stream processing, analytics, and management. PostgreSQL simplicity, unrivaled performance, and seamless elasticity. 🚀 10x more productive. 🚀 10x more cost-efficient.
Language: Rust - Size: 187 MB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 6,320 - Forks: 513
RedisGears/RedisGears
Dynamic execution framework for your Redis data
Language: Rust - Size: 4.72 MB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 354 - Forks: 62
pipeless-ai/pipeless
An open-source computer vision framework to build and deploy apps in minutes
Language: Rust - Size: 142 MB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 648 - Forks: 31
halaxa/json-machine
Efficient, easy-to-use, and fast PHP JSON stream parser
Language: PHP - Size: 1.45 MB - Last synced: 1 day ago - Pushed: 4 days ago - Stars: 1,018 - Forks: 62
ThreeDotsLabs/watermill
Building event-driven applications the easy way in Go.
Language: Go - Size: 4.32 MB - Last synced: 1 day ago - Pushed: 3 days ago - Stars: 6,762 - Forks: 354
bakdata/kpops
Deploy Kafka pipelines to Kubernetes
Language: Python - Size: 7.64 MB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 12 - Forks: 1
fluent/fluent-bit
Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows
Language: C - Size: 88.1 MB - Last synced: 4 days ago - Pushed: 4 days ago - Stars: 5,345 - Forks: 1,460
Nastel/tnt4j-streams-syslogd
TNt4J Streams for handling Syslog messages
Language: Java - Size: 636 KB - Last synced: 1 day ago - Pushed: 1 day ago - Stars: 0 - Forks: 0
Correia-jpv/fucking-awesome-bigdata
A curated list of awesome big data frameworks, resources and other awesomeness. With repository stars⭐ and forks🍴
Size: 674 KB - Last synced: about 6 hours ago - Pushed: 1 day ago - Stars: 4 - Forks: 1
reugn/go-streams
A lightweight stream processing library for Go
Language: Go - Size: 379 KB - Last synced: 1 day ago - Pushed: 12 days ago - Stars: 1,754 - Forks: 144
whitaker-io/machine
Machine is a workflow/pipeline library for processing data
Language: Go - Size: 1.39 MB - Last synced: 1 day ago - Pushed: 2 days ago - Stars: 142 - Forks: 13
Nastel/JESL
jKool Event Streaming Library -- telemetry collection, simulation and streaming to jKool enabled servers, jKool Cloud.
Language: Java - Size: 1.07 MB - Last synced: 7 days ago - Pushed: 8 days ago - Stars: 4 - Forks: 0
alif-munim/learning-flink
Playing around with Apache Flink, and its built-in Apache Kafka and Elasticsearch connectors.
Language: Java - Size: 124 KB - Last synced: 2 days ago - Pushed: about 3 years ago - Stars: 0 - Forks: 0
DataFog/datafog-python
DevSecOps for PII
Language: Python - Size: 8.01 MB - Last synced: 2 days ago - Pushed: 2 days ago - Stars: 5 - Forks: 1
madd86/awesome-system-design
A curated list of awesome System Design (A.K.A. Distributed Systems) resources.
Size: 1.71 MB - Last synced: 2 days ago - Pushed: about 1 month ago - Stars: 8,309 - Forks: 781
IRC-SPHERE/HyperStreamOnlineLearning
Plugins for Online Learning (supervised or unsupervised) in HyperStream
Language: Python - Size: 110 KB - Last synced: 2 days ago - Pushed: over 6 years ago - Stars: 3 - Forks: 1
IRC-SPHERE/HyperStream
HyperStream
Language: Python - Size: 20.1 MB - Last synced: 2 days ago - Pushed: 23 days ago - Stars: 13 - Forks: 5
mkuthan/stream-processing
Learn how to develop and test stateful streaming and batch data pipelines
Language: Scala - Size: 25 MB - Last synced: 2 days ago - Pushed: 2 days ago - Stars: 6 - Forks: 2
decodableco/examples
This repository will contain examples of use cases that utilize Decodable streaming solution
Language: Makefile - Size: 13.5 MB - Last synced: 2 days ago - Pushed: 2 days ago - Stars: 39 - Forks: 20
streamnative/function-mesh
The serverless framework purpose-built for event streaming applications.
Language: Go - Size: 27.8 MB - Last synced: 2 days ago - Pushed: 2 days ago - Stars: 208 - Forks: 27
Nastel/tnt4j-streams
TNT4J Streams allows data streaming, parsing from various data sources into TNT4J event sinks
Language: Java - Size: 49.3 MB - Last synced: 1 day ago - Pushed: 2 days ago - Stars: 5 - Forks: 5
DSIN-INSA-Strasbourg/Hermes
Change Data Capture (CDC) tool from any source(s) to any target
Language: Python - Size: 396 KB - Last synced: 2 days ago - Pushed: 2 days ago - Stars: 1 - Forks: 0
GridProtectionAlliance/openPDC
Open Source Phasor Data Concentrator
Language: C# - Size: 2.21 GB - Last synced: about 8 hours ago - Pushed: 8 days ago - Stars: 125 - Forks: 59
airtai/faststream
FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.
Language: Python - Size: 157 MB - Last synced: 4 days ago - Pushed: 4 days ago - Stars: 1,796 - Forks: 78
Harish-Srinivas-07/Saec-Spotbus
SAEC Spotbus, a Flutter app, enhances transportation at S.A Engineering College. Utilizing Google Maps API and Firebase, it offers real-time tracking, route info, and notifications. With user separation and security measures, it ensures smooth communication between students and drivers, revolutionizing campus commuting.
Language: Dart - Size: 4.85 MB - Last synced: 3 days ago - Pushed: 3 days ago - Stars: 0 - Forks: 0
Nastel/TNT4J
Track and Trace 4 Java API, Application event streaming and logging framework for correlation, diagnostics and tracking of application activities.
Language: Java - Size: 5.07 MB - Last synced: 7 days ago - Pushed: 8 days ago - Stars: 45 - Forks: 14
javascriptdata/danfojs
Danfo.js is an open source, JavaScript library providing high performance, intuitive, and easy to use data structures for manipulating and processing structured data.
Language: TypeScript - Size: 80.1 MB - Last synced: 3 days ago - Pushed: 19 days ago - Stars: 4,651 - Forks: 205
manuzhang/awesome-streaming
a curated list of awesome streaming frameworks, applications, etc
Size: 2.67 MB - Last synced: 1 day ago - Pushed: 2 months ago - Stars: 2,561 - Forks: 286
tradewelltech/beavers
Python stream processing for analytics
Language: Python - Size: 275 KB - Last synced: 2 days ago - Pushed: 3 days ago - Stars: 19 - Forks: 1
leesf/hudi-resources
汇总Apache Hudi相关资料
Size: 23.8 MB - Last synced: 3 days ago - Pushed: 3 days ago - Stars: 518 - Forks: 155
devnw/stream
stream is a concurrency pattern implementation using Go generics. a.k.a. my accidentally awesome library
Language: Go - Size: 273 KB - Last synced: about 16 hours ago - Pushed: about 17 hours ago - Stars: 64 - Forks: 3
confluentinc/ksql
The database purpose-built for stream processing applications.
Language: Java - Size: 175 MB - Last synced: 6 days ago - Pushed: 6 days ago - Stars: 5,815 - Forks: 1,031
ParaGroup/WindFlow
A C++17 Data Stream Processing Parallel Library for Multicores and GPUs
Language: C++ - Size: 47 MB - Last synced: 3 days ago - Pushed: 23 days ago - Stars: 64 - Forks: 16
broneq/sql-stream-queue
SQL stream queue implementation- inspired on redis
Size: 20.5 KB - Last synced: 5 days ago - Pushed: about 5 years ago - Stars: 0 - Forks: 0
zakariamaaraki/RemoteCodeCompiler
An online code compiler supporting 11 programming languages (Java, Kotlin, Scala, C, C++, C#, Golang, Python, Ruby, Rust and Haskell) for competitive programming and coding interviews.
Language: Java - Size: 3.32 MB - Last synced: 5 days ago - Pushed: 5 days ago - Stars: 131 - Forks: 47
systemaccounting/mxfactorial
a payment application intended for deployment by the united states treasury that replaces banking with accounting
Language: Rust - Size: 6.43 MB - Last synced: 6 days ago - Pushed: 6 days ago - Stars: 43 - Forks: 27
OCHA-DAP/hdx-python-utilities
A range of helpful utilities for Python developers including streaming tabular data, date parsing, JSON and YAML handling, dictionary and list utilities
Language: Python - Size: 1.28 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 9 - Forks: 6
Banno/kafka4s
Functional programming with Kafka and Scala
Language: Scala - Size: 3.09 MB - Last synced: 6 days ago - Pushed: 6 days ago - Stars: 87 - Forks: 17
Hapag-Lloyd/fluent-bit-multiline
Fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows.
Language: Dockerfile - Size: 77.1 KB - Last synced: 6 days ago - Pushed: 6 days ago - Stars: 2 - Forks: 0
uhop/stream-fork
Fork a writable stream into several parallel writable streams.
Language: JavaScript - Size: 36.1 KB - Last synced: 2 days ago - Pushed: over 3 years ago - Stars: 11 - Forks: 2
benthosdev/benthos-captain
A Kubernetes Operator to orchestrate Benthos pipelines
Language: Go - Size: 665 KB - Last synced: 2 days ago - Pushed: 7 days ago - Stars: 36 - Forks: 5
FutureSDR/FutureSDR
An Async SDR Runtime for Heterogeneous Architectures
Language: Rust - Size: 25.1 MB - Last synced: 6 days ago - Pushed: about 1 month ago - Stars: 262 - Forks: 46
n0-computer/quic-rpc
A streaming rpc system based on quic
Language: Rust - Size: 569 KB - Last synced: 7 days ago - Pushed: 7 days ago - Stars: 76 - Forks: 10
ktamashun/Callisto
PHP library for the Twitter Streaming API
Language: PHP - Size: 104 KB - Last synced: 7 days ago - Pushed: about 7 years ago - Stars: 2 - Forks: 0
kmonsoor/netdata-kapacitor-tickscripts
Kapacitor TICKscripts for using on streams coming from netdata monitoring systems
Size: 1.95 KB - Last synced: 7 days ago - Pushed: over 6 years ago - Stars: 0 - Forks: 0
pbernet/akka_streams_tutorial
A collection of runnable and self-contained examples inspired by various akka-streams (pekko-streams) and Alpakka (Pekko connectors) docs, tutorials and blogs
Language: Scala - Size: 66.3 MB - Last synced: 8 days ago - Pushed: 8 days ago - Stars: 29 - Forks: 11
miztiik/azure-event-hub-streams
Event Streaming with Azure Event Hub
Language: Bicep - Size: 1.01 MB - Last synced: 8 days ago - Pushed: 11 months ago - Stars: 0 - Forks: 0
aartikis/RTEC
RTEC is an Event Calculus implementation optimised for stream reasoning
Language: Prolog - Size: 13 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 78 - Forks: 15
dynatrace-oss/hash4j
Dynatrace hash library for Java
Language: Java - Size: 40.4 MB - Last synced: 23 days ago - Pushed: 23 days ago - Stars: 73 - Forks: 9
clj-commons/manifold
A compatibility layer for event-driven abstractions
Language: Clojure - Size: 1.55 MB - Last synced: about 21 hours ago - Pushed: about 2 months ago - Stars: 1,008 - Forks: 106
gazette/core
Build platforms that flexibly mix SQL, batch, and stream processing paradigms
Language: Go - Size: 64.2 MB - Last synced: 9 days ago - Pushed: 9 days ago - Stars: 516 - Forks: 50
hstreamdb/hstream
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
Language: Haskell - Size: 6.11 MB - Last synced: 12 days ago - Pushed: 13 days ago - Stars: 691 - Forks: 56
newetty/appuno
This repositories provides a project layout for a Streamlit app.
Language: HTML - Size: 6.27 MB - Last synced: 10 days ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0
TawfikYasser/Keyed-Watermarks-in-Apache-Flink
Keyed Watermarks in Apache Flink
Language: Java - Size: 358 KB - Last synced: 10 days ago - Pushed: 10 days ago - Stars: 1 - Forks: 1
thriving-dev/kafka-streams-cassandra-state-store
'Drop-in' Kafka Streams State Store implementation that persists data to Apache Cassandra / ScyllaDB
Language: Java - Size: 1.09 MB - Last synced: 4 days ago - Pushed: 4 days ago - Stars: 20 - Forks: 4
pandening/storm-ml
an online learning algorithm library for Storm
Language: Java - Size: 3.75 MB - Last synced: 11 days ago - Pushed: over 1 year ago - Stars: 18 - Forks: 7
codefeedr/codefeedr
CodeFeedr core infrastructure
Language: Scala - Size: 7.79 MB - Last synced: 11 days ago - Pushed: over 3 years ago - Stars: 10 - Forks: 6
runreveal/kawa
A blazingly fast event stream processing library powering the reveald event processing daemon.
Language: Go - Size: 940 KB - Last synced: 7 days ago - Pushed: 12 days ago - Stars: 81 - Forks: 2
cedrickchee/twit
A simple Twitter client
Language: TypeScript - Size: 64.5 KB - Last synced: 12 days ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0
cedrickchee/nodejs-in-depth
Master and understand deeper Node.js fundamentals and internals
Language: JavaScript - Size: 18.6 KB - Last synced: 12 days ago - Pushed: over 3 years ago - Stars: 3 - Forks: 0
mathsaey/skitter
A Domain Specific Language for Distributed, Reactive Workflows
Language: Elixir - Size: 1.64 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 16 - Forks: 1
hazelcast/hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
Language: Java - Size: 384 MB - Last synced: 14 days ago - Pushed: 14 days ago - Stars: 5,859 - Forks: 1,792
numaproj/numaflow
Kubernetes-native platform to run massively parallel data/streaming jobs
Language: Go - Size: 27.5 MB - Last synced: 14 days ago - Pushed: 14 days ago - Stars: 913 - Forks: 88
dagronf/DSFValueStream
Generate a stream of values over time
Language: Swift - Size: 9.77 KB - Last synced: 13 days ago - Pushed: about 3 years ago - Stars: 1 - Forks: 0
benman1/pipes
minimal workflow engine for data processing (POC)
Language: C++ - Size: 33.2 KB - Last synced: 14 days ago - Pushed: about 5 years ago - Stars: 0 - Forks: 0
neo4j-contrib/neo4j-streams
Neo4j Kafka Connector
Language: Kotlin - Size: 3.55 MB - Last synced: 17 days ago - Pushed: 19 days ago - Stars: 167 - Forks: 67
TouK/nussknacker
Low-code tool for automating actions on real time data | Stream processing for the users.
Language: Scala - Size: 139 MB - Last synced: 15 days ago - Pushed: 15 days ago - Stars: 599 - Forks: 89
TU-Berlin-DIMA/scotty-window-processor
This repository provides Scotty, a framework for efficient window aggregations for out-of-order Stream Processing.
Language: Java - Size: 553 KB - Last synced: 15 days ago - Pushed: 8 months ago - Stars: 75 - Forks: 23
relvaner/nodes4j-core
Framework for parallel processing based on Actor4j. Useful for data analysis.
Language: Java - Size: 279 KB - Last synced: 15 days ago - Pushed: 5 months ago - Stars: 4 - Forks: 3
ymtszw/elm-broker
Data stream buffer for Elm application, inspired by Apache Kafka
Language: Elm - Size: 72.3 KB - Last synced: 15 days ago - Pushed: over 5 years ago - Stars: 0 - Forks: 0
PureSolTechnologies/streaming
Library for streaming extensions.
Language: Java - Size: 527 KB - Last synced: 15 days ago - Pushed: over 4 years ago - Stars: 0 - Forks: 1
turu/yalal
Yet Another Lame Algorithm Library
Language: Python - Size: 50.8 KB - Last synced: 15 days ago - Pushed: almost 2 years ago - Stars: 2 - Forks: 0
glassflow/glassflow-python-sdk
GlassFlow Python SDK to publish and consume data to your pipelines at Glassflow.dev
Language: Python - Size: 4.35 MB - Last synced: 16 days ago - Pushed: 16 days ago - Stars: 7 - Forks: 0
mp911de/redis-stream-demo
Demo for Redis Streams
Language: Java - Size: 159 KB - Last synced: 16 days ago - Pushed: almost 4 years ago - Stars: 33 - Forks: 13
