Topic: "stream-processing"
maki-nage/distogram
A library to compute histograms on distributed environments, on streaming data
Language: Python - Size: 3.1 MB - Last synced at: 12 days ago - Pushed at: about 2 months ago - Stars: 23 - Forks: 1
asavinov/machine-learning-and-data-processing
A collection of resources on machine learning, data processing and related areas
Size: 48.8 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 23 - Forks: 7
ranjanrak/clickhouse-tickstore
Go package to store real time streaming websocket data in clickhouse using queuing and bulk insert.
Language: Go - Size: 23.4 KB - Last synced at: 19 days ago - Pushed at: about 2 years ago - Stars: 23 - Forks: 9
tmcgrath/kafka-streams
Oh you know, just a coupla, two, tree Kafka Streams in Scala
Language: Scala - Size: 27.3 KB - Last synced at: over 1 year ago - Pushed at: about 4 years ago - Stars: 23 - Forks: 14
O2-Czech-Republic/proxima-platform
The Proxima platform.
Language: Java - Size: 9.3 MB - Last synced at: about 12 hours ago - Pushed at: about 13 hours ago - Stars: 21 - Forks: 7
saidsef/aws-kinesis-local
Build for local AWS Kinesis
Language: Dockerfile - Size: 118 KB - Last synced at: 13 days ago - Pushed at: 18 days ago - Stars: 21 - Forks: 4
hazelcast/hazelcast-jet-contrib
Extension modules for Hazelcast Jet
Language: Java - Size: 13.5 MB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 21 - Forks: 25
heyoka/faxe
Language: Erlang - Size: 2.66 MB - Last synced at: about 15 hours ago - Pushed at: about 15 hours ago - Stars: 20 - Forks: 1
swimos/ripple
Simple shared surface streaming application
Language: TypeScript - Size: 147 KB - Last synced at: 17 days ago - Pushed at: over 1 year ago - Stars: 20 - Forks: 5
AdaptiveMachineLearning/artml
ARTML- Real time learning
Language: Jupyter Notebook - Size: 2.41 MB - Last synced at: 6 months ago - Pushed at: over 5 years ago - Stars: 20 - Forks: 14
GetFeedback/kahpp-oss
Kafka Streams made easy with a YAML file
Language: Java - Size: 3.58 MB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 19 - Forks: 2
AutomataLab/JPStream
JPStream: JSONPath Stream Processing in Parallel
Language: C - Size: 479 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 19 - Forks: 5
IBMStreams/administration
Umbrella project for the IBMStreams organization. This project will be used for the management of the individual projects within the IBMStreams organization.
Size: 31.3 KB - Last synced at: about 1 month ago - Pushed at: over 4 years ago - Stars: 19 - Forks: 10
nextorigin/godot2 Fork of nodejitsu/godot
A streaming real-time event processor based on Riemann written in Node.js -- Streams2/3 edition
Language: CoffeeScript - Size: 491 KB - Last synced at: 7 days ago - Pushed at: over 8 years ago - Stars: 19 - Forks: 0
traj-explorer/glink
This repo is deprecated, Please refer to https://github.com/glink-incubator/glink
Language: Java - Size: 10.6 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 18 - Forks: 11
pandening/storm-ml
an online learning algorithm library for Storm
Language: Java - Size: 3.75 MB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 18 - Forks: 7
Svti/streamer
streamer 实时计算引擎
Language: JavaScript - Size: 1.71 MB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 18 - Forks: 8
StarPlatinumStudio/Flink-SQL-Practice
Flink SQL 实战 -中文博客专栏
Language: Java - Size: 80.9 MB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 18 - Forks: 5
kotarot/sawatabi
Sawatabi is an application framework to develop and run stream-data-oriented Ising applications with quantum annealing.
Language: Python - Size: 11.2 MB - Last synced at: 2 days ago - Pushed at: almost 4 years ago - Stars: 18 - Forks: 7
djjonno/kerala
Distributed KV Streams
Language: Kotlin - Size: 884 KB - Last synced at: about 1 month ago - Pushed at: over 4 years ago - Stars: 18 - Forks: 1
confluentinc/learn-kafka-courses
Learn the basics of Apache Kafka® from leaders in the Kafka community with these video courses covering the Kafka ecosystem and hands-on exercises.
Language: Shell - Size: 41 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 17 - Forks: 77
aksakalli/EsperIoT
Small and simple stream-based CEP tool for IoT devices connected to an MQTT broker
Language: Java - Size: 108 KB - Last synced at: 21 days ago - Pushed at: 8 months ago - Stars: 17 - Forks: 5
calebzulawski/rivulet
Asynchronous pipelines of contiguous data, for rust.
Language: Rust - Size: 3.99 MB - Last synced at: about 22 hours ago - Pushed at: over 1 year ago - Stars: 17 - Forks: 1
badtuple/remits
Remote Iterator Server
Language: Rust - Size: 171 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 17 - Forks: 2
spy16/fusion
💥 Fusion is a tiny stream processing library written in Go.
Language: Go - Size: 139 KB - Last synced at: 18 days ago - Pushed at: over 4 years ago - Stars: 17 - Forks: 1
catenae/catenae-kafka
Catenae 2 – Microservices Framework for Kafka
Language: Python - Size: 592 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 17 - Forks: 2
Jayvardhan-Reddy/Azure-Certification-DP-201
Road to Azure Data Engineer Part-II: DP-201 - Designing an Azure Data Solution
Size: 3.59 MB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 17 - Forks: 15
konimarti/flow
Create simple flows based on user-defined filters (data stream processing).
Language: Go - Size: 90.8 KB - Last synced at: 7 days ago - Pushed at: almost 6 years ago - Stars: 17 - Forks: 1
snuspl/pluto
MIST: High-performance IoT Stream Processing
Language: Java - Size: 2.85 MB - Last synced at: 12 months ago - Pushed at: about 6 years ago - Stars: 17 - Forks: 3
Point72/csp-gateway
Streaming application framework built on csp
Language: Python - Size: 7.88 MB - Last synced at: 2 days ago - Pushed at: 8 days ago - Stars: 16 - Forks: 2
pbotros/river
A high-throughput, structured streaming framework built atop Redis Streams. C++, Python, and MATLAB support.
Language: C++ - Size: 4.86 MB - Last synced at: 24 days ago - Pushed at: over 1 year ago - Stars: 16 - Forks: 3
Axual/ksml
Kafka Streams for Low Code Environments
Language: Java - Size: 1.08 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 16 - Forks: 9
nanelimon-organization/twitter_hashtag_following
This job is used to collect live tweets from the specified Twitter hashtag and saves the data in a specified model.
Language: Python - Size: 126 KB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 16 - Forks: 1
dmitriz/tiny-cps 📦
Tiny goodies for Continuation-Passing-Style functions (OLDER VERSION), use instead the NEWER `cpsfy`
Language: JavaScript - Size: 561 KB - Last synced at: 5 days ago - Pushed at: about 5 years ago - Stars: 16 - Forks: 0
duanebester/akka-ws-test
Realtime feedback of Akka Stream processing via WebSockets
Language: Scala - Size: 6.84 KB - Last synced at: about 1 year ago - Pushed at: over 5 years ago - Stars: 16 - Forks: 2
simplygreatwork/godsend
A simple and eloquent workflow for streaming messages to micro-services.
Language: JavaScript - Size: 634 KB - Last synced at: 8 days ago - Pushed at: almost 8 years ago - Stars: 16 - Forks: 1
nextorigin/godot2-dash Fork of riemann/riemann-dash
An HTTP dashboard for Godot2.
Language: JavaScript - Size: 1.09 MB - Last synced at: 7 days ago - Pushed at: over 8 years ago - Stars: 16 - Forks: 1
marcelmittelstaedt/BigData
Lecture: Big Data
Language: HTML - Size: 588 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 15 - Forks: 12
meroxa/turbine-go
Turbine Library for Go
Language: Go - Size: 6.28 MB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 15 - Forks: 3
llxxbb/Nature
Nature is a development support platform, it separates data definition from code, so it decouple the data from business system.
Language: Rust - Size: 31.7 MB - Last synced at: 28 days ago - Pushed at: 10 months ago - Stars: 15 - Forks: 5
KumKeeHyun/gstream
Kafka Streams DSL inspired, Stream processing library abstracting pipelines pattern using generic.
Language: Go - Size: 179 KB - Last synced at: 21 days ago - Pushed at: over 2 years ago - Stars: 15 - Forks: 1
angelhof/flumina
A parallel programming model for online applications with complex synchronization requirements.
Language: Erlang - Size: 2.63 MB - Last synced at: 22 days ago - Pushed at: almost 3 years ago - Stars: 15 - Forks: 1
robhowley/s3-streaming
stream and (de)serialize s3 streams
Language: Python - Size: 11.7 KB - Last synced at: 14 days ago - Pushed at: about 3 years ago - Stars: 15 - Forks: 5
TomDoesTech/with-streaming-with-next.js
Language: TypeScript - Size: 43.9 KB - Last synced at: 17 days ago - Pushed at: about 3 years ago - Stars: 15 - Forks: 7
IBMStreams/tutorials
A project for developing tutorials for Streams
Language: Jupyter Notebook - Size: 37.7 MB - Last synced at: 16 days ago - Pushed at: over 4 years ago - Stars: 15 - Forks: 22
chartbeat-labs/ottla
An opinionated clojure framework for writing kafka machines
Language: Clojure - Size: 45.9 KB - Last synced at: 12 days ago - Pushed at: about 5 years ago - Stars: 15 - Forks: 0
qntfy/frizzle
The magic message bus
Language: Go - Size: 34.2 KB - Last synced at: 10 months ago - Pushed at: about 6 years ago - Stars: 15 - Forks: 4
bakdata/kpops
Deploy Kafka pipelines to Kubernetes
Language: Python - Size: 15.6 MB - Last synced at: 6 days ago - Pushed at: 14 days ago - Stars: 14 - Forks: 2
rixed/ramen
A stream processing language and compiler for small-scale monitoring
Language: OCaml - Size: 22.4 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 14 - Forks: 4
innogames/flink-real-time-crm
Demo Flink and Kafka project to show how to react on tracking events in real-time and trigger offer for customer engagement based on campaign configurations. The project also utilizes the Broadcast State Pattern in order to update the rules (campaigns) at runtime without restarting the project, using a dedicated, low-frequency, Kafka topic.
Language: Java - Size: 1.22 MB - Last synced at: 3 days ago - Pushed at: 5 months ago - Stars: 14 - Forks: 2
confluentinc/kafka-tutorials
Tutorials and Recipes for Apache Kafka
Language: Java - Size: 21.1 MB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 14 - Forks: 89
usedatabrew/blink
OpenSource data platform to build event-driven systems. It's like Deebezium for golang :)
Language: Go - Size: 7.15 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 14 - Forks: 1
hpi-epic/ESPBench
ESPBench - The Enterprise Stream Processing Benchmark
Language: Scala - Size: 1.18 MB - Last synced at: 23 days ago - Pushed at: over 1 year ago - Stars: 14 - Forks: 2
IBMStreams/streamsx.kafka
Repository for integration with Apache Kafka
Language: Java - Size: 42.2 MB - Last synced at: 16 days ago - Pushed at: almost 3 years ago - Stars: 14 - Forks: 9
streamthoughts/demo-twitter-ksqldb-clickhouse
Demonstration Project : Fast Data Analytic platform with Clickhouse, Apache Kafka and ksqlDB
Language: Java - Size: 9.77 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 14 - Forks: 11
daniyall/pyPiper
Pipelining framework for python. Designed for data analysis but can be useful to other applications
Language: Python - Size: 68.4 KB - Last synced at: 12 days ago - Pushed at: about 6 years ago - Stars: 14 - Forks: 0
InsightDataScience/kafka-streams-examples
Language: Scala - Size: 11.1 MB - Last synced at: over 1 year ago - Pushed at: almost 8 years ago - Stars: 14 - Forks: 6
kalmyk/fox-wamp
Web Application Message Async Server and WAMP/MQTT bridge
Language: JavaScript - Size: 1 MB - Last synced at: 4 days ago - Pushed at: 25 days ago - Stars: 13 - Forks: 6
ParaGroup/StreamBenchmarks
Suite of Benchmark Applications for Stream Processing Systems
Language: C++ - Size: 44.2 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 13 - Forks: 4
criblpacks/cribl-palo-alto-networks
Process, reduce, and transform Palo Alto Networks Firewall logs.
Language: Python - Size: 117 KB - Last synced at: 8 months ago - Pushed at: 8 months ago - Stars: 13 - Forks: 7
TU-Berlin-DIMA/Condor
Condor allows for the specification of synopsis-based streaming jobs on top of general dataflow systems. Condor provides a collection of twelve synopses and an integration to Apache Flink.
Language: Java - Size: 134 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 13 - Forks: 2
IRC-SPHERE/HyperStream
HyperStream
Language: Python - Size: 20.1 MB - Last synced at: 9 days ago - Pushed at: about 1 year ago - Stars: 13 - Forks: 5
maki-nage/rxsci
ReactiveX for data science
Language: Python - Size: 373 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 13 - Forks: 2
IshaanAdarsh/MedStream-Analytics
The project leverages Apache Flink, Apache Kafka and Python digital Twin to provide real-time insights into healthcare data, enabling timely interventions and proactive patient care.
Language: Jupyter Notebook - Size: 76.8 MB - Last synced at: 15 days ago - Pushed at: over 1 year ago - Stars: 13 - Forks: 4
qntfy/frafka
Frizzle for Apache Kafka
Language: Go - Size: 53.7 KB - Last synced at: 10 months ago - Pushed at: over 4 years ago - Stars: 13 - Forks: 4
MaxHalford/tuna
:fish: A streaming ETL for fish
Language: Go - Size: 75.2 KB - Last synced at: 25 days ago - Pushed at: about 6 years ago - Stars: 13 - Forks: 1
abhirockzz/kafka-streams-interactive-queries
Interactive Queries in Kafka Streams
Language: Java - Size: 13.7 KB - Last synced at: 15 days ago - Pushed at: over 6 years ago - Stars: 13 - Forks: 7
calvinlfer/Akka-Streams-custom-stream-processing-examples
Demos of how to do custom stream processing using the Akka Streams GraphStages API
Language: Scala - Size: 21.5 KB - Last synced at: 4 days ago - Pushed at: about 8 years ago - Stars: 13 - Forks: 4
decodableco/dbt-decodable
A dbt adapter for Decodable
Language: Python - Size: 229 KB - Last synced at: 4 days ago - Pushed at: 2 months ago - Stars: 12 - Forks: 4
billyrrr/onto
Idealistic and yet usable framework for event-driven backend
Language: Python - Size: 1.01 MB - Last synced at: 13 days ago - Pushed at: over 2 years ago - Stars: 12 - Forks: 1
muoncore/newton
Extend Muon into the world of Spring. Implement Muon apis, especially around events to provide DDD patterns natively in Spring Boot
Language: Java - Size: 478 KB - Last synced at: about 1 year ago - Pushed at: over 6 years ago - Stars: 12 - Forks: 5
preritj/show_attend_tell
Caption generator for live camera feed
Language: Python - Size: 3.8 MB - Last synced at: almost 2 years ago - Pushed at: over 7 years ago - Stars: 12 - Forks: 2
GMAP/SPBench
SPBench: A Framework for Benchmarking Stream Processing Applications
Language: C++ - Size: 3.61 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 11 - Forks: 3
confluentinc/flink-table-api-python-examples
Python Examples for running Apache Flink® Table API on Confluent Cloud
Language: Python - Size: 44.9 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 11 - Forks: 4
lRomul/rosny
Lightweight library for building concurrent systems
Language: Python - Size: 426 KB - Last synced at: 2 days ago - Pushed at: about 1 year ago - Stars: 11 - Forks: 2
beamline/framework
The Beamline streaming process mining framework
Language: Java - Size: 1.18 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 3
samaysar/dotdotnet 📦
C#.NET based DevFast NuGet package
Language: C# - Size: 3.98 MB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 11 - Forks: 2
MoimHossain/event-sourcing
An implementation of Event Sourcing and CQRS based on Azure table storage (EventStore) and Document DB (Materialized Views)
Language: C# - Size: 55.7 KB - Last synced at: 10 days ago - Pushed at: about 2 years ago - Stars: 11 - Forks: 1
minhtran241/gRPC-introduction
Implementation of gRPC with Go
Language: Go - Size: 2.96 MB - Last synced at: 15 days ago - Pushed at: over 2 years ago - Stars: 11 - Forks: 0
pdaodao/hello-flink
apache flink learning
Language: Java - Size: 64.5 KB - Last synced at: 9 months ago - Pushed at: almost 3 years ago - Stars: 11 - Forks: 4
mikeroyal/Apache-Ignite-Guide
Apache Ignite Guide
Size: 162 KB - Last synced at: 25 days ago - Pushed at: over 3 years ago - Stars: 11 - Forks: 4
caiomsouza/microsoft-big-data-scientist-and-ai
Microsoft Big Data, Data Scientist, and AI
Size: 9.46 MB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 11 - Forks: 3
uhop/stream-fork
Fork a writable stream into several parallel writable streams.
Language: JavaScript - Size: 36.1 KB - Last synced at: 1 day ago - Pushed at: over 4 years ago - Stars: 11 - Forks: 2
dalvangriebler/SPar
SPar is an internal DSL for high-level stream parallelism
Language: C++ - Size: 18 MB - Last synced at: about 1 year ago - Pushed at: over 4 years ago - Stars: 11 - Forks: 1
yennanliu/spark-etl-pipeline
Various data stream/batch process demo with Apache Scala Spark 🚀
Language: Scala - Size: 5.06 MB - Last synced at: about 1 year ago - Pushed at: about 5 years ago - Stars: 11 - Forks: 8
monasca/monasca-aggregator
Near real-time continuous aggregation of Monasca metrics
Language: Go - Size: 115 KB - Last synced at: 5 months ago - Pushed at: about 6 years ago - Stars: 11 - Forks: 8
CannonFodderr/audiosystem
Multi-room audio control / Monitor with WebRTC, Web Audio API, Node, React, MongoDB & Electron
Language: JavaScript - Size: 29.5 MB - Last synced at: about 2 years ago - Pushed at: about 6 years ago - Stars: 11 - Forks: 0
vectorhacker/goro
Go client library for EventStore.
Language: Go - Size: 9 MB - Last synced at: 10 months ago - Pushed at: about 6 years ago - Stars: 11 - Forks: 2
biggis-project/biggis-landuse 📦
Land use update detection
Language: JavaScript - Size: 545 KB - Last synced at: about 1 year ago - Pushed at: over 6 years ago - Stars: 11 - Forks: 3
hpgrahsl/wearedevs-2018
Code for my talk "Stateful & Reactive Streaming Applications Without a Database" at WeAreDevelopers 2018
Language: Java - Size: 1.4 MB - Last synced at: 21 days ago - Pushed at: almost 7 years ago - Stars: 11 - Forks: 1
seanpquig/confluent-platform-spark-streaming
Working example of consuming Avro data from Kafka with Spark Streaming
Language: Scala - Size: 13.7 KB - Last synced at: over 1 year ago - Pushed at: about 9 years ago - Stars: 11 - Forks: 9
padogrid/padogrid
A comprehensive addon tool for managing data grid environments by distributed workspaces and online use case bundles
Language: Shell - Size: 14 MB - Last synced at: 9 days ago - Pushed at: 10 days ago - Stars: 10 - Forks: 1
Correia-jpv/fucking-awesome-bigdata
A curated list of awesome big data frameworks, resources and other awesomeness. With repository stars⭐ and forks🍴
Size: 678 KB - Last synced at: 15 days ago - Pushed at: 15 days ago - Stars: 10 - Forks: 1
OCHA-DAP/hdx-python-utilities
A range of helpful utilities for Python developers including streaming tabular data, date parsing, JSON and YAML handling, dictionary and list utilities
Language: Python - Size: 1.42 MB - Last synced at: 13 days ago - Pushed at: about 1 month ago - Stars: 10 - Forks: 6
sostc/deva
函数流，数据流，同步异步，事件驱动，多种模式channel
Language: Python - Size: 10.1 MB - Last synced at: 26 days ago - Pushed at: 3 months ago - Stars: 10 - Forks: 4
naughtygopher/nibbler
A package for micro batch processing
Language: Go - Size: 32.2 KB - Last synced at: 25 days ago - Pushed at: 5 months ago - Stars: 10 - Forks: 0
hazelcast-demos/evergreen-cache
Language: Java - Size: 66.4 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 10 - Forks: 5
lsst-sqre/kafka-aggregator
A Kafka aggregator based on the Faust Python Stream Processing library
Language: Python - Size: 790 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 10 - Forks: 1
criblpacks/cribl-windows-events
This pack is targeted for collections of Window events in the Classic or newer XML format. For events in the Classic format, sometimes the Message field contains XML.
Size: 706 KB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 10 - Forks: 2
prakashdontaraju/google-cloud-ecommerce
ecommerce GCP Streaming pipeline ― Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipeline ― Cloud Storage, Dataproc, PySpark, Cloud Spanner and Tableau
Language: Python - Size: 4.38 MB - Last synced at: 9 months ago - Pushed at: about 3 years ago - Stars: 10 - Forks: 3
