flink-stream-processing | Topic | Ecosyste.ms: Repos

Topic: "flink-stream-processing"

czy006/FlinkClub

这是我自己的Flink中文社区翻译稿存储仓库，用于提供给需要朋友进行二次创作。同时提供Flink一些课外的相关知识文档供大家学习

Size: 40.7 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 367 - Forks: 142

streamnative/pulsar-flink 📦

Elastic data processing with Apache Pulsar and Apache Flink

Language: Java - Size: 2.16 MB - Last synced at: 24 days ago - Pushed at: over 2 years ago - Stars: 279 - Forks: 120

godaai/flink-book-zh

Flink Tutorial Project

Language: Java - Size: 21.6 MB - Last synced at: 2 months ago - Pushed at: 11 months ago - Stars: 200 - Forks: 66

getindata/flink-http-connector

Http Connector for Apache Flink. Provides sources and sinks for Datastream , Table and SQL APIs.

Language: Java - Size: 684 KB - Last synced at: 14 days ago - Pushed at: 15 days ago - Stars: 181 - Forks: 48

Kryptonite for Kafka is a client-side 🔒 field level 🔓 cryptography library for Apache Kafka® offering a Kafka Connect SMT, ksqlDB UDFs, Flink UDFs, and a standalone HTTP API service. It's an ! UNOFFICIAL ! community project

Language: Java - Size: 272 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 85 - Forks: 7

TU-Berlin-DIMA/scotty-window-processor

This repository provides Scotty, a framework for efficient window aggregations for out-of-order Stream Processing.

Language: Java - Size: 553 KB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 75 - Forks: 23

decodableco/examples

🌟 Examples of use cases that utilize Decodable, as well as demos for related open-source projects such as Apache Flink, Debezium, and Postgres.

Language: Java - Size: 19.9 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 71 - Forks: 34

aws-samples/amazon-managed-service-for-apache-flink-examples

Collection of code examples for Amazon Managed Service for Apache Flink

Language: Java - Size: 16.8 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 57 - Forks: 36

mikeroyal/Apache-Flink-Guide

Apache Flink Guide

Size: 171 KB - Last synced at: about 2 months ago - Pushed at: over 3 years ago - Stars: 57 - Forks: 8

microsoft/flink-on-azure

Examples of Flink on Azure

Language: Java - Size: 921 KB - Last synced at: 3 days ago - Pushed at: over 1 year ago - Stars: 53 - Forks: 8

mickey0524/flink-streaming-source-analysis

flink 流处理源码分析

Language: Java - Size: 4.58 MB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 49 - Forks: 18

zlzhang0122/flink-in-action

基于Flink的批流处理实战案例

Language: Java - Size: 8.02 MB - Last synced at: over 2 years ago - Pushed at: almost 3 years ago - Stars: 35 - Forks: 15

Anant/Cassandra.Realtime

Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink

Language: Scala - Size: 575 MB - Last synced at: 26 days ago - Pushed at: almost 3 years ago - Stars: 31 - Forks: 24

cjermain/flink-onnx-pytorch

Streaming machine learning using PyTorch, Flink, and ONNX

Language: Scala - Size: 33.2 KB - Last synced at: about 1 month ago - Pushed at: about 4 years ago - Stars: 25 - Forks: 10

sergio11/traffic_sentinel_architecture

🚀 Traffic Sentinel: A scalable IoT system using Fog nodes and Apache Flink to process 📷 IP camera streams, powered by YOLO for intelligent 🚗 traffic monitoring on highways. 🛣️

Language: Python - Size: 74.1 MB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 23 - Forks: 3

hey-johnnypark/apache-flink-jdbc-streaming

Sample project for Apache Flink with Streaming Engine and JDBC Sink

Language: Java - Size: 5.86 KB - Last synced at: about 1 year ago - Pushed at: about 8 years ago - Stars: 22 - Forks: 5

aws-samples/amazon-kinesis-data-analytics-flink-benchmarking-utility

Amazon Managed Service for Apache Flink Benchmarking Utility helps with capacity planning, integration testing, and benchmarking of Amazon Managed Service for Apache Flink applications.

Language: Java - Size: 281 KB - Last synced at: 3 days ago - Pushed at: almost 2 years ago - Stars: 20 - Forks: 4

BrooksIan/Flink2Kafka

A Flink applcation that demonstrates reading and writing to/from Apache Kafka with Apache Flink

Language: Java - Size: 2.98 MB - Last synced at: 2 months ago - Pushed at: almost 2 years ago - Stars: 20 - Forks: 7

aws-samples/amazon-kinesis-data-analytics-blueprints 📦

Kinesis Data Analytics Blueprints are a curated collection of Apache Flink applications. Each blueprint will walk you through how to solve a practical problem related to stream processing using Apache Flink. These blueprints can be leveraged to create more complex applications to solve your business challenges in Apache Flink.

Language: TypeScript - Size: 73.6 MB - Last synced at: 3 days ago - Pushed at: almost 2 years ago - Stars: 17 - Forks: 7

AhmetFurkanDEMIR/Flink-Example

Flink Example

Language: Scala - Size: 5.6 MB - Last synced at: about 2 months ago - Pushed at: over 1 year ago - Stars: 15 - Forks: 0

innogames/flink-real-time-crm

Demo Flink and Kafka project to show how to react on tracking events in real-time and trigger offer for customer engagement based on campaign configurations. The project also utilizes the Broadcast State Pattern in order to update the rules (campaigns) at runtime without restarting the project, using a dedicated, low-frequency, Kafka topic.

Language: Java - Size: 1.22 MB - Last synced at: about 3 hours ago - Pushed at: 7 months ago - Stars: 14 - Forks: 2

aws-samples/dynamic-rules-engine

The Dynamic Rules Engine is a serverless application that enables real-time evaluation of rules against sensor data, leveraging AWS Kinesis Data Streams, Amazon Managed Service for Apache Flink, and AWS Lambda.

Language: Java - Size: 109 KB - Last synced at: 3 days ago - Pushed at: 8 months ago - Stars: 11 - Forks: 2

ev2900/Flink_Kinesis_Data_Analytics

Apache Flink examples designed to be run by AWS Kinesis Data Analytics (KDA).

Language: Python - Size: 17.3 MB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 10 - Forks: 11

riferrei/is-using-kop-a-good-idea

Is using KoP (Kafka-On-Pulsar) a good idea? Use the scenarios implemented in this repository to check whether Pulsar with KoP enabled is a good fit for your most common Kafka workloads.

Language: Java - Size: 898 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 10 - Forks: 2

galgus/flink-connector-http

Flink HTTP Sink Connector

Language: Java - Size: 10.7 KB - Last synced at: over 1 year ago - Pushed at: about 4 years ago - Stars: 10 - Forks: 9

aws-samples/amazon-managed-service-for-apache-flink-taxi-consumer

Sample Apache Flink application that can be deployed to Amazon Managed Service for Apache Flink. It reads taxi events from a Kinesis data stream, processes and aggregates them, and ingests the result to an Amazon OpenSearch Service cluster for visualization with Dashboard.

Language: Java - Size: 47.9 KB - Last synced at: 3 days ago - Pushed at: 5 months ago - Stars: 8 - Forks: 4

tj---/iceberg-demo

A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino

Language: Java - Size: 13.7 KB - Last synced at: almost 2 years ago - Pushed at: about 3 years ago - Stars: 8 - Forks: 3

Amir2244/movies-rating

"movies-rating" is a recommendation system project that leverages distributed frameworks. Which includes services such as Hadoop Namenode, Hadoop Datanode, Spark Master, Spark Worker, and Redis.

Language: Java - Size: 443 KB - Last synced at: about 3 hours ago - Pushed at: about 3 hours ago - Stars: 7 - Forks: 0

eBay/flink-kudu-streaming-connector

A flink source connector to provide the continuous, incremental and streaming events from Kudu tables

Language: Java - Size: 1.11 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 7 - Forks: 5

Adsizzlerlabs/mangolaa-streams-processing-flink

Stream processing for the Mangolaa platform using Apache Kafka, Apache Flink, Java 8 and Lombok

Language: Java - Size: 55.7 KB - Last synced at: over 2 years ago - Pushed at: about 7 years ago - Stars: 7 - Forks: 3

mikeroyal/Apache-Beam-Guide

Apache Beam Guide

Size: 170 KB - Last synced at: 2 months ago - Pushed at: over 3 years ago - Stars: 6 - Forks: 3

fediazgon/flink-vehicle-telematics

Stream processing of simulated on-vehicle sensors data

Language: Java - Size: 1.2 MB - Last synced at: almost 2 years ago - Pushed at: almost 6 years ago - Stars: 6 - Forks: 2

thomas-chauvet/predict-xgboost-flink

Use xgboost model to score data on Flink's datastream

Language: Scala - Size: 84 KB - Last synced at: over 1 year ago - Pushed at: about 6 years ago - Stars: 6 - Forks: 2

j3-signalroom/apache_flink-kickstarter

Examples of Apache Flink® applications showcasing the DataStream API, Table API in Java and Python, and Flink SQL, featuring AWS, GitHub, Terraform, Streamlit, and Apache Iceberg.

Language: Java - Size: 33.4 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 5 - Forks: 0

crate/cratedb-flink-jobs

This repository accompanies the article "Build a data ingestion pipeline using Kafka, Flink, and CrateDB" and the "CrateDB Community Day #2".

Language: Java - Size: 8.48 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 5 - Forks: 3

arkady-emelyanov/toy-data-platform

Toy data platform for a company that provides web analytics

Language: HCL - Size: 485 KB - Last synced at: 2 months ago - Pushed at: about 4 years ago - Stars: 5 - Forks: 0

ankushs92/apache-flink-aggregations-clickstreams

Count clicks in an unbounded clickstream over a Time window using Apache Flink's DataStream API

Language: Java - Size: 27.3 KB - Last synced at: over 2 years ago - Pushed at: about 7 years ago - Stars: 5 - Forks: 4

ehabqadah/Spark_Streaming_vs_Flink

A Comparative Evaluation of Spark and Flink Stream Processing.

Language: Java - Size: 16.2 MB - Last synced at: almost 2 years ago - Pushed at: over 7 years ago - Stars: 5 - Forks: 1

e3oroush/flink-tutorial

A simple introduction to Apache/Flink CEP. Working with time window aggregation and simple match expression.

Language: Java - Size: 16.6 KB - Last synced at: 3 months ago - Pushed at: almost 6 years ago - Stars: 4 - Forks: 0

yuhexiong/kafka-data-pipeline-structured-flink-java

Data pipeline from Kafka to Kafka, Doris and Doris to Kafka using Flink Java.

Language: Java - Size: 76.2 KB - Last synced at: about 2 months ago - Pushed at: 6 months ago - Stars: 3 - Forks: 0

crs4/Jeenk

Jeenk: scalable genomics tools, powered by Apache Flink

Language: Scala - Size: 489 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 2

zBrainiac/StreamAnalytics

Language: Java - Size: 2.94 MB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 2

MetaArivu/Kinesis-Quickstart

AWS Kinesis: Data Streams | Data Firehose | Data Analytics

Language: Java - Size: 40.9 MB - Last synced at: over 2 years ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 3

wuzguo/hadoop-study

hadoop study project

Language: Scala - Size: 28.4 MB - Last synced at: over 2 years ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 0

marlesson/simple_weblog_analysis_flink

Simple example for access count in Apache logs using Apache Flink

Language: Python - Size: 28.3 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 3 - Forks: 2

innogames/flink-real-time-crm-ui

Demo UI for the flink-real-time-crm project using Spring Boot with Thymeleaf. The Demo UI is able to send messages to and consume from the related Kafka topics.

Language: Java - Size: 1.7 MB - Last synced at: about 3 hours ago - Pushed at: 7 months ago - Stars: 2 - Forks: 0

appuv/KafkaTemperatureAnalyticsFlink

This repository showcases a sample implementation of temperature data analysis using Apache Flink, highlighting real-time stream processing capabilities for performing analytics and generating insights from sensor data.

Language: Java - Size: 185 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 2 - Forks: 1

nkonev/flink-pipe

A [single|uber|fat] jar standalone Apache Flink connected to PostgreSQL via Ververica CDC connector. Usage Flink SQL to replicate data from PostgreSQL to Elasticsearch/something else.

Language: Kotlin - Size: 78.1 KB - Last synced at: 3 months ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0

BarriBarri20/flink-tuto

Health monitoring demo for checking glucose level of patients

Language: Java - Size: 1.08 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 1

anjijava16/ApacheFlink_Utils_Prv

Apache Flink Utils

Language: Java - Size: 2.19 MB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 2

tonvanbart/flink-mqtt

Simple Flink job with MQTT sink function

Language: Scala - Size: 39.1 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

mainakchhari/apache-flink-quickstart

Starter templates for getting started with Apache Flink ( java-based stream processing library)

Language: Java - Size: 1.95 KB - Last synced at: 7 months ago - Pushed at: almost 3 years ago - Stars: 2 - Forks: 0

raymondtay/tube

Apache Flink Data Pipelines for processing Slack data

Language: Scala - Size: 925 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 0

CristianAbrante/FlinkPredictionProject

Flink introductory project for the subject cloud computing of the EIT Digital Master's degree in Data Science and innovation at UPM

Language: Java - Size: 27.3 KB - Last synced at: about 1 year ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 0

mk-hasan/Flink-Kuberenets

Run Flink program with kubernets

Language: Java - Size: 12.7 KB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 0

mgoblin/streams

Pet project to grow Apache Flink skills

Language: Scala - Size: 102 KB - Last synced at: 3 months ago - Pushed at: about 7 years ago - Stars: 2 - Forks: 0

AhmetFurkanDEMIR/Flink-ETL-Archetype

Modern ETL Architecture Built with Flink 1.20.0 and Java 11

Language: Java - Size: 84 KB - Last synced at: 7 days ago - Pushed at: 22 days ago - Stars: 1 - Forks: 0

Nasruddin/realtime-streaming-kafka-flink-pinot-postgres-superset

Setup for realtime data streaming using Kafka, Flink, Pinot, MySQL, Postgres and Superset

Language: Python - Size: 4.67 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

gAmUssA/parkflow

Real-time parking management system with stream processing and analytics capabilities.

Language: Kotlin - Size: 558 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 1 - Forks: 1

Bigsmooth68/telecom-messages-correlation

Apache Flink job to correlate telecom signaling messages for KPI extracted from streaming solutions

Language: Python - Size: 38.1 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 1 - Forks: 0

sygnowski/flink-todo-app

Todo List as Flink statefult job. Create, Add, Remove Todo Items via REST interface and keep everithing as Flink State.

Language: Java - Size: 102 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 1

tuancamtbtx/flink-streaming-example

Source code - Deploy Flink job by k8s operator

Language: Java - Size: 86.9 KB - Last synced at: 4 months ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

montevideolabs-org/flink-kafka-real-time-pipeline

Pipeline components for real time data processing. Consists on a Flink module written on Scala.

Language: Scala - Size: 2.93 KB - Last synced at: almost 2 years ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 0

yahah100/flink_streaming_twitter

Twitter Flink Streaming data project

Language: Java - Size: 44.2 MB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 0

haxxorsid/flink-datalake-bulk-upload 📦

Bulk image streaming and upload using Flink (+ Kubernetes), Kafka, Data Lake, and SQL (Provided with React UI and Node server for Demo).

Language: Java - Size: 417 KB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 0

froblesmartin/BachFinalProject

Project to compare Apache Spark Streaming vs Apache Flink.

Language: Java - Size: 42 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 1

snigdhasambitak/flink-app-example

simple flink app and kubernetes deployment configurations

Language: Java - Size: 12.7 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0

shaunmcglinchey/serverless-streaming-analytics

WIP Serverless Streaming Analytics data pipeline composed of AWS Kinesis Data Streams, AWS Kinesis Data Analytics (Flink), AWS S3, AWS Lambda, Snowflake and Python components. Provisioned using Terraform.

Language: HCL - Size: 12.7 KB - Last synced at: 5 months ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 1

mehmetozanguven/flink_examples

Includes examples for Apache Flink

Language: Java - Size: 52.7 KB - Last synced at: about 2 years ago - Pushed at: about 5 years ago - Stars: 1 - Forks: 0

DataSystemsGroupUT/DISGD

A distributed shared-nothing variant of the incremental stochastic gradient descent algorithm

Language: Java - Size: 711 KB - Last synced at: almost 2 years ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 0

sparsecode/Streamy

Language: Scala - Size: 72.3 KB - Last synced at: about 1 year ago - Pushed at: almost 6 years ago - Stars: 1 - Forks: 0

SebastianSchmidl/FastFlinkStreams

A Flink demo project using Scala and SBT that analyzes HTTP log data from NASA.

Language: Scala - Size: 23.4 KB - Last synced at: 3 months ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 0

triviadata/streaming-playground

Language: Java - Size: 101 KB - Last synced at: almost 2 years ago - Pushed at: about 7 years ago - Stars: 1 - Forks: 0

mgoblin/streaming_examples

Language: Scala - Size: 77.1 KB - Last synced at: 3 months ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 1

Anonymous0-0paper/SWG

AutoPipe: LLM Assisted Automatic Stream Processing Pipeline Generation

Language: Python - Size: 101 KB - Last synced at: 3 days ago - Pushed at: 4 days ago - Stars: 0 - Forks: 0

TaskMASTERtap/Flink-ETL-Archetype

Modern ETL Architecture Built with Flink 1.20.0 and Java 11

Language: Java - Size: 85 KB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 0 - Forks: 0

dyrnq/cdc-doris

a poc for cdc to doris.

Language: Shell - Size: 21.5 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

tashi-2004/Apache-Flink-Spark-Data-Streaming

This project showcases a real-time data streaming pipeline using Apache Flink, Apache Spark, and Grafana. It streams data, stores it in Parquet format, and performs aggregations for insights, with seamless visualization via Grafana dashboards.

Language: Python - Size: 62.6 MB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

dyrnq/cdc-vagrant

CDC(Change Data Capture) is made up of two components, the CDD and the CDT. CDD is stand for Change Data Detection and CDT is stand for Change Data Transfer.

Language: Shell - Size: 150 KB - Last synced at: 3 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

sowrabh-m/Data_Processing_using_Spark_Flink

This project demonstrates data cleaning, processing with Apache Spark and Apache Flink, both locally and on AWS EMR.

Language: Python - Size: 1.46 MB - Last synced at: 3 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

suryadev99/stream_processing_website_click_data

Stream Processing of website click data using Kafka and monitored and visualised using Prometheus and Grafana

Language: Python - Size: 508 KB - Last synced at: 3 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

sdabhi23/kafka-data-pipeline

A streaming data pipeline uses Kafka as the backbone and Flink for data processing and transformations. Kafka Connect is used for writing the streams to S3 compatible blob stores and Redis (low latency KV store for real-time ML inference). Spark is used for the batch job to backfill the ml feature data.

Language: Python - Size: 159 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

Stefen-Taime/Real-Time-Extraction-Transformation-and-Exposure-Architecture-for-Rail-Data

we are thrilled to announce our new PoC project aimed at providing a complete real-time extraction, transformation, and exposure architecture for the new provincial transportation systems.

Language: Python - Size: 87.9 KB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

SalmaHisham/Big-Data-Exploration

This repository contains my coursework projects for the Big Data course in my Master's degree program.

Language: Jupyter Notebook - Size: 19.9 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

skalskibukowa/Project-Kafka-Flink

Project to practice Python / Kafka / Flink

Language: Shell - Size: 17.6 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

pranav-patil/aws-kinesis-analytics

AWS Kinesis Analytics gather metrics from various computers (cpu, memory), perform aggregation on Kinesis stream data using Kinesis Analytics (with flink) and store the stream data into AWS S3 bucket which is used by Amazon Athena for running various Analytics queries and rending charts using Grafana.

Language: Java - Size: 1.29 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0