GoogleCloudPlatform/dataflow-opinion-analysis

Opinion Analysis of News, Threaded Conversations, and User Generated Content

Language: Java - Size: 100 MB - Last synced at: 8 days ago - Pushed at: 7 months ago - Stars: 102 - Forks: 25

tosun-si/asgarde

Asgarde allows simplifying error handling with Apache Beam Java, with less code, more concise and expressive code.

Language: Java - Size: 159 KB - Last synced at: 3 months ago - Pushed at: 9 months ago - Stars: 74 - Forks: 5

mercari/DataflowTemplate

Mercari Dataflow Template

Language: Java - Size: 3.21 MB - Last synced at: 4 days ago - Pushed at: 6 days ago - Stars: 72 - Forks: 22

ostelco/ostelco-core

Cloud-native Telco BSS hosted in GCP K8s with standalone Diameter to gRPC gateway. Rule Engine using Neo4j graphs. Analytics Events sent to GCP BigData (Dataflow+BigQuery) via PubSub. It's awesome!

Language: Kotlin - Size: 25.8 MB - Last synced at: about 1 year ago - Pushed at: almost 4 years ago - Stars: 36 - Forks: 13

tosun-si/pasgarde

Asgarde allows simplifying error handling with Apache Beam Python, with less code, more concise and expressive code.

Language: Python - Size: 61.5 KB - Last synced at: about 1 month ago - Pushed at: almost 3 years ago - Stars: 31 - Forks: 1

hayatoy/dataflow-tutorial

Cloud Dataflow Tutorial for Beginners

Language: Python - Size: 14.6 KB - Last synced at: 10 days ago - Pushed at: about 3 years ago - Stars: 25 - Forks: 9

datastacktv/apache-beam-batch-processing

Public source code for the Batch Processing with Apache Beam (Python) online course

Language: Python - Size: 81.1 KB - Last synced at: 9 days ago - Pushed at: over 4 years ago - Stars: 18 - Forks: 9

GoogleCloudPlatform/dataflow-pubsub-dedup

Language: Java - Size: 67.4 KB - Last synced at: 8 days ago - Pushed at: 7 months ago - Stars: 16 - Forks: 10

tosun-si/midgard

Midgard is a wrapper on Beam Kotlin, allowing more concise and expressive code. It removes Beam boilerplate code and proposes more Functional Programming style

Language: Kotlin - Size: 97.7 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 16 - Forks: 1

dongma/springcloud-dataflow

build streaming apps on spring cloud dataflow platform

Language: Java - Size: 3.03 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 2

viveknaskar/cloud-dataflow-with-memorystore

Cloud Dataflow pipeline that reads the file from Cloud Storage and processes and outputs in the memory store.

Language: Java - Size: 26.4 KB - Last synced at: 14 days ago - Pushed at: over 1 year ago - Stars: 4 - Forks: 1

zdenulo/upload-data-datastore-dataflow

Language: Python - Size: 3.91 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 4 - Forks: 8

goatcheesesaladwithpeanutoildressing/hashtagsbattle 📦

IIM-DEVOPS - (demo) Real-time Twitter's hashtags analytics... fully managed by Google Cloud

Language: Python - Size: 827 KB - Last synced at: 2 days ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 0

viveknaskar/google-dataflow-redis-example Fork of arun-james/dataflow-example

Cloud dataflow pipeline code that processes data from a cloud storage bucket, transforms it and stores in Google's highly scalable, reduced latency in-memory database, memorystore which is an implementation of Redis.

Language: Java - Size: 80.1 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

tosun-si/dataflow-java-ci-cd

Project showing a CI CD pipeline for Dataflow Java with Flex Template and Cloud Build

Language: Java - Size: 3.31 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 0

goatcheesesaladwithpeanutoildressing/meetuplytics 📦

Realtime Meetup "Répondez, s'il vous plaît" (RSVPs) analytics built upon Apache-Beam - Streaming Processing

Language: Python - Size: 16.8 MB - Last synced at: 2 days ago - Pushed at: almost 5 years ago - Stars: 2 - Forks: 0

sanketrs/implementation-of-modern-data-engineering-architecture-with-fabric_analytics

Building a next-generation hybrid data pipeline architecture that combines the power of Microsoft Fabric, Azure Cloud, and Power BI. This pipeline is engineered to tackle the challenges of real-time data ingestion, multi-layered processing, and analytics, delivering business-critical insights.

Language: Python - Size: 32.2 KB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

esakik/data-engineering-essentials

Samples related to data engineering, e.g. spark, embulk, airflow, etc.

Language: Python - Size: 413 KB - Last synced at: 21 days ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 1

maximoleinyk/pubsub-filter

GKE Replacement for PubSub-to-PubSub Cloud Dataflows in GCP

Language: TypeScript - Size: 409 KB - Last synced at: 2 months ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

viveknaskar/cloud-dataflow-template-poc

Creating Cloud Dataflow template using Java for counting a number of words from a document.

Language: Java - Size: 74.2 KB - Last synced at: 2 months ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 1

seahrh/fraud-detection-dataflow

Working example of a real-time inference pipeline on GCP Cloud Dataflow

Language: Python - Size: 111 KB - Last synced at: about 1 month ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 1

saiteja09/CloudDataFlow-ETL-OnPremise-JDBC

ETL OnPremises Data to Google BigQuery using Google Cloud Data Flow via JDBC driver

Language: Java - Size: 21.5 KB - Last synced at: about 2 years ago - Pushed at: almost 6 years ago - Stars: 1 - Forks: 2

imrenagi/beam-bank-trx-analytics

Experiment in using windowing and trigger for more accurate streaming analytics with Apache Beam

Language: Java - Size: 14.6 KB - Last synced at: 12 months ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 0