An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: google-dataflow

ngrunwald/datasplash

Clojure API for a more dynamic Google Dataflow

Language: Clojure - Size: 824 KB - Last synced at: 8 days ago - Pushed at: 8 days ago - Stars: 131 - Forks: 32

blockchain-etl/hedera-etl

ETL scripts for Hedera Hashgraph

Language: Java - Size: 511 KB - Last synced at: about 24 hours ago - Pushed at: 4 months ago - Stars: 12 - Forks: 3

blockchain-etl/bitcoin-etl

ETL scripts for Bitcoin, Litecoin, Dash, Zcash, Doge, Bitcoin Cash. Available in Google BigQuery https://goo.gl/oY5BCQ

Language: Python - Size: 354 KB - Last synced at: 26 days ago - Pushed at: about 2 months ago - Stars: 422 - Forks: 130

blockchain-etl/eos-etl

ETL scripts for EOS.

Language: Python - Size: 226 KB - Last synced at: 15 days ago - Pushed at: about 2 years ago - Stars: 8 - Forks: 7

Zeyroxalex/Solace

Your Personal Wellness Companion

Language: Dart - Size: 0 Bytes - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

blockchain-etl/blockchain-etl-streaming

Streaming Ethereum and Bitcoin blockchain data to Google Pub/Sub or Postgres in Kubernetes

Language: Python - Size: 64.5 KB - Last synced at: 2 days ago - Pushed at: over 3 years ago - Stars: 80 - Forks: 22

blockchain-etl/blockchain-etl-architecture

Blockchain ETL Architecture

Size: 101 KB - Last synced at: 15 days ago - Pushed at: over 2 years ago - Stars: 47 - Forks: 14

AhmdLx/Cyclistic_Bike_Share_Analysis

Business Intelligence full project , which is a component of my Google Business Intelligence Certificate.

Size: 1.24 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0

davideanastasia/apache-beam-getting-started

Getting Started with Apache Beam: inverted index

Language: Java - Size: 15.6 KB - Last synced at: about 1 year ago - Pushed at: about 7 years ago - Stars: 5 - Forks: 2

tjyu1040/google-python-playground

Playground for Google Python Libraries

Language: Python - Size: 438 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 2

gdimask/kusumo_fam_spotify

ETL pipeline using Apache Beam(Python) on Google Dataflow for our Spotify usage.

Language: Python - Size: 10.7 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

blockchain-etl/anomalous-transactions-detector-dataflow

Dataflow pipeline for detecting anomalous transactions on the Ethereum and Bitcoin blockchains

Language: Java - Size: 41 KB - Last synced at: 15 days ago - Pushed at: over 4 years ago - Stars: 5 - Forks: 1

komsitr/cis9440-nyc-rodent-issue

Analyzes NYC 311 Service Requests data to find insights from the rodent complaints with secondary data sources

Language: Python - Size: 4.44 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

yu-iskw/kuromoji-for-bigquery 📦

Tokenize Japanese text on BigQuery with Kuromoji in Apache Beam/Google Dataflow at scale

Language: Java - Size: 11 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 14 - Forks: 3

yu-iskw/bigquery-to-datastore 📦

Export a whole BigQuery table to Google Datastore with Apache Beam/Google Dataflow

Language: Java - Size: 93.8 KB - Last synced at: about 1 year ago - Pushed at: over 4 years ago - Stars: 58 - Forks: 18

SolaceProducts/solace-apache-beam

Solace connector for Apache Beam / Google Cloud Dataflow

Language: Java - Size: 3.3 MB - Last synced at: 13 days ago - Pushed at: about 1 year ago - Stars: 4 - Forks: 14

dsnair/GCP

Tutorials on Google Cloud Platform

Language: Jupyter Notebook - Size: 21.6 MB - Last synced at: 6 months ago - Pushed at: almost 7 years ago - Stars: 8 - Forks: 1

QubitProducts/metrics-flow

Metrics collection library for Google Dataflow

Language: Java - Size: 138 KB - Last synced at: about 2 months ago - Pushed at: over 6 years ago - Stars: 13 - Forks: 3

QubitProducts/mflowd

A go daemon that collects monitoring metrics from Google Dataflow workers and exposes them to Prometheus

Language: Go - Size: 29.3 KB - Last synced at: about 2 months ago - Pushed at: about 7 years ago - Stars: 5 - Forks: 1

Xennis/dataflow-demo 📦

Apache Beam (Google Dataflow) demo

Language: Python - Size: 4.88 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 0

jeremylorino/gcp-dataprep-bigquery-twitter-stream

Stream Twitter Data into BigQuery with Cloud Dataprep

Language: JavaScript - Size: 1.53 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 22 - Forks: 7

GianlucaMancusi/COVID-19-Apache-Beam-Statistics

Statistical processing of COVID-19 data using Apache Beam for Google Cloud Dataflow in Python. Project for the exam of "Sistemi ed Applicazioni Cloud" (2019-20), Magistrale di Ingegneria Informatica at the Dipartimento di Ingegneria Enzo Ferrari.

Language: Python - Size: 322 KB - Last synced at: over 2 years ago - Pushed at: about 5 years ago - Stars: 12 - Forks: 0

irchanbani/nusa

Another Dataflow Templates

Language: Java - Size: 13.7 KB - Last synced at: 5 days ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

sann3/apache-beam-input-from-s3

Read files from s3 and create pcollection from it.

Language: Java - Size: 13.7 KB - Last synced at: almost 2 years ago - Pushed at: about 3 years ago - Stars: 2 - Forks: 1

DataFabricRus/rya-beam-pipelines

Apache Beam Pipelines for Apache Rya

Language: Java - Size: 67.4 KB - Last synced at: about 1 month ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0

artempyanykh/data-zero-to-cloud

Slides and code for my talk 'Data pipelines. From zero to cloud scale'

Language: Jupyter Notebook - Size: 34.7 MB - Last synced at: 3 months ago - Pushed at: almost 7 years ago - Stars: 2 - Forks: 0

ravwojdyla/squanch

Monitor/graph JMX stats of Google Cloud Dataflow workers.

Language: Python - Size: 14.6 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0