Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub / tosun-si 8 repositories
Co founder & head of data at GroupBees | Tech lead | data (JVM, Python) | GCP lover & certified | Craftsman | Devops | FP lover | Creator of Asgarde
tosun-si/bigtesty
BigTesty is a framework that allows to create Integration Tests with BigQuery on a real and short lived Infrastructure.
Language: Python - Size: 14.9 MB - Last synced: 6 days ago - Pushed: 6 days ago - Stars: 6 - Forks: 0
tosun-si/airflow-composer-error-handling
This project shows how to apply error handling in Airflow DAGs and Cloud Composer in Google Cloud. Instead of repeat a technical code of error handling in each DAG, the principle is to use a callback and a failure interceptor.
Language: Python - Size: 7.19 MB - Last synced: 29 days ago - Pushed: about 1 month ago - Stars: 1 - Forks: 0
tosun-si/bigtesty-example
This project shows examples to launch BigQuery integration tests with the BigTesty framework
Size: 5.18 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 0 - Forks: 0
tosun-si/world-cup-qatar-team-stats-kotlin-midgard
This application shows a full Apache Beam pipeline with Kotlin and Midgard library. The use case works on the last Qatar FIFA world cup data and calculate players statistics per team. This application will be presented at Beam Summit 2023 in New York
Language: Kotlin - Size: 846 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 3 - Forks: 1
tosun-si/midgard
Midgard is a wrapper on Beam Kotlin, allowing more concise and expressive code. It removes Beam boilerplate code and proposes more Functional Programming style
Language: Kotlin - Size: 85.9 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 16 - Forks: 1
tosun-si/asgarde
Asgarde allows simplifying error handling with Apache Beam Java, with less code, more concise and expressive code.
Language: Java - Size: 146 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 72 - Forks: 4
tosun-si/world-cup-qatar-event-driven-serverless-archi-workflows
Project showing a use case with a full Event Driven and Serverless Architecture with Cloud Functions, Cloud Run services and Cloud Workflows
Language: Python - Size: 14.8 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 1 - Forks: 0
tosun-si/dataflow-java-ci-cd
Project showing a CI CD pipeline for Dataflow Java with Flex Template and Cloud Build
Language: Java - Size: 3.31 MB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 2 - Forks: 0
tosun-si/dataflow-python-ci-cd
Project showing a CI CD pipeline for Dataflow Python with Flex Template and Cloud Build
Language: Python - Size: 671 KB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 2 - Forks: 0
tosun-si/pasgarde
Asgarde allows simplifying error handling with Apache Beam Python, with less code, more concise and expressive code.
Language: Python - Size: 61.5 KB - Last synced: 22 days ago - Pushed: almost 2 years ago - Stars: 27 - Forks: 1
tosun-si/teams-league-cloudrun-rust
This project shows a complete Rust program with a real world use case, deployed in Cloud Run
Language: Rust - Size: 58.6 KB - Last synced: 4 months ago - Pushed: 4 months ago - Stars: 0 - Forks: 2
tosun-si/teams-league-cloud-workflows-elt
This project shows a real world use case with ELT pipeline using Cloud Storage, BigQuery and Cloud Workflows
Language: HCL - Size: 9.22 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 5 - Forks: 1
tosun-si/fp-rust
This repo contains Functional Programming codes conception with Rust
Language: Rust - Size: 24.4 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 0 - Forks: 0
tosun-si/teams-league-cloud-workflows-etl-dataflow
This project shows a real world use case with ETL pipeline using Cloud Storage, Dataflow, BigQuery and Cloud Workflows
Language: HCL - Size: 5.69 MB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 1 - Forks: 1
tosun-si/teams-league-java-dlq-asgarde-beam-summit
Project presented at Beam Summit 2022 that shows a complete use case with a Dead Letter Queue on errors with Beam Java and Asgarde library.
Language: Java - Size: 74.2 KB - Last synced: 2 months ago - Pushed: 2 months ago - Stars: 1 - Forks: 0
tosun-si/datasets-tables-bq-pulumi
This project shows how to create BigQuery Datasets with tables using Pulumi and elegant/scalable Json configuration. This use cas was previously created with Terraform and the goal is to rewrite it with Pulumi and the Python SDK.
Language: Python - Size: 3.53 MB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 0 - Forks: 0
tosun-si/world-cup-qatar-event-driven-serverless-archi
This project show a complete and real world use case with Event Driven and Serverless architecture on Google Cloud
Language: Python - Size: 7.33 MB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0
tosun-si/sa-custom-roles-gcp-terraform
This project shows a complete use case with the least privilege principle on Google Cloud using modular Terraform, Terragrunt and Cloud Build
Language: HCL - Size: 1.05 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 2 - Forks: 0
tosun-si/teams-league-spark-scala-dataproc-serverless
This project shows a complete, concrete and a real world use case with a Spark Scala job run with Dataproc Serverless on Google Cloud.
Language: Scala - Size: 1.78 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0
tosun-si/teams-league-airflow-spark-scala-etl
This project shows a real world use case with ETL batch pipeline using Cloud Storage, Scala Spark with Dataproc Serverless and BigQuery orchestrated by Cloud Composer / Airflow
Language: Scala - Size: 2.37 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0
tosun-si/teams-league-airflow-elt
The goal of this article is showing a real world use case for ELT batch pipeline, with Cloud Storage, BigQuery, Apache Airflow and Cloud Composer : The Extract part is managed in Cloud Storage The Load part is managed from Cloud Storage to BigQuery The Transform part is managed by a BigQuery SQL query Everything is orchestrated by Airflow
Language: Python - Size: 311 KB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 0 - Forks: 0
tosun-si/datasets-tables-bq-one-module-terraform
This project how to create BigQuery Datasets and tables with Terraform and elegant Json configuration. This example use a single Terraform module to create datasets and tables. The deployment of IAC part is done with Cloud Build.
Language: HCL - Size: 1.14 MB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 0 - Forks: 0
tosun-si/teams-league-airflow-dataflow-etl
This project shows a real world use case with ETL batch pipeline using Cloud Storage, Dataflow and BigQuery orchestrated by Cloud Composer / Airflow
Language: Python - Size: 1.18 MB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 0 - Forks: 0
tosun-si/teams-league-airflow-cloudrun-etl
This project shows a real world use case with ETL batch pipeline using Cloud Storage, Cloud Run Service and BigQuery orchestrated by Cloud Composer / Airflow
Language: Python - Size: 2.12 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0
tosun-si/datasets-tables-workspace-terraform
Project showing the use of Terraform Workspaces with a complete use case on Google Cloud. Workspaces allow to isolate an infra with its own state on the same GCP project. For example, it can be interesting to have a workspace per developer for testing purpose and allowing each of them to test its infra in an isolated environment.
Language: HCL - Size: 1.24 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0
tosun-si/world-cup-qatar-team-stats-java
This application shows a full Apache Beam pipeline with Java. The use case works on the last Qatar FIFA world cup data and calculate players statistics per team. This application will be presented at Beam Summit 2023 in New York. A Kotlin version of this use case is also used in another repo.
Language: Java - Size: 820 KB - Last synced: 12 months ago - Pushed: 12 months ago - Stars: 0 - Forks: 0
tosun-si/datasets-tables-bq-multi-modules-terraform
This project how to create BigQuery Datasets and tables with Terraform and elegant Json configuration. This example use two Terraform modules to create datasets and tables. The deployment of IAC part is done with Cloud Build.
Language: HCL - Size: 1.35 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0
tosun-si/teams-league-cloudrun-service-fastapi
Project showing a complete use case with a Cloud Run Service written with a Python module and multiple files. The deployment of service is done with FastApi and Uvicorn.
Language: Python - Size: 2.68 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 1
tosun-si/event-arc-trigger-function
This project shows a complete use case with an event driven Cloud Function written in Python and triggered with Event Arc
Language: HCL - Size: 441 KB - Last synced: 10 months ago - Pushed: 10 months ago - Stars: 0 - Forks: 0
tosun-si/teams-league-kotlin-dlq-asgarde-beam-summit
Project presented at Beam Summit 2022 that shows a complete use case with a Dead Letter Queue on errors with Beam Kotlin and Asgarde library.
Language: Kotlin - Size: 41 KB - Last synced: 6 months ago - Pushed: 6 months ago - Stars: 0 - Forks: 0
tosun-si/bees-demo-fp
This project shows some legacy code and patterns and a refactoring for each of them with Functional Programming, lambda and functions composition
Language: Java - Size: 56.6 KB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 0 - Forks: 0
tosun-si/developers-conferences-agenda Fork of scraly/developers-conferences-agenda
This repository list a maximum of tech conferences's date and CFP in order to help conferences organizers, speakers & attendees
Language: JavaScript - Size: 5.85 MB - Last synced: about 1 year ago - Pushed: about 1 year ago - Stars: 0 - Forks: 0
tosun-si/teams-league-java-ddd-beam-summit
Language: Java - Size: 31.3 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 1 - Forks: 1
tosun-si/tosun-si
TOSUN SI repository
Language: Java - Size: 389 KB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 1 - Forks: 1
tosun-si/teams-league-python-ddd-beam-summit
Language: Python - Size: 45.9 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 4 - Forks: 1
tosun-si/teams-league-airflow-beam-bq
Language: Python - Size: 212 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0
tosun-si/teams-league-python-dlq-asgarde-beam-summit
Language: Python - Size: 53.7 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 2 - Forks: 0
tosun-si/teams-league-python-dlq-native-beam-summit
Language: Python - Size: 44.9 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0
tosun-si/teams-league-java-dlq-native-beam-summit
Language: Java - Size: 45.9 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0
tosun-si/tp-teams-handling
Language: TypeScript - Size: 208 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 1 - Forks: 1
tosun-si/xebia-mowitnow
Language: Java - Size: 78.1 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0
tosun-si/syomi
Language: Scala - Size: 177 KB - Last synced: about 1 year ago - Pushed: over 4 years ago - Stars: 1 - Forks: 0
tosun-si/spark-poc
Language: Scala - Size: 11.2 MB - Last synced: about 1 year ago - Pushed: almost 5 years ago - Stars: 0 - Forks: 0
tosun-si/fizz-buzz-refacto-java
Language: Java - Size: 17.6 KB - Last synced: about 1 year ago - Pushed: about 5 years ago - Stars: 0 - Forks: 0
tosun-si/tutorials Fork of eugenp/tutorials
The "REST With Spring" Course:
Language: Java - Size: 104 MB - Last synced: about 1 year ago - Pushed: almost 6 years ago - Stars: 0 - Forks: 0
tosun-si/kotlin-test
Language: Kotlin - Size: 1.95 KB - Last synced: about 1 year ago - Pushed: over 6 years ago - Stars: 0 - Forks: 0
tosun-si/hacklab-rxjava
Language: Java - Size: 24.4 KB - Last synced: about 1 year ago - Pushed: almost 7 years ago - Stars: 0 - Forks: 0
tosun-si/java8-example
Language: Java - Size: 117 KB - Last synced: about 1 year ago - Pushed: about 7 years ago - Stars: 1 - Forks: 0
tosun-si/tosun-si.github.io Fork of HubPress/hubpress.io
A web application to build your blog on GitHub
Language: CSS - Size: 20.4 MB - Last synced: about 1 year ago - Pushed: over 6 years ago - Stars: 0 - Forks: 0