GitHub topics: gcs | Ecosyste.ms: Repos

pgbackrest/pgbackrest

Reliable PostgreSQL Backup & Restore

Language: C - Size: 55.2 MB - Last synced at: about 10 hours ago - Pushed at: about 12 hours ago - Stars: 3,234 - Forks: 239

fog/fog-google

Fog for Google Cloud Platform

Language: Ruby - Size: 2.02 MB - Last synced at: about 6 hours ago - Pushed at: about 15 hours ago - Stars: 99 - Forks: 146

rilldata/rill

Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.

Language: Go - Size: 547 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 2,301 - Forks: 146

ArduPilot/MissionPlanner

Mission Planner Ground Control Station for ArduPilot (c# .net)

Language: C# - Size: 295 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 2,049 - Forks: 2,619

andrcuns/allure-report-publisher

Upload allure reports to cloud storage

Language: Ruby - Size: 8.1 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 37 - Forks: 11

hpc-gridware/testsuite

Test environment for the Open Cluster Schedule which is a drop-in replacement of AGE/UGE/SGE.

Language: Tcl - Size: 7.49 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 4 - Forks: 2

google-github-actions/upload-cloud-storage

A GitHub Action for uploading files to a Google Cloud Storage (GCS) bucket.

Language: TypeScript - Size: 9.23 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 251 - Forks: 53

Altinity/clickhouse-backup

Tool for easy backup and restore for ClickHouse® using object storage for backup files.

Language: Go - Size: 6.26 MB - Last synced at: 2 days ago - Pushed at: 3 days ago - Stars: 1,452 - Forks: 244

apache/opendal-go-services

Apache OpenDAL Go Binding Services Releases

Language: Go - Size: 711 MB - Last synced at: 2 days ago - Pushed at: 4 days ago - Stars: 14 - Forks: 2

apache/opendal

Apache OpenDAL: One Layer, All Storage.

Language: Rust - Size: 48.3 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 4,404 - Forks: 628

NARAE-INHA-UNIV/NALDA

NALDA(NARAE Aero Link & Data Analysis) GCS

Language: QML - Size: 3.28 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 6 - Forks: 4

bluerobotics/Cockpit-docs

Documentation for the Cockpit control station software

Language: JavaScript - Size: 112 MB - Last synced at: 4 days ago - Pushed at: 5 days ago - Stars: 0 - Forks: 2

rameel/ramstack.filesystem

A .NET library that provides an abstraction for virtual file systems, including built-in implementations.

Language: C# - Size: 492 KB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 6 - Forks: 0

boring-registry/boring-registry

A Simple Terraform Provider and Module Registry

Language: Go - Size: 26.9 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 216 - Forks: 40

yoshidan/google-cloud-rust

Google Cloud Client Libraries for Rust.

Language: Rust - Size: 2.39 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 294 - Forks: 125

beshoysabri/GSheet_GCP_Cal_Syncer

Python Flask service deployed on Cloud Run that syncs Google Sheets data to Google Calendar with SQLite persistence and Cloud Scheduler automation.

Language: Python - Size: 31.3 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 0 - Forks: 0

ducktors/storagebus

A storage abstraction layer for Node.js that removes any difference among multiple public cloud storage services and local filesystems

Language: TypeScript - Size: 1.18 MB - Last synced at: 9 days ago - Pushed at: 10 days ago - Stars: 13 - Forks: 3

OpenECPDS boosts the efficiency and productivity of data services by using proven and innovative technologies. It offers a portable, adaptable application for diverse environments, with a user-friendly tool for managing data acquisition, dissemination with push/pull mechanisms, and a notification system, all using standard protocols.

Language: Java - Size: 214 MB - Last synced at: 9 days ago - Pushed at: 10 days ago - Stars: 4 - Forks: 1

Othoz/gcsfs

Google Cloud Storage filesystem for PyFilesystem2

Language: Python - Size: 132 KB - Last synced at: 9 days ago - Pushed at: about 1 year ago - Stars: 43 - Forks: 18

Alex-Nettekoven/ETL-Pipeline-Retail-Data-Analytics

Retail Data Analytics | Airflow, dbt, BigQuery • Automated ETL from GCS to BigQuery and optimized transformations with dbt for faster, cleaner data.

Language: Python - Size: 7.04 MB - Last synced at: 9 days ago - Pushed at: 10 days ago - Stars: 0 - Forks: 0

uploaduncle/tp-infra

tp-infra: infraestructura de datos para Ciencia de Datos con generación sintética, pipelines ETL, Data Warehouse y Data Marts en BigQuery para analítica 🐙

Language: Jupyter Notebook - Size: 618 KB - Last synced at: 11 days ago - Pushed at: 11 days ago - Stars: 0 - Forks: 0

bluerobotics/cockpit

An intuitive and customizable cross-platform ground control station for remote vehicles of all types.

Language: Vue - Size: 578 MB - Last synced at: 8 days ago - Pushed at: 11 days ago - Stars: 119 - Forks: 36

fsouza/fake-gcs-server

Google Cloud Storage emulator & testing library.

Language: Go - Size: 3.69 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 1,217 - Forks: 241

Xxmadkillerx10/data-engineering-zoomcamp

The Data Engineering Zoomcamp covers essential skills in containerization, workflow orchestration, data warehousing, analytics engineering, batch, and streaming processing. It includes tools like Docker, Terraform, BigQuery, dbt, Spark, Kafka, Kestra, Postgres, Google Data Studio, and Metabase.

Size: 1.95 KB - Last synced at: 13 days ago - Pushed at: 13 days ago - Stars: 0 - Forks: 0

astronomer/astro-sdk 📦

Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.

Language: Python - Size: 7.54 MB - Last synced at: 6 days ago - Pushed at: 4 months ago - Stars: 375 - Forks: 50

GoogleCloudPlatform/dcm2bq

A service for creating a JSON metadata representation for DICOM from multiple input sources and storing into Google Cloud Big Query (BQ).

Language: JavaScript - Size: 546 KB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 3 - Forks: 1

flamingo-run/gcp-pilot

Language: Python - Size: 3.09 MB - Last synced at: 14 days ago - Pushed at: 14 days ago - Stars: 21 - Forks: 6

fnix/activestorage-resumable 📦

Resumable support for ActiveStorage

Language: JavaScript - Size: 390 KB - Last synced at: 8 days ago - Pushed at: 10 months ago - Stars: 30 - Forks: 1

firebolt-db/firebolt-core

Firebolt Core is a free, self-hosted edition of Firebolt's distributed query engine (https://www.firebolt.io/); it provides high-performance data warehousing capabilities that can be deployed anywhere from a single laptop to enterprise datacenters.

Language: Shell - Size: 350 KB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 172 - Forks: 6

arjunprabhulal/adk-vertex-ai-rag-engine

A RAG agent using Google's ADK & Vertex AI that lets set up semantic search across documents in under 2 minutes. Features GCS integration and natural language querying

Language: Python - Size: 93.8 MB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 35 - Forks: 18

hauntsaninja/boostedblob

Command line tool and async library to perform basic file operations on local paths, Google Cloud Storage paths and Azure Blob Storage paths.

Language: Python - Size: 610 KB - Last synced at: 4 days ago - Pushed at: 2 months ago - Stars: 34 - Forks: 26

Iriiiiii83838/chronicle-sniffer

# Chronicle-Sniffer Chronicle-Sniffer is a tool designed to capture and analyze network traffic efficiently. It integrates seamlessly with GCP, Terraform, and Docker, providing a robust solution for developers. 🐙✨

Language: HCL - Size: 5.36 MB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 1 - Forks: 0

heatxsink/x

This is my `x` repo, there are many others like it but this one is mine.

Language: Go - Size: 170 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 0 - Forks: 0

seung-lab/cloud-volume

Read and write Neuroglancer datasets programmatically.

Language: Python - Size: 65.9 MB - Last synced at: 9 days ago - Pushed at: 17 days ago - Stars: 156 - Forks: 51

tweag/credential-helper

A credential-helper framework and agent for Bazel and similar tools implementing the credential-helper spec.

Language: Go - Size: 321 KB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 24 - Forks: 5

entur/terraform-google-cloud-storage

Terraform module for GCP Storage Buckets

Language: HCL - Size: 156 KB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 0 - Forks: 0

ShubhamTiwary914/video-transcode-gcp

Video Transcode Pipeline on GCP with FFMPEG

Language: Go - Size: 115 KB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 0 - Forks: 0

supakunz/Book-Revenue-Pipeline-GCP

Deploying ETL pipeline on cloud, analyzing on BigQuery, dashboarding on Looker Studio

Language: Python - Size: 300 KB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 1 - Forks: 0

tweedegolf/image-thumbs

Rust crate for easy image thumbnail generation for object storage

Language: Rust - Size: 376 KB - Last synced at: 23 days ago - Pushed at: 23 days ago - Stars: 0 - Forks: 0

fs2-blobstore/fs2-blobstore

Minimal, idiomatic, stream-based Scala interface for key/value store implementations

Language: Scala - Size: 1.8 MB - Last synced at: 5 days ago - Pushed at: 16 days ago - Stars: 60 - Forks: 8

src-d/jgscm

Jupyter support for Google Cloud Storage

Language: Python - Size: 61.5 KB - Last synced at: 6 days ago - Pushed at: over 6 years ago - Stars: 44 - Forks: 20

data-integrations/google-cloud

A collection of Google Cloud Platform (GCP) plugins

Language: Java - Size: 11.3 MB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 48 - Forks: 89

spotify/gcs-tools

GCS support for avro-tools, parquet-tools and protobuf

Language: Scala - Size: 195 KB - Last synced at: 8 days ago - Pushed at: 4 months ago - Stars: 76 - Forks: 15

Dumiyav/QuickMedCalc

Clinical calculator and decision aid tool for medical professionals

Language: Python - Size: 8.58 MB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 0 - Forks: 0

thanos-io/objstore

Go module providing unified interface and efficient clients to work with various object storage providers until like GCS, S3, Azure, SWIFT, COS and more.

Language: Go - Size: 1.05 MB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 161 - Forks: 96

beyondstorage/go-storage

A vendor-neutral storage library for Golang: Write once, run on every storage service.

Language: Go - Size: 5.08 MB - Last synced at: 14 days ago - Pushed at: 8 months ago - Stars: 609 - Forks: 56

MarcosACH/tp-infra

Este repositorio contiene todos los archivos que componen al trabajo práctico final de la materia Infraestructura para la Ciencia de Datos de la Licenciatura en Ciencia de Datos (UNSAM).

Language: Jupyter Notebook - Size: 627 KB - Last synced at: 29 days ago - Pushed at: 29 days ago - Stars: 0 - Forks: 0

Siddha911/Citibike-data-project

Data engineering project for the DEZoomcamp 2024

Language: Python - Size: 2.28 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

CloudVLab/terraform-lab-foundation

Terraform Lab Foundation provides general building blocks for Google Cloud content authors. Samples are developed for the most common use cases when building on Google Cloud.

Language: HCL - Size: 16.2 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 17 - Forks: 21

lynnlangit/gcp-essentials

Sample code and notes for my GCP courses on LinkedIn Learning

Language: Jupyter Notebook - Size: 247 MB - Last synced at: 7 days ago - Pushed at: about 2 months ago - Stars: 254 - Forks: 178

ArduPilot/apm_planner

APM Planner Ground Control Station (Qt)

Language: C++ - Size: 257 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 536 - Forks: 476

affordablemobiles/gcs-sftp-server

SFTP Server with backing storage via Google Cloud Storage (GCS)

Language: Go - Size: 116 KB - Last synced at: 21 days ago - Pushed at: 5 months ago - Stars: 12 - Forks: 5

jpalumickas/uplo

Handle file uploads to different storage services like Amazon S3, Google Cloud or etc. It also supports different type of ORM adapters, like Prisma.

Language: TypeScript - Size: 3.75 MB - Last synced at: 4 days ago - Pushed at: 3 months ago - Stars: 13 - Forks: 2

relaycorp/object-storage-js

Node.js client for object stores like AWS S3, GCP GCS or Minio

Language: TypeScript - Size: 2.53 MB - Last synced at: 28 days ago - Pushed at: 10 months ago - Stars: 10 - Forks: 1

HBTGmbH/gcsproxy Fork of daichirata/gcsproxy

Reverse proxy for Google Cloud Storage

Language: Go - Size: 69.3 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

yassineelidrissi/uploadex

Uploadex is a provider-agnostic, production-ready file upload module for NestJS.

Language: TypeScript - Size: 1.02 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 23 - Forks: 1

digital-clouds/space

Storage Automation

Language: JavaScript - Size: 69.3 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0

hackersandslackers/bigquery-python-tutorial

:bar_chart: :snake: Create tables in Google BigQuery, auto-generate their schemas, and retrieve said schemas.

Language: Python - Size: 236 KB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 10 - Forks: 5

DanEngelbrecht/golongtail

Command line front end for longtail synchronization tool

Language: Go - Size: 266 MB - Last synced at: 22 days ago - Pushed at: 2 months ago - Stars: 34 - Forks: 10

EmbarkStudios/tame-gcs

📂 A small library with a limited set of Google Cloud Storage operations 🦀

Language: Rust - Size: 254 KB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 42 - Forks: 10

hpc-gridware/drmaa-java

Java binding for DRMAA version 1

Language: Java - Size: 138 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 4 - Forks: 0

hpc-gridware/go-clusterscheduler

Simple Go API wrapping Open Cluster Schedulers cli

Language: Go - Size: 7.83 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 4 - Forks: 0

hairyhenderson/go-fsimpl

Go io/fs.FS filesystem implementations for various URL schemes

Language: Go - Size: 1.8 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 310 - Forks: 22

hayorov/helm-gcs

Manage Helm 3 repositories on Google Cloud Storage 🔐 **privately**

Language: Go - Size: 19.2 MB - Last synced at: 24 days ago - Pushed at: 24 days ago - Stars: 284 - Forks: 64

raniellyferreira/rotate-files

Rotate files locally, in S3 (api-compatible), Google Storage or Azure Blob Storage based on custom backup rotation scheme

Language: Go - Size: 275 KB - Last synced at: 22 days ago - Pushed at: 25 days ago - Stars: 11 - Forks: 1

chartmuseum/storage

Go library providing common interface for working across multiple cloud storage backends

Language: Go - Size: 4.91 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 225 - Forks: 62

NARAE-INHA-UNIV/NALDA_video_stream

Video stream

Language: CMake - Size: 4.25 MB - Last synced at: about 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 1

tosh2230/stairlight

A data lineage tool detects table dependencies from rendered SQL statements.

Language: Python - Size: 2.53 MB - Last synced at: 6 days ago - Pushed at: 3 months ago - Stars: 30 - Forks: 0

judahpaul16/canarygc

A web-based ground control station (GCS) for remote autopilot management via the MAVLink protocol.

Language: Svelte - Size: 62.1 MB - Last synced at: 7 days ago - Pushed at: 2 months ago - Stars: 1 - Forks: 1

orisano/bctx

bctx is a tool for packing and uploading docker build context.

Language: Go - Size: 5.44 MB - Last synced at: 8 days ago - Pushed at: 2 months ago - Stars: 12 - Forks: 2

justindujardin/pathy

simple, flexible, offline capable, cloud storage with a Python path-like interface

Language: Python - Size: 784 KB - Last synced at: 2 months ago - Pushed at: 4 months ago - Stars: 174 - Forks: 22

Thanh28012010/firebolt-core

<img alt="Firebolt Core logo" src="static/core.png?raw=true" width="400" /> Firebolt Core is a free, self-hosted edition of <a href="https://www.firebolt.io/">Firebolt's high-performance distributed query engine</a>, designed to power the data infrastructure behind today's most demanding app

Language: Shell - Size: 261 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

borfergi/stock-market-data-pipeline

A fully serverless data pipeline that prepares stock market data from your selected companies using GCS, PySpark, BigQuery, Composer (Airflow), and Terraform.

Language: Python - Size: 190 KB - Last synced at: about 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

theopenlane/gcs-rsync-buildkite-plugin

a Buildkite plugin to sync files in a repo to a gcs bucket

Language: Shell - Size: 35.2 KB - Last synced at: 7 days ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

GenCr-ft/.github

GenCr@ft AI Studio .github for hosting gitPages, Studio related Readmes

Language: JavaScript - Size: 44.9 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

K2laced/Storytelling-gcp

Create and explore AI-generated stories with Los Mirlos Storytelling, a serverless app on Google Cloud. Join us in shaping narratives! 🌟📚

Language: Python - Size: 2.17 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

luigicabrera10/Storytelling-gcp

Los Mirlos Storytelling, a magical serverless backend built with Google Cloud Functions and powered by Gemini (Google's LLM)

Language: Python - Size: 2.16 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

GeraAnggaraPutra/xyz-golang-casestudy

Test Kredit Plus

Language: Go - Size: 197 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

scottwernervt/cloudstorage

Unified cloud storage API for storage services.

Language: Python - Size: 466 KB - Last synced at: 2 days ago - Pushed at: over 1 year ago - Stars: 93 - Forks: 28

cboudereau/gcs-rsync

Lightweight Google Cloud Storage sync Rust Client with better performance than gsutil rsync

Language: Rust - Size: 203 KB - Last synced at: 7 days ago - Pushed at: 3 months ago - Stars: 18 - Forks: 10

srbsnkr/ETL-pipeline-Batch-processing-with-Airflow

Settings up ETL pipeline with Cloud composure, Airflow, Google cloud run function, GCS, BigQuery

Language: Python - Size: 11.7 KB - Last synced at: about 20 hours ago - Pushed at: 4 months ago - Stars: 1 - Forks: 1

daichirata/fluent-plugin-gcs

Google Cloud Storage output plugin for Fluentd.

Language: Ruby - Size: 57.6 KB - Last synced at: 26 days ago - Pushed at: over 1 year ago - Stars: 44 - Forks: 20

danmasta/ghost-gcs-adapter

Ghost GCS Storage Adapter

Language: JavaScript - Size: 601 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 8 - Forks: 3

MansaGroup/gcs-cache-action 📦

A GitHub Action to cache your workload to a Google Cloud Storage bucket.

Language: TypeScript - Size: 2.42 MB - Last synced at: about 2 hours ago - Pushed at: over 2 years ago - Stars: 18 - Forks: 35