UnitVectorY-Labs/bqpubauditsink-tofu

A module for OpenTofu that deploys bqpubauditsink to GCP Cloud Run, along with configuring essential services including the Pub/Sub subscription and BigQuery dataset and table.

Language: HCL - Size: 31.3 KB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 0 - Forks: 0

krishna-aditi/nlp-sentiment-analysis-on-stock-news-and-price-monitoring

WebApp to bring together Text Summarization and Sentiment Analysis of the stock related news to better understand the stock price trends.

Language: Jupyter Notebook - Size: 3.07 MB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 15 - Forks: 6

krishna-aditi/Sevir-Lambda-APIs

SEVIR Lambda functions for Summarization and Named-Entity Recognition. Deployed on AWS ECR.

Language: Python - Size: 2.11 MB - Last synced at: 16 days ago - Pushed at: 17 days ago - Stars: 0 - Forks: 0

ginokent/bqschema-gen-go

BigQuery table schema Go struct generator

Language: Go - Size: 70.3 KB - Last synced at: 23 days ago - Pushed at: about 1 month ago - Stars: 18 - Forks: 1

Ditectrev/Google-Cloud-Platform-GCP-Associate-Cloud-Engineer-Practice-Tests-Exams-Questions-Answers

⛳️ PASS: Google Cloud Platform (GCP) Associate Cloud Engineer (ACE) by learning based on our Questions & Answers (Q&A) Practice Tests Exams.

Size: 6.21 MB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 152 - Forks: 75

rahult18/atmo-flow

AtmoFlow is a robust data engineering pipeline built on Google Cloud Platform (GCP) that processes and analyzes weather and air quality data in both batch and streaming modes

Language: Python - Size: 5.52 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

sofiasawczenko/ETL_employee_info_pipeline

This repository contains code and configuration files for an Extract, Transform, Load (ETL) project using Google Cloud Data Fusion for data extraction, Apache Airflow/Composer for orchestration, and Google BigQuery for data loading.

Language: Python - Size: 22.5 KB - Last synced at: 23 days ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

Romboost-Repo/PipeLogger

Language: Python - Size: 18.6 KB - Last synced at: 15 days ago - Pushed at: 8 months ago - Stars: 7 - Forks: 2

Abel3581/consultas-bigQuery-gcp

Consultas bigQuery GCP

Language: Java - Size: 3.39 MB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

pavans78/Export-logs-to-Bigquery-Terraform

Terraform for log sink and exporting the logs to the BigQuery.

Language: HCL - Size: 0 Bytes - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

pavans78/bq-resources-terraform

This repo contains Terraform code, how to create the datasets, tables , tables using partitioning, bigquery views, scheduled Query and for-each for creating more than one resources.

Language: HCL - Size: 28.3 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

pavans78/bigquery-terraform

This repo contains how to create the datasets, tables and tables using partitioning and for-each for creating more than one resources using Terrafrom.

Language: HCL - Size: 19.5 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

prakashdontaraju/google-cloud-ecommerce

ecommerce GCP Streaming pipeline ― Cloud Storage, Compute Engine, Pub/Sub, Dataflow, Apache Beam, BigQuery and Tableau; GCP Batch pipeline ― Cloud Storage, Dataproc, PySpark, Cloud Spanner and Tableau

Language: Python - Size: 4.38 MB - Last synced at: 9 months ago - Pushed at: about 3 years ago - Stars: 10 - Forks: 3

Antonio-Borges-Rufino/Build-an-ETL-Pipeline-for-Financial-Data-Analytics-on-GCP-IaC

Size: 858 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

visheshgupta-BA/US-Crime-Data-Assault-Offenses-Analysis

This project involves about analyzing US crime data related to assault offenses in all agency types and the data was analyzed using GCP BigQuery to upload the cleaned data to a data warehouse, and Tableau was used to create an interactive dashboard.

Language: Jupyter Notebook - Size: 1.29 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

cakirmuha/log-collector

Language: Go - Size: 85 KB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

colinphil/global-temperatures-health-database

Complete ETL process to create a database on Google Cloud Platform

Language: Jupyter Notebook - Size: 5.73 MB - Last synced at: over 1 year ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

sagar118/DataTalksClub-Data-Engineering

Language: Jupyter Notebook - Size: 187 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

cicerooficial/desafio-case-python-sauter

O Desafio Python tem como objetivo reflitir alguns desafios que um Engenheiro de Dados possa enfrentar na Sauter.

Language: Jupyter Notebook - Size: 4.99 MB - Last synced at: about 1 year ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

Enr1que319/Mexico-Gas-Prices

Project that runs in GCP using Big Query and Cloud Functions services, this pipeline is an ETL process that leaves the information ready to apply different analyzes.

Language: Python - Size: 688 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

ghrasko/beamdemo

Demonstrating Apache Beam capabilities with GCP Pub/Sub, BigQuery and Storage

Language: Python - Size: 339 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 3