Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: firehose

raystack/firehose

Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

Language: Java - Size: 13.9 MB - Last synced: 7 days ago - Pushed: 11 months ago - Stars: 314 - Forks: 52

bkerler/edl

Inofficial Qualcomm Firehose / Sahara / Streaming / Diag Tools :)

Language: Python - Size: 61.7 MB - Last synced: 12 days ago - Pushed: 30 days ago - Stars: 1,410 - Forks: 344

Moulick/kinesis2elastic

Receives data from firehose and puts it to ElasticSearch

Language: Go - Size: 1.33 MB - Last synced: 19 days ago - Pushed: 19 days ago - Stars: 3 - Forks: 0

cloudfoundry/firehose_exporter

Cloud Foundry Firehose Prometheus exporter

Language: Go - Size: 32.7 MB - Last synced: 3 days ago - Pushed: 16 days ago - Stars: 26 - Forks: 22

ShixiangWang/DoAbsolute

:package: Automate Absolute Copy Number Calling using 'ABSOLUTE' package

Language: R - Size: 2.5 MB - Last synced: 15 days ago - Pushed: 6 months ago - Stars: 35 - Forks: 12

miztiik/apigw-proxy-for-firehose

Demo to show how to proxy firehose with apigw and enfore TLS1.2

Language: Python - Size: 1.26 MB - Last synced: about 1 month ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 1

HotGarbo/dumppit

A reddit firehose

Language: HTML - Size: 1.57 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1 - Forks: 1

wolfeidau/cloudfront-simple-analytics

simple analytics service for CloudFront

Language: Go - Size: 0 Bytes - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 0 - Forks: 0

spoqa/firefighter

AWS Kinesis Data Firehose logging handler for Python

Language: Python - Size: 20.5 KB - Last synced: about 1 month ago - Pushed: about 5 years ago - Stars: 1 - Forks: 1

pinax-network/firehose-antelope

Firehose implementation for Antelope

Language: Go - Size: 19.8 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 8 - Forks: 1

itsjerryokolo/cryptopunks_substreams

Cryptopunks Substreams module

Language: Rust - Size: 158 KB - Last synced: about 1 month ago - Pushed: over 1 year ago - Stars: 4 - Forks: 0

cscape/mastodon-firehose

🐘🌊 Centralized public streaming API for the Mastodon network.

Language: JavaScript - Size: 34.2 KB - Last synced: about 1 month ago - Pushed: over 5 years ago - Stars: 12 - Forks: 1

starknet-graph/substreams-starknet

Rust library for Starknet substreams development

Language: Rust - Size: 20.5 KB - Last synced: 15 days ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0

coralogix/terraform-coralogix-aws

Coralogix AWS Integrations modules for Terraform.

Language: HCL - Size: 2.59 MB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 4 - Forks: 21

pinax-network/endpoints

Substreams,Firehose & JSON RPC public endpoints

Size: 3.91 KB - Last synced: about 2 months ago - Pushed: over 1 year ago - Stars: 3 - Forks: 0

paoloo/firehose

This repository creates a Kineses firehose stream, a S3 bucket and define the machanics to store data from stream into S3

Language: HCL - Size: 2.93 KB - Last synced: 2 months ago - Pushed: about 4 years ago - Stars: 1 - Forks: 1

JamieCressey/Gopher

Ships locally grok parsed logs to Kinesis Firehose

Language: Go - Size: 3.91 KB - Last synced: 2 months ago - Pushed: about 7 years ago - Stars: 1 - Forks: 0

checkr/fluentd-firehose

Fluentd docker image with plugins to ship logs to AWS firehose

Language: Shell - Size: 6.84 KB - Last synced: 2 months ago - Pushed: almost 7 years ago - Stars: 10 - Forks: 2

Pavel216989/interview-test-assignment

HTTP api that writes raw data to a data lake in AWS S3 using AWS Kinesis Firehose

Language: Python - Size: 85.9 KB - Last synced: 2 months ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

CiscoDevNet/DNASpaces-FirehoseAPI-RightNowVisitors

This sample application has both server & client. The server uses Cisco DNA Spaces Firehose API events entry, exit, current location and associated profile, builds data pipeline using AWS S3 and AWS Redshift. The client UI provides the details of the currently available devices in the location

Language: Java - Size: 2.2 MB - Last synced: about 2 months ago - Pushed: 5 months ago - Stars: 5 - Forks: 2

g-lorena/aws_streaming_pipeline

AWS streaming pipeline for real-time analysis

Language: Python - Size: 363 KB - Last synced: 3 months ago - Pushed: 3 months ago - Stars: 0 - Forks: 0

fatum/firehose

Events aggregator for Amazon Firehose service written in elixir

Language: Elixir - Size: 17.6 KB - Last synced: 7 days ago - Pushed: over 2 years ago - Stars: 2 - Forks: 1

seatgeek/nomad-firehose

Firehose all nomad job, allocation, nodes and evaluations changes to rabbitmq, kinesis or stdout

Language: Go - Size: 211 KB - Last synced: 30 days ago - Pushed: over 3 years ago - Stars: 115 - Forks: 33

ronilaukkarinen/fedionfire

Watch every Mastodon/Fediverse post in real-time - filter the firehose

Language: PHP - Size: 285 KB - Last synced: 5 months ago - Pushed: 5 months ago - Stars: 6 - Forks: 1

epomatti/aws-cloudwatch-subscriptions

Subscribing to CloudWatch Logs with various destinations

Language: HCL - Size: 215 KB - Last synced: 7 months ago - Pushed: 7 months ago - Stars: 0 - Forks: 0

seanvelasco/bluesky-firehose

Real-time Bluesky Feed

Language: TypeScript - Size: 264 KB - Last synced: 8 months ago - Pushed: 8 months ago - Stars: 2 - Forks: 0

diffusion-playground/kafka-integration-intro-js

Introduction to Diffusion Real-Time Event Stream through a simple application using Diffusion Cloud and Apache Kafka. A simple projects illustrating real-time replication and fan-out of foreign exchange (fx) event streams from Kafka cluster A to Kafka cluster B, through Diffusion Cloud instance via the use of our Kafka Adapter.

Language: HTML - Size: 8.12 MB - Last synced: 8 months ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

epomatti/aws-kinesis

AWS Kinesis services architecture

Language: HCL - Size: 1.62 MB - Last synced: 9 months ago - Pushed: 9 months ago - Stars: 0 - Forks: 0

pinax-network/substreams_firehose

Extract any data from the blockchain using gRPC-enabled endpoints (powered by Firehose and Substreams)

Language: Python - Size: 75.1 MB - Last synced: 9 days ago - Pushed: 5 months ago - Stars: 3 - Forks: 1

nolotz/terraform-aws-datadog-firehose

Terraform Turn Key Firehose Delivery Stream for DataDog Solution

Language: HCL - Size: 5.86 KB - Last synced: 9 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

wybiral/hookah

A cross-platform tool for data pipelines.

Language: Go - Size: 3.09 MB - Last synced: 10 months ago - Pushed: about 4 years ago - Stars: 88 - Forks: 8

DrewMcArthur/embedding-firehose

A firehose of post embeddings, downstream of the bluesky firehose

Language: TypeScript - Size: 268 KB - Last synced: 10 months ago - Pushed: about 1 year ago - Stars: 0 - Forks: 0

librariesio/firehose 📦

:fire_engine: SSE bridge

Language: JavaScript - Size: 142 KB - Last synced: about 1 month ago - Pushed: 10 months ago - Stars: 12 - Forks: 7

peavers-archive/codeshelf-tool-executor

This stand-alone library handles the basic command execution and push to Firehose

Language: Java - Size: 72.3 KB - Last synced: 16 days ago - Pushed: about 1 year ago - Stars: 0 - Forks: 0

thomasdesr/firehose-batcher

Provide a lightweight wrapper to batch record sends to AWS Kinesis Firehose

Language: Go - Size: 1.63 MB - Last synced: 10 months ago - Pushed: over 6 years ago - Stars: 1 - Forks: 1

CiscoDevNet/DNASpaces-FirehoseAPI-DetectAndLocate

This is a sample application for consuming "Device Location Update" event of the Cisco DNA Spaces Firehose API. It also provides a reference implementation of detect and locate use case.

Language: Java - Size: 4.95 MB - Last synced: about 2 months ago - Pushed: about 1 year ago - Stars: 5 - Forks: 6

lifadev/archive_aws-lambda-go-event 📦

Type definitions for AWS Lambda event sources.

Language: Go - Size: 465 KB - Last synced: 11 months ago - Pushed: over 6 years ago - Stars: 77 - Forks: 18

pinax-network/substreams-sink-prometheus.rs

Substreams Prometheus sink module

Language: Rust - Size: 235 KB - Last synced: 12 days ago - Pushed: about 1 year ago - Stars: 1 - Forks: 0

dod-iac/terraform-aws-kinesis-firehose-s3-bucket

Creates a Kinesis Data Firehose Delivery Stream that delivers records to a S3 Bucket

Language: HCL - Size: 12.7 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 6 - Forks: 4

pranav-patil/aws-metric-api

AWS Serverless metric api with Athena storage.

Language: HCL - Size: 33.2 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

DemocracyClub/dc_logging

Logging library for DC products

Language: Python - Size: 460 KB - Last synced: about 1 month ago - Pushed: 2 months ago - Stars: 0 - Forks: 0

twingly/twingly-livefeed-node 📦

⚠️ *UNMAINTAINED* Node client for Twingly LiveFeed v4

Language: JavaScript - Size: 2.93 KB - Last synced: about 1 month ago - Pushed: over 6 years ago - Stars: 0 - Forks: 0

bufferapp/firehoser 📦

Command line tool that automates the setup of a lambda function that fowards records from Kinesis to Firehose.

Language: Python - Size: 12.7 KB - Last synced: 13 days ago - Pushed: over 6 years ago - Stars: 0 - Forks: 1

mirusresearch/firehoser 📦

A wrapper around AWS Kinesis Firehose with retry logic and custom queuing behavior. Requires node >= 6.0.0

Language: JavaScript - Size: 109 KB - Last synced: 14 days ago - Pushed: almost 2 years ago - Stars: 22 - Forks: 5

finbox-in/AWS-Cost-Report

Script to generate a Cost Report in XLSX format, with different sheets indicating different actionable reports

Language: Python - Size: 46.9 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 24 - Forks: 3

ali-habibzadeh/serverless-crawler

A serverless crawler with Lambda, Dynamodb and Kinesis Firehose

Language: TypeScript - Size: 1.77 MB - Last synced: 12 days ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0

islajd/DataLake

Serverless Datalake solution based on AWS. Constructed using AWS S3, Glue, Athena, Firehose.

Language: JavaScript - Size: 3.81 MB - Last synced: 11 months ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

epomatti/aws-terraform

Terraform recipes for AWS

Language: HCL - Size: 73.2 KB - Last synced: about 1 year ago - Pushed: almost 2 years ago - Stars: 0 - Forks: 0

christiandbf/web-scraping

Web scraping using Lambdas

Language: JavaScript - Size: 1.09 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

sharathgopinath/billing-alert

Generates billing alerts for a highway toll operating company using Streaming Data Solutions on AWS with Amazon Kinesis

Language: C# - Size: 2.05 MB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 1 - Forks: 0

taiyoh/toyhose

Language: Go - Size: 186 KB - Last synced: 10 months ago - Pushed: about 1 year ago - Stars: 2 - Forks: 0

jormaechea/aws-firehose-producer

Easily produce data for your AWS Firehose Data Stream

Language: JavaScript - Size: 7.81 KB - Last synced: about 1 year ago - Pushed: about 2 years ago - Stars: 0 - Forks: 0

yannh/aws-firehose-s3-producer

Stream files uploaded to AWS S3 to AWS Kinesis Firehose

Language: JavaScript - Size: 166 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 1 - Forks: 1

productiveAnalytics/aws-cdk-constructs-sandbox

Cloud Development Kit (AWS CDK) using TypeScript, Python and Java

Language: Java - Size: 5.49 MB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

TrygviZL/CoinCap-firehose-s3-DynamicPartitioning

AWS CDK project using typescript. Services: Lambda, Kinesis Firehose, Glue, Quicksight.

Language: TypeScript - Size: 392 KB - Last synced: about 1 year ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

aws-cloudformation/aws-cloudformation-resource-providers-kinesisfirehose

The CloudFormation Resource Provider Package For Amazon Kinesis Data Firehose

Language: Java - Size: 311 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 2 - Forks: 2

rrohitramsen/firehose

Firehose - Spark streaming 2.2 + Kafka 0.8_2

Language: Java - Size: 25.6 MB - Last synced: about 1 month ago - Pushed: almost 7 years ago - Stars: 9 - Forks: 7

melgenek/magnolia-cdk-glue-firehose

Writing Parquet files in Scala using AWS Firehose and Glue

Language: Scala - Size: 9.77 KB - Last synced: about 1 month ago - Pushed: over 2 years ago - Stars: 0 - Forks: 1

KanchiMoe/Terraform-for-AWS-Macie

Terraform code to process a stream from a Discord server, and process it with AWS Macie to identify personally identifiable information.

Language: HCL - Size: 8.79 KB - Last synced: about 1 year ago - Pushed: almost 3 years ago - Stars: 0 - Forks: 0

bolzon/poc-localstack

Proof of concept using localstack as a mock AWS (cloud) to build a basic data ingestion infra using Terraform

Language: HCL - Size: 25.4 KB - Last synced: about 1 year ago - Pushed: over 3 years ago - Stars: 0 - Forks: 1

nicor88/aws-infrastructure

AWS infrastructure: Cloudformation, Terraform...

Language: Python - Size: 247 KB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 4 - Forks: 2

jdtully/bootstrap

learning javascript, drinking from a firehose

Language: JavaScript - Size: 969 KB - Last synced: about 1 year ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

juanlamadrid20/amazon-serverless-datalake-workshop Fork of aws-samples/amazon-serverless-datalake-workshop

A workshop demonstrating the capabilities of S3, Athena, Glue, Kinesis, and Quicksight.

Size: 68.7 MB - Last synced: about 1 year ago - Pushed: about 4 years ago - Stars: 0 - Forks: 0

ptimson/firehose-mock

An embedded Java mock for AWS Kinesis Firehose

Language: Java - Size: 39.1 KB - Last synced: 10 months ago - Pushed: about 6 years ago - Stars: 2 - Forks: 2

nicor88/aws-streaming-pipeline

Streaming pipeline based on AWS resources

Language: Python - Size: 195 KB - Last synced: about 1 year ago - Pushed: over 5 years ago - Stars: 1 - Forks: 2

Eli-Goldberg/bunyan-firehose

Language: JavaScript - Size: 13.7 KB - Last synced: 25 days ago - Pushed: over 6 years ago - Stars: 3 - Forks: 4

matthewmueller/firehose-analytics

Send events to AWS Firehose

Language: Go - Size: 8.79 KB - Last synced: about 2 months ago - Pushed: over 6 years ago - Stars: 1 - Forks: 0