airscholar/e2e-data-engineering

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

Language: Python - Size: 289 KB - Last synced at: 16 days ago - Pushed at: 4 months ago - Stars: 250 - Forks: 123

lyes-sefiane/multi-element-relationally-interconnected-topology

Multi-Element Relationally Interconnected Topology 🇩🇿 🇨🇦

Language: Java - Size: 802 KB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 1 - Forks: 0

JoanRoucoux/url-shortener-full-app

URL shortener app using React, Node.js, Redis, MongoDB, Apache ZooKeeper, Nginx and Docker

Language: TypeScript - Size: 119 KB - Last synced at: about 2 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

JoanRoucoux/url-shortener-demo-app

URL shortener demo app using React, Node.js, Redis, MongoDB, Apache ZooKeeper, Nginx and Docker

Language: TypeScript - Size: 114 KB - Last synced at: about 2 months ago - Pushed at: 7 months ago - Stars: 1 - Forks: 0

Ren294/SmartTraffic_Lakehouse_for_HCMC

A Smart Traffic Management System for Ho Chi Minh City, Vietnam leveraging batch and real-time data processing, intuitive dashboards, and monitoring tools to optimize traffic flow, enhance safety, and support sustainable urban mobility through advanced analytics and user-friendly applications.

Language: Python - Size: 163 MB - Last synced at: about 2 months ago - Pushed at: 5 months ago - Stars: 4 - Forks: 0

ndomah/Realtime-Data-Streaming-of-Random-User-Data

End-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage.

Language: Python - Size: 305 KB - Last synced at: 15 days ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

unicef/magasin-drill

Apache Drill and Apache Zookeeper helm charts for kubernetes

Language: Shell - Size: 1.12 MB - Last synced at: about 2 months ago - Pushed at: 6 months ago - Stars: 2 - Forks: 2

josep2/Jathena

Proof of concept open source Amazon Athena

Size: 40.5 MB - Last synced at: 1 day ago - Pushed at: almost 8 years ago - Stars: 21 - Forks: 4

pj-mill/distributed-systems

A look at the Apache ZooKeeper coordination service for distributed services including distributed messaging brokers with kafka and a distributed search engine using TF-IDF Algorithm

Language: Java - Size: 15 MB - Last synced at: 11 days ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

LegolasVzla/django-twitter-spark

Thesis project: topic categorization and sentiment analysis on twitter with Apache Spark

Language: Python - Size: 17.3 MB - Last synced at: 2 months ago - Pushed at: over 2 years ago - Stars: 16 - Forks: 3

prekshivyas/DataStreamingETL

Utilizing my background and love for Apache Airflow and Data to build a real-time data streaming pipeline

Language: Python - Size: 722 KB - Last synced at: 2 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

vishalbansal28/End-to-end-realtime-data-streaming

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

Language: Python - Size: 286 KB - Last synced at: 3 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

daniel-keogh/zookeeper-cluster-healer

An application which uses Apache ZooKeeper to monitor and automatically heal a cluster of workers

Language: Java - Size: 11.7 KB - Last synced at: 3 months ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

tuhinsharma121/eagleeye

A realtime ingestion and profiling engine for fast data.

Language: Java - Size: 44.9 KB - Last synced at: about 22 hours ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 1

NitinDatta8/realtime-data-streaming

End-to-end data engineering pipeline with various technologies to ingest real time data.

Language: Python - Size: 284 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 1

Agirish/drill-helm-charts

Helm Charts to Deploy Apache Drill on Kubernetes

Language: Shell - Size: 191 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 14 - Forks: 12

PranjalGhildiyal/RealTimeSeries

Real time streaming of a time series with corresponding forecasts.

Language: Python - Size: 13.3 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 1

MuskanRaisinghani23/Real-Time-Data-Streaming

The project demonstrates an end-to-end data pipeline using Apache Kafka to fetch and stream data from a website. The project is containerized with Docker for streamlined deployment and dependency management.

Language: Python - Size: 4.88 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

Kridosz/Real-Time-Data-Streaming

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

Language: Python - Size: 285 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 1

engapa/zookeeper-k8s-openshift

Zookeeper docker container, ready for deployments on kubernetes and openshift

Language: Shell - Size: 169 KB - Last synced at: 2 months ago - Pushed at: about 4 years ago - Stars: 23 - Forks: 27

muKaustav/ShortURL

A distributed and highly available URL Shortener built on MERN stack, using Apache Zookeeper, cached using Redis, containerized by Docker.

Language: JavaScript - Size: 4.93 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 8 - Forks: 1

kay-verma/Distributed-Algorithm

Implementation of ZNode election and re-election using Apache ZooKeeper

Language: Java - Size: 2.93 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

Hogwai/kafka-microservices

Microservices with Apache Kafka, Kafka Streams

Language: Java - Size: 80.1 KB - Last synced at: 3 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

mihail-stoica/Distributed-Systems

Distributed Java Applications at Scale, Parallel Programming, Distributed Computing

Language: Java - Size: 13.7 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

fractalliter/spring-batch-example

A demonstration with Spring Batch framework, Kafka, and PostgreSQL

Language: Java - Size: 326 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

manios/zookeeper-docker

Docker image packaging for Apache Zookeeper

Language: Shell - Size: 5.86 KB - Last synced at: about 1 year ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0

willianlim/springboot-kafka-tutorial

Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.

Language: Java - Size: 3.05 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

willianlim/springKafka

Entendendo como funciona o Kafka

Language: Java - Size: 82 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

116davinder/zooki 📦

Apache Zookeeper Metric Collector

Language: Python - Size: 32.2 KB - Last synced at: over 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

116davinder/zookeeper-cluster-ansible

Fully Managed Apache Zookeeper Cluster with Ansible & Terraform.

Language: HCL - Size: 211 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 10 - Forks: 8

luckyp71/hadoop-hbase-phoenix-zookeeper-integration

Hadoop, HBase, Phoenix, and Zookeeper Integration

Language: Shell - Size: 30.3 KB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0

zbennett10/vscode-zookeeper

A Visual Studio Code extension for managing Apache Zookeeper

Language: TypeScript - Size: 191 KB - Last synced at: over 2 years ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 0

Agirish/drill-containers

Dockerfiles & YAML definitions for Apache Drill

Language: Shell - Size: 55.7 KB - Last synced at: over 2 years ago - Pushed at: over 6 years ago - Stars: 20 - Forks: 14

ziedYazidi/Kafka-Spark-HBase-Sentiment-Analysis

This project aims to consume a twitter stream via Apache Kafka, apply a sentiment analysis on the tweets with Apache Spark jobs and save the result into Apache HBase.

Language: Java - Size: 150 KB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 5 - Forks: 1

rarants/zookeeper-in-python-with-kazoo

Estudo sobre o Apache Zookeeper em Python, utilizando a biblioteca Kazoo.

Language: Python - Size: 4.93 MB - Last synced at: over 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 1

bilalcaliskan/zookeeper-ansible-role

An Ansible role which installs and configures Apache Zookeeper on Redhat/Debian based hosts

Language: Jinja - Size: 78.1 KB - Last synced at: over 2 years ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 0

onebytellc/zookeeper-demo

It contains the manifest to demo the watch feature of the zookeeper.

Language: Python - Size: 9.77 KB - Last synced at: 15 days ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 3

mgarmes/kafka-docker

Dockerfile for Apache Kafka

Language: Shell - Size: 7.81 KB - Last synced at: over 1 year ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

IsuruBoyagane15/distributed-consensus

Distributed consensus algorithms implemented using Apache Kafka as a message broker.

Language: Java - Size: 31.1 MB - Last synced at: over 2 years ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0

tansudasli/kafka-sandbox

Apache Kafka installation on GCP and e-commerce product additions scenario to Kafka

Language: Java - Size: 4.68 MB - Last synced at: 3 months ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0

tigstep/kafka_storm_pipeline

A real-time, dockerized Kafka event processor pipeline (utilizing an Apache Storm topology). The project is running in AWS with automated infrastructure deployment and execution, using Ansible.

Language: Java - Size: 204 KB - Last synced at: over 2 years ago - Pushed at: about 6 years ago - Stars: 2 - Forks: 1

wikitops/ansible_zookeeper

Ansible playbook to deploy a Zookeeper cluster on Linux Vagrant instance.

Language: Python - Size: 25.4 KB - Last synced at: about 1 month ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 1

Arquisoft/InciManager_e3a

InciManagement_e3a

Language: Java - Size: 4.82 MB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 2

alejandroSuch/docker-kafka

Docker image for Apache Kafka and Zookeeper

Language: Shell - Size: 10.7 KB - Last synced at: about 1 year ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0

wtanaka/docker-ubuntu-1604-oracle-java-8-zookeeper

Dockerfile for Ubuntu 16.04 with Oracle Java 8 and Zookeeper from Ubuntu packages

Size: 1000 Bytes - Last synced at: 3 months ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0

wtanaka/docker-ubuntu-1604-oracle-java-9-zookeeper

Dockerfile for Ubuntu 16.04 with Oracle Java 9 and Zookeeper from Ubuntu packages

Size: 1000 Bytes - Last synced at: 3 months ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0

jasonzhang8801/distributed_message_queue

Distributed Message Queue

Language: Java - Size: 267 KB - Last synced at: over 2 years ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 3

jasonzhang8801/real_time_log_analysis

Language: Java - Size: 3.34 MB - Last synced at: over 2 years ago - Pushed at: about 8 years ago - Stars: 0 - Forks: 1