GitHub / BhawnaMehbubani / Kafka-Spark-Redshift-Streaming-Data-Ingestion-Project

This project is a real-time data pipeline designed for ingesting, processing, and storing telecom call records. It integrates Apache Kafka, Apache Spark Streaming, and AWS Redshift to handle large volumes of streaming data in near real-time. The pipeline is containerized with Docker Compose, enabling easy deployment, scalability, and modularity.

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BhawnaMehbubani%2FKafka-Spark-Redshift-Streaming-Data-Ingestion-Project

Topics: apache-kafka, apache-spark, aws-redshift, docker, spark-streaming

• Files
• Readme
• Dependencies