GitHub / aymane-maghouti / Real-Time-Data-Pipeline-Using-Kafka

This project implements a real-time data pipeline using Apache Kafka, Python's psutil library for metric collection, and SQL Server for data storage. The pipeline collects metrics data from the local computer, processes it through Kafka brokers, and loads it into a SQL Server database. Additionally, a real-time dashboard is created using Power BI.

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/aymane-maghouti%2FReal-Time-Data-Pipeline-Using-Kafka

Commit Stats

Commits: 7
Authors: 2
Mean commits per author: 3.5
Development Distribution Score: 0.286
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/aymane-maghouti/Real-Time-Data-Pipeline-Using-Kafka

Topics: apache-kafka, data-collection, data-streaming, data-visualization, powerbi, python, real-time, real-time-data-pipeline

• Files
• Readme
• Dependencies