GitHub topics: nifi | Ecosyste.ms: Repos

konpyutaika/nifikop

The NiFiKop NiFi Kubernetes operator makes it easy to run Apache NiFi on Kubernetes. Apache NiFI is a free, open-source solution that support powerful and scalable directed graphs of data routing, transformation, and system mediation logic.

Language: Go - Size: 93 MB - Last synced at: about 5 hours ago - Pushed at: about 13 hours ago - Stars: 168 - Forks: 57

AeJkudera/OLAP-ETL-with-Apache-NiFi-Spark

ETL (Extract, Transform, Load) pipeline for converting an OLTP relational schema into an OLAP star schema using Apache NiFi, MySQL, and Apache Spark.

Language: Python - Size: 3.68 MB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 0 - Forks: 0

OBenner/data-engineering-interview-questions

More than 2000+ Data engineer interview questions.

Size: 938 KB - Last synced at: 2 days ago - Pushed at: 4 months ago - Stars: 1,334 - Forks: 476

Netcracker/qubership-nifi

Language: Java - Size: 779 KB - Last synced at: 2 days ago - Pushed at: 2 days ago - Stars: 1 - Forks: 6

easy-global-market/nifi-file-identity-provider-bundle

Identity Provider for Apache NiFi, allowing username/password authentication backed by a local file store.

Language: Java - Size: 153 KB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 2 - Forks: 0

devopscorner/nifi

Production Grade Nifi & Nifi Registry. Deploy for VM (Virtual Machine) with Terraform + Ansible, Helm & Helmfile for Kubernetes (EKS)

Language: Python - Size: 12.5 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 12 - Forks: 0

apache/nifi

Apache NiFi

Language: Java - Size: 267 MB - Last synced at: 6 days ago - Pushed at: 7 days ago - Stars: 5,327 - Forks: 2,803

george0st/Ff2Cql

A simple transfer data between NiFi and CQL solution (support Apache Cassandra, ScyllaDB, AstraDB, etc.).

Language: Java - Size: 67.2 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 62 - Forks: 0

apache/nifi-minifi-cpp

Apache NiFi - MiNiFi C++

Language: C++ - Size: 44.6 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 153 - Forks: 94

nielsbasjes/dsmr-tools

A java simulator/parser/toolkit for the Dutch Smart Meter Requirements (DSMR)

Language: Java - Size: 2.41 MB - Last synced at: 6 days ago - Pushed at: 8 days ago - Stars: 18 - Forks: 4

fabiogjardim/bigdata_docker

Big Data Ecosystem Docker

Language: VBA - Size: 126 MB - Last synced at: 6 days ago - Pushed at: about 2 years ago - Stars: 414 - Forks: 322

Teradata/kylo

Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.

Language: Java - Size: 84.3 MB - Last synced at: 2 days ago - Pushed at: over 2 years ago - Stars: 1,113 - Forks: 575

CogStack/CogStack-NiFi

Building data processing pipelines for documents processing with NLP using Apache NiFi and related services

Language: Python - Size: 97 MB - Last synced at: 12 days ago - Pushed at: 12 days ago - Stars: 51 - Forks: 19

saidsef/k8s-nifi-cluster

Apache NiFi cluster running in Kubernetes

Size: 96.7 KB - Last synced at: 4 days ago - Pushed at: 3 months ago - Stars: 56 - Forks: 25

jgwoolley/nf2t-web

A little helper website for packing and unpacking Apache Nifi Flow Files in the browser!

Language: TypeScript - Size: 920 KB - Last synced at: 7 days ago - Pushed at: 18 days ago - Stars: 0 - Forks: 0

apache/nifi-api

Apache NiFi API

Language: Java - Size: 292 KB - Last synced at: 6 days ago - Pushed at: 18 days ago - Stars: 4 - Forks: 10

easy-global-market/nifi-provenance-reporting-bundle

NiFi provenance reporting tasks

Language: Java - Size: 1.02 MB - Last synced at: 5 days ago - Pushed at: 5 days ago - Stars: 3 - Forks: 0

konpyutaika/nigoapi

A generated go client for NiFi and NiFi registry

Language: Go - Size: 3.47 MB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 6 - Forks: 4

Chaffelson/nipyapi

A convenient Python wrapper for Apache NiFi

Language: Python - Size: 4.38 MB - Last synced at: 2 days ago - Pushed at: about 2 months ago - Stars: 258 - Forks: 75

easy-global-market/nifi-ngsild-postgresql

NiFi processor to export denormalized NGSI-LD entities into a PostgreSQL database

Language: Java - Size: 198 KB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 3 - Forks: 0

dreamcodez/resume

Matthew Elders' Resume: https://dreamcodez.cc

Language: TypeScript - Size: 2.63 MB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 4 - Forks: 0

apache/nifi-site

Apache NiFi website

Language: HTML - Size: 61.2 MB - Last synced at: 6 days ago - Pushed at: 22 days ago - Stars: 17 - Forks: 51

nielsbasjes/energy 📦

A java library to read data from my Modbus based energy devices.

Language: Java - Size: 804 KB - Last synced at: 3 days ago - Pushed at: 23 days ago - Stars: 9 - Forks: 3

CalvinHartwell/getting-started-with-kylo

An introduction to using Kylo, an open source data lake builder from Teradata

Size: 3.88 MB - Last synced at: 7 days ago - Pushed at: almost 8 years ago - Stars: 8 - Forks: 4

Svastikkka/DOCKER

Docker compose yml of diffrent tools setup locally

Language: Python - Size: 22.2 MB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 2 - Forks: 1

apache/nifi-fds

Mirror of Apache NiFi Flow Design System

Language: HTML - Size: 173 MB - Last synced at: 6 days ago - Pushed at: almost 2 years ago - Stars: 45 - Forks: 25

Pedro-Manoel/iot-analytics-solution-tcc

🎓 Repositório com a solução de IoT Analytics desenvolvida como parte do Trabalho de Conclusão de Curso (TCC) do curso de Ciência da Computação da Universidade Federal de Campina Grande (UFCG)

Language: TypeScript - Size: 177 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 4 - Forks: 0

apache/nifi-registry 📦

Apache NiFi Registry

Language: Java - Size: 9.32 MB - Last synced at: 6 days ago - Pushed at: almost 4 years ago - Stars: 109 - Forks: 98

dannyb2018/CPTAUtilityLibrary

DB connection pooling, kafka to graphql over websockets, simplified graphql queries and mutations, wrapper around nifi rest api

Language: Java - Size: 356 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 1

jgwoolley/nf2t-cli

A Java CLI for parsing Apache NiFi FlowFiles.

Language: Java - Size: 391 KB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 1 - Forks: 0

lifan0127/nifi-langchain

LangChain Expression Language (LCEL) As NiFi Processors

Language: Java - Size: 931 KB - Last synced at: 6 days ago - Pushed at: over 1 year ago - Stars: 12 - Forks: 3

apache/nifi-python-extensions

Apache NiFi Python Extensions

Language: Python - Size: 40 KB - Last synced at: 6 days ago - Pushed at: 6 months ago - Stars: 22 - Forks: 12

seilylook/Data_Engineering_with_Python

Data Engineering with Python

Language: Python - Size: 10.3 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

vast-data/vastdb_nifi

NiFi 2.x Processors designed for interacting with the VAST Database, enabling schema and table management, efficient ingest, query and modification of columnar data

Language: Python - Size: 102 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 1 - Forks: 1

Renatoelho/criando-bots-telegram

Crie seu próprio bot personalizado e comece a interagir com os usuários no Telegram de maneira única e criativa. Seja para fins de automação, entretenimento ou utilidade, este repositório é o seu ponto de partida para dominar o desenvolvimento de bots com Python para o Telegram.

Language: Python - Size: 4.41 MB - Last synced at: 11 days ago - Pushed at: about 2 years ago - Stars: 6 - Forks: 3

Renatoelho/analise-credito

Este projeto de engenharia de dados, desenvolvido por nós, Renato Coelho e Gyan Lucas, tem como objetivo conceitual e educativo demonstrar como seria uma solução de análise de crédito utilizando ferramentas open source e proprietárias em conjunto para atender a esse propósito.

Language: Python - Size: 3.48 MB - Last synced at: 2 months ago - Pushed at: almost 2 years ago - Stars: 2 - Forks: 0

Renatoelho/fluxo-elt

Trata-se de um processo de ELT (Extração, Carga e Transformação) que integra um sistema legado com um banco de dados relacional (no exemplo, um MySQL) para um banco NoSQL (ElasticSearch) sem alterações significativas nos dados transferidos.

Language: Python - Size: 4.99 MB - Last synced at: 2 months ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

Renatoelho/instalacao-configuracao-apache-nifi

O Apache NiFi é um projeto de código aberto da Apache Software Foundation que fornece uma plataforma para automatização de fluxo de dados, coleta, processamento e distribuição de dados em tempo real.

Size: 7.81 KB - Last synced at: 2 months ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 2

sergio11/document_search_engine_architecture

📄🚀 Unleash a powerful Document Search Engine with Apache NiFi for lightning-fast, comprehensive text indexing and search.

Language: Java - Size: 13.5 MB - Last synced at: about 2 months ago - Pushed at: 2 months ago - Stars: 30 - Forks: 11

sergio11/traffic_sentinel_architecture

🚀 Traffic Sentinel: A scalable IoT system using Fog nodes and Apache Flink to process 📷 IP camera streams, powered by YOLO for intelligent 🚗 traffic monitoring on highways. 🛣️

Language: Python - Size: 74.1 MB - Last synced at: about 2 months ago - Pushed at: 2 months ago - Stars: 23 - Forks: 3

chadgeary/nifi 📦

Deploy a secured, clustered, auto-scaling NiFi service in AWS.

Language: HCL - Size: 4.93 MB - Last synced at: about 2 months ago - Pushed at: almost 3 years ago - Stars: 49 - Forks: 15

MostafaGalal1/OLAP-ETL-with-Apache-NiFi-Spark

Language: Python - Size: 3.57 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

dstl/nifi-processors 📦

NiFi Processors

Language: Java - Size: 336 KB - Last synced at: 14 days ago - Pushed at: about 2 years ago - Stars: 2 - Forks: 1

sakkiii/apache-nifi-helm

Helm chart deploys Apache NiFi in a Kubernetes cluster

Language: Smarty - Size: 837 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 5 - Forks: 0

Nkeramov/neuromask_nifi_bundle

Custom processor for Apache NIFi for Neuromask project

Language: Java - Size: 12.7 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 2 - Forks: 0

Nkeramov/bash_scripts

Some useful bash scripts

Language: Shell - Size: 38.1 KB - Last synced at: 3 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

burakai/EGAL_Yet-Another-Earthquake-Project

Yet Another Earthquake Project from the team EGAL.

Language: Python - Size: 44.9 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 2

akarce/RedditDataPipeline

Data Engineering with Reddit Api, Airflow, Hive, Postgres, MinIO, Nifi, Trino, Tableau and Superset

Language: Python - Size: 137 MB - Last synced at: about 2 months ago - Pushed at: 9 months ago - Stars: 5 - Forks: 3

mryoshq/Cache-System

Cache system : NiFi, Kafka, Websockets (Pusher), Docker, MongoDB, Redis and MySQL

Language: JavaScript - Size: 381 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

fernandoareias/Nifi.POC

NiFi Data Integration and Migration

Language: Dockerfile - Size: 43.2 MB - Last synced at: about 1 month ago - Pushed at: 5 months ago - Stars: 4 - Forks: 1

Orange-OpenSource/nifikop 📦

The NiFiKop NiFi Kubernetes operator makes it easy to run Apache NiFi on Kubernetes. Apache NiFI is a free, open-source solution that support powerful and scalable directed graphs of data routing, transformation, and system mediation logic.

Language: Go - Size: 13.6 MB - Last synced at: 17 days ago - Pushed at: about 3 years ago - Stars: 129 - Forks: 34

tomarv2/nifi

NiFi deployment as StatefulSet & CICD

Language: Python - Size: 14.5 MB - Last synced at: about 2 months ago - Pushed at: 4 months ago - Stars: 4 - Forks: 0

interTwin-eu/dcnios

DCNiOS is a Data Connector through Apache NiFi for OSCAR, that facilitates the creation of event-driven processes connecting a Storage System.

Language: Python - Size: 43.2 MB - Last synced at: 16 days ago - Pushed at: 16 days ago - Stars: 3 - Forks: 1

ging/fiware-draco

The Draco Generic Enabler is an alternative data persistence mechanism for managing the history of context. It is based on Apache NiFi and is a dataflow system based on the concepts of flow-based programming. It supports powerful and scalable directed graphs of data routing, transformation, and system mediation logic and also offers an intuitive graphical interface

Language: Java - Size: 9.26 MB - Last synced at: 16 days ago - Pushed at: 7 months ago - Stars: 20 - Forks: 14

EricLondon/nifi-jruby-csv-to-json-to-elasticsearch

Nifi CSV to JSON to Elasticsearch

Language: Ruby - Size: 8.79 KB - Last synced at: 21 days ago - Pushed at: 10 months ago - Stars: 2 - Forks: 1

angelagonzalezp/airflow-example-dags

Example DAGs

Language: Python - Size: 4.88 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0

microsoft/MonitoFi

MonitoFi: Health & Performance Monitor for your Apache NiFi

Language: Python - Size: 3.98 MB - Last synced at: 2 days ago - Pushed at: almost 2 years ago - Stars: 62 - Forks: 16

mahmoudimus/nifi-starlarky

Using VGS' Starlarky engine to power Starlark processors as well as Starlark NiFi DSL

Size: 4.88 KB - Last synced at: 2 months ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

mrcsparker/nifi-sqllookup-services-bundle

NIFI controllers for SQL record and attributes lookups with built-in caching

Language: Java - Size: 601 KB - Last synced at: about 2 months ago - Pushed at: over 3 years ago - Stars: 19 - Forks: 11

apache/nifi-maven

Apache NiFi NAR Maven Plugin

Language: Java - Size: 166 KB - Last synced at: 6 days ago - Pushed at: 6 months ago - Stars: 27 - Forks: 32

apache/nifi-minifi 📦

Apache MiNiFi (a subproject of Apache NiFi)

Language: Java - Size: 1.9 MB - Last synced at: 6 days ago - Pushed at: over 4 years ago - Stars: 125 - Forks: 103

Ren294/Covid-Data-Process

This project integrates real-time data processing and analytics using Apache NiFi, Kafka, Spark, Hive, and AWS services for comprehensive COVID-19 data insights.

Language: Shell - Size: 6.22 MB - Last synced at: about 1 month ago - Pushed at: 8 months ago - Stars: 6 - Forks: 0

burakugurr/cdc-postgresql_to_minio

This project delves into leveraging CDC for PostgreSQL databases using Debezium, orchestrating data processing through NiFi, and subsequently storing the processed data in MinIO, a high-performance S3-compatible storage solution.

Size: 12.7 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

Inspirate789/BMSTU-DB

:open_file_folder: Лекции, семинары и лабораторные работы по курсу "Базы данных" в МГТУ им. Н. Э. Баумана.

Language: Go - Size: 79.8 MB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 1

blezek/nifi-dicom

DICOM handling for NiFi

Language: Java - Size: 2.87 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 12 - Forks: 10

spinnerconsulting/helm-nifi

Helm Chart for Apache Nifi

Language: JavaScript - Size: 0 Bytes - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 0 - Forks: 0

joaohf/nifi_s2s

NiFi Site-to-Site Erlang client implementation

Language: Erlang - Size: 108 KB - Last synced at: 3 days ago - Pushed at: almost 5 years ago - Stars: 2 - Forks: 0

tspannhw/yolo3-keras-tensorflow

A tweak to https://github.com/qqwweee/keras-yolo3 to store images and json attributes

Language: Python - Size: 15.6 KB - Last synced at: about 1 month ago - Pushed at: over 6 years ago - Stars: 4 - Forks: 1

nineinfra/kubectl-nine

kubectl-nine is a kubectl plugin to manage the NineInfra and the NineClusters on the k8s.

Language: Go - Size: 4.52 MB - Last synced at: about 2 months ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 3

AlexsJones/kubernetes-nifi-cluster

Apache Nifi cluster running in kubernetes

Language: Shell - Size: 31.3 KB - Last synced at: about 2 months ago - Pushed at: over 5 years ago - Stars: 84 - Forks: 21

hermannpencole/nifi-swagger-client

Client swagger for nifi with security

Language: Java - Size: 1.46 MB - Last synced at: 4 months ago - Pushed at: about 3 years ago - Stars: 38 - Forks: 20

burakugurr/PX4-Flight-Analysis-Data-Pipeline

Drone flight log data engineering pipeline using Apache Nifi+MinIO+Opensearch+Apache Airflow

Language: Python - Size: 51.7 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

influxdata/nifi-influxdb-bundle 📦

InfluxDB Processors For Apache NiFi

Language: Java - Size: 2.7 MB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 36 - Forks: 10

isaccanedo/nifi

:cloud: Apache NiFi

Language: Java - Size: 58.3 MB - Last synced at: 3 months ago - Pushed at: 10 months ago - Stars: 1 - Forks: 0

javiroman/nifi-prometheus-bundle

Apache NiFi Prometheus Remote Write Processor

Language: Java - Size: 65.4 KB - Last synced at: 3 months ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 1

hilaryRope/NiFi-custom-processors

Language: Java - Size: 35.2 KB - Last synced at: 11 months ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0

cetic/helm-nifi 📦

Helm Chart for Apache Nifi

Language: JavaScript - Size: 1.9 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 207 - Forks: 214

hermannpencole/nifi-config

Automatically deploy and configure Template on Nifi

Language: Java - Size: 441 KB - Last synced at: 11 months ago - Pushed at: over 1 year ago - Stars: 54 - Forks: 39

sitewhere/sitewhere-nifi

Integration components which support interacting with SiteWhere data in Apache Nifi.

Language: Java - Size: 43 KB - Last synced at: 3 months ago - Pushed at: over 5 years ago - Stars: 3 - Forks: 0

Rajsingh92/MUST_HAVE_SKILLS

This repo consists of all important concepts for data engineers.

Language: Java - Size: 1.69 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 6

giros-dit/sda-announce

Website for the Semantic Data Aggregator (SDA)

Size: 27.8 MB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 1

DashDipti/cdf-workshop

This workshop aims to make use of log data to help practitioners gain understanding of CDF and to show the value it brings to enterprises who understand that data in motion related use cases can add value to their business.

Size: 28.5 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 1

DrSnowbird/nifi Fork of apache/nifi

Mirror of Apache NiFi

Language: Java - Size: 156 MB - Last synced at: about 1 year ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

giros-dit/semantic-data-aggregator

A semantic monitoring framework for aggregating data from heterogeneous sources.

Language: Java - Size: 519 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 4 - Forks: 0

jorgeacf/nifi-flows

This repository contains my NiFi templates

Size: 27.3 KB - Last synced at: about 1 year ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 0

PSSABISHEK/skoruz_analytics

Python scripts to handle data migration

Language: Python - Size: 188 KB - Last synced at: about 1 year ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0

uuhnaut69/workflow-process-engine

Apache nifi, azkaban

Size: 6.84 KB - Last synced at: about 1 year ago - Pushed at: almost 6 years ago - Stars: 2 - Forks: 0

Mansurow/bmstu-iu7-5sem-DB

📚 Курс по Базам Данных

Language: Python - Size: 5.51 MB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

phrocker/nifi-datasynthesizer

Apache NiFi Data Synthesizer

Language: Java - Size: 2.72 MB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 14 - Forks: 3

anthu/nifi-snowflake-bundle

Unofficial Snowflake Stream Ingest bundle for Apache NiFi

Language: Java - Size: 73.2 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 1

zeroae/nifi-7zip-bundle

7ZipBinding NiFi Processor

Language: Java - Size: 87.9 KB - Last synced at: 3 months ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 0

Glympse/terraform-provider-nifi

Terraform provider for interacting with NiFi cluster

Language: Go - Size: 323 KB - Last synced at: 4 months ago - Pushed at: almost 6 years ago - Stars: 51 - Forks: 32

tspannhw/nifi-nlp-processor

Apache NiFi NLP Processor

Language: Java - Size: 78.4 MB - Last synced at: about 1 year ago - Pushed at: over 1 year ago - Stars: 18 - Forks: 15

Renatoelho/nifi-kafka-integracao

Vou mostrar como realizar a integração entre o Apache Nifi e o Apache Kafka de maneira simples e eficiente. Ao combinar essas duas poderosas ferramentas, é possível otimizar o fluxo de dados entre sistemas de forma escalável e sem complicações.

Size: 193 KB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

minio/nifi-minio 📦

A custom ContentRepository implementation for NiFi to persist data to MinIO Object Storage

Language: Java - Size: 145 KB - Last synced at: about 1 year ago - Pushed at: almost 3 years ago - Stars: 32 - Forks: 8