Ecosyste.ms: Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: dataflow

SmartStandards/SmartAmbience

The 'AmbientField' is the next generation of 'AsyncLocal'. It can survive a context switch and can create/restore snapshots. Its perfect for getting multi-tenant support into microservies.

Language: C# - Size: 4.05 MB - Last synced: about 4 hours ago - Pushed: about 4 hours ago - Stars: 0 - Forks: 0

nipy/nipype

Workflows and interfaces for neuroimaging packages

Language: Python - Size: 74.8 MB - Last synced: 7 minutes ago - Pushed: 11 days ago - Stars: 735 - Forks: 520

allegro/bigflow

A Python framework for data processing on GCP.

Language: Python - Size: 107 MB - Last synced: about 16 hours ago - Pushed: about 23 hours ago - Stars: 116 - Forks: 23

GlobalFishingWatch/pipe-segment

Dataflow pipeline for running the vessel track segmenter.

Language: Python - Size: 116 MB - Last synced: about 22 hours ago - Pushed: 2 days ago - Stars: 1 - Forks: 2

Bearer/bearer

Code security scanning tool (SAST) to discover, filter and prioritize security and privacy risks.

Language: Go - Size: 22.7 MB - Last synced: about 21 hours ago - Pushed: 1 day ago - Stars: 1,774 - Forks: 81

simomux/LLVM_17

Lab assignments for my Middle-End compilers class A.Y. 2023-2024

Language: C++ - Size: 1.72 MB - Last synced: about 10 hours ago - Pushed: about 23 hours ago - Stars: 0 - Forks: 0

bytewax/bytewax

Python Stream Processing

Language: Python - Size: 10.4 MB - Last synced: about 24 hours ago - Pushed: 1 day ago - Stars: 1,230 - Forks: 56

Xilinx/finn

Dataflow compiler for QNN inference on FPGAs

Language: Python - Size: 77.1 MB - Last synced: about 24 hours ago - Pushed: 2 days ago - Stars: 672 - Forks: 213

oracle-samples/oracle-dataflow-samples

Sample examples Examples demonstrating how to use OCI Data Flow

Language: Scala - Size: 27.2 MB - Last synced: 1 day ago - Pushed: 2 days ago - Stars: 33 - Forks: 29

pd-l2ork/pd-l2ork

This is pd-l2ork 2.x that integrates pd-l2ork 1.x and Purr-Data and continues to build on the pd-l2ork's focus on user-friendly interface and a robust set of dsp objects.

Language: C - Size: 227 MB - Last synced: 2 days ago - Pushed: 3 days ago - Stars: 36 - Forks: 6

DFiantHDL/DFHDL

DFiant HDL (DFHDL): A Dataflow Hardware Descripition Language

Language: Scala - Size: 49 MB - Last synced: about 20 hours ago - Pushed: about 21 hours ago - Stars: 70 - Forks: 8

castilloglenn/dataflow-animation

Dataflow is a Python library designed to simplify the visualization of data flows through real-time animations.

Language: Python - Size: 88.9 KB - Last synced: 5 days ago - Pushed: 5 days ago - Stars: 0 - Forks: 0

trustmaster/pyflyde

Python runtime for Flyde - visual flow-based programming language and IDE

Language: Python - Size: 606 KB - Last synced: 7 days ago - Pushed: 8 days ago - Stars: 1 - Forks: 0

Chaffelson/nipyapi

A convenient Python wrapper for Apache NiFi

Language: Python - Size: 3.42 MB - Last synced: 2 days ago - Pushed: about 1 month ago - Stars: 241 - Forks: 75

cross-platform/dspatchables

DSPatch Component Repository

Language: C++ - Size: 6.92 MB - Last synced: 9 days ago - Pushed: 9 days ago - Stars: 24 - Forks: 6

joernio/joern

Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc

Language: Scala - Size: 154 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1,766 - Forks: 235

python-security/pyt

A Static Analysis Tool for Detecting Security Vulnerabilities in Python Web Applications

Language: Python - Size: 3.2 MB - Last synced: 5 days ago - Pushed: over 3 years ago - Stars: 2,163 - Forks: 238

cross-platform/dspatcher

Cross-Platform Graphical Tool for DSPatch

Language: C++ - Size: 5.05 MB - Last synced: 9 days ago - Pushed: 9 days ago - Stars: 59 - Forks: 16

Malcohol/BabelWires

A framework for data format conversion applications.

Language: C++ - Size: 2.54 MB - Last synced: 10 days ago - Pushed: 11 days ago - Stars: 0 - Forks: 0

wotbrew/relic

Functional relational programming for Clojure(Script).

Language: Clojure - Size: 1.67 MB - Last synced: 11 days ago - Pushed: 5 months ago - Stars: 395 - Forks: 7

GoogleCloudPlatform/data-analytics-golden-demo

An end to end demo of Google's Cloud data and analytic stack.

Language: Jupyter Notebook - Size: 10.5 MB - Last synced: 13 days ago - Pushed: 14 days ago - Stars: 194 - Forks: 54

dora-rs/dora

low latency, composable, and distributed dataflow for AI and robotic application

Language: Rust - Size: 5.19 MB - Last synced: 16 days ago - Pushed: 16 days ago - Stars: 1,017 - Forks: 45

composewell/streamly

High performance, concurrent functional programming abstractions

Language: Haskell - Size: 15.2 MB - Last synced: 14 days ago - Pushed: 15 days ago - Stars: 849 - Forks: 62

newcat/baklavajs

Graph / node editor in the browser using VueJS

Language: TypeScript - Size: 10.6 MB - Last synced: 15 days ago - Pushed: 15 days ago - Stars: 1,373 - Forks: 106

houseofcat/RabbitMQ.Dataflows

A set of libraries for rapidly developing RabbitMQ workflows/pipelines.

Language: C# - Size: 2 MB - Last synced: 16 days ago - Pushed: 16 days ago - Stars: 10 - Forks: 2

streamblocks/streamblocks-platforms

StreamBlocks available platforms

Language: C++ - Size: 3.5 MB - Last synced: about 21 hours ago - Pushed: 1 day ago - Stars: 5 - Forks: 3

scipipe/scipipe

Robust, flexible and resource-efficient pipelines using Go and the commandline

Language: Go - Size: 1.05 MB - Last synced: 11 days ago - Pushed: 10 months ago - Stars: 1,053 - Forks: 72

BayAreaCloudCity/gcp

Predictive Traffic Analysis with Google Cloud Platforms

Language: Python - Size: 51.8 KB - Last synced: 15 days ago - Pushed: 15 days ago - Stars: 1 - Forks: 0

ipyflow/ipyflow

A reactive Python kernel for Jupyter notebooks.

Language: Python - Size: 23.3 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1,072 - Forks: 20

steltenpower/flowchat

IDEA: Draw processes and channels very fast and then generate code (e.g. Golang compiled to WASM brings parallelism to browser)

Language: HTML - Size: 69.3 KB - Last synced: 16 days ago - Pushed: 7 months ago - Stars: 1 - Forks: 0

stanford-mast/nn_dataflow

Explore the energy-efficient dataflow scheduling for neural networks.

Language: Python - Size: 1.05 MB - Last synced: 14 days ago - Pushed: over 3 years ago - Stars: 206 - Forks: 78

MichaelGehling/FeatureLoom

FeatureLoom is a C# development framework that focuses on a lean development and efficient code, speeds-up development by simplification while offering opt-in for a high level of control, promotes modular and extensible code by introducing means to easily decouple components with asynchronous communication, strives for high performance and a small memory footprint, equally supports synchronous and asynchronous programming to allow the right approach at the right time.

Language: C# - Size: 3.88 MB - Last synced: 15 days ago - Pushed: 17 days ago - Stars: 8 - Forks: 0

janaom/gcp-de-project-streaming-pubsub-beam-dataflow

This project demonstrates an end-to-end solution for processing and analyzing real-time conversations data from a JSON file using GCP services and infrastructure automation, showcasing data storage, streaming, processing, and analysis at scale.

Language: Python - Size: 172 KB - Last synced: 18 days ago - Pushed: 18 days ago - Stars: 0 - Forks: 0

google/megalista

First Party data integration solution built for marketing teams to enable audience and conversion onboarding into Google Marketing products (Google Ads, Campaign Manager, Google Analytics).

Language: Python - Size: 1.34 MB - Last synced: 9 days ago - Pushed: 29 days ago - Stars: 117 - Forks: 55

VikramTiwari/end-to-end-machine-learning-with-google-cloud

End to End Machine Learning with Google Cloud Platform

Language: Python - Size: 33.2 KB - Last synced: 16 days ago - Pushed: over 5 years ago - Stars: 42 - Forks: 15

jerosoler/Drawflow

Simple flow library 🖥️🖱️

Language: JavaScript - Size: 6.9 MB - Last synced: about 1 month ago - Pushed: about 2 months ago - Stars: 4,100 - Forks: 686

Emplifi/BakeryJS

Dataprocessing framework for JavaScript 🎂

Language: TypeScript - Size: 2.61 MB - Last synced: 21 days ago - Pushed: over 1 year ago - Stars: 25 - Forks: 6

asyncvlsi/act

ACT hardware description language and core tools.

Language: C++ - Size: 4.77 MB - Last synced: 21 days ago - Pushed: 21 days ago - Stars: 92 - Forks: 22

openrewrite/rewrite-analysis

OpenRewrite recipes for data flow analysis.

Language: Java - Size: 76.1 MB - Last synced: 16 days ago - Pushed: 21 days ago - Stars: 8 - Forks: 8

SpatialGraphics/SpatialNode

Qt Node Editor. Dataflow programming framework for pyside6

Language: Python - Size: 1.11 MB - Last synced: 6 days ago - Pushed: 22 days ago - Stars: 3 - Forks: 1

vectaport/flowgraph

Flowgraph package for scalable asynchronous system development

Language: Go - Size: 164 KB - Last synced: 17 days ago - Pushed: about 3 years ago - Stars: 56 - Forks: 8

izar/pytm

A Pythonic framework for threat modeling

Language: Python - Size: 1.6 MB - Last synced: 22 days ago - Pushed: 22 days ago - Stars: 836 - Forks: 160

AhmadrezaMozaffary/1st-react-project

A small expense tracker application which developed using HTML, CSS, Javascript, and ReactJS library 🏅

Language: JavaScript - Size: 301 KB - Last synced: 23 days ago - Pushed: almost 2 years ago - Stars: 1 - Forks: 0

spotify/scio

A Scala API for Apache Beam and Google Cloud Dataflow.

Language: Scala - Size: 61.4 MB - Last synced: 27 days ago - Pushed: 28 days ago - Stars: 2,520 - Forks: 507

microflo/microflo

Live dataflow programming for microcontrollers and embedded

Language: CoffeeScript - Size: 10.5 MB - Last synced: 12 days ago - Pushed: almost 4 years ago - Stars: 217 - Forks: 27

ffernandez92/airflow-composer-plugins

Airflow Composer Plugins

Language: HTML - Size: 72.3 KB - Last synced: 25 days ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0

sfujiwara/dataflow-gcs2gdrive

An implementation of Dataflow Template copying files from Google Cloud Storage to Google Drive

Language: Python - Size: 6.84 KB - Last synced: 25 days ago - Pushed: over 5 years ago - Stars: 3 - Forks: 1

VikramTiwari/dataflow-samples

samples for dataflow

Language: Python - Size: 62.5 KB - Last synced: 16 days ago - Pushed: over 6 years ago - Stars: 2 - Forks: 1

gkrupp/FlowPy

ELTE Computer Science, BSc Thesis 2019 – Dataflow interface for python packages

Language: JavaScript - Size: 1.28 MB - Last synced: 26 days ago - Pushed: over 3 years ago - Stars: 1 - Forks: 0

Blocks-Editor/blocks

Blocks. An online drag-and-drop smart contract builder.

Language: JavaScript - Size: 25.4 MB - Last synced: 19 days ago - Pushed: 8 months ago - Stars: 151 - Forks: 34

dgtony/dataflow

Dataflow-like execution for complex computations

Language: Go - Size: 17.6 KB - Last synced: 27 days ago - Pushed: over 4 years ago - Stars: 2 - Forks: 0

skydoves/Chamber

⚖️ A lightweight Android lifecycle-aware and thread-safe pipeline for communicating between components with custom scopes.

Language: Kotlin - Size: 255 KB - Last synced: 16 days ago - Pushed: about 3 years ago - Stars: 186 - Forks: 13

cda-group/arcon

State-first Streaming Applications in Rust

Language: Rust - Size: 3.27 MB - Last synced: 28 days ago - Pushed: almost 2 years ago - Stars: 172 - Forks: 17

deib-polimi/renoir

Reactive Network of Operators In Rust. Framework for Parallel and distributed computation inspired from the DataFlow model

Language: Rust - Size: 6.24 MB - Last synced: 28 days ago - Pushed: about 1 month ago - Stars: 45 - Forks: 3

asg017/dataflow

An experimental self-hosted Observable notebook editor, with support for FileAttachments, Secrets, custom standard libraries, and more!

Language: JavaScript - Size: 704 KB - Last synced: 13 days ago - Pushed: over 2 years ago - Stars: 379 - Forks: 21

hopenbuild/Data-Hopen

A dataflow-graph library and task runner with first-class edges

Language: Perl - Size: 520 KB - Last synced: 29 days ago - Pushed: about 3 years ago - Stars: 0 - Forks: 1

benman1/pipes

minimal workflow engine for data processing (POC)

Language: C++ - Size: 33.2 KB - Last synced: 29 days ago - Pushed: about 5 years ago - Stars: 0 - Forks: 0

thi-ng/umbrella

⛱ Broadly scoped ecosystem & mono-repository of 190 TypeScript projects (and 155 examples) for general purpose, functional, data driven development

Language: TypeScript - Size: 199 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 3,198 - Forks: 143

GoogleCloudPlatform/fraudfinder

Fraudfinder: A comprehensive lab series on how to build a real-time fraud detection system on Google Cloud

Language: Jupyter Notebook - Size: 13 MB - Last synced: 29 days ago - Pushed: about 1 month ago - Stars: 177 - Forks: 66

kestra-io/docs

Documentation for Kestra — an event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

Language: Vue - Size: 1.17 GB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 61 - Forks: 46

ffan/dbus Fork of funkygao/dbus

yet another databus that transfer/transform pipeline data between plugins

Language: Go - Size: 940 KB - Last synced: about 1 month ago - Pushed: about 7 years ago - Stars: 3 - Forks: 0

erdos-project/erdos

Dataflow system for building self-driving car and robotics applications.

Language: Rust - Size: 10.2 MB - Last synced: 25 days ago - Pushed: over 1 year ago - Stars: 191 - Forks: 43

a972667237/data-flow-c

data-flow-c is a project that extend c language, this repo is the runtime library of data-flow-c

Language: C - Size: 125 KB - Last synced: about 1 month ago - Pushed: almost 5 years ago - Stars: 1 - Forks: 0

eea/eprtr-lcp-dataflow

Language: XQuery - Size: 9.75 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1 - Forks: 0

davideanastasia/apache-beam-getting-started

Getting Started with Apache Beam: inverted index

Language: Java - Size: 15.6 KB - Last synced: about 1 month ago - Pushed: almost 6 years ago - Stars: 5 - Forks: 2

kentaro/pratipad

A Declarative Framework for Describing Bidirectional Dataflow.

Language: Elixir - Size: 48.8 KB - Last synced: about 1 month ago - Pushed: about 2 years ago - Stars: 9 - Forks: 0

preesm/preesm

Parallel and Real-time Embedded Executives Scheduling Method

Language: Java - Size: 214 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 32 - Forks: 8

ARM-software/CMSIS-Stream

CMSIS-Stream software component

Language: Python - Size: 8.64 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 12 - Forks: 1

noleme/noleme-flow

A library enabling DAG structuring of data processing programs such as ETLs

Language: Java - Size: 297 KB - Last synced: about 2 months ago - Pushed: 2 months ago - Stars: 15 - Forks: 4

nevalang/neva

🌊 Flow-based programming language with static types and implicit parallelism. Compiles to native code and Go

Language: Go - Size: 23 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 68 - Forks: 7

ERnsTL/flowd

An inter-language runtime for flow-based programming (FBP)

Language: Rust - Size: 1.94 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 24 - Forks: 2

vspiewak/google-dataflow-boilerplate

PubSub To BigQuery using DataFlow & Spotify SCIO

Language: Java - Size: 15.6 KB - Last synced: about 1 month ago - Pushed: about 7 years ago - Stars: 1 - Forks: 1

nextflow-io/nextflow

A DSL for data-driven computational pipelines

Language: Groovy - Size: 53.8 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 2,536 - Forks: 584

willcrichton/flowistry

Flowistry is an IDE plugin for Rust that helps you focus on relevant code.

Language: Rust - Size: 69.9 MB - Last synced: 30 days ago - Pushed: 3 months ago - Stars: 1,815 - Forks: 39

google/grizzly

End-to-end DataOps platform deployed by Terraform.

Language: Python - Size: 112 MB - Last synced: 9 days ago - Pushed: 15 days ago - Stars: 56 - Forks: 10

jerosoler/drawflow-minimap-example

Example of Minimap for Drawflow

Language: JavaScript - Size: 4.88 KB - Last synced: about 1 month ago - Pushed: almost 3 years ago - Stars: 11 - Forks: 5

horizon-research/systolic-array-dataflow-optimizer

A general framework for optimizing DNN dataflow on systolic array

Language: Python - Size: 61.5 KB - Last synced: 30 days ago - Pushed: over 3 years ago - Stars: 29 - Forks: 9

zslwyuan/Hi-ClockFlow

Multi-Clock Dataflow Automation and Throughput Optimization in High-Level Synthesis

Size: 7.81 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1 - Forks: 0

eea/pam-necs-webform

Questionnaire for reporting on Policies and Measures under the Directive (EU) 2016/2284 of the European Parliament and of the Council on the reduction of national emission of certain atmospheric pollutants (NEC Directive)

Language: HTML - Size: 302 KB - Last synced: about 1 month ago - Pushed: over 5 years ago - Stars: 0 - Forks: 0

eea/mmr-art15-webform

Language: Vue - Size: 1.08 MB - Last synced: about 1 month ago - Pushed: over 5 years ago - Stars: 0 - Forks: 0

eea/lcp-dataflow

XQuery checks for LCP dataflow

Language: JavaScript - Size: 14.8 MB - Last synced: about 1 month ago - Pushed: over 5 years ago - Stars: 0 - Forks: 0

eea/cdda-dataflow

CDDA - xquery checks

Language: XQuery - Size: 345 KB - Last synced: about 1 month ago - Pushed: over 6 years ago - Stars: 0 - Forks: 0

eea/air-quality-dataflow

Air Quality dataflow checks

Language: XQuery - Size: 5.1 MB - Last synced: about 1 month ago - Pushed: over 6 years ago - Stars: 0 - Forks: 0

cross-platform/dspatch

The Refreshingly Simple Cross-Platform C++ Dataflow / Patching / Pipelining / Graph Processing / Stream Processing / Reactive Programming Framework

Language: C++ - Size: 5.85 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 200 - Forks: 43

serverless/event-gateway

React to any event with serverless functions across clouds

Language: Go - Size: 1.12 MB - Last synced: about 1 month ago - Pushed: almost 4 years ago - Stars: 1,643 - Forks: 97

GoogleCloudPlatform/dlp-dataflow-deidentification

Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP

Language: Java - Size: 47.5 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 83 - Forks: 55

johannaojeling/dataflow-gcp-aws-identity-federation

Guide and resources to set up identity federation between GCP and AWS which enables a Dataflow service account to assume an AWS role

Language: Go - Size: 11.7 KB - Last synced: about 2 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0

chigraph/chigraph

A visual systems language for beginners compiled using LLVM

Language: C++ - Size: 63.5 MB - Last synced: 30 days ago - Pushed: 8 months ago - Stars: 379 - Forks: 66

hasielhassan/PlumberManager

A helper tool to design CG Pipeline interactive diagrams and data flow documentation

Language: Python - Size: 3.97 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 57 - Forks: 6

gtk7032/pglineage

pglineage is a tool to create data flow diagrams for PostgreSQL by analyzing SQL

Language: Python - Size: 972 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 14 - Forks: 1

spotify/pythonflow

:snake: Dataflow programming for python.

Language: Python - Size: 222 KB - Last synced: about 1 month ago - Pushed: 12 months ago - Stars: 280 - Forks: 49

russomi-labs/gcloud-data-notes

Notes for Data Engineer – Professional Certification Preparation for Google

Size: 42 KB - Last synced: about 2 months ago - Pushed: over 5 years ago - Stars: 5 - Forks: 2

orcc/orc-apps

Open RVC-CAL Applications

Language: C - Size: 20.9 MB - Last synced: about 2 months ago - Pushed: about 3 years ago - Stars: 11 - Forks: 10

google/shenzhen-go 📦

Experimental visual Go environment

Language: JavaScript - Size: 87.6 MB - Last synced: 9 days ago - Pushed: almost 3 years ago - Stars: 464 - Forks: 44

a5chin/event-driven-dataflow

This Terraform module sets up a workflow where files stored in Cloud Storage trigger events in Eventarc, which then processes the files and stores the data in Spanner.

Language: HCL - Size: 123 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0

helioribeiro/dataflow-coding-challenge-delivery

This repo contains step by step guide on how I executed this challenge. I won't disclaim challenge information, as this repo was made specifically for the team that created the test.

Language: Python - Size: 25.4 KB - Last synced: about 2 months ago - Pushed: 2 months ago - Stars: 0 - Forks: 0

Jasmine582/Name_Tags

Name tag generator to create bulk name tags using functional components and ES6 modules.

Language: JavaScript - Size: 3.91 KB - Last synced: about 2 months ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

Jasmine582/Hotel_Booking_App

A hotel search tool that allows the user to filter the type of hotel they would like to stay in

Language: JavaScript - Size: 6.84 KB - Last synced: about 2 months ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0

denniskniep/provider-springclouddataflow

Crossplane Spring Cloud Data Flow Provider

Language: Go - Size: 184 KB - Last synced: 26 days ago - Pushed: 2 months ago - Stars: 2 - Forks: 0

Nicolas-Constanty/Dnai.Editor

Dnai Editor - Visual Scripting (Node Editor)

Language: C++ - Size: 205 MB - Last synced: about 2 months ago - Pushed: about 4 years ago - Stars: 134 - Forks: 30