Ecosyste.ms: Repos
An open API service providing repository metadata for many open source software ecosystems.
GitHub topics: dataflow
SmartStandards/SmartAmbience
The 'AmbientField' is the next generation of 'AsyncLocal'. It can survive a context switch and can create/restore snapshots. Its perfect for getting multi-tenant support into microservies.
Language: C# - Size: 4.05 MB - Last synced: about 4 hours ago - Pushed: about 4 hours ago - Stars: 0 - Forks: 0
nipy/nipype
Workflows and interfaces for neuroimaging packages
Language: Python - Size: 74.8 MB - Last synced: 7 minutes ago - Pushed: 11 days ago - Stars: 735 - Forks: 520
allegro/bigflow
A Python framework for data processing on GCP.
Language: Python - Size: 107 MB - Last synced: about 16 hours ago - Pushed: about 23 hours ago - Stars: 116 - Forks: 23
GlobalFishingWatch/pipe-segment
Dataflow pipeline for running the vessel track segmenter.
Language: Python - Size: 116 MB - Last synced: about 22 hours ago - Pushed: 2 days ago - Stars: 1 - Forks: 2
Bearer/bearer
Code security scanning tool (SAST) to discover, filter and prioritize security and privacy risks.
Language: Go - Size: 22.7 MB - Last synced: about 21 hours ago - Pushed: 1 day ago - Stars: 1,774 - Forks: 81
simomux/LLVM_17
Lab assignments for my Middle-End compilers class A.Y. 2023-2024
Language: C++ - Size: 1.72 MB - Last synced: about 10 hours ago - Pushed: about 23 hours ago - Stars: 0 - Forks: 0
bytewax/bytewax
Python Stream Processing
Language: Python - Size: 10.4 MB - Last synced: about 24 hours ago - Pushed: 1 day ago - Stars: 1,230 - Forks: 56
Xilinx/finn
Dataflow compiler for QNN inference on FPGAs
Language: Python - Size: 77.1 MB - Last synced: about 24 hours ago - Pushed: 2 days ago - Stars: 672 - Forks: 213
oracle-samples/oracle-dataflow-samples
Sample examples Examples demonstrating how to use OCI Data Flow
Language: Scala - Size: 27.2 MB - Last synced: 1 day ago - Pushed: 2 days ago - Stars: 33 - Forks: 29
pd-l2ork/pd-l2ork
This is pd-l2ork 2.x that integrates pd-l2ork 1.x and Purr-Data and continues to build on the pd-l2ork's focus on user-friendly interface and a robust set of dsp objects.
Language: C - Size: 227 MB - Last synced: 2 days ago - Pushed: 3 days ago - Stars: 36 - Forks: 6
DFiantHDL/DFHDL
DFiant HDL (DFHDL): A Dataflow Hardware Descripition Language
Language: Scala - Size: 49 MB - Last synced: about 20 hours ago - Pushed: about 21 hours ago - Stars: 70 - Forks: 8
castilloglenn/dataflow-animation
Dataflow is a Python library designed to simplify the visualization of data flows through real-time animations.
Language: Python - Size: 88.9 KB - Last synced: 5 days ago - Pushed: 5 days ago - Stars: 0 - Forks: 0
trustmaster/pyflyde
Python runtime for Flyde - visual flow-based programming language and IDE
Language: Python - Size: 606 KB - Last synced: 7 days ago - Pushed: 8 days ago - Stars: 1 - Forks: 0
Chaffelson/nipyapi
A convenient Python wrapper for Apache NiFi
Language: Python - Size: 3.42 MB - Last synced: 2 days ago - Pushed: about 1 month ago - Stars: 241 - Forks: 75
cross-platform/dspatchables
DSPatch Component Repository
Language: C++ - Size: 6.92 MB - Last synced: 9 days ago - Pushed: 9 days ago - Stars: 24 - Forks: 6
joernio/joern
Open-source code analysis platform for C/C++/Java/Binary/Javascript/Python/Kotlin based on code property graphs. Discord https://discord.gg/vv4MH284Hc
Language: Scala - Size: 154 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1,766 - Forks: 235
python-security/pyt
A Static Analysis Tool for Detecting Security Vulnerabilities in Python Web Applications
Language: Python - Size: 3.2 MB - Last synced: 5 days ago - Pushed: over 3 years ago - Stars: 2,163 - Forks: 238
cross-platform/dspatcher
Cross-Platform Graphical Tool for DSPatch
Language: C++ - Size: 5.05 MB - Last synced: 9 days ago - Pushed: 9 days ago - Stars: 59 - Forks: 16
Malcohol/BabelWires
A framework for data format conversion applications.
Language: C++ - Size: 2.54 MB - Last synced: 10 days ago - Pushed: 11 days ago - Stars: 0 - Forks: 0
wotbrew/relic
Functional relational programming for Clojure(Script).
Language: Clojure - Size: 1.67 MB - Last synced: 11 days ago - Pushed: 5 months ago - Stars: 395 - Forks: 7
GoogleCloudPlatform/data-analytics-golden-demo
An end to end demo of Google's Cloud data and analytic stack.
Language: Jupyter Notebook - Size: 10.5 MB - Last synced: 13 days ago - Pushed: 14 days ago - Stars: 194 - Forks: 54
dora-rs/dora
low latency, composable, and distributed dataflow for AI and robotic application
Language: Rust - Size: 5.19 MB - Last synced: 16 days ago - Pushed: 16 days ago - Stars: 1,017 - Forks: 45
composewell/streamly
High performance, concurrent functional programming abstractions
Language: Haskell - Size: 15.2 MB - Last synced: 14 days ago - Pushed: 15 days ago - Stars: 849 - Forks: 62
newcat/baklavajs
Graph / node editor in the browser using VueJS
Language: TypeScript - Size: 10.6 MB - Last synced: 15 days ago - Pushed: 15 days ago - Stars: 1,373 - Forks: 106
houseofcat/RabbitMQ.Dataflows
A set of libraries for rapidly developing RabbitMQ workflows/pipelines.
Language: C# - Size: 2 MB - Last synced: 16 days ago - Pushed: 16 days ago - Stars: 10 - Forks: 2
streamblocks/streamblocks-platforms
StreamBlocks available platforms
Language: C++ - Size: 3.5 MB - Last synced: about 21 hours ago - Pushed: 1 day ago - Stars: 5 - Forks: 3
scipipe/scipipe
Robust, flexible and resource-efficient pipelines using Go and the commandline
Language: Go - Size: 1.05 MB - Last synced: 11 days ago - Pushed: 10 months ago - Stars: 1,053 - Forks: 72
BayAreaCloudCity/gcp
Predictive Traffic Analysis with Google Cloud Platforms
Language: Python - Size: 51.8 KB - Last synced: 15 days ago - Pushed: 15 days ago - Stars: 1 - Forks: 0
ipyflow/ipyflow
A reactive Python kernel for Jupyter notebooks.
Language: Python - Size: 23.3 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1,072 - Forks: 20
steltenpower/flowchat
IDEA: Draw processes and channels very fast and then generate code (e.g. Golang compiled to WASM brings parallelism to browser)
Language: HTML - Size: 69.3 KB - Last synced: 16 days ago - Pushed: 7 months ago - Stars: 1 - Forks: 0
stanford-mast/nn_dataflow
Explore the energy-efficient dataflow scheduling for neural networks.
Language: Python - Size: 1.05 MB - Last synced: 14 days ago - Pushed: over 3 years ago - Stars: 206 - Forks: 78
MichaelGehling/FeatureLoom
FeatureLoom is a C# development framework that focuses on a lean development and efficient code, speeds-up development by simplification while offering opt-in for a high level of control, promotes modular and extensible code by introducing means to easily decouple components with asynchronous communication, strives for high performance and a small memory footprint, equally supports synchronous and asynchronous programming to allow the right approach at the right time.
Language: C# - Size: 3.88 MB - Last synced: 15 days ago - Pushed: 17 days ago - Stars: 8 - Forks: 0
janaom/gcp-de-project-streaming-pubsub-beam-dataflow
This project demonstrates an end-to-end solution for processing and analyzing real-time conversations data from a JSON file using GCP services and infrastructure automation, showcasing data storage, streaming, processing, and analysis at scale.
Language: Python - Size: 172 KB - Last synced: 18 days ago - Pushed: 18 days ago - Stars: 0 - Forks: 0
google/megalista
First Party data integration solution built for marketing teams to enable audience and conversion onboarding into Google Marketing products (Google Ads, Campaign Manager, Google Analytics).
Language: Python - Size: 1.34 MB - Last synced: 9 days ago - Pushed: 29 days ago - Stars: 117 - Forks: 55
VikramTiwari/end-to-end-machine-learning-with-google-cloud
End to End Machine Learning with Google Cloud Platform
Language: Python - Size: 33.2 KB - Last synced: 16 days ago - Pushed: over 5 years ago - Stars: 42 - Forks: 15
jerosoler/Drawflow
Simple flow library 🖥️🖱️
Language: JavaScript - Size: 6.9 MB - Last synced: about 1 month ago - Pushed: about 2 months ago - Stars: 4,100 - Forks: 686
Emplifi/BakeryJS
Dataprocessing framework for JavaScript 🎂
Language: TypeScript - Size: 2.61 MB - Last synced: 21 days ago - Pushed: over 1 year ago - Stars: 25 - Forks: 6
asyncvlsi/act
ACT hardware description language and core tools.
Language: C++ - Size: 4.77 MB - Last synced: 21 days ago - Pushed: 21 days ago - Stars: 92 - Forks: 22
openrewrite/rewrite-analysis
OpenRewrite recipes for data flow analysis.
Language: Java - Size: 76.1 MB - Last synced: 16 days ago - Pushed: 21 days ago - Stars: 8 - Forks: 8
SpatialGraphics/SpatialNode
Qt Node Editor. Dataflow programming framework for pyside6
Language: Python - Size: 1.11 MB - Last synced: 6 days ago - Pushed: 22 days ago - Stars: 3 - Forks: 1
vectaport/flowgraph
Flowgraph package for scalable asynchronous system development
Language: Go - Size: 164 KB - Last synced: 17 days ago - Pushed: about 3 years ago - Stars: 56 - Forks: 8
izar/pytm
A Pythonic framework for threat modeling
Language: Python - Size: 1.6 MB - Last synced: 22 days ago - Pushed: 22 days ago - Stars: 836 - Forks: 160
AhmadrezaMozaffary/1st-react-project
A small expense tracker application which developed using HTML, CSS, Javascript, and ReactJS library 🏅
Language: JavaScript - Size: 301 KB - Last synced: 23 days ago - Pushed: almost 2 years ago - Stars: 1 - Forks: 0
spotify/scio
A Scala API for Apache Beam and Google Cloud Dataflow.
Language: Scala - Size: 61.4 MB - Last synced: 27 days ago - Pushed: 28 days ago - Stars: 2,520 - Forks: 507
microflo/microflo
Live dataflow programming for microcontrollers and embedded
Language: CoffeeScript - Size: 10.5 MB - Last synced: 12 days ago - Pushed: almost 4 years ago - Stars: 217 - Forks: 27
ffernandez92/airflow-composer-plugins
Airflow Composer Plugins
Language: HTML - Size: 72.3 KB - Last synced: 25 days ago - Pushed: over 3 years ago - Stars: 0 - Forks: 0
sfujiwara/dataflow-gcs2gdrive
An implementation of Dataflow Template copying files from Google Cloud Storage to Google Drive
Language: Python - Size: 6.84 KB - Last synced: 25 days ago - Pushed: over 5 years ago - Stars: 3 - Forks: 1
VikramTiwari/dataflow-samples
samples for dataflow
Language: Python - Size: 62.5 KB - Last synced: 16 days ago - Pushed: over 6 years ago - Stars: 2 - Forks: 1
gkrupp/FlowPy
ELTE Computer Science, BSc Thesis 2019 – Dataflow interface for python packages
Language: JavaScript - Size: 1.28 MB - Last synced: 26 days ago - Pushed: over 3 years ago - Stars: 1 - Forks: 0
Blocks-Editor/blocks
Blocks. An online drag-and-drop smart contract builder.
Language: JavaScript - Size: 25.4 MB - Last synced: 19 days ago - Pushed: 8 months ago - Stars: 151 - Forks: 34
dgtony/dataflow
Dataflow-like execution for complex computations
Language: Go - Size: 17.6 KB - Last synced: 27 days ago - Pushed: over 4 years ago - Stars: 2 - Forks: 0
skydoves/Chamber
⚖️ A lightweight Android lifecycle-aware and thread-safe pipeline for communicating between components with custom scopes.
Language: Kotlin - Size: 255 KB - Last synced: 16 days ago - Pushed: about 3 years ago - Stars: 186 - Forks: 13
cda-group/arcon
State-first Streaming Applications in Rust
Language: Rust - Size: 3.27 MB - Last synced: 28 days ago - Pushed: almost 2 years ago - Stars: 172 - Forks: 17
deib-polimi/renoir
Reactive Network of Operators In Rust. Framework for Parallel and distributed computation inspired from the DataFlow model
Language: Rust - Size: 6.24 MB - Last synced: 28 days ago - Pushed: about 1 month ago - Stars: 45 - Forks: 3
asg017/dataflow
An experimental self-hosted Observable notebook editor, with support for FileAttachments, Secrets, custom standard libraries, and more!
Language: JavaScript - Size: 704 KB - Last synced: 13 days ago - Pushed: over 2 years ago - Stars: 379 - Forks: 21
hopenbuild/Data-Hopen
A dataflow-graph library and task runner with first-class edges
Language: Perl - Size: 520 KB - Last synced: 29 days ago - Pushed: about 3 years ago - Stars: 0 - Forks: 1
benman1/pipes
minimal workflow engine for data processing (POC)
Language: C++ - Size: 33.2 KB - Last synced: 29 days ago - Pushed: about 5 years ago - Stars: 0 - Forks: 0
thi-ng/umbrella
⛱ Broadly scoped ecosystem & mono-repository of 190 TypeScript projects (and 155 examples) for general purpose, functional, data driven development
Language: TypeScript - Size: 199 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 3,198 - Forks: 143
GoogleCloudPlatform/fraudfinder
Fraudfinder: A comprehensive lab series on how to build a real-time fraud detection system on Google Cloud
Language: Jupyter Notebook - Size: 13 MB - Last synced: 29 days ago - Pushed: about 1 month ago - Stars: 177 - Forks: 66
kestra-io/docs
Documentation for Kestra — an event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
Language: Vue - Size: 1.17 GB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 61 - Forks: 46
ffan/dbus Fork of funkygao/dbus
yet another databus that transfer/transform pipeline data between plugins
Language: Go - Size: 940 KB - Last synced: about 1 month ago - Pushed: about 7 years ago - Stars: 3 - Forks: 0
erdos-project/erdos
Dataflow system for building self-driving car and robotics applications.
Language: Rust - Size: 10.2 MB - Last synced: 25 days ago - Pushed: over 1 year ago - Stars: 191 - Forks: 43
a972667237/data-flow-c
data-flow-c is a project that extend c language, this repo is the runtime library of data-flow-c
Language: C - Size: 125 KB - Last synced: about 1 month ago - Pushed: almost 5 years ago - Stars: 1 - Forks: 0
eea/eprtr-lcp-dataflow
Language: XQuery - Size: 9.75 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1 - Forks: 0
davideanastasia/apache-beam-getting-started
Getting Started with Apache Beam: inverted index
Language: Java - Size: 15.6 KB - Last synced: about 1 month ago - Pushed: almost 6 years ago - Stars: 5 - Forks: 2
kentaro/pratipad
A Declarative Framework for Describing Bidirectional Dataflow.
Language: Elixir - Size: 48.8 KB - Last synced: about 1 month ago - Pushed: about 2 years ago - Stars: 9 - Forks: 0
preesm/preesm
Parallel and Real-time Embedded Executives Scheduling Method
Language: Java - Size: 214 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 32 - Forks: 8
ARM-software/CMSIS-Stream
CMSIS-Stream software component
Language: Python - Size: 8.64 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 12 - Forks: 1
noleme/noleme-flow
A library enabling DAG structuring of data processing programs such as ETLs
Language: Java - Size: 297 KB - Last synced: about 2 months ago - Pushed: 2 months ago - Stars: 15 - Forks: 4
nevalang/neva
🌊 Flow-based programming language with static types and implicit parallelism. Compiles to native code and Go
Language: Go - Size: 23 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 68 - Forks: 7
ERnsTL/flowd
An inter-language runtime for flow-based programming (FBP)
Language: Rust - Size: 1.94 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 24 - Forks: 2
vspiewak/google-dataflow-boilerplate
PubSub To BigQuery using DataFlow & Spotify SCIO
Language: Java - Size: 15.6 KB - Last synced: about 1 month ago - Pushed: about 7 years ago - Stars: 1 - Forks: 1
nextflow-io/nextflow
A DSL for data-driven computational pipelines
Language: Groovy - Size: 53.8 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 2,536 - Forks: 584
willcrichton/flowistry
Flowistry is an IDE plugin for Rust that helps you focus on relevant code.
Language: Rust - Size: 69.9 MB - Last synced: 30 days ago - Pushed: 3 months ago - Stars: 1,815 - Forks: 39
google/grizzly
End-to-end DataOps platform deployed by Terraform.
Language: Python - Size: 112 MB - Last synced: 9 days ago - Pushed: 15 days ago - Stars: 56 - Forks: 10
jerosoler/drawflow-minimap-example
Example of Minimap for Drawflow
Language: JavaScript - Size: 4.88 KB - Last synced: about 1 month ago - Pushed: almost 3 years ago - Stars: 11 - Forks: 5
horizon-research/systolic-array-dataflow-optimizer
A general framework for optimizing DNN dataflow on systolic array
Language: Python - Size: 61.5 KB - Last synced: 30 days ago - Pushed: over 3 years ago - Stars: 29 - Forks: 9
zslwyuan/Hi-ClockFlow
Multi-Clock Dataflow Automation and Throughput Optimization in High-Level Synthesis
Size: 7.81 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 1 - Forks: 0
eea/pam-necs-webform
Questionnaire for reporting on Policies and Measures under the Directive (EU) 2016/2284 of the European Parliament and of the Council on the reduction of national emission of certain atmospheric pollutants (NEC Directive)
Language: HTML - Size: 302 KB - Last synced: about 1 month ago - Pushed: over 5 years ago - Stars: 0 - Forks: 0
eea/mmr-art15-webform
Language: Vue - Size: 1.08 MB - Last synced: about 1 month ago - Pushed: over 5 years ago - Stars: 0 - Forks: 0
eea/lcp-dataflow
XQuery checks for LCP dataflow
Language: JavaScript - Size: 14.8 MB - Last synced: about 1 month ago - Pushed: over 5 years ago - Stars: 0 - Forks: 0
eea/cdda-dataflow
CDDA - xquery checks
Language: XQuery - Size: 345 KB - Last synced: about 1 month ago - Pushed: over 6 years ago - Stars: 0 - Forks: 0
eea/air-quality-dataflow
Air Quality dataflow checks
Language: XQuery - Size: 5.1 MB - Last synced: about 1 month ago - Pushed: over 6 years ago - Stars: 0 - Forks: 0
cross-platform/dspatch
The Refreshingly Simple Cross-Platform C++ Dataflow / Patching / Pipelining / Graph Processing / Stream Processing / Reactive Programming Framework
Language: C++ - Size: 5.85 MB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 200 - Forks: 43
serverless/event-gateway
React to any event with serverless functions across clouds
Language: Go - Size: 1.12 MB - Last synced: about 1 month ago - Pushed: almost 4 years ago - Stars: 1,643 - Forks: 97
GoogleCloudPlatform/dlp-dataflow-deidentification
Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP
Language: Java - Size: 47.5 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 83 - Forks: 55
johannaojeling/dataflow-gcp-aws-identity-federation
Guide and resources to set up identity federation between GCP and AWS which enables a Dataflow service account to assume an AWS role
Language: Go - Size: 11.7 KB - Last synced: about 2 months ago - Pushed: over 1 year ago - Stars: 0 - Forks: 0
chigraph/chigraph
A visual systems language for beginners compiled using LLVM
Language: C++ - Size: 63.5 MB - Last synced: 30 days ago - Pushed: 8 months ago - Stars: 379 - Forks: 66
hasielhassan/PlumberManager
A helper tool to design CG Pipeline interactive diagrams and data flow documentation
Language: Python - Size: 3.97 MB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 57 - Forks: 6
gtk7032/pglineage
pglineage is a tool to create data flow diagrams for PostgreSQL by analyzing SQL
Language: Python - Size: 972 KB - Last synced: about 1 month ago - Pushed: about 1 month ago - Stars: 14 - Forks: 1
spotify/pythonflow
:snake: Dataflow programming for python.
Language: Python - Size: 222 KB - Last synced: about 1 month ago - Pushed: 12 months ago - Stars: 280 - Forks: 49
russomi-labs/gcloud-data-notes
Notes for Data Engineer – Professional Certification Preparation for Google
Size: 42 KB - Last synced: about 2 months ago - Pushed: over 5 years ago - Stars: 5 - Forks: 2
orcc/orc-apps
Open RVC-CAL Applications
Language: C - Size: 20.9 MB - Last synced: about 2 months ago - Pushed: about 3 years ago - Stars: 11 - Forks: 10
google/shenzhen-go 📦
Experimental visual Go environment
Language: JavaScript - Size: 87.6 MB - Last synced: 9 days ago - Pushed: almost 3 years ago - Stars: 464 - Forks: 44
a5chin/event-driven-dataflow
This Terraform module sets up a workflow where files stored in Cloud Storage trigger events in Eventarc, which then processes the files and stores the data in Spanner.
Language: HCL - Size: 123 KB - Last synced: about 2 months ago - Pushed: about 2 months ago - Stars: 0 - Forks: 0
helioribeiro/dataflow-coding-challenge-delivery
This repo contains step by step guide on how I executed this challenge. I won't disclaim challenge information, as this repo was made specifically for the team that created the test.
Language: Python - Size: 25.4 KB - Last synced: about 2 months ago - Pushed: 2 months ago - Stars: 0 - Forks: 0
Jasmine582/Name_Tags
Name tag generator to create bulk name tags using functional components and ES6 modules.
Language: JavaScript - Size: 3.91 KB - Last synced: about 2 months ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0
Jasmine582/Hotel_Booking_App
A hotel search tool that allows the user to filter the type of hotel they would like to stay in
Language: JavaScript - Size: 6.84 KB - Last synced: about 2 months ago - Pushed: over 2 years ago - Stars: 0 - Forks: 0
denniskniep/provider-springclouddataflow
Crossplane Spring Cloud Data Flow Provider
Language: Go - Size: 184 KB - Last synced: 26 days ago - Pushed: 2 months ago - Stars: 2 - Forks: 0
Nicolas-Constanty/Dnai.Editor
Dnai Editor - Visual Scripting (Node Editor)
Language: C++ - Size: 205 MB - Last synced: about 2 months ago - Pushed: about 4 years ago - Stars: 134 - Forks: 30