Renoir
REactive Network of Operators in Rust
Renoir (short: Noir) [/ʁənwaʁ/, /nwaʁ/] is a distributed data processing platform based on the dataflow paradigm that provides an ergonomic programming interface, similar to that of Apache Flink, but has much better performance characteristics.
Renoir converts each job into a dataflow graph of operators and groups them in blocks. Blocks contain a sequence of operors which process the data sequentially without repartitioning it. They are the deployment unit used by the system and can be distributed and executed on multiple systems.
Resources#
deib-polimi/renoir
Reactive Network of Operators In Rust. Framework for Parallel and distributed computation inspired from the DataFlow model
Rust
53
4
Publications
The Renoir Dataflow Platform: Efficient Data Processing without Complexity (FGCS 2024)
↗
↖
Safe Shared State in Dataflow Systems (DEBS'24)
↗
↖
Analysis of market data with Noir: DEBS grand challenge (DEBS'22)
↗
↖