diff --git a/justification/max.txt b/justification/max.txt index 4da056f..e4d8852 100644 --- a/justification/max.txt +++ b/justification/max.txt @@ -1,6 +1,3 @@ -Organisations use distributed stream processing systems to run never-ending services to drive their business-critical -analytics. Therefore, it is crucial that the systems are fault-tolerant. The three papers that have been selected all take a -different approach to achieve fault-tolerance and they are as following: (1) lineage-based recovery; (2) global consistent -checkpointing; (3) distributed state store. The aim is to gain a deeper understanding of the tradeoffs between the different -techniques. But, also to get an insight on which may be most applicable for future systems (Arcon) when taking the growing -network speeds into consideration. +The dataflow processing model is at the core of modern distributed data processing frameworks. In this talk, we will look into +3 systems (MillWheel, Ray, and Naiad) that utilise the aforementioned model. The aim is to gain a deeper understanding of the +design choices (e.g., how the dataflow model is used, how the system approaches state) and their implications for different applications. diff --git a/papers/Lightweight Asynchronous Snapshots for Distributed Dataflows.pdf b/papers/Lightweight Asynchronous Snapshots for Distributed Dataflows.pdf deleted file mode 100644 index 907b040..0000000 Binary files a/papers/Lightweight Asynchronous Snapshots for Distributed Dataflows.pdf and /dev/null differ diff --git a/papers/Lineage Stash: Fault Tolerance Off the Critical Path.pdf b/papers/Lineage Stash: Fault Tolerance Off the Critical Path.pdf deleted file mode 100644 index 36c5373..0000000 Binary files a/papers/Lineage Stash: Fault Tolerance Off the Critical Path.pdf and /dev/null differ diff --git a/papers/Naiad_A_Timely_Dataflow_System.pdf b/papers/Naiad_A_Timely_Dataflow_System.pdf new file mode 100644 index 0000000..430e6be Binary files /dev/null and b/papers/Naiad_A_Timely_Dataflow_System.pdf differ diff --git a/papers/Ray_A_Distributed_Framework_For_Emerging_AI_Applications.pdf b/papers/Ray_A_Distributed_Framework_For_Emerging_AI_Applications.pdf new file mode 100644 index 0000000..ab514c3 Binary files /dev/null and b/papers/Ray_A_Distributed_Framework_For_Emerging_AI_Applications.pdf differ