Due to the increasing interest in real-time processing, many stream processing frameworks were developed. However, no clear guidelines have been established for choosing a framework and designing efficient processing pipelines. In this talk, Giselle talks about decision factors and tuning tips for some of the most popular stream processing frameworks: Spark Streaming, Kafka Streams and Flink.
Giselle van Dongen is Lead Data Scientist at Klarrio specializing in real-time data analysis, processing and visualization. Concurrently she is a PhD researcher at Ghent University, teaching and benchmarking real-time distributed processing systems such as Spark Streaming, Structured Streaming, Flink and Kafka Streams.