Note: Please excuse us for the audio and video quality at the start of the video.
Imagine that you need to create an environmental and statistical view of the largest port of Europe, Rotterdam. At your disposal is a variety of (real-time) data sources. This presentation is a walk-through on how we as a team of engineers and scientists combined the different data formats its attributes and infrastructure to create the required views. This resulted in an architecture based on Apache Kafka Stream processing and utilizing Time-series and Document stores incorporated in a Kubernetes cluster. Harbourmaster data (Cargo, docks, etc.) and Radar, AIS (GPS, Ship information) are the main sources. They are processed in realtime so we can present (near real-time) dashboards about Co2 emissions, ship movements, passages, and visits. The efforts from the Port Of Rotterdam are a part of their ambition to become the smartest, efficient and most environmental friendly port of the world.
Bio Pieter
BigData Hacker The world of BigData analysis and processing is an exciting one. The more I do with it the more energy I receive from it. Through my participation in a large variety of projects, Voice systems, fraud detection, and b2b, I have a broad experience and as being a dyslexic I tend to think outside the box and see connections that a lot of people do not sees. Currently active at the Port of Rotterdam and enabling them to become the smartest harbor in the world.
