Vacaturebeschrijving
Data Engineer GCP Platform in Nederland
Nederland
For the cargo division of a major Dutch airline, we are looking for a Medior/Senior Real-time Data Engineer to help develop a modern, real-time data and reporting platform on Google Cloud Platform (GCP).
You will contribute to building a scalable, generic real-time data platform that supports critical cargo hub operations, including truck and ULD arrivals, offloads and shipment manifests. Key Responsibilities:
- Develop and maintain real-time data processing and event streaming pipelines.
- Build event refinement and event combination solutions for multiple business use cases.
- Migrate legacy operational reporting to the new real-time data platform.
- Further develop the Build-up Monitor from Proof of Concept to a production-ready MVP.
- Deliver robust, scalable and well-documented streaming solutions.
- Medior/Senior experience as a Data Engineer, with a strong focus on real-time data processing.
- Strong programming skills in Java and/or Scala.
- Hands-on experience with Apache Spark, particularly Structured Streaming.
- Experience with Apache Kafka, including topics, producers and consumers.
- Experience with NoSQL databases.
- Hands-on experience with Google Cloud Platform (GCP).
- Able to work independently, take ownership and solve problems in a complex enterprise environment.
- Strong communication skills and the ability to operate with limited business support.
- Nice to Have: Experience in logistics, aviation or cargo operations.
- Nice to Have: Experience with operational reporting environments.
Vergelijkbare vacatures laden…