Terug naar de lijst

Vacaturebeschrijving

Data Engineer GCP Platform in Nederland

Nederland

For the cargo division of a major Dutch airline, we are looking for a Medior/Senior Real-time Data Engineer to help develop a modern, real-time data and reporting platform on Google Cloud Platform (GCP).

You will contribute to building a scalable, generic real-time data platform that supports critical cargo hub operations, including truck and ULD arrivals, offloads and shipment manifests. Key Responsibilities:

  • Develop and maintain real-time data processing and event streaming pipelines.
  • Build event refinement and event combination solutions for multiple business use cases.
  • Migrate legacy operational reporting to the new real-time data platform.
  • Further develop the Build-up Monitor from Proof of Concept to a production-ready MVP.
  • Deliver robust, scalable and well-documented streaming solutions.
  • Medior/Senior experience as a Data Engineer, with a strong focus on real-time data processing.
  • Strong programming skills in Java and/or Scala.
  • Hands-on experience with Apache Spark, particularly Structured Streaming.
  • Experience with Apache Kafka, including topics, producers and consumers.
  • Experience with NoSQL databases.
  • Hands-on experience with Google Cloud Platform (GCP).
  • Able to work independently, take ownership and solve problems in a complex enterprise environment.
  • Strong communication skills and the ability to operate with limited business support.
  • Nice to Have: Experience in logistics, aviation or cargo operations.
  • Nice to Have: Experience with operational reporting environments.
Vergelijkbare vacatures laden…