Search by job, company or skills
We are seeking a skilled Data Integration Engineer to design, build, and maintain secure, scalable, and high-performance data pipelines for our next-generation Air Traffic Management (ATM) platform. You will work with modern cloud and data technologies, enabling real-time data-driven decision-making for safer and more efficient airspace operations. While not mandatory, familiarity with AI/Agentic AI concepts and aviation data is a plus.
Responsibilities
. Design and develop scalable batch and streaming pipelines using modern tools like AWS, Databricks etc
. Implement reliable data processing, transformation, and storage with a focus on performance, security, and governance.
. Collaborate with data scientists, engineers, and domain experts to ensure the platform supports advanced analytics and AI-readiness.
. Optimize pipelines for resilience, observability, and cost-effectiveness using monitoring and automation tools.
. Maintain clear documentation and contribute to continuous improvements in data architecture.
Core Qualifications
. Strong hands-on experience with AWS cloud services, particularly for data engineering.
. Proficiency in Python or Scala, with practical knowledge of Spark and distributed data processing.
. Experience building and maintaining scalable data pipelines (batch and real-time).
. Solid knowledge of SQL, data modelling, and transformation techniques.
. Familiarity with data security, governance, and compliance best practices.
. Strong problem-solving, analytical, and communication skills.
Preferred Qualifications
. Experience with AWS Databricks, Delta Lake, and medallion architecture.
. Exposure to AI/Gen AI concepts or intelligent agent-based architectures.
. Familiarity with aviation data standards (e.g., ADS-B, ARINC 424, flight schedules) or willingness to learn.
. AWS Certifications in Data Analytics, Big Data, or Machine Learning.
. Experience with real-time data processing and high-volume systems.
Date Posted: 19/08/2025
Job ID: 124174313