Job Description

We are seeking a full-time, permanent Data Engineer (Junior/Senior) to design, develop, and maintain scalable data pipelines and infrastructure for efficient data collection, processing, storage, and management.

Key Responsibilities

Design, build, and optimise ETL processes, data pipelines, and data warehouse solutions.
Develop and maintain data systems for batch, real-time, and large-scale data processing.
Work with data scientists and stakeholders to understand data requirements and deliver suitable solutions.
Ensure data quality, security, governance, and pipeline performance.
Monitor data workflows and troubleshoot data processing issues.
Support data infrastructure design, solution implementation, and technical proposals.

Requirements

Minimum 2 years of experience in data engineering, ETL development, and data pipeline implementation.
Strong proficiency in SQL and Python.
Experience with ETL tools such as Informatica or Talend.
Knowledge of data warehousing, data modelling, and database management.
Familiarity with big data technologies such as Spark, Hadoop, or Hive.
Experience handling structured and unstructured data from multiple sources.
Knowledge of data wrangling, data transformation, and data quality management.
Exposure to Power BI, Docker, Kubernetes, Microservices Architecture, or DevSecOps is an advantage.