Position Overview
We are looking to recruit several Data Engineers to design, develop, and maintain scalable, secure, and high-performance data platforms that enable efficient data collection, storage, processing, and analytics. In this role, you will build robust batch and real-time data pipelines, optimise data architectures, and ensure data quality, governance, and availability to support business intelligence and advanced analytics initiatives.
Key Responsibilities
- Collaborate with customers, business stakeholders, partners, and internal teams to understand data requirements and provide technical solutions.
- Partner closely with data scientists and analytics teams to support data modelling and machine learning initiatives.
- Design, develop, document, and maintain scalable data models, ETL/ELT processes, data warehouses, and data pipelines for large volumes of structured and unstructured data.
- Build and optimise batch, near real-time, and real-time data processing solutions.
- Monitor, maintain, and improve the performance, reliability, and scalability of data platforms and pipelines.
- Define, monitor, and report Service Level Agreements (SLAs) for data pipelines and data products.
- Implement data security, governance, and compliance standards across data platforms.
- Drive data quality assurance initiatives and establish best practices for data integrity and consistency.
- Support pre-sales activities by providing technical expertise for data management solutions, proposal development, and post-implementation support.
Requirements
- Minimum 3 years of experience designing, building, and optimising data pipelines, data architectures, and datasets using ETL/Data Integration tools such as Informatica, Talend, or equivalent.
- Hands-on experience with data transformation, metadata management, workload management, and big data technologies such as Apache Spark, Hadoop, and Hive.
- Strong proficiency in:SQLPythonDatabase Management Systems (DBMS)Data WranglingData Visualisation
- Experience working with diverse data sources, including:Flat filesSQL databasesSAP databasesPostgreSQLUnstructured data (text, documents, images, audio, video, sensor data)
- Good understanding of data security, governance, and data quality best practices.
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication and stakeholder management abilities.
Only shortlisted candidates will be notified.
(EA Reg No: 20C0312)
