

Search by job, company or skills

This is a fast-growing organization investing in modern data and AI capabilities to support digital products, analytics, and AI-driven innovation. As part of its continued expansion, the organization is seeking to appoint a Lead Data Engineer to design and build scalable data platforms and lead the delivery of high-quality data engineering solutions.
This is an excellent opportunity for an experienced data engineer who wants to remain hands-on while providing technical leadership, shaping engineering standards, and working closely with software, analytics, and AI/ML teams.
ResponsibilitiesYou will lead the design, development, and evolution of scalable data platforms and pipelines supporting analytics, digital products, and AI/ML workloads. You will provide technical leadership across data architecture, data modelling, ETL/ELT, distributed processing, orchestration, data quality, and platform reliability.
Working closely with data engineers, software engineers, data scientists, and AI engineers, you will design robust data pipelines and ensure that data is reliable, accessible, and optimized for downstream consumption. You will establish engineering standards around testing, validation, observability, CI/CD, and automation while guiding the team on system design and architectural decisions.
You will also champion the adoption of AI-enabled engineering practices, leveraging copilots, agents, and other AI development tools to accelerate development, improve code and data quality, automate engineering workflows, and enhance overall team productivity. As a technical lead, you will mentor engineers, conduct design and code reviews, and help develop engineering capability across the team.
RequirementsWe are looking for a Lead Data Engineer with 5-10 years of experience designing and delivering production-grade data platforms and pipelines, with demonstrated experience providing technical leadership to engineering teams.
You should have strong experience with modern cloud-based data platforms and architectures, with hands-on expertise building scalable data solutions in AWS, Azure, or Google Cloud environments. Strong proficiency in Python and SQL is essential, together with practical experience in distributed data processing technologies such as Apache Spark / PySpark.
You should have hands-on experience with data orchestration and workflow management, as well as establishing data quality practices covering automated testing, validation, monitoring, and observability. A solid understanding of data modelling, data warehousing, and modern data architecture principles is essential.
Experience building and operating data pipelines that support analytics, machine learning, and Generative AI workloads is highly desirable. You should also have practical exposure to AI-enabled data engineering practices, including using copilots, AI agents, or similar tools across the engineering lifecycle to improve development productivity, automation, testing, documentation, and solution quality.
The ideal candidate will combine strong hands-on engineering capability with proven experience in system design, architecture, technical decision-making, and mentoring or leading data engineers.
To applyInterested candidates, please send your resume to Eliza Ng at [Confidential Information], quoting the job title. Due to the high volume of applications, only shortlisted candidates will be notified.
Licence No: 16S8060
Registration No: R1549515
Job ID: 153371295
Skills:
Sql, Databricks, Java, Devops, Tableau, Pyspark, AWS, Nosql, Kubernetes, Python, Docker, Scala, Git, Informatica IDMC
Skills:
Java, Ranger, Hadoop, Scala, Prometheus, Bitbucket, Grafana, OpenShift Container Platform, Jenkins, Hive, Docker, Ansible, Spark, Splunk, Python, Kubernetes, HDFS, Quantexa
Skills:
Java, Encryption, cloud security, Rest Apis, Azure, Python, Google Cloud, AWS, data classification, key management
Skills:
Machine Learning, Alteryx, Data Transformation, Power Bi, Api Development, Tableau, Deep Learning, Tensorflow, Nlp, Pytorch, MLops, Database Design, Azure Cloud services, Talend, Reporting Tools, GenAI technologies, generative models, AI technologies, Analytics, DataOps, large language models
Skills:
snowflake , Ssrs, Power Bi, Pyspark, PostgreSQL, Apache Spark, SSIS, Apache Airflow, Ssas, MySQL, Amazon Redshift, Dax, Etl Development, Azure DevOps, MDX, Data Warehousing Architecture, Google BigQuery, Row-Level Security, Power BI Service, dbt, SQL Server 2017, BIML