Data Team Lead

Role: BAU Data LEAD

Type: Contract

We are looking for a seasoned BAU Lead - Data Engineering to lead our data operations and support function in a cloud-first environment. The ideal candidate will bring strong technical leadership, hands-on expertise in AWS and Snowflake, and proven experience in managing Business-As-Usual (BAU) data platforms, production support, and continuous improvement initiatives.

Responsibilities

Develop tools to improve data flows between internal/external systems and the data lake/warehouse.

Work with stakeholders to understand needs for data structure, availability, scalability, and accessibility.

Build robust and reproducible data ingest pipelines to collect, clean, harmonize, merge, and consolidate data sources.

Understanding existing data applications and infrastructure architecture

Build and support new data feeds for various Data Management layers and Data Lakes

Evaluate business needs and requirements.

Support migration of existing data transformation jobs in Oracle, and MSSQL to Snowflake.

Lead the migration of the existing data transformation jobs in Oracle, Hive, Impala etc. into Spark, Python on Glue etc.

Able to document the processes and steps.

Develop and maintain datasets.

Improve data quality and efficiency.

Lead Business requirements and deliver accordingly.

Collaborate with Data Scientists, Architect and Team on several Data Analytics projects.

Collaborate with DevOps Engineer to improve system deployment and monitoring process.

Experience in critical production support and how the BAU functions is preferred.

Required Qualifications:

At least 8+ years of Data Engineer Experience

Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field.

At least 5+ years of recent hands-on professional experience (actively coding) working as a Lead handling support & production issue.

2+ experience with large scale datasets, data lake and data warehouse technologies such as AWS Redshift, Google BigQuery, Snowflake. Snowflake is highly preferred.

At least 3+ years of experience in ETL (AWS Glue), Amazon S3, Amazon RDS, Amazon Kinesis, Amazon Lambda, Apache Airflows, Amazon Step Functions.

Professional experience working in an agile, dynamic and customer-facing environment is required.

Understanding of distributed systems and cloud technologies (AWS) is highly preferred.

Understanding of data streaming and scalable data processing is preferred to have.

Strong knowledge in scripting languages like SQL ,Python, UNIX shell and Spark is required.

Understanding of RDBMS, Data ingestions, Data flows, Data Integrations etc.

Technical expertise with data models, data mining and segmentation techniques.

Experience with full SDLC lifecycle and Lean or Agile development methodologies.

Knowledge of CI/CD and GIT Deployments.

Ability to work in team in diverse/ multiple stakeholder environment.

Ability to communicate complex technology solutions to diverse teams namely, technical, business and management teams

************************************************************************************

Interested candidate please share your updated copy of resume at [Confidential Information]

( To receive a quick response, kindly leave a message on the WhatsApp number +65 96310776)

**********************************************************************************