Data Engineer

About the Company

We are a premium financial technology and enterprise data solutions provider partnering with top-tier banking institutions to manage and modernize massive data ecosystems. By combining enterprise-grade data governance, advanced processing frameworks, and highly disciplined banking architecture, we build secure systems that drive critical business intelligence. We focus on engineering excellence, data warehousing optimization, and nurturing top-tier local technical talent in Singapore.

About the Job

We are seeking a senior, highly disciplined Data Engineer / Data Warehouse Specialist to take ownership of end-to-end Extract, Transform, Load (ETL/ELT) development and big data pipelining. In this role, you will act as a core technical driver bridging traditional Enterprise Data Warehousing (EDW) with modern distributed big data architectures.

You will design robust data transformation pipelines, build custom, in-house Change Data Capture (CDC) frameworks, and optimize complex data flows across hybrid environments. This role requires an engineer who is heavily seasoned in optimizing resource utilization within high-volume environments and building end-to-end automation frameworks to ingest multi-platform legacy and enterprise data streams securely.

Key Responsibilities

Enterprise Data Warehousing & ETL/ELT Core

• Data Pipeline Engineering: Design and develop highly performant EDW ETL/ELT code matrices utilizing Teradata SQL, Informatica PowerCenter, Apache Spark, QueryGrid, and Trino to ingest, transform, and load enterprise data streams into Teradata warehouses or datamarts.

• Performance Engineering: Execute comprehensive structural analysis and performance tuning of highly complex data applications to drastically minimize resource utilization and optimize execution runtimes.

• Automation Framework Design: Author robust automation blueprints utilizing Teradata's Global Core Framework (GCFR), Unix Shell Scripting, and BTEQ utilities to manage automated end-to-end data loads and integrate seamlessly with Enterprise scheduling controls.

Custom CDC Engineering & Master Data Management

• In-House CDC Tooling: Build and maintain an in-house Change Data Capture (CDC) integration framework using Java to cleanly process OLR logs from SAP (Oracle database backends) and orchestrate configurable data ingestion routines into Teradata.

• MDM Application Engineering: Install, build, and configure custom Master Data Management (MDM) applications tailored for manual user data uploads, complete with dynamic data validation rules and structural approval workflow engines.

Big Data Ecosystem Collaboration

• Hybrid Pipelining: Leverage and orchestrate data pathways across the modern Hadoop Ecosystem including Hive, Impala, Spark, Kafka, Apache Iceberg, Ranger, Atlas, NiFi, and Flink.

Skills & Experience Required

Must-Have Skills (Mandatory for Skills Matching)

• Teradata & Warehousing Ecosystem: Advanced, expert-level hands-on experience in Teradata-based ETL development, including Teradata SQL, BTEQ, and Teradata GCFR architectures.

• Informatica PowerCenter: Deep proficiency in traditional enterprise ETL pipeline engineering using Informatica PowerCenter.

• Modern Distributed Compute: Practical experience configuring and writing transformation code using Apache Spark and querying distributed data via Trino.

• Core Systems Automation: Advanced proficiency in Unix/Linux Shell Scripting for automated system jobs.

• Java Development: Practical experience using Java to build backend data utilities, integration modules, or custom data hooks (such as CDC engines).

Good-to-Have Skills

• Familiarity with foundational Big Data storage and governance tools (e.g., Hive, Impala, Apache Iceberg metadata tables, Apache Ranger, or Apache Atlas).

• Exposure to stream processing frameworks like Apache Kafka, NiFi, or Flink.

• Prior experience working with enterprise financial architectures, core banking data domains, or highly audited banking data lakes.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Technology, Computer Engineering, or an equivalent technical field.

• Strong structural troubleshooting skills with a highly analytical approach to tuning slow-running database queries.

How to Apply

Please click on the apply button to apply online. For more information, please reach out to Vievien Nathan.

EA License Number: 94C3609