Data Engineer (Banking, 1-year renewable contract)

Key Responsibilities

• Design, develop, and maintain EDW ETL/ELT solutions using Teradata SQL, Informatica, Apache Spark, QueryGrid, and Trino
• Perform data transformation and loading into Enterprise Data Warehouse (EDW) and datamart environments
• Develop and optimize complex ETL/data processing applications with a focus on performance tuning and resource optimization
• Build and maintain automation frameworks using GCFR, shell scripting, and BTEQ to support end-to-end processing and integration controls
• Develop in-house CDC (Change Data Capture) frameworks using Java to process Oracle/SAP OLR logs and ingest data into Teradata platforms
• Create configurable ingestion and data processing frameworks to support scalable data operations
• Support installation, enhancement, and maintenance of Master Data Management (MDM) applications, including data validation and approval workflows
• Work extensively within Hadoop ecosystem technologies such as Hive, Impala, Spark, Kafka, Iceberg, Ranger, Atlas, NiFi, and Flink
• Support data pipeline orchestration, monitoring, troubleshooting, and optimization activities
• Collaborate with cross-functional teams to deliver scalable and high-performing enterprise data solutions

Key Requirements

• Strong hands-on experience in ETL/ELT development using Informatica PowerCenter and Teradata technologies
• Solid experience with Teradata SQL, Apache Spark, QueryGrid, and Trino
• Strong exposure to Hadoop ecosystem technologies including Hive, Impala, Kafka, Spark, Iceberg, Ranger, Atlas, NiFi, and Flink
• Experience developing automation frameworks using shell scripting, GCFR, and BTEQ
• Hands-on experience building CDC frameworks and Java-based ingestion solutions
• Experience working with Enterprise Data Warehouse (EDW) and datamart environments
• Strong performance tuning and optimization experience for complex data processing applications
• Knowledge and experience in Master Data Management (MDM) implementation and support
• Good understanding of data pipeline orchestration and large-scale enterprise data processing
• Strong analytical, troubleshooting, and problem-solving skills
• Experience working in enterprise or banking data environments is preferred