Data Engineer

Data Engineer (2 Positions)

Singapor

e
KEY SKILL

-ETL/ELT Development using Informati

caPower Center and Terada

taData Platform Experti

seData Pipeline & Orchestration using enterprise scheduling too

lsPerformance Optimizati

onData Integration & C

DCMDM - Reference data manageme

ntETL Framework & Automation Developme

nt
KEY RESPONSIBILITES AND SKILL

SET
• Create EDW ETL/ELT codes using Teradata SQL, Informatica, Apache Spark, QueryGrid, Trino to perform various transformations and load into Teradata based data warehouse or datam

arts- Performance tuning of highly complex applications to reduce reso

urce- Create framework using GCFR, shell scripts, BTEQ and shell scripts to automate end to end. Also to integrate with con

trol- Build in-house CDC framework using Java to process OR logs from SAP(Oracle) and ingestion the data into Teradata. Create framework around this CDC ingestion to make it configur

able•Install and build Master Data Management (MDM) application for various user uploads along with data validations and approval work

flow- Strong hands on experience with the ETL(Informatica Power Center) and Teradata based ETL development, similarly Hadoop ecosystem (Hive, Impala, Spark, Kafka, Iceberg, Ranger, Atlas, Nifi, Flink etc.,), and data pipeline orchestrat

ion.- Create EDW ETL/ELT codes using Teradata SQL, Informatica, apache Spark, QueryGrid, Trino to perform various transformation and load into Teradata based data warehouse or datam

arts- Performance tuning of highly complex applications to reduce reso

urce- Create framework using GCFR, shell scripts, BTEQ and shell scripts to automate end to end. Also to integrate with con

trol- Build in-house CDC framework using Java to process OR logs from SAP(Oracle) and ingestion the data into Teradata. Create framework around this CDC ingestion to make it configur

able- Install and build Master Data Management(MDM) application for various user uploads along with data validations and approval workflow U