Search by job, company or skills

Innova Digital Solutions Pte Ltd

Data Engineer

6-15 Years
SGD 5,000 - 8,000 per month
Save
new job description bg glownew job description bg glow
  • Posted 6 hours ago
  • Be among the first 10 applicants
Early Applicant
Quick Apply

Job Description

Job Objectives

   

Develop and deliver scalable ETL/ELT solutions across Teradata and Hadoop platforms by building robust data pipelines, ingestion frameworks, and automation capabilities. Ensure efficient data processing, performance optimization, and reliable integration of enterprise data sources, while supporting data warehouse, CDC, and MDM initiatives.

 

  Key Responsibilities & Skillset

   

·   Create EDW ETL/ELT codes using Teradata SQL, Informatica, Apache Spark, QueryGrid, Trino to perform various transformations and load into Teradata based data warehouse or datamarts

·   Performance tuning of highly complex applications to reduce resource usage

·   Create framework using GCFR, shell scripts, BTEQ and shell scripts to automate end to end. Also to integrate with control 

·   Build in-house CDC framework using Java to process OLR logs from SAP(Oracle) and ingestion the data into Teradata. Create framework around this CDC ingestion to make it configurable

·   Install and build Master Data Management (MDM) application for various user uploads along with data validations and approval workflow.

  Strong hands‑on experience with the ETL(Informatica Power Center) and Teradata based ETL development, similarly Hadoop ecosystem (Hive, Impala, Spark, Kafka, Iceberg, Ranger, Atlas, Nifi, Flink etc.,), and data pipeline orchestration.

Create EDW ETL/ELT codes using Teradata SQL, Informatica, apache Spark, QueryGrid, Trino to perform various transformation and load into Teradata based data warehouse or datamarts

Performance tuning of highly complex applications to reduce resource usage

Create framework using GCFR, shell scripts, BTEQ and shell scripts to automate end to end. Also to integrate with control 

Build in-house CDC framework using Java to process OLR logs from SAP(Oracle) and ingestion the data into Teradata. Create framework around this CDC ingestion to make it configurable

Install and build Master Data Management(MDM) application for various user uploads along with data validations and approval workflow.

   

Develop and deliver scalable ETL/ELT solutions across Teradata and Hadoop platforms by building robust data pipelines, ingestion frameworks, and automation capabilities. Ensure efficient data processing, performance optimization, and reliable integration of enterprise data sources, while supporting data warehouse, CDC, and MDM initiatives.

   Key Responsibilities & Skillset

   

·   Create EDW ETL/ELT codes using Teradata SQL, Informatica, Apache Spark, QueryGrid, Trino to perform various transformations and load into Teradata based data warehouse or datamarts

·   Performance tuning of highly complex applications to reduce resource usage

·   Create framework using GCFR, shell scripts, BTEQ and shell scripts to automate end to end. Also to integrate with control 

·   Build in-house CDC framework using Java to process OLR logs from SAP(Oracle) and ingestion the data into Teradata. Create framework around this CDC ingestion to make it configurable

·   Install and build Master Data Management (MDM) application for various user uploads along with data validations and approval workflow.

  Strong hands‑on experience with the ETL(Informatica Power Center) and Teradata based ETL development, similarly Hadoop ecosystem (Hive, Impala, Spark, Kafka, Iceberg, Ranger, Atlas, Nifi, Flink etc.,), and data pipeline orchestration.

Create EDW ETL/ELT codes using Teradata SQL, Informatica, apache Spark, QueryGrid, Trino to perform various transformation and load into Teradata based data warehouse or datamarts

Performance tuning of highly complex applications to reduce resource usage

Create framework using GCFR, shell scripts, BTEQ and shell scripts to automate end to end. Also to integrate with control 

Build in-house CDC framework using Java to process OLR logs from SAP(Oracle) and ingestion the data into Teradata. Create framework around this CDC ingestion to make it configurable

Install and build Master Data Management(MDM) application for various user uploads along with data validations and approval workflow.


More Info

About Company

Volt is an award winning, global workforce solution provider, listed on the NYSE and a Fortune 1000 organisation. Volt propels businesses and careers forward with expert momentum. Volt’s 35,000 employees work across 85 offices worldwide to provide workforce management and talent acquisition solutions to businesses and job placement services. With 70 years of industry leadership and a growing global team of employment strategists, partnerships and proactive approach to business needs, Volt strive to maintain an innovative and highly relevant sector-based portfolio globally

Job ID: 148415905

Similar Jobs

Singapore

Skills:

JavaNosqlApache FlinkOLAPPythonSqlRelational

Singapore, Jalan Besar

Skills:

JavaBteqRangerHadoop EcosystemKafkaTeradata SqlImpalaHiveApache SparkSparkGCFR shell scriptsATLASETL Informatica Power CenterFlinkTeradataIcebergQueryGridTrinoNifi

Singapore, Cross Street

Skills:

BteqJavaUnix Shell ScriptingApache SparkInformatica PowercenterTeradata SqlTrino

Singapore, Kallang

Skills:

PostgresLinux Shell ScriptingOracleMssqlSqlPythonS3 bucketCI CD pipelinesTrinoHDFS

Singapore

Skills:

snowflake GithubS3Aws LambdaPysparkKafkaEmrRedshiftSqlELTKinesisGitlabDatabricksPythonAWSEtlGlue