- Understand the business requirements/logic, translate it to functional requirements and implement the end to end workflow.
- Build data pipelines to perform ETL across data warehouses, such as RDBMS and Snowflake.
- Work closely with data analysts and business end-users to implement and support data platforms using best-of-breed technology and methodology.
- Analyse systems operations data (SLAs, customer satisfaction, delivery quality, team efficiency etc.) to identify actionable trends for continual improvements.
- Work closely with data platform teams to build systematic process and services to support efficient onboarding and management of data sets into the data virtualization layer.
- Design and implement scalable data pipelines and data service modules with robustness in-mind to support the growing demands from business users.
Requirements:
- At least 5 years experience of working as a data engineer in big data field.
- Solid working knowledge of implementing data workflows using Informatica BDM (DEI) on data warehouses and big data platforms, such as RDBMS, Snowflake.
- Familiar with application integration with RDBMS such as Oracle, MS-SQL, MySQL. Working knowledge of Oracle and MS-SQL will be a plus.
- Hands-on experience of using Linux (or Unix-like OS) as the development environment and familiar with shell scripts and command line tools in Linux/Unix environment.
- Exposure and knowledge in the following technologies is advantageous:
- SQL Databases: Oracle, MS-SQL
- Programming and Scripting: Python, Shell Script
- AWS Services: S3, EMR
- Experienced with the Systems Development Life Cycle implementation methodology (SDLC) and/or agile methodologies like Scrum and Kanban.
- Understand and apply the good industry practice of code versioning, testing, CICD workflow and code documentation.
- Good team player, with strong analytical skills and enjoy complex problem solving with innovative ideas.
- Strong communication/people skills required to interact with data analysts, business end-users and vendors to design and develop solutions.
- Good at working with details and is meticulous for operations.
Please refer to U3's Privacy Notice for Job Applicants/Seekers at When you apply, you voluntarily consent to the collection, use and disclosure of your personal data for recruitment/employment and related purposes.
