Senior Data Engineer (AWS Migration Lead)

Fresher

Save

Early Applicant

Job Description

Key Responsibilities:

Migration & Technical Implementation:
Lead migration of on-premises and SharePoint-based data infrastructure to AWS Data Analytics Platform (DAP)
Collaborate with AWS teams to develop comprehensive migration strategies and implementation plans
Re-architect existing Python scripts and UiPath automation workflows for AWS SageMaker or Glue scripts
Design and implement robust data pipelines and ETL processes within AWS environment
Migrate Tableau dashboards to AWS QuickSight whilst maintaining full functionality
Establish data connections from multiple sources (HRPS, Gateway, SharePoint, Microsoft Lists, FormSG, MS Access)
Ensure seamless transition with zero disruption to existing data operations
Documentation & Knowledge Transfer:
Create comprehensive documentation for all new AWS processes and workflows
Develop training materials and conduct knowledge transfer sessions for end users
Support HR officers in accessing and utilising dashboards in the new AWS environment
Conduct thorough testing and validation of migrated systems

Requirements

AWS Services
Extensive experience with AWS services (SageMaker, QuickSight, Athena, Lambda, data pipelines)
Experience using AWS services in Python and Command Line Interface
Proficiency in serverless architecture design and Lambda function development
Infrastructure as Code (IaaC)
Experience in Infrastructure-as-Code (eg. CloudFormation, YAML, JSON infrastructure scripts)
Lambda function provisioning and management through IaaC templates
Integration of serverless components with traditional infrastructure resources
Programming and Automation Skills
Proficiency in Python programming and UiPath automation
Experience developing and deploying Lambda functions for data processing and automation
Understanding of event-driven architecture and serverless computing patterns
Data Visualisation and Analytics
Strong background in Tableau and QuickSight dashboard development
Experience with ETL processes and data pipeline design
Knowledge of serverless data processing workflows using Lambda
DevOps and Collaboration
Experience working with DevOps stack (eg. Ship-hats, GitLab, Nexus Repo etc)
Understanding of CI/CD pipelines for both application code and infrastructure deployment
Experience with infrastructure change management including security groups and network ACLs
Technical writing and documentation skills
Training delivery and user support capabilities