ASTEK has been providing IT and Engineering solutions for some of the world's largest industrial and services groups for more than 35 years with 10,000 passionate experts in 22 countries throughout Europe, APAC, Middle East and the Americas
Currently, we are looking for Senior Data Engineer which would be based in Singapore.
Responsibilities and requirements:
- Bachelor's degree with minimum 8 years experience
- Design and implement robust data pipelines and ETL processes within AWS environment
- Migrate Tableau dashboards to AWS QuickSight whilst maintaining full functionality
- Re-architect existing Python scripts and UiPath automation workflows for AWS SageMaker or Glue scripts
- Establish data connections from multiple sources (HRPS, Gateway, SharePoint, Microsoft Lists, FormSG, MS Access)
- Lead migration of on-premises and SharePoint-based data infrastructure to AWS Data Analytics Platform (DAP)
- Ensure seamless transition with zero disruption to existing data operations
- Create comprehensive documentation for all new AWS processes and workflows
- Develop training materials and conduct knowledge transfer sessions for end users
- Experience in Infrastructure-as-Code (eg. CloudFormation, YAML, JSON infrastructure scripts)
- Lambda function provisioning and management through IaaC templates
- Experience working with DevOps stack (eg. Ship-hats, GitLab, Nexus Repo etc)
- Understanding of CI/CD pipelines for both application code and infrastructure deployment
- Experience with infrastructure change management including security groups and network ACLs
- Collaborate with AWS teams to develop comprehensive migration strategies and implementation plans
- Conduct thorough testing and validation of migrated systems
