Job Summary
We are looking for a Data Engineer with 47 years of experience to support government projects by building and maintaining scalable data platforms and pipelines. The role requires strong expertise in AWS services and Databricks (Spark, PySpark, Delta Lake), along with solid knowledge of ETL/ELT and data warehousing.
Mandatory Skill-set
- Must have 47 years of Data Engineering experience;
- Strong experience with AWS Cloud platform: (S3, Glue, Lambda, Redshift or similar services);
- Proven expertise in Databricks, including Spark, PySpark, and Delta Lake;
- Experience building and maintaining scalable data pipelines;
- Strong knowledge of ETL/ELT processes and data integration;
- Solid understanding of data warehousing concepts and best practices;
- Experience working in Agile/Scrum environments;
- Strong technical troubleshooting and analytical skills.
Desired Skill-set
- Experience working on government or large-scale enterprise data projects;
- Exposure to data platform architecture and collaboration with data architects;
- Strong understanding of data quality, performance tuning, and optimization;
- Experience with data modeling and downstream analytics enablement;
- Ability to work closely with cross-functional stakeholders (analysts, business teams);
- Familiarity with automation and monitoring of data pipelines.
Responsibilities
- Design, develop, and maintain data pipelines and data platforms on AWS;
- Build and optimize data ingestion, transformation, and processing workflows using Databricks;
- Work closely with data architects, analysts, and stakeholders to understand requirements;
- Implement data models, ETL/ELT processes, and data integrations;
- Troubleshoot and resolve data quality, performance, and pipeline issues;
- Participate in Agile ceremonies including sprint planning, stand-ups, and retrospectives.
Should you be interested in this career opportunity, please send in your updated resume to [Confidential Information] at the earliest.
When you apply, you voluntarily consent to the disclosure, collection and use of your personal data for employment/recruitment and related purposes in accordance with the SCIENTE Group Privacy Policy, a copy of which is published at SCIENTE's website (https://www.sciente.com/privacy-policy).
Confidentiality is assured, and only shortlisted candidates will be notified for interviews.
EA Licence No. 07C5639
