We are looking for an experienced Senior Data Engineer to join our team and lead the design, development, and optimization of scalable data pipelines and data platforms. The ideal candidate has strong hands-on experience in data engineering, data integration, and data governance, with the ability to work across complex systems and large datasets.
Key Responsibilities:
- Design, build, and maintain scalable ETL/ELT data pipelines.
- Lead data extraction, transformation, loading, data cleaning, and basic exploratory analysis.
- Develop source-to-target mappings, metadata management, and data quality frameworks.
- Partner with stakeholders to gather and translate business and technical requirements.
- Support data modelling, information lifecycle management, and master data initiatives.
- Ensure compliance with relevant data governance standards.
- Collaborate with cross-functional teams to support analytics, reporting, and system integration efforts.
Required Experience:
- Minimum 6 years of hands-on experience in data engineering or systems implementation.
- Strong background in data integration, analytics, and building end-to-end data pipelines.
- Experience handling large datasets and conducting EDA, data quality checks, and feature engineering.
- Understanding of information management concepts such as data modelling, information lifecycle management, and master data management.
Nice to Have:
- Experience gathering requirements for data warehouse or similar large-scale systems.
- Knowledge of Change Management, Risk Management, and Incident Management.
- Experience supporting government projects or familiarity with IM8 and PSGA standards.
- Proficiency with Microsoft Azure data services and Power BI.
- Agile or other project management certifications.
Technical Skills:
- Strong proficiency in PySpark, SQL, and Python.
- Able to process and optimize large-scale datasets in distributed environments.
- Familiarity with Azure-based data platforms is a plus.
To apply,simply click the Apply button or send your updated profileto
EA Licence No.:18S9405 / EA Reg. No.:R1330864
PerceptSolutions is expanding and actively seeking talented individuals. We encourageapplicants to follow Percept Solutions on LinkedIn at https://www.linkedin.com/company/percept-solutions/to stay informed about new opportunities and events.
