Data Engineer

Responsibilities

Champion Data Access and User Experience

• Assess and coordinate data requests from business users, acting as a trusted advisor to understand their requirements and recommend the most appropriate datasets for their objectives.
• Convert complex data availability assessments into clear, practical guidance, enabling users to navigate HPB's data ecosystem with confidence.
• Work closely with requestors, the data operations team, and domain data engineers to ensure approved data requests are fulfilled efficiently and effectively.

Deliver Excellence in Data Engineering and Service

• Develop and implement reliable data extraction and delivery processes that support varied business needs while upholding high standards of accuracy and security.
• Manage recurring data contributions to government partners, ensuring smooth coordination from data ingestion through to compliant and timely delivery.
• Ensure all data services adhere to established governance frameworks and access control standards, maintaining trust, reliability, and compliance.

Enhance Data Discovery and Organisational Intelligence

• Manage and maintain comprehensive metadata for HPB's data discovery platform, ensuring datasets are accurately documented and easy to discover for informed decision-making.
• Partner with data owners and the engineering team to improve metadata quality and build comprehensive catalogues that help users locate and utilise data effectively.
• Continuously refine dataset descriptions, classifications, and catalogue information to improve the overall user experience across the organisation.

Provide Expert Support and Continuous Innovation

• Provide strong Level-1 support through the CDOO service management system, offering triaging and guidance to ensure smooth day-to-day operations.
• Identify and drive process improvements that enhance service quality, shorten turnaround times, and improve user satisfaction across all data service touchpoints.
• Maintain thorough documentation and knowledge repositories to support operational excellence and team capability development.

Qualifications

• Experience
• Minimum 2 years of experience in data engineering, operations, analytics support, integration, or metadata management roles at Associate Consultant level. Experience in public health would be advantageous.
• Education
• Bachelor's degree in Computer Science, Computer Engineering, Information Systems, Data Analytics, or a related discipline from a recognised institution.
• Alternatively, professional certifications in data engineering, data analytics, or data science from accredited bodies, together with relevant experience, may be accepted for candidates with a Bachelor's degree in Engineering or Science.

Required Skills

• SQL and PySpark and/or Python, with hands-on experience working with structured datasets and data transformation processes.
• Cloud-based data platforms, preferably Microsoft Azure, including Databricks and enterprise data warehouse environments.
• Data governance, metadata management, and data catalogue concepts.

Preferred Skills

• Experience with Microsoft Purview and Unity Catalog.
• Professional certifications in cloud, data engineering, data governance, or analytics-related domains.