Role Summary
The Data Engineer will support a critical database migration initiative within ASM that impacts hundreds of enterprise visualization dashboards. This role will work closely with the ASM Data Analytics team to ensure data pipeline continuity, dashboard stability, and minimal business disruption during the migration. The role will require the initiative to reach out, liaise and communicate with global network teams to identify, data map and configure connection settings in line with global directive.
The ideal candidate has a strong foundation in data engineering, SQL-based data systems, and BI tools, with hands-on experience in Databricks, Python, and Tableau. This role is execution-focused and suited for someone who can operate independently under guidance from the DA team lead.
Key Responsibilities
Database Migration Support
- Support end-to-end database migration activities, including data validation, transformation, and reconciliation.
- Assist in migrating data sources that underpin large-scale visualization dashboards.
- Identify and resolve data integrity, performance, and compatibility issues arising from migration.
Data Engineering & Platform Management
- Develop and maintain SQL and Python-based data pipelines using Databricks and Jupyter Notebooks.
- Create and manage Databricks compute clusters and SQL Warehouses and configure Unity Catalog for data governance and access control.
- Optimize queries and data models to ensure performance and scalability post-migration.
BI & Dashboard Enablement
- Reconfigure, test, and validate Tableau dashboards impacted by database changes.
- Partner with dashboard owners to ensure data accuracy, performance, and functional parity after migration.
- Support ad-hoc analysis and troubleshooting related to Tableau and SpotFire dashboards.
Collaboration & Documentation
- Work closely with Data Analysts, Business Stakeholders, and IT teams within ASM.
- Document migration steps, data mappings, and known issues to support knowledge transfer and audit readiness.
- Follow ASM data governance, security, and compliance standards.
- Collaborate with global network/database team to identify, engineer and key data elements in-line with existing needs.
Required Skills & Qualifications
Technical Skills (Mandatory)
- Tableau certification (required active or recently obtained).
- Strong proficiency in SQL / MySQL for querying, transformation, and validation.
- Hands-on experience with Python for data processing and automation.
- Experience using Databricks, including: Creating and managing compute clusters and SQL Warehouses.
- Working with Unity Catalog
- Experience working with Jupyter Notebooks.
Technical Skills (Nice-to-Have / Highly Favored)
- Experience with SpotFire (dashboard development or support).
- Prior involvement in database or platform migration projects.
- Familiarity with manufacturing, biotech, or regulated environments.
