Search Jobs
Search by job, company or skills
Search by job, company or skills
Location: Singapore (Singaporeans preferred)
6+ years of experience in data platforms and large-scale data migration
Strong experience in Cloudera, Azure Data Factory (ADF), and Azure Databricks
We are looking for an experienced Data Migration Specialist to lead end-to-end historical data migration from legacy platforms such as Cloudera (Hive/HDFS) to Azure-based data platforms. The role involves designing and executing large-scale data migration strategies, building scalable and reliable pipelines, and ensuring data accuracy through reconciliation and validation processes.
The candidate will work closely with platform, ingestion, and business teams to support migration, parallel run, and final cutover with audit compliance and business sign-off.
Own end-to-end historical data migration from Cloudera (Hive/HDFS) and legacy systems
Design and execute one-time bulk data migration and ongoing incremental loads
Develop metadata-driven pipelines using Azure Data Factory
Build scalable, restartable, and idempotent data migration pipelines
Implement migration using existing ingestion frameworks or custom-built frameworks
Develop reconciliation reports including counts, checksums, and balances
Create automated testing frameworks for validating historical data migration
Handle schema drift, data inconsistencies, and legacy data anomalies
Support parallel run, migration cutover, and business validation/sign-off
Act as the single point of contact for migration across technical and business teams
OX Consultancy is an IT recruitment firm and we offer a range of services that cover permanent, contract and flexible on demand recruitment. Our team have enormous experience enabling the right solution for your needs. Whether your business need is to transform talent acquisition, hire permanent staff, or plug in the gaps around your workforce, we can adapt our services to meet your business needs.
Job ID: 146176885
