We are looking for a skilled CDC Data Engineer with hands-on experience in implementing and managing Change Data Capture pipelines using tools such as Qlik Replicate. The role involves designing and configuring data replication processes, developing transformation and validation scripts, and ensuring reliable and accurate data movement across systems. The ideal candidate will collaborate closely with business and technical teams to translate functional requirements into robust CDC implementations and support end-to-end data integration processes.
Key Responsibilities:
- Implement, configure, and manage CDC pipelines using tools such as Qlik Replicate or similar technologies.
- Develop and maintain scripts or code (Python, SQL, Shell, or Java) to perform data transformations, validations, and automation tasks.
- Perform source-to-target data mapping and ensure data integrity and consistency during replication processes.
- Conduct data validation, reconciliation, and exception handling to maintain high data quality.
- Collaborate with business users, business analysts, and application teams to understand and clarify functional requirements.
- Support SIT, UAT, and production deployments, including defect analysis and issue resolution.
- Monitor CDC jobs and replication processes, identify performance issues, and escalate risks or errors where necessary.
- Maintain technical documentation, including data mappings, CDC configurations, and operational procedures.
- Perform impact analysis when there are source system or schema changes.
- Provide post-go-live support and assist with knowledge transfer to operations and support teams.
Required Skills:
- Hands-on experience with CDC tools such as Qlik Replicate for data replication, configuration, and monitoring.
- Strong scripting/programming skills in Python, SQL, Shell, or Java for data processing and automation.
- Ability to gather, analyze, and translate business and functional requirements into technical CDC implementations.
- Experience with source-to-target data mapping and data replication processes.
Good to Have Skills:
- Knowledge of data quality frameworks, validation techniques, and reconciliation processes.
- Experience with monitoring performance and handling errors in CDC pipelines.
- Familiarity with version control systems or CI/CD practices for managing CDC scripts and configurations.
