Key Responsibilities
- Design, engineer, and continuously enhance complex data ingestion, transformation, and orchestration pipelines leveraging Azure Data Factory (ADF), Azure Data Lake, and other Azure services.
- Develop, optimize, and operationalize high-performance distributed data-processing workloads using PySpark and Spark, ensuring scalability and efficiency across large-volume, multi-terabyte datasets.
- Design, implement, and maintain end-to-end ETL/ELT frameworks, including enterprise-grade data integration, cleansing, and migration solutions across heterogeneous systems.
- Build, optimize, and govern Power BI reporting and analytics ecosystems, including semantic model design, DAX optimization, performance tuning, and enterprise deployment workflows.
- Implement and maintain robust CI/CD automation using Azure DevOps, enforce disciplined branching and release strategies, and ensure software quality through Git-based version control best practices.
- Collaborate closely with Business Analysts, Project Managers, and diverse business stakeholders to interpret complex requirements and translate them into scalable, secure, and production-ready technical solutions.
- Ensure adherence to rigorous data governance standards by safeguarding data quality, reliability, operational resilience, and performance across all pipelines, services, and integration touchpoints.
Requirements
- Bachelor's degree in Computer Science, Applied Mathematics, Engineering, or a closely aligned quantitative discipline.
- 7-10 years of progressive, hands-on experience in Data Engineering or Big Data technologies.
- Extensive, demonstrable experience within the Banking and Financial Services industry is mandatory.
- Advanced proficiency in Python, PySpark, and SQL, with the ability to engineer high-performance solutions for distributed computing environments.
- Practical application of industry-standard engineering practices, including Git-based workflows, Jira-driven delivery management, and DevOps-oriented CI/CD pipelines.
- Proven ability to function both autonomously and collaboratively in dynamic, fast-paced, and ambiguity-driven environments.
- Proven analytical acumen, intellectual curiosity, and the capability to navigate complex technical challenges while managing multiple priorities concurrently.
Interested Applicants, please email your resume to [Confidential Information] (R1441955), stating the position as the subject title in the email.
