DevOps Engineer

Job Description: DevOps / DevSecOps Engineer

A hands-on DevOps / DevSecOps Engineer to design, build, and operate secure, audit-ready CI/CD and release governance for an Azure-based data platform ecosystem covering Azure Databricks, Azure Data Factory (ADF), and Informatica IDMC. The role owns multi-environment deployment automation (Dev → UAT → Prod), embeds security controls, and ensures every release complies with customer IT security standards and audit expectations.

Experience:

• 6+ years overall experience in data platforms and cloud delivery, with at least 3+ years in Azure based data platforms and CI/CD implementation across Databricks, Azure Data Factory (ADF), and Informatica IDMC.

Key Responsibilities (R&R)

• Design, build, and operate Azure DevOps pipelines for Dev → UAT → Prod promotion with approval gates and segregation of duties.

• Implement environment aware deployments with parameterisation, secrets management, and rollback capability.

• Integrate Databricks Asset Bundles, notebooks, workflows, and jobs into standardized release pipelines.

• Enable CI/CD for ADF pipelines and IDMC mappings, ensuring dependency validation and controlled promotion.

• Implement rerun, replay, and recovery pipelines to support operational resilience.

• Embed DevSecOps controls including RBAC, least privilege access, MFA for privileged roles, and secure secret handling.

• Integrate platform alerts and deployment events with ServiceNow and enterprise monitoring tools.

• Ensure deployments comply with customers IT Security standards and audit expectations.

• Act as DevOps SPOC across data engineering, governance, security, and platform teams.

Mandatory Skills (Must Have)

• CI/CD for Azure Databricks (Notebooks, Jobs, Workflows, Asset Bundles).

• Azure Data Factory (ADF) CI/CD and environment promotion.

• Informatica IDMC deployment and promotion concepts.

• Azure DevOps pipelines and Git branching strategies.

• Secrets management using Azure Key Vault.

• Entra ID / Azure AD (RBAC, SSO, SCIM concepts).

• Strong DevSecOps fundamentals in regulated enterprise environments.

• Experience working with multi environment (Dev/UAT/Prod) data platforms.

Good to Have Skills

• Unity Catalog awareness (deployment impact, permissions, lineage dependencies).

• ServiceNow integration for alerts and change notifications.

• Exposure to Azure Sentinel / security logging integration.

• Experience supporting data platform reruns, reconciliation, and DLP operations.

• Understanding of metadata driven ingestion and orchestration frameworks.

• Experience in large enterprise / public sector / regulated environments.

Behavioural & Delivery Expectations

• Strong ownership mindset with accountability for CI/CD and release governance.

• Ability to operate under tight go-live timelines while maintaining audit discipline.

• Strong collaboration skills across engineering, platform, and security teams.