Job Summary
We are seeking a Principal Data Architect to lead the design and implementation of enterprise-scale cloud data and AI platforms. The role will drive data architecture, Lakehouse platforms, AI/ML solutions, data governance, and technical strategy across complex enterprise environments.
Key Responsibilities
- Design enterprise Data & AI architecture and cloud data platforms.
- Lead Databricks Lakehouse, Delta Lake, DLT and Unity Catalog implementations.
- Develop scalable ETL/ELT, data engineering and data modelling solutions.
- Design AI/ML, GenAI and MLOps platforms and production solutions.
- Implement data governance, quality, security, lineage and access controls.
- Lead cloud platforms across Azure and AWS.
- Design real-time data solutions using Kafka, Azure Event Hub and Spark Streaming.
- Drive CI/CD, DevOps and cloud cost optimization for data platforms.
- Provide technical leadership and mentoring to Data Engineers, ML Engineers and Data Scientists.
- Engage stakeholders to define technology roadmaps, solution architecture and delivery plans.
Requirements
- 15+ years experience in Data Architecture, Data Engineering or Enterprise Architecture.
- Strong experience with Databricks, Azure/AWS, PySpark, Python and SQL.
- Expertise in Lakehouse, Data Warehousing, ETL/ELT and Data Modelling.
- Experience with AI/ML, GenAI, LLM, MLOps and MLflow.
- Strong knowledge of Data Governance, Data Quality, Security and Privacy.
- Experience with Kafka/Azure Event Hub, CI/CD and DevOps.
- Strong technical leadership and stakeholder management skills.
Preferred: Databricks certifications, DAMA-DMBOK, PMP, Power BI/Tableau/Qlik experience.