Job Summary
We are seeking an experienced Azure/AWS Data Architect to lead the design and implementation of secure, scalable, and high-performance data platforms. This role is responsible for defining end-to-end architecture across Azure, AWS, Microsoft Fabric, and Databricks, enabling advanced analytics, AI, and business intelligence capabilities.
The ideal candidate will have strong expertise in modern data lakehouse architectures, AWS/Azure deployments, and infrastructure automation, with the ability to translate business requirements into robust, production-ready solutions.
Key Responsibilities
- Architecture & Design
Design and implement modern data platform architectures using:
Azure: Data Lake Gen2, Synapse Analytics, Data FactoryMicrosoft Fabric: OneLake, Dataflows Gen2, Pipelines, Direct Lake, Semantic ModelsDatabricks: Data engineering, ML, and real-time analyticsAWS: Glue, Athena, Redshift, EMR, RDS, Kinesis, S3, Lambda
Define enterprise lakehouse and warehouse architectures, including medallion (Bronze/Silver/Gold) patterns
Build end-to-end pipelines (ingestion transformation modeling serving)
Design Power BI solutions with Direct Lake, Lakehouse, or Warehouse connectivity
- Governance & Security
Define data governance, security, and compliance frameworks in collaboration with IT security teams.
Collaborate with governance teams to integrate Microsoft Purview for data cataloging, classification, lineage, and sensitivity labeling.
Define and enforce RBAC, managed identity access, private endpoint strategy, and DLP policies across all data services.
Ensure compliance with regulatory frameworks such as GDPR, PDPA, or HIPAA - Performance & Cost Optimisation
Optimise performance and cost by selecting appropriate storage and compute SKUs, caching, partitioning, and workload management strategies.
Implement real-time ingestion and streaming solutions using Real-Time Hub and Event Streams in Fabric. - Infrastructure as Code & Cloud Deployment
Design and deploy cloud infrastructure using Terraform (mandatory)
Implement end-to-end infrastructure provisioning, including:Data services (Fabric, Databricks, Synapse, Glue, Redshift, etc.)Networking (VNet/VPC, subnets, routing, firewalls, private endpoints)Security (IAM roles, Key Vault / Secrets Manager, encryption, policies)
Build and maintain CI/CD pipelines using Azure DevOps or GitHub Actions
Ensure environments are repeatable, version-controlled, and production-ready
- Collaboration & Leadership
Work closely with Data Engineers, BI Developers, Data Scientists, and Business Analysts to translate business requirements into technical designs.
Mentor technical teams in implementing best practices for data architecture, DevOps, and CI/CD automation.
Participate in cloud transformation initiatives, migrations, and legacy modernization projects.
Required Skills and Experience
Core Technical Skills
- Azure Services: Synapse Analytics, Data Factory, Data Lake Gen2, Key Vault, Monitor, Purview, Event Hub, Functions, Storage Accounts, Private DNS
- Microsoft Fabric: OneLake, Pipelines, Notebooks, Semantic Models, Real-Time Hub, Data Activator
- Databricks: Delta Lake, Unity Catalog, MLflow, Delta Live Tables, Job Clusters, Notebooks
- AWS Services: AWS Glue, Athena, RDS, Kinesis, etc
- Power BI: Advanced DAX, deployment pipelines, pbip projects, dataset modeling
- Security: Private Endpoints, RBAC, Managed Identity, network isolation, Purview integration
- Infrastructure-as-Code: Terraform, ARM Templates, Azure DevOps or GitHub Actions for CI/CD
- Added advantage: experience with implementing AI/ML services in Azure/AWS or Databricks
Experience
- Minimum 5 years in data architecture or equivalent roles
- At least 5 years of experience in Azure data stack
- Hands-on experience with Microsoft Fabric and production workloads in Databricks
- Proven experience implementing secure and governed enterprise data platforms
Preferred Certifications
- Microsoft Certified: Azure Solutions Architect Expert
- Microsoft Certified: Fabric Analytics Engineer Associate
- Databricks Certified Data Engineer (Associate/Professional)
- Microsoft Certified: Azure Data Engineer Associate
Soft Skills
- Strong communication and stakeholder management skills
- Analytical mindset with a problem-solving attitude
- Familiarity with Agile and DevOps methodologies
- Ability to work across cross-functional teams in multi-cloud or hybrid environments
