Job Description

TCS Hiring: Databricks Platform Architect | PAN India | 12 to 18 Years

We are seeking an experienced Databricks Platform Architect to lead enterprise-scale Databricks platform setup, modernization, governance, and cloud transformation initiatives.

The ideal candidate should possess strong expertise in Databricks Architecture, Cloud Infrastructure, Lakehouse Platforms, Data Governance, DevOps Automation, and Enterprise Data Platforms, along with proven experience delivering large-scale platform implementations.

Experience

12 to 18 years of overall IT experience
4 to 8+ years of hands-on Databricks experience
Experience in multiple enterprise-scale Databricks implementations
Strong client-facing and solutioning experience

Mandatory Skills

Strong Databricks Platform Architecture experience
Strong PySpark, Delta Lake, and Cloud (AWS/Azure/GCP) experience
Proven Data Migration and Modernization experience
Strong Data Architecture and Data Governance expertise
Hands-on experience in Greenfield Databricks implementations
Terraform and Infrastructure as Code (IaC) experience
CI/CD, DevOps, and Platform Automation expertise
Client-facing consulting and stakeholder management experience

Key Responsibilities

Architect and deploy enterprise-grade Databricks platforms across AWS, Azure, and GCP
Design multi-environment architecture (Dev, QA, UAT, Prod)
Implement Unity Catalog, governance, security, lineage, and compliance frameworks
Lead cloud migration and data modernization initiatives
Establish scalable Lakehouse Architecture using Delta Lake
Define infrastructure automation using Terraform
Implement DevOps, CI/CD, and deployment automation frameworks
Optimize cluster strategies, platform performance, scalability, and cost controls
Set up monitoring, observability, alerting, and operational frameworks
Collaborate with business stakeholders and delivery teams to define enterprise data solutions

Required Technical Skills

Databricks: Unity Catalog, Delta Lake, Workflows, Cluster Policies, Auto Scaling, Lakehouse Architecture

Cloud Platforms: AWS, Azure, GCP

Programming: PySpark, Python, SQL

Infrastructure & Automation: Terraform, GitHub, Azure DevOps, Jenkins, CI/CD

Governance & Security: RBAC, ABAC, Data Lineage, Data Masking, Encryption, Secrets Management

Monitoring & Observability: Datadog, Azure Monitor, CloudWatch