Azure Data Engineer with Databricks & DLT
IBM- Posted 25 days ago
- Over 100 applicants have applied
Job Description
Total 9-12,Relevant 6+ yrs : Mandate-Strong Azure Data Engineer with advanced skills in Python (coding/scripting),SCD, SQL, Azure Data factory, Data Modeling, and Databricks (PySpark, Delta Live Tables, structured/live streaming, Unity Catalog) Medallion Architecture. Handson exp in performance optimisation of DLT pipelines,cost optimization for Databricks in live streaming (Photon, serverless/nonserverless)./ ELT/Asset Bundle /ADLS/Role requires AI/GenAI-driven innovation—leveraging LLMs/agents to accelerate automated pipeline development.(Gen AI: Genie, Mosaic AI, GitHub CoPilot - Knowledge)
Secondary: CI/CD, Power BI,Azure Synapse,Terraform,Azure Functions, Logic Apps.Mosaic AI, Ginie
Requires strong ownership, analytical excellence, selfdrive, excellent communication and professional conduct .
More Info
Key Skills
LLMs
Performance Optimisation of DLT Pipelines
CI CD
Photon Serverless
Asset Bundle
Medallion Architecture
GitHub CoPilot
AI GenAI-driven Innovation
Structured Live Streaming
Gen AI Genie
ADLS
Delta Live Tables
Mosaic AI
Unity Catalog
Cost Optimization for Databricks
