Search by job, company or skills

Azure Data Engineer with Databricks & DLT

Azure Data Engineer with Databricks & DLT

IBM
6-8 Years
Not Disclosed
  • Posted 25 days ago
  • Over 100 applicants have applied

Job Description

Total 9-12,Relevant 6+ yrs : Mandate-Strong Azure Data Engineer with advanced skills in Python (coding/scripting),SCD, SQL, Azure Data factory, Data Modeling, and Databricks (PySpark, Delta Live Tables, structured/live streaming, Unity Catalog) Medallion Architecture. Handson exp in performance optimisation of DLT pipelines,cost optimization for Databricks in live streaming (Photon, serverless/nonserverless)./ ELT/Asset Bundle /ADLS/Role requires AI/GenAI-driven innovation—leveraging LLMs/agents to accelerate automated pipeline development.(Gen AI: Genie, Mosaic AI, GitHub CoPilot - Knowledge)

Secondary: CI/CD, Power BI,Azure Synapse,Terraform,Azure Functions, Logic Apps.Mosaic AI, Ginie

Requires strong ownership, analytical excellence, selfdrive, excellent communication and professional conduct .

More Info

Job Type:
Industry:
Employment Type:

Key Skills

LLMs

Performance Optimisation of DLT Pipelines

CI CD

Photon Serverless

Asset Bundle

Medallion Architecture

GitHub CoPilot

AI GenAI-driven Innovation

Structured Live Streaming

Gen AI Genie

ADLS

Delta Live Tables

Mosaic AI

Unity Catalog

Cost Optimization for Databricks

About Company