Data Engineer

Azure Databricks Jr Developer

Experience: 7-10 Years

Location: Gurgaon

Skill: Azure Databricks, Azure Data Engineering

Job Description

We are looking for an experienced Azure Databricks Developer to design, develop, and optimize scalable data solutions on the Azure cloud platform. The ideal candidate should have strong expertise in Azure Databricks, PySpark, Data Engineering, and modern data warehousing concepts.

Key Responsibilities

• Develop and maintain ETL/ELT data pipelines using Azure Databricks and PySpark.
• Design and implement scalable data processing solutions for structured and unstructured datasets.
• Build, optimize, and manage Delta Lake architectures.
• Integrate data from multiple sources such as Azure Data Lake Storage, Azure SQL Database, APIs, and third-party systems.
• Collaborate with business stakeholders, data architects, and analytics teams to understand requirements.
• Monitor, troubleshoot, and optimize data workflows for performance and reliability.
• Implement data quality, governance, and security best practices.
• Support data migration and modernization initiatives on Azure.

Mandatory Skills

• 7+ years of IT experience with strong Data Engineering background.
• Hands-on experience in Azure Databricks.
• Strong proficiency in PySpark and Spark SQL.
• Experience with Azure Data Factory (ADF).
• Knowledge of Azure Data Lake Storage (ADLS Gen2).
• Experience with Delta Lake and Lakehouse architecture.
• Strong SQL development and performance tuning skills.
• Understanding of Data Warehousing concepts and ETL frameworks.
• Experience with Git-based source control and CI/CD pipelines.