Azure Data Engineer (Databricks)
Azure Data Engineer (Databricks)
Srihire Consulting Services Private LimitedQuick Apply
- Posted 3 months ago
- Over 500 applicants have applied
Job Description
Description
We are seeking an experienced Azure Data Engineer with expertise in Databricks to join our dynamic team in India. The ideal candidate will have a robust background in data engineering and a passion for building efficient data solutions in the Azure ecosystem.
Responsibilities
- Design and implement scalable data pipelines using Azure Databricks.
- Collaborate with data architects and data scientists to create data models and optimize performance.
- Develop ETL processes to extract, transform, and load data from various sources into Azure.
- Monitor and maintain data quality and integrity throughout the data lifecycle.
- Implement security measures to protect sensitive data in compliance with regulations.
- Document data engineering processes and best practices for team knowledge sharing.
Skills and Qualifications
- 7-14 years of experience in data engineering or related field.
- Proficiency in Azure Data Services, especially Azure Databricks.
- Strong programming skills in Python or Scala for data processing.
- Experience with SQL and data modeling techniques.
- Familiarity with data warehousing concepts and tools.
- Knowledge of big data technologies like Spark and Hadoop.
- Ability to work with data visualization tools such as Power BI or Tableau.
- Strong problem-solving skills and ability to work in a team environment.
More Info
Key Skills
ETL Processes
Spark Programming
About Company
Srihire is an IT staffing company that provides end-to-end talent solutions for technology roles across India.
Skills:
Adf, Pyspark, Apache Spark, Azure Databricks, Azure Sql, ELT, Data Quality, Azure Data Factory, Advanced Sql, Oracle, Python, Etl, Medallion Architecture, Spark Performance Tuning, pipeline development, ADLS, Lakehouse, Delta Lake
Skills:
Azure Data Factory, Scala, Data Warehousing, Azure Databricks, Data Modeling, Sql, Python, Palantir, ETL processes
Skills:
snowflake , Gitlab, Databricks, Sql, ELT, Apache Airflow, Data Architecture, Rest Apis, MLops, Etl, AWS, Kubernetes, Python, Azure, Docker, Git, Data Modeling, cdc, Airbyte, AI Coding Assistants
Skills:
Azure Data Factory, Databricks, Sql, Pyspark, Power Bi, Terraform, ELT, Azure Functions, Python, Azure Synapse, LLMs, Agents, Performance Optimisation of DLT Pipelines, CI CD, Photon Serverless, Asset Bundle, Medallion Architecture, GitHub CoPilot, AI GenAI-driven Innovation, Structured Live Streaming, Gen AI Genie, ADLS, Delta Live Tables, Mosaic AI, Unity Catalog, Cost Optimization for Databricks, Logic Apps