Job Summary:
As a Databricks SME, you will be responsible for providing expert guidance and support in the implementation and optimization of Databricks solutions. You will work closely with cross-functional teams to design, develop, and deploy data pipelines and analytics solutions that meet business needs.
Key Responsibilities:
- Serve as the primary expert on Databricks, providing technical guidance and support to teams.
- Design and implement data pipelines using Databricks and Apache Spark.
- Collaborate with data engineers, data scientists, and business stakeholders to understand data requirements and deliver solutions.
- Optimize existing Databricks workflows for performance and efficiency. Conduct training sessions and workshops to enhance team knowledge of Databricks.
- Stay updated on the latest Databricks features and best practices, and share insights with the team.
- Troubleshoot and resolve issues related to Databricks environments and workflows.
Requirements / Qualifications Qualifications:
- Bachelor's degree in Computer Science, Data Science, or a related field.
- Proven experience with Databricks and Apache Spark.
- Strong programming skills in languages such as Python, Scala, or SQL.
- Experience with data modeling, ETL processes, and data warehousing concepts.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
- 4 - 5 years experience in datalake solutions
Preferred Qualifications:
- Databricks certification is a plus.
- Experience with cloud platforms (AWS, Azure, GCP).
- Familiarity with machine learning frameworks and tools.
