Role and Responsibilities
Job Summary:
As a Databricks SME, you will be responsible for providing expert guidance and support in the implementation and optimization of Databricks solutions. You will work closely with cross-functional teams to design, develop, and deploy data pipelines and analytics solutions that meet business needs.
Key Responsibilities:
- Serve as the primary expert on Databricks, providing technical guidance and support to teams.
- Design and implement data pipelines using Databricks and Apache Spark.
- Collaborate with data engineers, data scientists, and business stakeholders to understand data requirements and deliver solutions.
- Optimize existing Databricks workflows for performance and efficiency.
- Conduct training sessions and workshops to enhance team knowledge of Databricks.
- Troubleshoot and resolve issues related to Databricks environments and workflows.
Requirements / Qualifications
Qualifications:
- Proven experience with Databricks and Apache Spark.
- Strong programming skills in languages such as Python, Scala, or SQL.
- Experience with data modeling, ETL processes, and data warehousing concepts.
- Experience in datalake solutions
Preferred Qualifications:
- Databricks certification is a plus.
- Experience with cloud platforms (AWS, Azure, GCP).
- Familiarity with machine learning frameworks and tools.