Databricks Infrastructure

Description

We are seeking an experienced Databricks Infrastructure professional to join our team in SEA. The ideal candidate will have a strong background in managing and optimizing Databricks environments in cloud settings, ensuring high availability, security, and performance of our data infrastructure.

Responsibilities

• Design and manage Databricks infrastructure on cloud platforms.
• Optimize and monitor performance of Databricks environments.
• Implement security and access controls for data processing.
• Collaborate with data engineering and analytics teams to ensure efficient data workflows.
• Troubleshoot and resolve infrastructure-related issues promptly.

Skills and Qualifications

Databricks certification requirement is mandated for this role

• 3-10 years of experience in cloud infrastructure management, preferably with Databricks.
• Strong understanding of data engineering principles and data pipeline architectures.
• Experience with cloud platforms such as AWS, Azure, or Google Cloud.
• Proficient in scripting languages like Python, Bash, or PowerShell.
• Knowledge of containerization technologies such as Docker and orchestration tools like Kubernetes.
• Familiarity with ETL processes and data warehousing concepts.
• Strong problem-solving skills and ability to work collaboratively in a team environment.