Candidate with a Business Analyst background who is capable of day-to-day Databricks data platform operations and development. This role requires both the ability to communicate requirements with business users and the technical design and implementation of data solutions.
Job Description
- Design and build data pipelines using Databricks
- Optimize Spark jobs and ETL processes to improve performance and stability
- Collaborate with data scientists and analysts to support business analysis and modeling
- Ensure data quality and governance, and maintain data consistency and security
- Manage and scale infrastructure for cloud-based data workloads
Job Requirements
- Familiarity with Databricks, Spark, and related big data processing technologies
- Strong Business Analyst background with the ability to communicate directly with users, gather and analyze requirements
- Experience in data pipeline and ETL design and optimization
- Familiarity with data processing and operations in cloud computing environments (such as AWS, Azure, or GCP)
- Focus on data governance and quality control
