
Search by job, company or skills
Key Responsibilities
. Develop Test Strategy: Create a comprehensive test plan for the Lakehouse, focusing on Data Integrity, Accuracy, and Consistency.
. Automate Validation: Replace manual spot-checking with automated Python test suites that run as part of the CI/CD pipeline.
. Defect Analysis: Identify and document data anomalies, working closely with Data Engineers to perform root-cause analysis on Spark job failures.
. Regression Testing: Ensure that new PySpark code deployments do not impact existing Gold layer business logic or dashboard reporting.
ExperienceRequirements
. Total QA/Testing Experience: 5+ years.
. Data Testing Experience: 3+ years specifically in Big Data, Hadoop, or CloudData Warehouse environments.
. Good to have : Databricks Experience: 1+ years of experience testingpipelines within a Databricks environment.
.
Automation
Focus: Proven track record of moving from manual SQL checks to automated Python-based testing frameworks.
Migration automation test experience using Python
Required Certifications
. Good to have: Databricks Certified Data Engineer Associate (at minimum).
. Preferred: ISTQB Foundation or Advanced Level (Test Automation Engineer).
Job ID: 148853171
We don’t charge any money for job offers