Mid-Level QA / Testing Automation Engineer

Key Responsibilities
. Develop Test Strategy: Create a comprehensive test plan for the Lakehouse, focusing on Data Integrity, Accuracy, and Consistency.
. Automate Validation: Replace manual spot-checking with automated Python test suites that run as part of the CI/CD pipeline.
. Defect Analysis: Identify and document data anomalies, working closely with Data Engineers to perform root-cause analysis on Spark job failures.
. Regression Testing: Ensure that new PySpark code deployments do not impact existing Gold layer business logic or dashboard reporting.

ExperienceRequirements

. Total QA/Testing Experience: 5+ years.

. Data Testing Experience: 3+ years specifically in Big Data, Hadoop, or CloudData Warehouse environments.

. Good to have : Databricks Experience: 1+ years of experience testingpipelines within a Databricks environment.

.

Automation

Focus: Proven track record of moving from manual SQL checks to automated Python-based testing frameworks.

. Migration automation test experience using Python

Required Certifications

. Good to have: Databricks Certified Data Engineer Associate (at minimum).

. Preferred: ISTQB Foundation or Advanced Level (Test Automation Engineer).