Testing Automation Engineer

We are looking for a Mid-Level QA / Testing Automation Engineer with strong experience in Data Testing, Python, SQL, PySpark, and Big Data environments.

Key Responsibilities

• Develop and maintain automated Python-based testing frameworks for data validation.
• Perform data testing, reconciliation, and migration testing using Python and SQL.
• Develop automated tests for PySpark transformations and data pipelines.
• Perform regression, integration, scalability, and end-to-end pipeline testing.
• Validate data across Bronze, Silver, and Gold layers.
• Test Databricks workflows, schema evolution, data lineage, and data quality.
• Identify defects and work with Data Engineers on root-cause analysis.

Requirements

• 5+ years of QA/Testing experience.
• 3+ years of Data Testing experience in Big Data, Hadoop, or Cloud Data Warehouse environments.
• Proven experience transitioning from manual SQL checks to Python-based automation.
• Experience with Python migration automation testing.
• Strong SQL and PySpark skills.
• Experience with Databricks is preferred.
• Knowledge of Great Expectations/Pandera, DLT Expectations, Pytest-Spark, Git, or Unity Catalog is an advantage.
• Databricks certification or ISTQB certification is a plus.

Python | PySpark | SQL | Data Testing | Test Automation | Databricks | Big Data | Hadoop | Data Validation | Migration Testing | Data Reconciliation

Thanks, 

Saghana Sithara 

Business Manager, Recruitment| Quess Selection & Services, Singapore 

EA License Number: 23C2060 Registration ID is R1550224 

Disclaimer: The company is committed to ensuring the privacy and security of your information. By submitting this form, you consent to the collection, processing, and retention of the information you provide. The data collected (which may include your contact details, educational background, work experience and skills) will be used solely for the purpose of evaluating your qualifications for the position you're applying for. Your data will be stored securely and retained for the duration necessary to fulfil our hiring process. If you are not selected for the position, your data will be kept on file for a limited period in case future opportunities arise. You have the right to access, correct, or delete your data at any time by contacting us at Quess Singapore | A Leading Staffing Services Provider in Singapore (quesscorp.sg) 

This is in partnership with the Employment and Employability Institute Pte Ltd (e2i). 

e2i is the empowering network for workers and employers seeking employment and employability solutions. e2i serves as a bridge between workers and employers, connecting with workers to offer job security through job-matching, career guidance and skills upgrading services, and partnering employers to address their manpower needs through recruitment, training, and job redesign solutions. e2i is a tripartite initiative of the National Trades Union Congress set up to support nation-wide manpower and skills upgrading initiatives. By applying for this role, you consent to Quesscorp Singapore's PDPA and e2i's PDPA.