Senior Data Engineer

Responsibilities

• Design and develop scalable data architectures and solutions on the Databricks platform
• Build, maintain, and optimize data pipelines using Spark (PySpark, Scala) for batch and incremental processing.
• Identify and resolve technical problems, tune workloads and clusters, and fine-tune queries for optimal performance.
• Ensure Databricks best practices, data governance, data quality, and data security frameworks are applied across all projects.

Skills/Requirement

. Bachelor's degree in computer science, Information Technology, or related field.

• 8+ yrs. experience working with data migration, transformation, processing & warehouse design, specifically on Databricks (Unity Catalog, Delta Lake) / Azure Data Factory / Azure SQL
• Expertise in developing efficient Azure Data Factory Pipelines and Databricks Notebooks (PySpark/Spark SQL)
• Proficient in PySpark, Spark SQL, T-SQL

Interested candidates, who wish to apply for the above position, please send in your resume to:

PERSOLKELLY Singapore Pte Ltd EA License No. 01C4394 EA Reg No: R23118975 (ABDUL RAHMAN ANSARI RAJA)

We regret to inform you that only shortlisted candidates will be contacted.

..................................

This is in partnership with Employment and Employability Institute Pte Ltd (e2i). e2i is the empowering network for workers and employers seeking employment and employability solutions. e2i serves as a bridge between workers and employers, connecting with workers to offer job security through job-matching, career guidance and skills upgrading services, and partnering employers to address their manpower needs through recruitment, training, and job redesign solutions. e2i is a tripartite initiative of the National Trades Union Congress set up to support nation-wide manpower and skills upgrading initiatives. By applying for this role, you consent to .

By sending us your personal data and curriculum vitae (CV), you are deemed to consent to PERSOLKELLY Singapore Pte Ltd and its affiliates to collect, use and disclose your personal data for the purposes set out in the Privacy Policy available at . You acknowledge that you have read, understood, and agree with the Privacy Policy.

..................................