Data Engineer

Responsibilities:

Develop and maintain data pipelines and ETL/ELT processes and ensuring maintainability through unit and integration testing.

Collaborate with data teams to understand requirements and automate deployment and monitoring.

Optimize data storage and troubleshoot issues to enhance performance.

Requirements

Possess a degree in Computer Science/Information Technology or related fields.

At least 5 years of relevant working experience in software or data engineering with proficiency in Python.

Strong experience in unit and integration testing.

Familiarity with DevOps practices and Agile methodologies.

Strong software engineering, analytical and problem-solving skills.

Good team player and communication skill.

Skillsets (Good to have)

Experience in AWS and Kubernetes (K8s).

Familiarity with data platforms such as Snowflake, Apache Spark, or Apache Hive, as well as orchestration tools like Apache Airflow, Dagster, or Prefect.

Familiarity with GitHub workflows and Datadog.

Disclaimer: The company is committed to ensuring the privacy and security of your information. By submitting this form, you consent to the collection, processing, and retention of the information you provide. The data collected (which may include your contact details, educational background, work experience and skills) will be used solely for the purpose of evaluating your qualifications for the position you're applying for. Your data will be stored securely and retained for the duration necessary to fulfill our hiring process. If you are not selected for the position, your data will be kept on file for a limited period in case future opportunities arise. You have the right to access, correct, or delete your data at any time by contacting us at Quess Singapore | A Leading Staffing Services Provider in Singapore (quesscorp.sg)