Data Engineer (UnitTest_DevOps_AWS_K8s_Snowflake_Spark_Hive_Airflow_DataDog)

Maltem Asia is seeking a Data Engineer for a Wealth Management Client based in Singapore.

Responsibilities:

• Develop and maintain data pipelines and ETL/ELT processes, and ensuring maintainability through unit and integration testing.
• Collaborate with data teams to understand requirements and automate deployment and monitoring.
• Optimize data storage and troubleshoot issues to enhance performance.

Must Have Skillsets:

• Possess a degree in Computer Science/Information Technology or related fields.
• Between 3 to 8+ years of relevant working experience in Software or Data Engineering with STRONG proficiency in Python.
• Strong experience in unit and integration testing.
• Familiarity with DevOps practices and Agile methodologies.
• Strong software engineering, analytical and problem-solving skills.

Good-To-Have:

• Experience in:
• AWS
• Kubernetes (K8s)
• Familiarity with data platforms such as:
• Snowflake
• Apache Spark
• Apache Hive
• Orchestration tools like:
• Apache Airflow
• Dagster
• Prefect
• Familiarity with GitHub workflows and Datadog.