Search by job, company or skills

Platform Data Engineer

Platform Data Engineer

pathgen
2-4 Years
Not Disclosed
  • Posted 4 hours ago
  • Be among the first 10 applicants

Job Description

Job Description: Platform Data Engineer

Role Overview:

We are looking for a pragmatic and technically skilled Data Engineer with a focus on engineering for diverse data types - including; natural language, geospatial and biological data. This role is ideal for someone with experience in building robust data pipelines to support health or biological applications.

This is a truly exciting opportunity to work with leading global institutions, government agencies, and country partners at the intersection of AI, public health & pathogen genomics to generate positive social impact whilst leading on cutting edge AI initiatives in APAC and the wider world!

Responsibilities:

  • Build and monitor scalable data ingestion pipelines for structured datasets (e.g., genomic repositories, scientific literature, climactic datasets, socio-economics).
  • Automate ETL processes, pre-processing workflows, and model lifecycle operations (kafka, airflow)
  • Collaborate with bioinformatics experts to ensure data quality and traceability.
  • Assist with deployment and maintenance of machine learning models using FastAPI and containerized microservices.
  • Manage model inference endpoints and batch inference workflows (e.g., AWS Batch or K8s).
  • Implement CI/CD pipelines for ML workflows using tools like GitHub Actions, Docker, Terraform

Essential Qualifications:

  • 2+ years of experience deploying and maintaining data pipelines in python.
  • Strong Python and data skills
  • Experience with Docker, container orchestration, and cloud deployments (AWS preferred).
  • Experience with data engineering workflows (e.g., Airflow, Prefect, Kafka, K8s).
  • Strong experience with data engineering best practices.
  • Experience with satellite or remote-sensing data (COGs, Tiffs, multi-band rasters, etc)

Bonus Qualifications:

Experience or familiarity with one or more of the following areas will be highly advantageous:

  • Domain expertise or strong interest in biological or geospatial data

Desired Personal Attributes:

  • Start-up mentality (flexible & pragmatic)
  • Strong collaboration skills in multi-disciplinary environments.
  • Systems thinking and a bias toward reliability & scalability.
  • Ability to design practical, maintainable data & ML infrastructure.

What We Offer:

  • A mission-driven environment focused on improving global public health.
  • Opportunities to work on high-impact problems in AI and pathogen genomics.
  • A flexible and collaborative work culture with a commitment to innovation.
  • Low bureaucracy - direct ownership of the product, no ticket-factory work.
  • Competitive salary & paid leave
  • Hybrid-friendly work pattern
  • No-crunch culture

Join us to help operationalize the future of genomic intelligence and deploy real-world AI tools that matter.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

3-6 yrs
Singapore
Skills:
Prometheus, Grafana, React, Flask, Python, BigQuery, Sql, Django, Gcp, MLops, FastAPI, Restful Apis, GitOps, vector databases, LangGraph, Vertex AI Agent Builder, OpenTelemetry, RAG pipelines, LLM evaluation, GKE, CrewAI tool function calling, CI/CD, ArgoCD, MCP, Google ADK
3-10 yrs
Singapore
Skills:
Government on Commercial Cloud (GCC), snowflake , Spark SQL, Apis, Sql, Version Control, Iam, Databricks, Data Modelling, Python, Airflow, Airbyte, Vector databases, IM8 security policy controls, Dimensional modelling, SHIP-HATS CI/CD toolchain, dbt, Snowflake Tasks, CI/CD, Fivetran, Feature stores, Databricks Workflows, Medallion architecture
5-7 yrs
Singapore
Skills:
Apache Flink, Google Cloud Platform, Data Modelling, Data Warehousing, Database Management Systems, Sql, Spark, Apache Kafka, Databricks, batch and streaming workflows, Airflow, dbt, ETL pipelines
3-5 yrs
Singapore
Skills:
snowflake , Databricks, Unix, Java, Yarn, Golang, HBase, Presto, Linux, Hive, Python, Spark, Flink, HDFS, StarRocks
5-7 yrs
Singapore
Skills:
Python, Ipc, KDB plus, large-scale data platforms, real-time market data, time-series databases, RDB HDB architectures, q language, trading or risk analytics systems, qSQL, tick-data platforms, keyed tables, partitioned tables, feed handlers, dictionaries and lists, performance optimisation, Linux-based development environments