Search by job, company or skills

Data Platform Engineer

Data Platform Engineer

optimum solutions pte ltd
3-5 Years
Not Disclosed
  • Posted 16 hours ago
  • Be among the first 10 applicants

Job Description

Key Responsibilities

• Support the daily operations of the data platform (e.g. handling error notifications, job monitoring & recovery, testing data pipelines);

• Investigate and troubleshoot reported incidents related to technical setup (e.g. connectivity failure, API timeout, service failure);

• Document changes to existing setup (e.g. data sources, pipelines, accounts);

• Research, propose and document technical requirements;

• Review and implement fixes for reported security vulnerabilities;

• Collaborate with the infrastructure team on the data team requests;

• Support product managers in cloud transformation journey for data products;

• Provide technical support and consultancy to business users;

• Develop reports to monitor usage, performance and security events;

• Generate mockup data and create unit tests;

• Set up DevOps pipelines;

• Optimise performance of data pipelines;

• Review data pipelines to ensure adherence to data management standards, policies and procedures.

Requirements

To meet the challenges of this role, you must have/ be:

• Minimum of Bachelor's Degree in Computer Science, Computer Engineering, or related disciplines;

• 3-5 years of work experience in Data Engineering, Data Science, Software Engineering or IT Infrastructure

• Proficient in developing dashboards (preferably with QuickSight or Tableau);

• Proficient in dashboard UX design;

• Proficient in SQL scripting to analyze, transform and integrate data sources;

• Proficient in Python;

Good to haves:

• Experience IT infrastructure (server, database, network administration experience is an advantage);

• Experience or certification in Tableau Server administration;

• Experience or certification in Talend administration;

• Experience or certification in MS SQL Server administration;

• Experience or certification in SAS Viya administration;

• Proficient in PowerShell;

• Experience in AWS or cloud services;

• Experience in SHIP-HATS or DevOps tools;

• Experience in Terraform or IaC;

• Experience with agile or other rapid application development methodologies;

More Info

Job Type:
Industry:
Employment Type:

Key Skills

Similar Jobs

5-8 yrs
SGD 6,000 - 12,000 per month
Singapore, Marina
Skills:
Ipc, Python, q language, KDB plus, qSQL, tick-data platforms, keyed tables, partitioned tables, feed handlers, RDB, dictionaries and lists, performance optimisation, HDB architectures, Linux-based development environments
3-6 yrs
SGD 11,000 - 13,000 per month
Singapore, Marina
Skills:
Java, Gcp, Terraform, Spark, Kafka, Python, Sql, AWS, Airflow, Go
6-8 yrs
Singapore
Skills:
Hadoop, Apis, Pyspark, Kafka, Informatica, Impala, Sql, Git, Hive, Spark, Cloudera, Talend, Python, Airflow, Teradata
5-7 yrs
Singapore
Skills:
snowflake , Github, Apache Spark, Datadog, ELT, Apache Airflow, Integration Testing, Databricks, Python, Kubernetes, Etl, AWS, Apache Hive, Apache Iceberg, Prefect, Vector Databases, Temporal, Dagster, Delta Lake
5-8 yrs
SGD 5,500 - 12,000 per month
Singapore, Raffles Link / Raffles Place
Skills:
snowflake , Github, Apache Spark, Datadog, Apache Airflow, Databricks, Python, Kubernetes, Apache Hive, Etl, AWS, Apache Iceberg, Prefect, Vector Databases, Temporal, Dagster, Delta Lake