Senior Data Operations Engineer

Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation and managed services. Given our decade of success we have evolved to become one of the top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail, and supply chain.

We are currently looking to hire Senior Data Operations Engineer. This is an exciting opportunity to expand your skill set, achieve job satisfaction and work-life balance. More details as below.

Senior Data Operations Engineer - Job Description

Role Overview

We are looking for a Senior Data Operations Engineer to support, monitor, troubleshoot, and optimize enterprise data platforms and pipelines. The role focuses on ensuring the reliability, availability, data quality, and performance of data operations across batch and real-time processing environments.

Key Responsibilities

. Monitor and manage ETL/ELT pipelines, data workflows, scheduled jobs, and production data processes.

. Ensure data pipelines meet defined SLA, availability, and performance requirements.

. Troubleshoot and resolve pipeline failures, data quality issues, job failures, and production incidents.

. Perform root cause analysis (RCA) and implement permanent solutions for recurring issues.

. Monitor data platforms, applications, jobs, and infrastructure using appropriate monitoring and alerting tools.

. Support production deployments, releases, and data platform changes.

. Work closely with Data Engineers, Cloud/Infrastructure teams, Application teams, and business stakeholders to resolve production issues.

. Perform data validation, reconciliation, quality checks, and exception handling.

. Optimize data pipelines and SQL queries for improved performance and reliability.

. Develop automation scripts using Python, SQL, Shell scripting, or similar technologies.

. Maintain operational documentation, support procedures, and runbooks.

. Participate in incident, problem, and change management processes.

. Support batch and real-time data processing environments.

. Identify opportunities to automate repetitive operational tasks and improve platform stability.

. Participate in on-call/24x7 production support, where required.

Required Technical Skills

. Strong experience in Data Operations, Data Engineering, or Production Support.

. Strong hands-on experience with SQL and Python.

. Experience supporting ETL/ELT pipelines and data integration workflows.

. Experience with Apache Spark / PySpark.

. Experience with orchestration tools such as Apache Airflow, Azure Data Factory, Databricks Workflows, or equivalent.

. Good knowledge of Linux/Unix and Shell scripting.

. Experience with Azure, AWS, or GCP cloud environments.

. Experience with Databricks, Snowflake, Azure Synapse, BigQuery, or similar data platforms.

. Good understanding of Data Lakes, Data Warehouses, and Lakehouse architectures.

. Experience with Git, CI/CD, Jenkins, Azure DevOps, or equivalent.

. Familiarity with monitoring/logging tools such as Splunk, Grafana, Prometheus, CloudWatch, Azure Monitor, or equivalent.

Data Operations & Reliability

. Strong understanding of SLA/SLO, incident management, problem management, and change management.

. Experience with data pipeline monitoring, alerting, and failure recovery.

. Ability to analyze application and system logs to identify the root cause of issues.

. Experience with data reconciliation and data quality monitoring.

. Knowledge of backup, recovery, high availability, and disaster recovery concepts.

. Ability to handle multiple production incidents and prioritize issues based on business impact.

Preferred Skills

. Experience with Kafka or other real-time streaming technologies.

. Knowledge of Docker and Kubernetes.

. Experience with Terraform / Infrastructure as Code.

. Exposure to DataOps, MLOps, or LLMOps.

. Basic understanding of AI/ML data pipelines and Generative AI workloads.

. Knowledge of data governance, security, and compliance practices.

Experience

. 5-8+ years of experience in Data Operations, Data Engineering, Production Support, or a related role.

. Strong experience supporting enterprise-scale data platforms in production environments.

. Experience working in an operational/support environment with strict SLA and incident-resolution requirements.

Overview

WHAT'S ON OFFER

You will be remunerated with an excellent base salary and entitled to attractive company benefits. Additionally, you will get the opportunity to enjoy a fun and collaborative work environment, alongside a strong career progression.

To submit your application, please apply online or email your UPDATED CV in Microsoft Word format to [Confidential Information]. Your interest will be treated with strict confidentiality.

CONSULTANT DETAILS

Consultant Name: Deepa Shivakoti
Reg No: R1765546
Avensys Consulting Pte Ltd
EA Licence 12C5759

Privacy Statement: Data collected will be used for recruitment purposes only. Personal data provided will be used strictly in accordance with the relevant data protection law and Avensys privacy policy.