Salary Range: MYR 4.800 - 5.900 (Gross)
Work Mode: Hybrid
Weshine is hiring for our client (Handshakes AI), based in Singapore, for a role based in Malaysia. Handshakes is an award-winning DataTech company. Enabling our clients to make safer, more informed decisions by delivering meaningful insights, harnessed from reliable data.
We are looking for a Data Engineer to join our Data & AI Engineering team. In this role, you will be responsible for developing, maintaining, and supporting data ingestion and processing pipelines for large-scale news and company data. You will work closely with Product Managers, Solution Architects, AI Engineers, and other stakeholders to deliver reliable data solutions that support business and product requirements.
Responsibilities
- Develop, maintain, and enhance ETL and data processing pipelines.
- Support and monitor production data pipelines to ensure data quality, reliability, and operational stability.
- Develop and optimize data workflows for ingesting, transforming, and storing structured and unstructured data.
- Troubleshoot and resolve data pipeline, database, and infrastructure-related issues.
- Work with stakeholders to understand business and product requirements and translate them into technical solutions.
- Manage and optimize data storage solutions across relational and NoSQL databases.
- Collaborate with cross-functional teams to support any product enhancements and operational improvements.
- Participate in code reviews, testing, deployment, and documentation activities.
Requirements
- Diploma or Bachelor's degree in Computer Science, Software Engineering, Data Engineering, or a related field.
- 2–5 years of experience in Data Engineering or a related role.
- Strong SQL skills and experience writing complex queries for data processing and analysis.
- Hands-on experience designing and maintaining ETL/data pipelines.
- Experience with Apache Spark for large-scale data processing.
- Experience working with relational databases such as Microsoft SQL Server or MySQL.
- Experience working with NoSQL databases such as Azure Cosmos DB or MongoDB.
- Experience working with cloud platforms and cloud-based services, preferably Microsoft Azure. Familiarity with Azure services such as Cosmos DB, Service Bus, Blob Storage, Function Apps, and Virtual Machines is an advantage.
- Strong problem-solving skills and the ability to troubleshoot production issues.
