Responsibilities
- Develop and maintain ETL/ELT pipelines using Python, PySpark, and SQL.
- Build and support batch and real-time data processing solutions.
- Integrate data from multiple sources and ensure data quality and reliability.
- Monitor, troubleshoot, and optimize data pipelines and workflows.
- Collaborate with business, analytics, and technology teams to deliver data-driven solutions.
- Support cloud-based data platforms and data warehousing initiatives.
- Develop automation and monitoring solutions to improve operational efficiency.
- Any other ad-hoc duties as assigned by supervisor.
Requirements
- Bachelor's Degree in Computer Science, Information Technology, Engineering, Data Science, or a related discipline.
- 3+ years of Data Engineering or ETL development experience.
- Strong proficiency in Python, PySpark, and SQL.
- Experience with Hadoop, Spark, Kafka, or similar big data technologies.
- Knowledge of data warehousing and data modeling concepts.
- Experience with cloud platforms such as Azure Data Factory, Azure Synapse, Databricks, or Azure Data Lake.
- Strong problem-solving and stakeholder management skills.
Technical Skills
- Experience with Apache Flink or real-time streaming technologies.
- Exposure to Power BI, Tableau, Qlik, or other BI tools.
- Familiarity with AI/LLM frameworks such as LangChain, LangGraph, or RAG solutions.
- Experience within banking, financial services, or large enterprise environments.
- Tech Stack: Python, PySpark, SQL, Hadoop, Spark, Kafka, Azure, Databricks, Power BI/Tableau.
Interested applicants, please email your resume to Andre Chua Jing Ming
Email: [Confidential Information]
CEI Reg No: R1989053
EA Licence No: 99C4599
Recruit Express Pte Ltd
