Responsibilities
- Develop, construct, test, and maintain scalable data systems, pipelines, and architectures such as data lakes and warehouses to support business analytics and operations
- Collect raw data from diverse sources, clean and transform it into usable formats through ETL/ELT processes to ensure data quality and accessibility
- Collaborate with data scientists, analysts, and business stakeholders to gather data requirements and deliver tailored data solutions that drive insights and business outcomes
- Continuously improve existing data frameworks by monitoring workflows, identifying bottlenecks, and troubleshooting issues to optimize system performance
- Implement data governance, validation, and security protocols to ensure compliance and protect sensitive information
- Design and implement efficient database and data warehouse schemas to support scalable data storage and retrieval
- Utilize orchestration tools like Apache Airflow to schedule and manage data workflows effectively
Required competencies and certifications
- Proficient programming skills in Python, Java, and SQL to develop and maintain data pipelines and systems
- Experience working with relational databases (PostgreSQL, MySQL) and NoSQL databases (MongoDB) to manage structured and unstructured data
- Proficiency in major cloud platforms (AWS, Azure, GCP) and their data services (e.g., S3, Redshift, EMR) to deploy and manage cloud-based data solutions
- Working knowledge of big data tools such as Apache Spark, Kafka, and Hadoop to process large-scale datasets
- Expertise in designing and implementing ETL/ELT processes for data extraction, transformation, and loading
- Strong understanding of software engineering principles, including data structures and algorithms, to build efficient and maintainable code
- Ability to apply strong analytical and problem-solving skills to resolve technical challenges and optimize data workflows
- Effective communication skills to collaborate with technical and non-technical teams and translate data requirements into actionable solutions
- Adaptability and eagerness to learn new software, BI tools, and emerging technologies in a fast-paced environment
Preferred competencies and qualifications
- Experience with BI or reporting tools, including publishing, scheduling, and managing permissions, to support data visualization and reporting needs
- Familiarity with version control systems such as GitHub and GitLab to manage codebase and collaborate on software development
- Knowledge of Software Development Life Cycle (SDLC) and Data Development Life Cycle (DDLC) methodologies to ensure structured project delivery
- Understanding of Agile and Scrum methodologies to contribute effectively in iterative and collaborative development environments
5 day week @ Jurong East area
Maestro HR
damien lee tian hong
R1106726
16C8462
