[What the role is]
About Us:
AI Verify Foundation is an open-source initiative under the Infocomm Media Development Authority (IMDA), dedicated to advancing trustworthy AI. We develop and maintain open-source frameworks for evaluating LLM applications (Moonshot) and predictive ML models (AI Verify Toolkit). Our mission is to empower developers, data scientists, and organisations to build responsible, transparent, and reliable AI systems.
The Role:
Were looking for a Product Analyst to elevate the quality and relevance of our product offerings to our users. Youll bridge cutting-edge AI research with real-world evaluation needs, shaping our tools and frameworks for the success of our developer community. You will lead the quality assurance of the datasets, evaluators in our products, including contributions from our open-source community.
[What you will be working on]
Key Responsibilities:
- Design and run offline A/B experiments to evaluate benchmark datasets and identify optimal evaluation methods for benchmark tests offered (including contributions from our open-source community) in Project Moonshot.
- Educate and engage the developer community and Gen AI application deployers to build awareness of the challenges in benchmark testing, and champion the solutions provided in our library.
- Research emerging GenAI evaluation techniques and open-source tools translate key insights to inform product roadmap and turn research findings into actionable prototypes for engineering teams.
What Were Looking For:
- Degree in Statistics or Economics, or a related technical field.
- 3-5 years experiences as data scientist, with strong grounding in statistics and experimental design and analysis.
- Proficiency in Python/R is required. Experience in AI testing is a plus.
- Deep intellectual capacity combined with a practical, user-centric mindset.
- Excellent communication skillsable to simplify complex concepts for varied audiences.
[What we are looking for]
Only shortlisted applicants will be notified.
Position will commensurate with experience.
