ADVANCE.AI is a leading AI company that provides digital transformation, fraud prevention, and process automation solutions for enterprise clients. A leader in Artificial Intelligence, risk management and has a global footprint with operations across ASEAN and wider APAC and Latin America it currently partners over 700 enterprise clients across banking, financial services, fintech, payment, retail and e-commerce sectors. ADVANCE.AI has a global footprint across 12 markets in 3 continents.
ADVANCE.AI is part of Advance Intelligence Group,
a Series D-backed Tech Unicorn valued at US$2 billion, and also one of the largest independent technology startups based in Singapore. Founded in 2016, the Group has presence across South and Southeast Asia, Latin America and Greater China. The Group is backed by top tier investors SoftBank Vision Fund 2, Warburg Pincus, Northstar,Vision Plus Capital, Gaorong Capital, Pavilion Capital, GSR Ventures and Singapore-based global investor EDBI.
Ranked among LinkedIn's Top 15 Startups in Singapore in 2022 (the third year in a row we've been on the list), we are partners with 700+ enterprise clients across Southeast Asia, South Asia and Mexico in sectors such as banking, financial services, fintech, payment, retail and e-commerce.
Advance Intelligence Group employees are united by a shared vision and purpose: to
Advance with Intelligence for a Better Life--for our customers, colleagues and communities.
Our culture is built on values that are core to who we are and what we stand for:
- We foster an INNOVATION mindset
- We achieve results with EFFICIENCY and excellence
- We take pride in the QUALITY of our work
- We uphold INTEGRITY in all we do
- We embrace COLLABORATION to work across business lines and borders
About the role:
We are looking for a
Junior Data Scientist to work on evaluation and experimentation for our AI smart routing system. The role will focus on understanding how different routing strategies affect
model quality, user experience, and cost efficiency, and building reliable evaluation frameworks to guide product decisions.
Responsibilities
- Design and run offline and online evaluations for different LLM routing strategies.
- Analyze user interaction, model usage, quality signals, cost, and budget-related metrics.
- Support A/B testing and controlled experiments to compare routing strategies.
- Build datasets, evaluation pipelines, dashboards, and monitoring metrics.
- Investigate failures and identify opportunities to improve routine decisions.
- Work closely with engineering and product teams to turn analysis into practical improvements.
Requirements
- Bachelor's or Master's degree in Computer Science, Data Science, Statistics, Mathematics, or a related field.
- Strong fundamentals in Python, SQL, statistics, and data analysis.
- Good understanding of experimentation, hypothesis testing, and A/B testing.
- Comfortable working with imperfect real-world data and open-ended problems.
- Strong analytical thinking and willingness to learn quickly.
- Interest in LLMs, AI agents, model evaluation, or AI infrastructure.
Nice to Have:
- Experience with LLM evaluation, recommendation/ranking systems, experimentation platforms, or machine learning projects.
- Familiarity with data visualization and building lightweight evaluation pipelines.
- Hands-on experience with LLM APIs or AI coding tools.
This is a hands-on role suitable for a strong fresh graduate who wants to work on
real-world AI systems, experimentation, and data-driven product development.
