About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include
Benchmark,
General Catalyst,
Peter Thiel,
Adam D'Angelo,
Larry Summers, and
Jack Dorsey.
Position: Financial AI Evaluator
Type:Contract
Compensation:$105/hour
Location:Remote
Role Responsibilities
- Write and refine prompts to guide model behavior in financial contexts.
- Evaluate LLM-generated responses to finance-related queries for accuracy and clarity.
- Conduct fact-checking using trusted public sources and financial references.
- Annotate model responses by identifying strengths and areas for improvement.
- Assess tone and appropriateness of responses for real-world financial use cases.
- Apply consistent evaluation standards by following clear taxonomies and guidelines.
Qualifications
Must-Have
- 5+ years of professional experience in Finance.
- Bachelor's, Master's, or PhD degree in Finance, Accounting, Economics, or related fields.
- Experience in Investment Banking, Corporate Finance, Accounting & Auditing, or Asset Management.
- Significant experience using large language models.
- Excellent writing skills and strong attention to detail.
Preferred
- Experience with RLHF, model evaluation, or data annotation.
- Experience writing or editing high-quality financial content.
- Familiarity with evaluation rubrics or quality scoring systems.
Application Process (Takes 2030 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: [Confidential Information]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
,
