About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include
Benchmark,
General Catalyst,
Peter Thiel,
Adam D'Angelo,
Larry Summers, and
Jack Dorsey.
Position: Korean Audio Generalist Evaluator Expert
Type:Short-term, structured engagement
Compensation:$50/hour
Commitment:10–20 hours/week
Role Responsibilities
- Transcribe and optimize audio and video content in Korean. Follow detailed constraints and instructions.
- Produce high-quality written outputs with supporting work in English when required.
- Define and document evaluation standards. Develop detailed evaluation rubrics and grading guidelines in Korean and English.
- Conduct model testing and grading. Evaluate responses against predefined criteria for accuracy, completeness, and instructional clarity.
- Support benchmarking and quality assurance. Participate in QA and review cycles to ensure tasks, rubrics, and outputs meet Mercor's quality bar.
- Collaborate with project leads to resolve ambiguities and improve task design.
Qualifications
Must-Have
- Strong writing, editing, and critical thinking skills.
- Ability to work independently, manage time effectively, and meet deadlines.
- Fluency in Korean and English (spoken and written).
- Available to commit 10–20 hours per week.
Preferred
- College students or recent graduates.
- Background in linguistics, humanities, social sciences, or technical fields.
- Prior experience with transcription, annotation, evaluation, or research workflows.
- Interest in AI, language models, or applied research environments.
Application Process (Takes 20–30 mins to complete)
- Complete a short AI-led interview (approximately 15 minutes).
- If selected, you will be onboarded and invited to begin project work.
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
- For any help or support, reach out to: [Confidential Information]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
,
