Audio Evaluator | Remote

Objective

Support AI audio research by transcribing, evaluating, and benchmarking Galician language data to improve language model performance and quality.

Opportunity Details

Job Format: Hourly contract; independent contractor; fully remote; flexible schedule

Pay: $50 per hour

Location: Remote

Primary Responsibilities

• Transcribe and analyze Galician audio and video content
• Produce structured written outputs in Galician and English
• Develop evaluation rubrics and grading standards for audio tasks
• Assess language model outputs for accuracy, fluency, and completeness
• Provide structured feedback to improve AI model performance
• Conduct QA reviews to ensure benchmark and dataset consistency

Role Requirements

• Fluency in Galician and professional fluency in English
• Ability to accurately transcribe and evaluate Galician audio content
• Experience creating or applying evaluation criteria and grading standards
• Strong writing and editing capabilities for structured outputs
• Ability to work independently and manage assigned deliverables
• Availability to contribute 10 20 hours per week