Russian Audio Generalist Evaluator Expert

$50/hr

50 people hired

RemoteGlobalTechnology3-5 YearsContractPosted Aug 13, 2026

About this role

You will support a high-impact audio AI research project by transcribing, annotating, evaluating, and quality-checking Russian audio and video content used to train and benchmark advanced language models. The role requires native or near-native Russian fluency, professional English proficiency, strong analytical judgment, and familiarity with Russian dialects, colloquialisms, regional vocabulary, tone, register, and contemporary language usage. Although the role is remote, candidates must be based in the San Francisco Bay Area for potential in-person collaboration.

Responsibilities

Audio transcription: Listen to and accurately transcribe Russian audio and video content according to detailed project guidelines.
Language analysis: Identify tone, intent, formal and informal register, dialects, regional expressions, and contemporary Russian usage.
Annotation: Label and analyse linguistic features, ambiguities, grammatical nuances, and edge cases in Russian audio content.
Evaluation standards: Develop clear evaluation rubrics, grading guidelines, and quality standards in Russian and English.
Model evaluation: Run prompts through AI models and assess outputs for accuracy, fluency, completeness, clarity, and instruction-following.
Structured feedback: Provide detailed feedback to help improve AI performance on Russian-language audio tasks.
Quality assurance: Participate in QA and review cycles to ensure annotations, rubrics, and outputs meet benchmark standards.
Task improvement: Collaborate with project leads to resolve ambiguities and refine task design and evaluation criteria.

Qualifications

Native or near-native Russian fluency, including strong spoken and written proficiency.
Professional fluency in English.
Strong familiarity with spoken Russian, regional vocabulary, dialects, colloquial expressions, and contemporary language usage.
Ability to accurately transcribe and analyse Russian audio across general consumer contexts.
Strong writing, editing, critical thinking, and analytical skills.
Excellent attention to detail and ability to follow detailed formatting and annotation guidelines.
Ability to work independently, manage time effectively, and consistently meet deadlines.
Must currently be based in the San Francisco Bay Area, United States.
Must be available for approximately 10–20 hours per week.