LLM Red-Teamer

Skills

About this role

In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

AI Evaluation & LLM Red Teaming Specialist

Responsibilities

• Develop complex, adversarial multi-turn conversations and task-based scenarios aligned with detailed project specifications.
• Author clear, precise evaluation rubrics to rigorously assess model responses against defined behavioral targets.
• Iteratively test conversations and tasks against frontier LLMs, escalating difficulty and nuance until the desired quality threshold is achieved.

Qualifications

• Exceptional written English skills, with clarity, precision, and strong structural organization.
• Prior experience in AI human data environments (RLHF, SFT, evaluations, annotation, or prompt engineering).
• Deep familiarity with large language models, including the ability to anticipate and identify common failure patterns.