Software Engineer

About this role

In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Software Engineering & AI Development Evaluation Specialist

Responsibilities

• Execute structured evaluation assignments that simulate authentic developer activities, including version control, code review, issue tracking, and CI/CD workflow execution utilizing AI-powered tools.
• Assess and grade the technical correctness of outputs, verifying results hands-on within relevant development environments and tools.
• Design, seed, and maintain reproducible test environments—such as code repositories with real commit histories and CI workflows—to ensure reliable and realistic task contexts.

Qualifications

• Minimum of 3 years of professional experience in software engineering, demonstrating strong command of Git/GitHub workflows (pull requests, code review, branching, analyzing diffs, CI log diagnostics).
• Proficient with CI/CD systems—ideally GitHub Actions—including authoring custom workflows and ensuring reproducible build processes.
• Versed in using connectors across Claude and ChatGPT.