Software Engineering Expert

$60–90/hr

26 people hired

RemoteGlobalTechnology1-3 YearsContractPosted Aug 18, 2026

About this role

You will design and review complex, multi-step software engineering tasks for frontier AI coding-agent benchmarks. | The role involves creating realistic engineering challenges covering Python implementation, environment setup, tooling, debugging, and documentation. | You will build reference solutions and analyze where AI coding agents succeed or fail. | This is a full-time W-2 role, fully remote within the United States.

Responsibilities

Design realistic software engineering tasks that challenge advanced AI coding agents across multiple technical skills.
Build clear, verifiable reference solutions in Python with appropriate setup, validation checks, and documentation.
Evaluate AI agent attempts to identify technical failures, reasoning gaps, and weaknesses.
Review tasks from other experts and provide feedback on correctness, clarity, difficulty, and reproducibility.

Qualifications

MSc or PhD in Computer Science or another STEM field, or equivalent practical experience in a research- or coding-intensive environment.
Minimum 1+ year of experience in software engineering, research engineering, or a related technical role.
Strong hands-on Python scripting and debugging skills, plus proficiency with Git, IDEs, and standard software-development workflows.
Strong written communication, attention to detail, and ability to independently solve ambiguous and open-ended engineering problems.