AI Software Engineering Domain Expert

Skills

About this role

Software Engineering Domain Experts to contribute to a customer’s project focused on developing and refining advanced AI systems. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.

Software Engineering, AI Evaluation, Prompt Engineering, Technical Documentation, Code Review

Responsibilities

• Analyze, review, and enhance AI-generated technical content, ensuring clarity, accuracy, and alignment with best practices in software engineering.
• Create, refine, and evaluate prompts and instructions designed to guide AI models in producing high-quality technical deliverables.
• Conduct rubric-based assessments of AI model outputs, providing detailed feedback on quality, correctness, and completeness.
• Draft and edit technical documentation, architecture plans, RFCs, design specifications, and engineering proposals for use in AI training.
• Perform independent research and fact-checking to validate technical assertions and ensure data-driven accuracy in content.
• Interpret and annotate data, leveraging software engineering expertise to support nuanced evaluation and labeling tasks.
• Collaborate asynchronously with project leads and other experts to meet deliverable requirements within established guidelines.

Qualifications

• 3+ years of professional experience in software engineering roles such as Software Engineer, Senior Software Engineer, Staff Engineer, Technical Lead, Engineering Manager, or Solutions Architect.
• Track record of authoring or reviewing technical artifacts, including documentation, architecture documents, design specifications, RFCs, engineering proposals, postmortems, technical blogs, or code reviews.
• Exceptional critical thinking, analytical reasoning, and logical problem-solving skills.
• Demonstrated attention to detail and commitment to quality assurance in technical outputs.
• Strong written communication abilities, with experience in professional or technical writing and editing.
• Familiarity with AI coding tools (e.g., code assistants, automated documentation generators) is a plus, but not required.
• Advanced degree (Master’s, JD, MBA, PhD) or credentials from highly selective universities or equivalent academic programs are highly regarded.