Risk Management Expert

About this role

Risk Management Subject Matter Expert (SME) to review AI-generated risk management responses and/or create expert risk content, evaluating reasoning quality and step-by-step decision-making while providing precise written feedback. You will assess solutions for accuracy, clarity, completeness, and adherence to the prompt; identify errors in risk identification, assessment methodology, controls design, mitigation planning, governance, and incident response logic; fact-check risk and compliance concepts; write high-quality explanations and model solutions that demonstrate correct approaches; and rate and compare multiple responses based on correctness and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs.

Test AI outputs for inaccuracies

Responsibilities

• Develop AI Training Content: Create detailed prompts and gold-standard outputs across risk topics (risk assessments, control mappings, mitigation plans, risk communications).
• Optimize AI Performance: Evaluate and rank AI responses to improve correctness, rigor, clarity, and practical usefulness.
• Ensure Model Integrity: Test AI outputs for inaccuracies, unsafe recommendations, misleading certainty, and bias; validate reliability across scenarios.

Qualifications

• Bachelor’s degree (or higher) in Business, Finance, Economics, Risk Management, Law, IT, or a related field (or equivalent professional experience).
• 5+ years of professional experience in risk management (ERM, operational risk, compliance, internal audit, security risk, third-party risk, or similar).
• Strong command of risk fundamentals: risk taxonomy, inherent vs residual risk, likelihood/impact scoring, control design and effectiveness, KRIs/KPIs.
• Familiarity with risk frameworks and standards (as applicable): COSO ERM, ISO 31000, NIST (for security risk), SOC 2/ISO 27001 concepts, SOX controls awareness.