Radiologist Evaluator (contract)
Overview
MarketerHire is seeking board-certified radiologists for a 12-week remote contract evaluating AI-generated radiology reports, impressions, and differential reasoning for clinical accuracy and quality. The role requires a medical degree, completed radiology residency, board certification or equivalent, at least 2 years of post-training independent reading experience, and a current or recently active license to practice in the US, Canada, or UK.
Responsibilities
<h2>Key Responsibilities</h2><ul><li>Evaluate AI-generated radiology reports and impressions against clinical quality rubrics covering finding detection, characterisation, differential reasoning, and reporting standards.</li><li>Assess whether imaging findings genuinely support the conclusions presented in AI-generated output.</li><li>Identify missed findings, incorrect characterisations, unsupported conclusions, and recommendations that do not follow accepted practice.</li><li>Review the quality and clinical accuracy of AI-generated differential reasoning.</li><li>Write clear, structured feedback and detailed justifications for every score.</li><li>Follow complex evaluation instructions and reason through ambiguous cases consistently.</li><li>Distinguish clearly between established knowledge and inference when evaluating reports.</li><li>Help refine grading criteria and iterate on evaluation processes based on feedback from senior reviewers.</li><li>Complete required onboarding related to data handling before beginning the engagement.</li><li>Maintain a consistent weekly commitment while working independently and adapting to new evaluation tools and processes.</li></ul>
Requirements
<h2>Required Qualifications</h2><ul><li>Medical degree and completed radiology residency.</li><li>Board certification or equivalent, including ABR, Royal College of Physicians and Surgeons of Canada, or FRCR.</li><li>2–3 years of post-training experience reading studies independently.</li><li>Current or recently active license to practice in the US, Canada, or UK.</li><li>Excellent written English.</li><li>Ability to follow complex instructions, reason through ambiguity, and spot errors in reports that read as confident and well written.</li><li>Ability to clearly separate what is known from what is being inferred, including whether imaging findings genuinely support a conclusion.</li><li>Ability to work independently, learn new tools quickly, and take feedback well.</li><li>Based in and working from the US, Canada, or UK.</li><li>Availability for a consistent weekly commitment throughout the 12-week project.</li><li>Ability to complete required data-handling onboarding before starting.</li></ul>
Benefits
<h2>Benefits and Perks</h2><ul><li>Remote contract engagement for professionals in the US, Canada, and UK.</li><li>Flexible scheduling within the required weekly commitment.</li><li>Defined 12-week engagement with the possibility of extension based on needs and performance.</li><li>Opportunity to shape how AI systems are evaluated in your field.</li></ul>