AI Labs
Radiologist Evaluator (contract)
- Experience
- 2–3 yrs
- Location
- United States, Canada, United Kingdom
- Work mode
- Remote
- Job type
- Contract
- Duration
- 12 Weeks
- Weekly
- 10+ hours
- Salary
- $50–$125 / hour
- Posted
- 10 days ago
About the role
AI Labs is seeking board-certified radiologists for a 12-week remote contract evaluating AI-generated radiology reports, impressions, and differential reasoning for clinical accuracy and quality. The role requires a medical degree, completed radiology residency, board certification or equivalent, at least 2 years of post-training independent reading experience, and a current or recently active license to practice in the US, Canada, or UK.
Key Responsibilities
- Evaluate AI-generated radiology reports and impressions against clinical quality rubrics covering finding detection, characterisation, differential reasoning, and reporting standards.
- Assess whether imaging findings genuinely support the conclusions presented in AI-generated output.
- Identify missed findings, incorrect characterisations, unsupported conclusions, and recommendations that do not follow accepted practice.
- Review the quality and clinical accuracy of AI-generated differential reasoning.
- Write clear, structured feedback and detailed justifications for every score.
- Follow complex evaluation instructions and reason through ambiguous cases consistently.
- Distinguish clearly between established knowledge and inference when evaluating reports.
- Help refine grading criteria and iterate on evaluation processes based on feedback from senior reviewers.
- Complete required onboarding related to data handling before beginning the engagement.
- Maintain a consistent weekly commitment while working independently and adapting to new evaluation tools and processes.
Required Qualifications
- Medical degree and completed radiology residency.
- Board certification or equivalent, including ABR, Royal College of Physicians and Surgeons of Canada, or FRCR.
- 2–3 years of post-training experience reading studies independently.
- Current or recently active license to practice in the US, Canada, or UK.
- Excellent written English.
- Ability to follow complex instructions, reason through ambiguity, and spot errors in reports that read as confident and well written.
- Ability to clearly separate what is known from what is being inferred, including whether imaging findings genuinely support a conclusion.
- Ability to work independently, learn new tools quickly, and take feedback well.
- Based in and working from the US, Canada, or UK.
- Availability for a consistent weekly commitment throughout the 12-week project.
- Ability to complete required data-handling onboarding before starting.
Benefits and Perks
- Remote contract engagement available to physicians in the US, Canada, and UK.
- Flexible scheduling that can be worked around clinical practice.
- Hourly compensation of $50–$125 per hour, paid weekly via Stripe or Wise.
- 12-week project with the possibility of extension based on project needs and performance.
- Work with de-identified or synthetic imaging and case material.
- No patient-care responsibilities.
- Reasonable accommodations available upon request.
Skills
- Radiology
- AI-generated radiology reports
- Impressions
- Clinical accuracy assessment
- Finding detection
- Finding characterisation
- Differential reasoning
- Reporting standards
- Missed findings
- Incorrect characterisations
- Unsupported conclusions
- Accepted practice
- Data handling
- Imaging AI validation
- Stripe
- Wise
Education
Required
- Medical degree
- Completed radiology residency
Preferred
- Fellowship training in a subspecialty such as neuroradiology, musculoskeletal, body, chest, or breast imaging
Certifications
Required
- Board certification or equivalent: ABR, Royal College of Physicians and Surgeons of Canada, or FRCR
Selection process
Step 1
Submitted
Someone who fits the role and has told you they are interested, with their resume.
Step 2
HiringWiring Assessment
Step 3
Client Assessment
Step 4
Selected
If they qualify and are selected, your payout is due.