Evaluate multimodal diagnostic reports generated by frontier vision models against DICOM clinical scans.
Detailed Scope & Deliverables
Evaluate multimodal diagnostic reports generated by large frontier vision-language models against DICOM findings and clinical protocols. You will inspect model outputs for diagnostic hallucinations, protocol violations, and anatomical misidentifications. Key areas include CT chest angiograms, head MRI sequences, and musculoskeletal plain radiography.
Verification Standards
Peer-reviewed scoring rubric provided before evaluation kick-off
Blinded adversarial and calibration vignettes to establish accuracy
Protected data-room protocol with strict non-disclosure compliance