Associate Director, Clinical AI Evaluation and Responsible Deployment

AstraZeneca seeks an Associate Director to design and implement evaluation frameworks for clinical AI systems. The role combines technical leadership with clinical expertise to define what constitutes safe, reliable, and deployable AI across trial design, monitoring, and analysis.

Responsibilities

• Define and implement evaluation strategy for clinical AI models across development, release, monitoring, and change control
• Build evaluation harnesses, test sets, simulation environments, and automated regression suites in Python
• Translate clinical expert judgment into task definitions, scoring rubrics, error taxonomies, and acceptance thresholds
• Lead failure analysis and red-teaming for hallucination, automation bias, data leakage, and unsafe workflow behaviour
• Establish traceability from intended use through requirements, test evidence, and release decisions across product lifecycle

Requirements

• PhD in Machine Learning, Computer Science, Statistics, or related quantitative field; or MD with strong computational track record
• 4–7 years post-PhD experience evaluating, validating, or deploying AI/ML in healthcare or safety-critical environments
• Hands-on Python and SQL proficiency; ability to build automated evaluation pipelines and version-controlled code
• Strong expertise in experimental design, statistical inference, error analysis, and measurement reliability
• Experience evaluating LLMs and agentic systems including retrieval, tool use, and multi-step workflows
• Proven ability to construct evaluation approaches with noisy labels, delayed outcomes, or differing expert opinions
• Experience producing audit-ready evidence under GCP and GxP for regulated AI systems