{"21035495":{"jobPath":"/jobs/21035495/breast-imaging-faculty-fy2526","source":"naylor","job":"21035495","jobTitle":"Breast Imaging Faculty FY2526"},"20831484":{"jobPath":"/jobs/20831484/post-doctoral-researcher-in-mathematics-or-statistics","source":"naylor","job":"20831484","jobTitle":"Post doctoral researcher in Mathematics or Statistics"},"21048019":{"jobPath":"/jobs/21048019/path-2-kawader-post-doctoral-associate-structural-materials-3d-printing-and-modeling-professor-mohamed-moustafa-research-group","source":"naylor","job":"21048019","jobTitle":"Path 2 Kawader: Post-Doctoral Associate – Structural Materials 3D Printing and Modeling [Professor Mohamed Moustafa research group]"},"21289704":{"jobPath":"/jobs/21289704/quantitative-sciences-unit-open-rank-faculty-search","source":"naylor","job":"21289704","jobTitle":"Quantitative Sciences Unit: Open Rank Faculty Search"},"21289635":{"jobPath":"/jobs/21289635/post-doctoral-fellowship-for-contextualized-evaluation-of-ai-for-healthcare","source":"naylor","job":"21289635","jobTitle":"Post-Doctoral Fellowship for Contextualized Evaluation of AI for Healthcare"},"20831483":{"jobPath":"/jobs/20831483/post-doctoral-researcher-in-mathematics","source":"naylor","job":"20831483","jobTitle":"Post doctoral researcher in Mathematics"},"21234518":{"jobPath":"/jobs/21234518/director-of-ken-gormley-law-library-and-information-resources","source":"naylor","job":"21234518","jobTitle":"Director of Ken Gormley Law Library and Information Resources"},"20951943":{"jobPath":"/jobs/20951943/post-doctoral-fellow-moral-ai-x28-cmu-and-duke-university-x29","source":"naylor","job":"20951943","jobTitle":"Post Doctoral Fellow - Moral-AI (CMU and Duke University)"},"20831482":{"jobPath":"/jobs/20831482/post-doctoral-researcher-in-statistics","source":"naylor","job":"20831482","jobTitle":"Post doctoral researcher in Statistics"},"21041059":{"jobPath":"/jobs/21041059/research-intern","source":"naylor","job":"21041059","jobTitle":"Research Intern"},"20904753":{"jobPath":"/jobs/20904753/urban-science-faculty-fellows","source":"naylor","job":"20904753","jobTitle":"Urban Science Faculty Fellows"},"20974546":{"jobPath":"/jobs/20974546/research-scholar-x28-part-time-x29","source":"naylor","job":"20974546","jobTitle":"Research Scholar (Part -time)"},"21247921":{"jobPath":"/jobs/21247921/post-doctoral-fellow","source":"naylor","job":"21247921","jobTitle":"Post Doctoral Fellow"},"21186144":{"jobPath":"/jobs/21186144/adjunct-faculty-criminal-justice-undergraduate","source":"naylor","job":"21186144","jobTitle":"Adjunct Faculty - Criminal Justice (Undergraduate)"},"21105455":{"jobPath":"/jobs/21105455/part-time-computer-science-professor-continuous-pool","source":"naylor","job":"21105455","jobTitle":"Part-time Computer Science Professor - Continuous pool"},"21204805":{"jobPath":"/jobs/21204805/path-1-x3a-research-assistant-x3a-laboratory-for-computer-human-intelligence","source":"naylor","job":"21204805","jobTitle":"Path 1: Research Assistant: Laboratory for Computer-Human Intelligence"},"21164741":{"jobPath":"/jobs/21164741/research-scientist-x28-part-time-x29","source":"naylor","job":"21164741","jobTitle":"Research Scientist (Part-time)"},"20923789":{"jobPath":"/jobs/20923789/dean-of-engineering","source":"naylor","job":"20923789","jobTitle":"Dean of Engineering"}}
Loading... Please wait.
ExpandShow Other Jobs
Job SavedSave Job
Post-Doctoral Fellowship for Contextualized Evaluation of AI for Healthcare
Carnegie Mellon University
Application
Details
Posted: 01-May-25
Location: Pittsburgh, PA
Internal Number: 167191
The Heinz College of Information Systems and Public Policy at Carnegie Mellon University is seeking a postdoctoral researcher to advance the development of rigorous, clinically grounded evaluation methodologies for Artificial Intelligence (AI) in healthcare. Our research focuses on building comprehensive evaluation frameworks that consider the context of AI deployment within clinical workflows and its impact on downstream decisions and patient outcomes. The complexity of AI’s integration into clinical workflows with human decision makers necessitates novel frameworks for evaluating AI models. We aim to address gaps in current AI evaluation practices by developing context-aware, decision-focused, and impact-driven methodologies. These include:benchmarks tailored to clinical use cases, evaluation approaches that account for human-AI interaction, and methods for assessing deployment readiness and clinical utility.
This work lies at the intersection of healthcare, AI/ML, and operations research (OR). This position offers an opportunity to contribute to research aimed at improving clinical and operational care delivery and patient safety through the development and evaluation of integrated AI/OR methods. Our research broadly explores the application of predictive, prescriptive, and generative AI techniques in various healthcare domains, including medication management and error reduction, clinical decision-making, and care coordination. Our existing collaboration network provides a rich environment for (1) identifying concrete use cases for AI evaluation methodologies and (2) validating the practical utility of our proposed approaches with clinical experts.
The postdoctoral researcher will play a central role in designing, implementing, and validating evaluation strategies that are both scientifically rigorous and practically useful. They will lead and contribute to the preparation of manuscripts for submission to top-tier journals in healthcare, AI/ML, and OR, and will play an active role in developing grant proposals for major funding agencies. A key goal is the design and development of deployable, scalable evaluation tools that can be adapted across a range of clinical contexts. The researcher will also have the opportunity to present their work at leading conferences and workshops, engaging with both academic and clinical communities to shape the conversation around trustworthy, real-world AI in healthcare.
The position will involve close collaboration with Professors Rema Padman and Holly Wiberg as well as external clinical collaborators. It offers an exciting opportunity to contribute to research that informs real-world AI adoption in healthcare—with the potential for high scholarly and real-world impact.
About Heinz College
The Heinz College of Information Systems and Public Policy at Carnegie Mellon University is a multi-disciplinary academic unit that values problem-driven research. Faculty research programs are motivated by important societal problems and pursue a variety of different approaches (e.g., empirical, quantitative modeling, computational analysis, and theoretical). A collection of research centers provides collaboration opportunities as well as the support required to make an impact on policy makers. Heinz College offers a strong community of support for postdoctoral researchers, with opportunities to connect with faculty and researchers across the college and broader campus. Please see www.heinz.cmu.edu for additional information.
Ideal candidates will have significant AI/ML and optimization experience, leveraging both model-based and data driven approaches to decision making, and strong programming skills. We are seeking researchers who have a passion for applying these methods in healthcare and are committed to responsible model and methods development and deployment. Applicants should have received a Ph.D. within the last two years?or expected by September 2025?in Operations Research, Operations Management, Computer Science (AI/ML), Biomedical Informatics, or a related field. The award includes a competitive post-doctoral fellowship and up to $5000 for research-related travel expenses. The award is for a 12-month period.
Applications should include a C.V., up to two research papers, and contact information for three professional references. Applications will be reviewed on a rolling basis, beginning 05/01/25. Applications will be accepted until the position is filled.
Carnegie Mellon University is an equal opportunity employer. It does not discriminate in admission, employment, or administration of its programs or activities on the basis of race, color, national origin, sex, disability, age, sexual orientation, gender identity, pregnancy or related condition, family status, marital status, parental status, religion, ancestry, veteran status, or genetic information. Furthermore, Carnegie Mellon University does not discriminate and is required not to discriminate in violation of federal, state, or local laws or executive orders.
Carnegie Mellon (www.cmu.edu) is a private, internationally ranked research university with programs in areas ranging from science, technology and business, to public policy, the humanities and the arts. More than 12,000 students in the university’s seven schools and colleges benefit from a small student-to-faculty ratio and an education characterized by its focus on creating and implementing solutions for real problems, interdisciplinary collaboration and innovation. A global university, Carnegie Mellon’s main campus in the United States is in Pittsburgh, Pa. It has campuses in California’s Silicon Valley and Qatar, and programs in Africa, Asia, Australia, Europe and Mexico.