{"id":4443,"date":"2026-11-20T19:26:30","date_gmt":"2026-11-20T19:26:30","guid":{"rendered":"https:\/\/drsoniafawad.com\/?p=4443"},"modified":"2026-11-20T19:26:30","modified_gmt":"2026-11-20T19:26:30","slug":"qa-what-happens-when-clinicians-disagree-with-ai","status":"publish","type":"post","link":"https:\/\/drsoniafawad.com\/?p=4443","title":{"rendered":"Q&#038;A: What happens when clinicians disagree with AI?"},"content":{"rendered":"<p><br \/>\n<\/p>\n<div data-component=\"ArticleContent\">\n<div class=\"article__below-title\">\n<div class=\" article__posted-date\">\n<p>November 20, 2026<\/p>\n<p>4 min read<\/p>\n<\/p><\/div>\n<div class=\"mobile-trust-box\">\n<div class=\"row\">\n<div class=\"col-12 col-md-6 offset-md-1 offset-xl-0 col-xl-12\">\n<div class=\"email-alert-button-wrapper d-none\" data-component=\"EmailTopicAlert\" data-module=\"Subspecialty Email Topic Alerts Top\" data-manage-email-link=\"\/footer\/account-information\/my-account\/email-subscriptions-and-alerts#emailAlerts\">\n  <hidden data-setting-item=\"d265901d-6d37-49c7-a8f6-c7bf19a02509\"\/><br \/>\n  <hidden data-crm-source=\"Subspecialty Topic Alert\"\/><\/p>\n<div class=\"email-alert-button d-none\" data-topic-button=\"not-subscribed\">\n<p>&#13;<br \/>\n      <span data-module-track-action=\"Email Alerts TOP_Click_Healio News Article\" data-module-track-label=\"Email Alerts TOP_Healio News Article\">&#13;<br \/>\n        <i class=\"fas fa-plus-circle\"\/>&#13;<br \/>\n        Add topic to email alerts&#13;<br \/>\n      <\/span>&#13;\n    <\/p>\n<div class=\"email-alert-inner collapse uc13c7044d8eb4c479a585787703d90ff\">\n<div class=\"email-alert-dialogue\">\n<p>&#13;<br \/>\n          Receive an email when new articles are posted on <span data-content=\"topic-title\"\/>&#13;\n        <\/p>\n<div class=\"d-none\" data-sign-up-type=\"unknown\">\n          Please provide your email address to receive an email when new articles are posted on <span data-content=\"topic-title\"\/>.<\/p><\/div>\n<\/p><\/div>\n<p>      <button type=\"button\" class=\"btn btn-primary\" data-loading-text=\"Loading &lt;i class=\" fa=\"\" fa-spinner=\"\" fa-spin=\"\">&#8220;&#13;<br \/>\n              data-action=&#8221;subscribe&#8221;&gt;&#13;<br \/>\n        Subscribe&#13;<br \/>\n      <\/button>\n    <\/div>\n<\/p><\/div>\n<div class=\"d-none\" data-topic-modal=\"failed\">    <strong>We were unable to process your request. Please try again later. If you continue to have this issue please contact <a href=\"https:\/\/www.healio.com\/news\/primary-care\/20261120\/mailto:customerservice@slackinc.com\">customerservice@slackinc.com<\/a>.<\/strong>  <\/p>\n<p><button data-dismiss=\"modal\" class=\"btn btn-primary btn-lg btn-block\">Back to Healio<\/button><\/p>\n<\/div>\n<\/div><\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\n<h2>Key takeaways:<\/h2>\n<ul>\n<li>AI is quickly integrating into various areas of medicine, but it is not perfect.<\/li>\n<li>So, keeping a human in the loop is a critical part of this integration, an expert said.<\/li>\n<\/ul>\n<p>ORLANDO \u2014 Healthcare providers need to continue exercising judgment like it is a muscle, in order for AI to reach its full potential in medicine, according to a speaker here.<\/p>\n<p>      <b>Harvey Castro, MD, MBA,<\/b> an emergency medicine physician and AI in healthcare speaker, was part of a panel discussion on what happens when a clinician disagrees with AI at this year\u2019s AIMed conference.<\/p>\n<figure class=\"figure article__og-image\">&#13;\n    <picture>&#13;<source srcset=\"https:\/\/www.healio.comhttps:\/\/www.healio.comhttps:\/\/www.healio.com\/~\/media\/slack-news\/fm_im\/misc\/infographics\/2026\/11_november\/pc1126castro_graphic_01_web.webp?w=476\" media=\"(max-width: 768px)\">&#13;<source srcset=\"https:\/\/www.healio.com\/~\/media\/slack-news\/fm_im\/misc\/infographics\/2026\/11_november\/pc1126castro_graphic_01_web.webp?w=800\" media=\"(max-width: 992px)\">&#13;<source srcset=\"https:\/\/www.healio.com\/~\/media\/slack-news\/fm_im\/misc\/infographics\/2026\/11_november\/pc1126castro_graphic_01_web.webp?w=595\" media=\"(max-width: 1200px)\">&#13;<source srcset=\"https:\/\/www.healio.comhttps:\/\/www.healio.comhttps:\/\/www.healio.com\/~\/media\/slack-news\/fm_im\/misc\/infographics\/2026\/11_november\/pc1126castro_graphic_01_web.webp?w=476\" media=\"(min-width: 1200px)\">&#13;<source srcset=\"https:\/\/www.healio.comhttps:\/\/www.healio.comhttps:\/\/www.healio.com\/~\/media\/slack-news\/fm_im\/misc\/infographics\/2026\/11_november\/pc1126castro_graphic_01_web.webp?w=476\">&#13;<br \/>\n&#13;<br \/>\n      <img decoding=\"async\" src=\"https:\/\/www.healio.com\/~\/media\/slack-news\/fm_im\/misc\/infographics\/2026\/11_november\/pc1126castro_graphic_01_web.jpg?w=800\" alt=\"PC1126Castro_Graphic_01_WEB\" class=\"figure-img img-fluid\" width=\"800\"\/>&#13;<br \/>\n    <\/source><\/source><\/source><\/source><\/source><\/picture>&#13;<figcaption class=\"figure-caption\">&#13;<br \/>\n      &#13;<br \/>\n    <\/figcaption>&#13;<br \/>\n  <\/figure>\n<p>Healio spoke with Castro to learn more about <a rel=\"noopener noreferrer\" href=\"https:\/\/www.healio.com\/news\/primary-care\/20261008\/qa-acp-updates-guidance-on-ethical-ai-use\" id=\"rId12\" target=\"_blank\">how AI is developing in medicine<\/a>, what healthcare providers should consider during its use and more.<\/p>\n<p>      <b>Healio: Why is this an important conversation right now?<\/b>    <\/p>\n<p>      <b>Castro:<\/b> For most of my career in the emergency department, the hard calls were made by me, my team and the patient. Now there is another voice in the room. AI tools are moving from offering suggestions to taking actions inside hospital systems, and every clinician is going to face a moment when the machine says one thing and their judgment says another.<\/p>\n<p>At AIMed26 in Orlando, I opened the session with a composite emergency department case and then chaired the panel \u201cWhat happens when AI and the clinician disagree?\u201d The question I kept asking was this: When a system keeps going after a doctor would stop, who protects the patient? We need that answer now, before these tools are everywhere.<\/p>\n<p>      <b>Healio: What steps should clinicians take when using AI to ensure it will be as accurate as possible?<\/b>    <\/p>\n<p>      <b>Castro:<\/b> Treat AI like a smart colleague who has never met your patient. Its note can be useful, and it can be wrong. Before acting on it, check it against the person in front of you, the history, the exam and the chart.<\/p>\n<p>AI saves real time when it drafts, summarizes or pulls information together. The minutes you should never give back are the ones spent checking anything that would change a diagnosis, a medication or whether a patient goes home. If you can\u2019t explain why the recommendation fits this patient, keep thinking. That check is part of the care, and it is what keeps the patient safe.<\/p>\n<p>      <b>Healio: What should be done when a clinician disagrees with AI<\/b><b>\u2019<\/b><b>s recommendations?<\/b>    <\/p>\n<p>      <b>Castro:<\/b> The clinician owns the decision, and the patient is counting on that. When I disagree with a recommendation, I don\u2019t follow it because the screen sounds confident. I write down what the tool suggested, why I disagreed and what I did instead.<\/p>\n<p>Hospitals should welcome that disagreement. If a system only measures whether doctors followed the model, people will stop speaking up, and patients lose one of their best safeguards. My rule is human plus AI. The physician keeps the moral compass, while the machine finds patterns and analyzes them at scale.<\/p>\n<p>      <b>Healio: Does that response change if the AI is an integrated part of the clinician<\/b><b>\u2019<\/b><b>s healthcare system? Should inaccuracies be reported somewhere?<\/b>    <\/p>\n<p>      <b>Castro:<\/b> Yes. An integrated tool is part of how the hospital delivers care, so its mistakes belong in the same safety process as any other clinical system. Report them to the clinical informatics team or chief medical informatics officer, to quality and patient safety, and to the vendor, with enough detail that someone can find the cause and fix it.<\/p>\n<p>Every report helps the next patient. If a hospital has no clear place to report a bad recommendation, that is a governance gap its leaders need to close.<\/p>\n<p>      <b>Healio: What are your thoughts on the potential of deskilling here?<\/b>    <\/p>\n<p>      <b>Castro:<\/b> I worry about it, especially for young doctors and nurses who will train alongside a model that always sounds sure of itself. If we only teach people how to use a tool and never how to question it, we will raise clinicians who miss a confident error.<\/p>\n<p>Medical education should keep the exam, the differential and the bedside at the center. I like one habit in particular: Before you look at the AI output, ask yourself what you would have done. Senior clinicians can help by thinking out loud when they disagree with a model, and by admitting it when the model turns out to be right. Judgment is a muscle, and our patients need us to keep it strong.<\/p>\n<p>      <b>Healio: Patients are increasingly presenting with <\/b>      <a rel=\"noopener noreferrer\" href=\"https:\/\/www.healio.com\/news\/primary-care\/20260122\/integrating-medical-records-with-ai-a-watershed-moment-in-medicine-is-it-dangerous\" id=\"rId13\" target=\"_blank\">        <b>information from their own AI systems<\/b>      <\/a>      <b>. How should clinicians handle that situation?<\/b>    <\/p>\n<p>      <b>Castro:<\/b> With respect and curiosity. A patient who brings in an AI answer is trying to take part in their own care, and that is a good thing. Thank them, look at it together, and then go back to their story, their symptoms and your exam.<\/p>\n<p>If the information is wrong or unsafe, explain why in plain language and walk them through what you recommend instead. Patients don\u2019t need us to win the argument. They need help making a safe decision, and they need to leave feeling heard.<\/p>\n<p>      <b>Healio: What is the take-home message?<\/b>    <\/p>\n<p>      <b>Castro:<\/b> AI should make care more human. <\/p>\n<p>At its best, technology gives clinicians more time to listen, to explain and to comfort. When a model and a clinician disagree, the right question is what helps this patient, and who is accountable if we get it wrong.<\/p>\n<p>      <b>Healio: Is there anything else you would like to add?<\/b>    <\/p>\n<p>      <b>Castro:<\/b> I am optimistic. Used well, AI can help a tired clinician catch something at 3 a.m., bring expert knowledge to communities that have little access to specialists, and give families clearer answers. Getting there takes humility. The tools need to show their reasoning, and we need to keep our judgment sharp.<\/p>\n<p>      <i>Editor\u2019s note: <\/i>      <i>These comments are educational and reflect the AIMed26 discussion. They are not medical advice for any individual patient or an endorsement of any product.<\/i>      <i\/>      <i\/>    <\/p>\n<h2>For more information:<\/h2>\n<p>      <b>Harvey Castro, MD, MBA,<\/b> can be reached at <a rel=\"noopener noreferrer\" href=\"https:\/\/www.harveycastromd.com\/\" id=\"rId14\" target=\"_blank\">https:\/\/www.harveycastromd.com<\/a> and on X, at @HarveyCastroMD.<\/p>\n<div class=\"article__content--footer\">\n<div class=\"sources-references-disclosures\">\n<h3>Sources\/Disclosures<\/h3>\n<h2> Source: <\/h2>\n<p class=\"citation\">Healio Interviews<\/p>\n<h2>Reference: <\/h2>\n<ul class=\"list-unstyled references\">\n<li>Castro H, et al. What happens when AI and the clinician disagree? Presented at: AIMed26; Nov. 11-13, 2026; Orlando.<\/li>\n<\/ul>\n<div class=\"disclosures\">\n<p>&#13;<br \/>\n        <strong> Disclosures: <\/strong>&#13;<br \/>\n        Castro reports being advisor to the CEO of Phantom Space; receiving honoraria for healthcare AI speaking; receiving royalties as an author on AI in healthcare, including <i>AI in Emergency Medicine<\/i> (Wiley); and holding a small equity interest in Nutex Health, including The Colony ER Hospital in The Colony, Texas. He is the former CEO and owner of Trusted Medical Centers and has sold his emergency centers. He has no financial relationships with payers, pharmacy or radiology benefit managers, or vendors of prior authorization or utilization review software.&#13;\n      <\/p>\n<\/p><\/div>\n<\/div>\n<p><!-- Healio AI Widget --><\/p>\n<div class=\"healio-ai-component-inline\" data-no-ads=\"true\" data-module-track-category=\"Healio AI\" data-module-track-action=\"Click\" data-module-track-label=\"Access Healio Ai from component - News_AI Component - In-Content (all devices)\">\n<div class=\"healio-ai-content\">\n    <img decoding=\"async\" src=\"https:\/\/m3.healio.com\/~\/media\/images\/healio-ai\/healio-ai_logo.svg\" alt=\"Healio AI\" class=\"healio-ai-logo\"\/><\/p>\n<p><strong>Ask a clinical question<\/strong> and tap into <strong>Healio AI&#8217;s knowledge<\/strong> base.<\/p>\n<ul>&#13;<\/p>\n<li>PubMed, enrolling\/recruiting trials, guidelines<\/li>\n<p>&#13;<\/p>\n<li>Clinical Guidance, Healio CME, FDA news<\/li>\n<p>&#13;<\/p>\n<li>Healio&#8217;s exclusive daily news coverage of clinical data<\/li>\n<p>&#13;\n    <\/ul>\n<p>    <button class=\"healio-ai-button\" onclick=\"window.location.href=\" https:=\"\">Learn more<\/button>\n  <\/div>\n<\/div>\n<div class=\"email-alert-button-wrapper d-none\" data-component=\"EmailTopicAlert\" data-module=\"Subspecialty Email Topic Alerts Top\" data-manage-email-link=\"\/footer\/account-information\/my-account\/email-subscriptions-and-alerts#emailAlerts\">\n  <hidden data-setting-item=\"d265901d-6d37-49c7-a8f6-c7bf19a02509\"\/><br \/>\n  <hidden data-crm-source=\"Subspecialty Topic Alert\"\/><\/p>\n<div class=\"email-alert-button d-none\" data-topic-button=\"not-subscribed\">\n<p>&#13;<br \/>\n      <span data-module-track-action=\"Email Alerts TOP_Click_Healio News Article\" data-module-track-label=\"Email Alerts TOP_Healio News Article\">&#13;<br \/>\n        <i class=\"fas fa-plus-circle\"\/>&#13;<br \/>\n        Add topic to email alerts&#13;<br \/>\n      <\/span>&#13;\n    <\/p>\n<div class=\"email-alert-inner collapse uc13c7044d8eb4c479a585787703d90ff\">\n<div class=\"email-alert-dialogue\">\n<p>&#13;<br \/>\n          Receive an email when new articles are posted on <span data-content=\"topic-title\"\/>&#13;\n        <\/p>\n<div class=\"d-none\" data-sign-up-type=\"unknown\">\n          Please provide your email address to receive an email when new articles are posted on <span data-content=\"topic-title\"\/>.<\/p><\/div>\n<\/p><\/div>\n<p>      <button type=\"button\" class=\"btn btn-primary\" data-loading-text=\"Loading &lt;i class=\" fa=\"\" fa-spinner=\"\" fa-spin=\"\">&#8220;&#13;<br \/>\n              data-action=&#8221;subscribe&#8221;&gt;&#13;<br \/>\n        Subscribe&#13;<br \/>\n      <\/button>\n    <\/div>\n<\/p><\/div>\n<div class=\"d-none\" data-topic-modal=\"failed\">    <strong>We were unable to process your request. Please try again later. If you continue to have this issue please contact <a href=\"https:\/\/www.healio.com\/news\/primary-care\/20261120\/mailto:customerservice@slackinc.com\">customerservice@slackinc.com<\/a>.<\/strong>  <\/p>\n<p><button data-dismiss=\"modal\" class=\"btn btn-primary btn-lg btn-block\">Back to Healio<\/button><\/p>\n<\/div>\n<\/div><\/div>\n<\/p><\/div>\n<p><br \/>\n<br \/><a href=\"https:\/\/www.healio.com\/news\/primary-care\/20261120\/qa-what-happens-when-clinicians-disagree-with-ai\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>November 20, 2026 4 min read &#13; &#13; &#13; Add topic to email alerts&#13; &#13; &#13; Receive an email when new articles are posted on &#13; Please provide your email address to receive an email when new articles are posted on . &#8220;&#13; data-action=&#8221;subscribe&#8221;&gt;&#13; Subscribe&#13; We were unable to process your request. Please try again later. If you continue to have this issue please contact customerservice@slackinc.com. Back to Healio Key takeaways: AI is quickly integrating into various areas of medicine, but it is not perfect. So, keeping a human in the loop is a critical part of this integration, an expert said. ORLANDO \u2014 Healthcare providers need to continue exercising judgment like it is a muscle, in order for AI to reach its full potential in medicine, according to a speaker here. Harvey Castro, MD, MBA, an emergency medicine physician and AI in healthcare speaker, was part of a panel discussion on what happens when a clinician disagrees with AI at this year\u2019s AIMed conference. &#13; &#13;&#13;&#13;&#13;&#13;&#13; &#13; &#13; &#13;&#13; &#13; &#13; Healio spoke with Castro to learn more about how AI is developing in medicine, what healthcare providers should consider during its use and more. Healio: Why is this an important conversation right now? Castro: For most of my career in the emergency department, the hard calls were made by me, my team and the patient. Now there is another voice in the room. AI tools are moving from offering suggestions to taking actions inside hospital systems, and every clinician is going to face a moment when the machine says one thing and their judgment says another. At AIMed26 in Orlando, I opened the session with a composite emergency department case and then chaired the panel \u201cWhat happens when AI and the clinician disagree?\u201d The question I kept asking was this: When a system keeps going after a doctor would stop, who protects the patient? We need that answer now, before these tools are everywhere. Healio: What steps should clinicians take when using AI to ensure it will be as accurate as possible? Castro: Treat AI like a smart colleague who has never met your patient. Its note can be useful, and it can be wrong. Before acting on it, check it against the person in front of you, the history, the exam and the chart. AI saves real time when it drafts, summarizes or pulls information together. The minutes you should never give back are the ones spent checking anything that would change a diagnosis, a medication or whether a patient goes home. If you can\u2019t explain why the recommendation fits this patient, keep thinking. That check is part of the care, and it is what keeps the patient safe. Healio: What should be done when a clinician disagrees with AI\u2019s recommendations? Castro: The clinician owns the decision, and the patient is counting on that. When I disagree with a recommendation, I don\u2019t follow it because the screen sounds confident. I write down what the tool suggested, why I disagreed and what I did instead. Hospitals should welcome that disagreement. If a system only measures whether doctors followed the model, people will stop speaking up, and patients lose one of their best safeguards. My rule is human plus AI. The physician keeps the moral compass, while the machine finds patterns and analyzes them at scale. Healio: Does that response change if the AI is an integrated part of the clinician\u2019s healthcare system? Should inaccuracies be reported somewhere? Castro: Yes. An integrated tool is part of how the hospital delivers care, so its mistakes belong in the same safety process as any other clinical system. Report them to the clinical informatics team or chief medical informatics officer, to quality and patient safety, and to the vendor, with enough detail that someone can find the cause and fix it. Every report helps the next patient. If a hospital has no clear place to report a bad recommendation, that is a governance gap its leaders need to close. Healio: What are your thoughts on the potential of deskilling here? Castro: I worry about it, especially for young doctors and nurses who will train alongside a model that always sounds sure of itself. If we only teach people how to use a tool and never how to question it, we will raise clinicians who miss a confident error. Medical education should keep the exam, the differential and the bedside at the center. I like one habit in particular: Before you look at the AI output, ask yourself what you would have done. Senior clinicians can help by thinking out loud when they disagree with a model, and by admitting it when the model turns out to be right. Judgment is a muscle, and our patients need us to keep it strong. Healio: Patients are increasingly presenting with information from their own AI systems . How should clinicians handle that situation? Castro: With respect and curiosity. A patient who brings in an AI answer is trying to take part in their own care, and that is a good thing. Thank them, look at it together, and then go back to their story, their symptoms and your exam. If the information is wrong or unsafe, explain why in plain language and walk them through what you recommend instead. Patients don\u2019t need us to win the argument. They need help making a safe decision, and they need to leave feeling heard. Healio: What is the take-home message? Castro: AI should make care more human. At its best, technology gives clinicians more time to listen, to explain and to comfort. When a model and a clinician disagree, the right question is what helps this patient, and who is accountable if we get it wrong. Healio: Is there anything else you would like to add? Castro: I am optimistic. Used well, AI can help a tired clinician catch something at 3 a.m., bring expert knowledge to communities that have little access to specialists, and give families<\/p>\n","protected":false},"author":1,"featured_media":4444,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-4443","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=\/wp\/v2\/posts\/4443","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4443"}],"version-history":[{"count":0,"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=\/wp\/v2\/posts\/4443\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=\/wp\/v2\/media\/4444"}],"wp:attachment":[{"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4443"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4443"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4443"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}