{"id":4352,"date":"2026-11-13T18:36:43","date_gmt":"2026-11-13T18:36:43","guid":{"rendered":"https:\/\/drsoniafawad.com\/?p=4352"},"modified":"2026-11-13T18:36:43","modified_gmt":"2026-11-13T18:36:43","slug":"asking-the-right-questions-how-to-design-fairer-more-rigorous-observational-studies","status":"publish","type":"post","link":"https:\/\/drsoniafawad.com\/?p=4352","title":{"rendered":"Asking the right questions: How to design fairer, more rigorous observational studies"},"content":{"rendered":"<p><br \/>\n<\/p>\n<div data-component=\"ArticleContent\">\n<div class=\"article__below-title\">\n<div class=\" article__posted-date\">\n<p>November 13, 2026<\/p>\n<p>5 min read<\/p>\n<\/div>\n<div class=\"mobile-trust-box\">\n<div class=\"row\">\n<div class=\"col-12 col-md-6 offset-md-1 offset-xl-0 col-xl-12\">\n<div class=\"email-alert-button-wrapper d-none\" data-component=\"EmailTopicAlert\" data-module=\"Subspecialty Email Topic Alerts Top\" data-manage-email-link=\"\/footer\/account-information\/my-account\/email-subscriptions-and-alerts#emailAlerts\">\n<hidden data-setting-item=\"d265901d-6d37-49c7-a8f6-c7bf19a02509\"\/><br \/>\n<hidden data-crm-source=\"Subspecialty Topic Alert\"\/><\/p>\n<div class=\"email-alert-button d-none\" data-topic-button=\"not-subscribed\">\n<p>\n<span data-module-track-action=\"Email Alerts TOP_Click_Healio News Article\" data-module-track-label=\"Email Alerts TOP_Healio News Article\"><br \/>\n<i class=\"fas fa-plus-circle\"\/><br \/>\nAdd topic to email alerts<br \/>\n<\/span>\n<\/p>\n<div class=\"email-alert-inner collapse uae95b06c12724a89927b4f809d1549e3\">\n<div class=\"email-alert-dialogue\">\n<p>\nReceive an email when new articles are posted on <span data-content=\"topic-title\"\/>\n<\/p>\n<div class=\"d-none\" data-sign-up-type=\"unknown\">\nPlease provide your email address to receive an email when new articles are posted on <span data-content=\"topic-title\"\/>.<\/p>\n<\/div>\n<\/div>\n<p><button type=\"button\" class=\"btn btn-primary\" data-loading-text=\"Loading &lt;i class=\" fa=\"\" fa-spinner=\"\" fa-spin=\"\">&#8221; data-action=subscribe&gt;<br \/>\nSubscribe<br \/>\n<\/button>\n<\/div>\n<\/div>\n<div class=\"d-none\" data-topic-modal=\"failed\"> <strong>We were unable to process your request. Please try again later. If you continue to have this issue please contact <a href=\"https:\/\/www.healio.com\/news\/dermatology\/20261113\/mailto:customerservice@slackinc.com\">customerservice@slackinc.com<\/a>.<\/strong> <\/p>\n<p><button data-dismiss=\"modal\" class=\"btn btn-primary btn-lg btn-block\">Back to Healio<\/button><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<h2>Key takeaways: <\/h2>\n<ul>\n<li>An observed association reported in a study may not reflect true causal mechanisms. <\/li>\n<li>Researchers must ask the right causal question when designing a study.<\/li>\n<\/ul>\n<p>Observational studies remain a valuable way to assess real-world relationships and long-term outcomes, but confounding variables, selection bias and poor design can make for spurious associations that perpetuate misinformation.<\/p>\n<p>The most difficult step for researchers designing an observational study is not choosing a statistical method, <b>Nandita Mitra, PhD,<\/b> professor of biostatistics and codirector of the Center for Causal Inference at the Hospital of the University of Pennsylvania, said during a keynote presentation at the <a rel=\"noopener noreferrer\" href=\"https:\/\/www.healio.com\/news\/dermatology\/20251203\/qa-how-to-improve-an-fda-label-with-evidence-advocacy\" id=\"rId9\" target=\"_blank\">Dermatology in Pharma Educational Collaborative<\/a> (DPEC).<\/p>\n<figure class=\"figure article__og-image\">\n<picture><source srcset=\"https:\/\/www.healio.comhttps:\/\/www.healio.comhttps:\/\/www.healio.com\/~\/media\/slack-news\/dermatology\/misc\/infographics\/2026\/11_november\/derm1125dpecmitraqaog.webp?w=476\" media=\"(max-width: 768px)\"><source srcset=\"https:\/\/www.healio.com\/~\/media\/slack-news\/dermatology\/misc\/infographics\/2026\/11_november\/derm1125dpecmitraqaog.webp?w=800\" media=\"(max-width: 992px)\"><source srcset=\"https:\/\/www.healio.com\/~\/media\/slack-news\/dermatology\/misc\/infographics\/2026\/11_november\/derm1125dpecmitraqaog.webp?w=595\" media=\"(max-width: 1200px)\"><source srcset=\"https:\/\/www.healio.comhttps:\/\/www.healio.comhttps:\/\/www.healio.com\/~\/media\/slack-news\/dermatology\/misc\/infographics\/2026\/11_november\/derm1125dpecmitraqaog.webp?w=476\" media=\"(min-width: 1200px)\"><source srcset=\"https:\/\/www.healio.comhttps:\/\/www.healio.comhttps:\/\/www.healio.com\/~\/media\/slack-news\/dermatology\/misc\/infographics\/2026\/11_november\/derm1125dpecmitraqaog.webp?w=476\"><img decoding=\"async\" src=\"https:\/\/www.healio.com\/~\/media\/slack-news\/dermatology\/misc\/infographics\/2026\/11_november\/derm1125dpecmitraqaog.jpg?w=800\" alt=\"You must ask the right question, design the right comparison and be honest about what you do not know.\" class=\"figure-img img-fluid\" width=\"800\"\/><br \/>\n<\/source><\/source><\/source><\/source><\/source><\/picture><figcaption class=\"figure-caption\">\n<\/figcaption><\/figure>\n<p>Before analyzing any study, Mitra said, the hardest questions come first: \u201cWhat are we trying to learn, and can the data we have answer that question?\u201d<\/p>\n<p>Causal inference, Mitra said, changes how people think about evidence by moving beyond observing patterns and toward understanding cause-and-effect relationships. <\/p>\n<p>\u201cIf I have a headache, I take aspirin and my headache goes away an hour later, that is not a causal claim,\u201d Mitra told Healio. \u201cWhat I would have to then think about is what would have happened to me had I not taken aspirin? Would my headache still have gone away? Inference relies on these hypothetical, counterfactual situations.\u201d<\/p>\n<p>Healio spoke with Mitra about the questions researchers should ask when designing an observational study, which variables to adjust for and why, and the importance of including a credible comparison group. DPEC, hosted by Penn\u2019s Center for Clinical Sciences in Dermatology and led by Healio Dermatology Chief Medical Editor <b>Joel<\/b><b> M. <\/b><b>Gelfand<\/b><b>, MD, MSCE, FAAD<\/b><b>,<\/b> is an academic-industry collaborative program that promotes continuing education for professionals working on clinical research.<\/p>\n<p> <b>Healio: W<\/b><b>hat is a causal question?<\/b> <\/p>\n<p> <b>Mitra:<\/b> The causal question compares two potential outcomes for the same patient. For example, an outcome with treatment vs. an outcome without treatment. The difference between these two outcomes is the causal effect for that patient; the unobserved alternative is the counterfactual. <\/p>\n<p>Most clinical questions \u2014 Does this treatment work? Does it cause harm? Would another treatment have been better? \u2014 are causal questions. The problem is we can never observe both outcomes for one person at a particular point in time. <\/p>\n<p>People sometimes confuse causation with association. Often, you find there is an association or correlation between a medication and a particular outcome, but that does not necessarily mean that the medication caused that outcome.<\/p>\n<p>Because we cannot observe the counterfactual, we must estimate it. We look for patients who can tell us what might have happened otherwise. The comparison group must be a credible stand-in for the missing counterfactual.<\/p>\n<p> <b>Healio: <\/b><b>During your talk, you <\/b><b>referred to a study that assessed <\/b> <a rel=\"noopener noreferrer\" href=\"https:\/\/www.healio.com\/news\/dermatology\/20260729\/hair-loss-and-ozempic-face-how-to-treat-the-aesthetic-cost-of-glp1s\" id=\"rId10\" target=\"_blank\"> <b>whether <\/b><b>GLP-1<\/b><b> receptor agonists <\/b><b>cause hair loss<\/b> <\/a> <b>, as reports of alopecia have increasingly appeared in real-world cohorts. <\/b><b>W<\/b><b>hat were <\/b><b>you <\/b><b>trying to convey with that example? <\/b> <\/p>\n<p> <b>Mitra: <\/b>I picked the topic because it is timely and relevant. The data seem to say yes. A systematic review and meta-analysis showed 40% higher odds for nonscarring alopecia with GLP-1 use. Should we believe it?<\/p>\n<p>When you are conducting these types of observational studies, you cannot randomize people who receive a GLP-1 vs. those who do not just to assess hair loss. Were the patients in the comparison group comparable to begin with? Before treatment, they may differ in obesity severity, age and sex, health-seeking behaviors, healthcare use, nutritional status and use of other medications. This is confounding. Simply adjusting for all the different factors that you have collected does not necessarily mean you now have a causal effect.<\/p>\n<p> <b>Healio: <\/b><b>What should researchers be adjusting for? <\/b><b>W<\/b><b>hat should they not be adjusting for? <\/b> <\/p>\n<p> <b>Mitra:<\/b> In my talk, I described what a confounder is. A confounder is a common cause of both the treatment and the outcome. People who start GLP-1s may be different from those who do not. These differences confound the association between GLP-1 use and hair loss. If you don\u2019t adjust for confounders, you could end up with a spurious association between the treatment and the outcome. So, we do want to adjust for confounders. However, you may not have measured all confounders so your study may still be susceptible to unmeasured confounding. In addition, there are other types of variables you must think about very carefully.<\/p>\n<p>There are mediators, variables that occur after treatment and are on the causal pathway to an outcome. If certain variables result from GLP-1 use, we often do not want to adjust for that if we want to estimate the total effect of GLP-1s on the outcome. Weight loss, for example, is a mediator. If we adjust for weight loss, we are no longer estimating the total effect of GLP-1 treatment. We have changed the causal question. But we might be interested in the indirect effect of weight loss. In those cases, we might want to then conduct a different type of analysis to assess that mediated effect.<\/p>\n<p>Colliders are a common effect of treatment and outcome, and we usually do not adjust for those variables. Selection bias is an example.<\/p>\n<p> <b>Healio: <\/b><b>How can researchers avoid <\/b><b>selection bia<\/b><b>s?<\/b> <\/p>\n<p> <b>Mitra: <\/b>Continuing with this example, those taking GLP-1s may be more likely to see a dermatologist. Those who have hair loss may be more likely to see a dermatologist. If you subset to investigating only patients who saw a dermatologist, that is selection bias or conditioning on a collider. By doing this, you might end up with a population of people that are not generalizable.<\/p>\n<p>Importantly, a statistician cannot make these decisions in a vacuum. When we think about causality and different types of variables, that information is coming from collaboration with a domain expert. When I work on dermatology studies, it is critical that I am working very closely with a dermatologist who can help me think through all the variables, how the treatment progresses and how data are collected.<\/p>\n<p> <b>Healio: <\/b><b>How <\/b><b>can<\/b><b> researchers <\/b><b>design <\/b><b>a fairer comparison<\/b><b>?<\/b> <\/p>\n<p> <b>Mitra:<\/b> When you are thinking about, specifically, an observational study where all of these issues can come into play, clinicians will often come to me and say, I want to use these statistical methods, like propensity score weighting or instrumental variable methods, because I want to make a causal claim. What I usually say first is, \u201cLet\u2019s go way back in the process. Imagine the trial you wish you could run. First, what is the question you want to answer? <\/p>\n<p>Causal inference is not a statistical method. It is a way of thinking about evidence. You must ask the right question, design the right comparison and be honest about what you do not know. <\/p>\n<p>Can you answer the question that you want to answer using the data you have? Also, think very carefully about the design of the study. The next step is to think about the different causal assumptions. Do we have a clear comparator group that could be thought of as that counterfactual world? And then, we finally get to the statistical methods.<\/p>\n<p>The methods have changed enormously over my career, but the questions I find myself asking have changed remarkably little.<\/p>\n<h2>For more information:<\/h2>\n<p> <b>Nandita Mitra, PhD,<\/b> is professor of biostatistics and codirector of the Center for Causal Inference at the Hospital of the University of Pennsylvania. Mitra can be reached at <a rel=\"noopener noreferrer\" href=\"https:\/\/www.healio.com\/news\/dermatology\/20261113\/mailto:nanditam@pennmedicine.upenn.edu\" id=\"rId11\" target=\"_blank\">nanditam@pennmedicine.upenn.edu<\/a>.<\/p>\n<div class=\"article__content--footer\">\n<div class=\"sources-references-disclosures\">\n<h3>Sources\/Disclosures<\/h3>\n<h2> Source: <\/h2>\n<p class=\"HealioSubhead\"><span style=\"line-height: 115%;\">Mitra N. Causal inference in the real world: A matter of life and death. Presented at: Dermatology in Pharma Educational Collaborative; Nov. 6, 2026; Philadelphia.<\/span><\/p>\n<h2>References:<\/h2>\n<div class=\"disclosures\">\n<p>\n<strong> Disclosures: <\/strong><br \/>\nMitra reports no relevant financial disclosures.\n<\/p>\n<\/div>\n<\/div>\n<div class=\"healio-ai-component-inline\" data-no-ads=\"true\" data-module-track-category=\"Healio AI\" data-module-track-action=\"Click\" data-module-track-label=\"Access Healio Ai from component - News_AI Component - In-Content (all devices)\">\n<div class=\"healio-ai-content\">\n<img decoding=\"async\" src=\"https:\/\/m3.healio.com\/~\/media\/images\/healio-ai\/healio-ai_logo.svg\" alt=\"Healio AI\" class=\"healio-ai-logo\"\/><\/p>\n<p><strong>Ask a clinical question<\/strong> and tap into <strong>Healio AI&#8217;s knowledge<\/strong> base.<\/p>\n<ul>\n<li>PubMed, enrolling\/recruiting trials, guidelines<\/li>\n<li>Clinical Guidance, Healio CME, FDA news<\/li>\n<li>Healio&#8217;s exclusive daily news coverage of clinical data<\/li>\n<\/ul>\n<p><button class=\"healio-ai-button\" onclick=\"window.location.href=\" https:=\"\">Learn more<\/button>\n<\/div>\n<\/div>\n<div class=\"email-alert-button-wrapper d-none\" data-component=\"EmailTopicAlert\" data-module=\"Subspecialty Email Topic Alerts Top\" data-manage-email-link=\"\/footer\/account-information\/my-account\/email-subscriptions-and-alerts#emailAlerts\">\n<hidden data-setting-item=\"d265901d-6d37-49c7-a8f6-c7bf19a02509\"\/><br \/>\n<hidden data-crm-source=\"Subspecialty Topic Alert\"\/><\/p>\n<div class=\"email-alert-button d-none\" data-topic-button=\"not-subscribed\">\n<p>\n<span data-module-track-action=\"Email Alerts TOP_Click_Healio News Article\" data-module-track-label=\"Email Alerts TOP_Healio News Article\"><br \/>\n<i class=\"fas fa-plus-circle\"\/><br \/>\nAdd topic to email alerts<br \/>\n<\/span>\n<\/p>\n<div class=\"email-alert-inner collapse uae95b06c12724a89927b4f809d1549e3\">\n<div class=\"email-alert-dialogue\">\n<p>\nReceive an email when new articles are posted on <span data-content=\"topic-title\"\/>\n<\/p>\n<div class=\"d-none\" data-sign-up-type=\"unknown\">\nPlease provide your email address to receive an email when new articles are posted on <span data-content=\"topic-title\"\/>.<\/p>\n<\/div>\n<\/div>\n<p><button type=\"button\" class=\"btn btn-primary\" data-loading-text=\"Loading &lt;i class=\" fa=\"\" fa-spinner=\"\" fa-spin=\"\">&#8221; data-action=subscribe&gt;<br \/>\nSubscribe<br \/>\n<\/button>\n<\/div>\n<\/div>\n<div class=\"d-none\" data-topic-modal=\"failed\"> <strong>We were unable to process your request. Please try again later. If you continue to have this issue please contact <a href=\"https:\/\/www.healio.com\/news\/dermatology\/20261113\/mailto:customerservice@slackinc.com\">customerservice@slackinc.com<\/a>.<\/strong> <\/p>\n<p><button data-dismiss=\"modal\" class=\"btn btn-primary btn-lg btn-block\">Back to Healio<\/button><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<p><br \/>\n<br \/><a href=\"https:\/\/www.healio.com\/news\/dermatology\/20261113\/asking-the-right-questions-how-to-design-fairer-more-rigorous-observational-studies\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>November 13, 2026 5 min read Add topic to email alerts Receive an email when new articles are posted on Please provide your email address to receive an email when new articles are posted on . &#8221; data-action=subscribe&gt; Subscribe We were unable to process your request. Please try again later. If you continue to have this issue please contact customerservice@slackinc.com. Back to Healio Key takeaways: An observed association reported in a study may not reflect true causal mechanisms. Researchers must ask the right causal question when designing a study. Observational studies remain a valuable way to assess real-world relationships and long-term outcomes, but confounding variables, selection bias and poor design can make for spurious associations that perpetuate misinformation. The most difficult step for researchers designing an observational study is not choosing a statistical method, Nandita Mitra, PhD, professor of biostatistics and codirector of the Center for Causal Inference at the Hospital of the University of Pennsylvania, said during a keynote presentation at the Dermatology in Pharma Educational Collaborative (DPEC). Before analyzing any study, Mitra said, the hardest questions come first: \u201cWhat are we trying to learn, and can the data we have answer that question?\u201d Causal inference, Mitra said, changes how people think about evidence by moving beyond observing patterns and toward understanding cause-and-effect relationships. \u201cIf I have a headache, I take aspirin and my headache goes away an hour later, that is not a causal claim,\u201d Mitra told Healio. \u201cWhat I would have to then think about is what would have happened to me had I not taken aspirin? Would my headache still have gone away? Inference relies on these hypothetical, counterfactual situations.\u201d Healio spoke with Mitra about the questions researchers should ask when designing an observational study, which variables to adjust for and why, and the importance of including a credible comparison group. DPEC, hosted by Penn\u2019s Center for Clinical Sciences in Dermatology and led by Healio Dermatology Chief Medical Editor Joel M. Gelfand, MD, MSCE, FAAD, is an academic-industry collaborative program that promotes continuing education for professionals working on clinical research. Healio: What is a causal question? Mitra: The causal question compares two potential outcomes for the same patient. For example, an outcome with treatment vs. an outcome without treatment. The difference between these two outcomes is the causal effect for that patient; the unobserved alternative is the counterfactual. Most clinical questions \u2014 Does this treatment work? Does it cause harm? Would another treatment have been better? \u2014 are causal questions. The problem is we can never observe both outcomes for one person at a particular point in time. People sometimes confuse causation with association. Often, you find there is an association or correlation between a medication and a particular outcome, but that does not necessarily mean that the medication caused that outcome. Because we cannot observe the counterfactual, we must estimate it. We look for patients who can tell us what might have happened otherwise. The comparison group must be a credible stand-in for the missing counterfactual. Healio: During your talk, you referred to a study that assessed whether GLP-1 receptor agonists cause hair loss , as reports of alopecia have increasingly appeared in real-world cohorts. What were you trying to convey with that example? Mitra: I picked the topic because it is timely and relevant. The data seem to say yes. A systematic review and meta-analysis showed 40% higher odds for nonscarring alopecia with GLP-1 use. Should we believe it? When you are conducting these types of observational studies, you cannot randomize people who receive a GLP-1 vs. those who do not just to assess hair loss. Were the patients in the comparison group comparable to begin with? Before treatment, they may differ in obesity severity, age and sex, health-seeking behaviors, healthcare use, nutritional status and use of other medications. This is confounding. Simply adjusting for all the different factors that you have collected does not necessarily mean you now have a causal effect. Healio: What should researchers be adjusting for? What should they not be adjusting for? Mitra: In my talk, I described what a confounder is. A confounder is a common cause of both the treatment and the outcome. People who start GLP-1s may be different from those who do not. These differences confound the association between GLP-1 use and hair loss. If you don\u2019t adjust for confounders, you could end up with a spurious association between the treatment and the outcome. So, we do want to adjust for confounders. However, you may not have measured all confounders so your study may still be susceptible to unmeasured confounding. In addition, there are other types of variables you must think about very carefully. There are mediators, variables that occur after treatment and are on the causal pathway to an outcome. If certain variables result from GLP-1 use, we often do not want to adjust for that if we want to estimate the total effect of GLP-1s on the outcome. Weight loss, for example, is a mediator. If we adjust for weight loss, we are no longer estimating the total effect of GLP-1 treatment. We have changed the causal question. But we might be interested in the indirect effect of weight loss. In those cases, we might want to then conduct a different type of analysis to assess that mediated effect. Colliders are a common effect of treatment and outcome, and we usually do not adjust for those variables. Selection bias is an example. Healio: How can researchers avoid selection bias? Mitra: Continuing with this example, those taking GLP-1s may be more likely to see a dermatologist. Those who have hair loss may be more likely to see a dermatologist. If you subset to investigating only patients who saw a dermatologist, that is selection bias or conditioning on a collider. By doing this, you might end up with a population of people that are not generalizable. Importantly, a statistician cannot make these decisions in a vacuum. When we think about causality and different types<\/p>\n","protected":false},"author":1,"featured_media":4353,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-4352","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=\/wp\/v2\/posts\/4352","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4352"}],"version-history":[{"count":0,"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=\/wp\/v2\/posts\/4352\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=\/wp\/v2\/media\/4353"}],"wp:attachment":[{"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4352"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4352"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/drsoniafawad.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4352"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}