{"id":3066,"date":"2023-11-06T14:33:00","date_gmt":"2023-11-06T14:33:00","guid":{"rendered":"https:\/\/www.osmosis.org\/blog\/?p=3066"},"modified":"2025-10-03T14:19:46","modified_gmt":"2025-10-03T22:19:46","slug":"unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program","status":"publish","type":"post","link":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program","title":{"rendered":"Unlocking the Secrets of Success: Effectively Evaluating Your Course or Program"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_80 ez-toc-wrap-center counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">In This Article<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\/#Starting_Your_Program_Evaluation\" >Starting Your Program Evaluation&nbsp;&nbsp;<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\/#Tasks_1-2_Identify_users_and_uses_of_the_evaluation\" >Tasks 1-2: Identify users and uses of the evaluation<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\/#Task_3_Identify_resources\" >Task 3: Identify resources<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\/#Task_4_Identify_evaluation_questions\" >Task 4: Identify evaluation questions<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\/#Tasks_5-6_Choose_evaluation_designs_and_measurement_methods\" >Tasks 5-6: Choose evaluation designs and measurement methods<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\/#Task_7_Address_ethical_concerns\" >Task 7: Address ethical concerns&nbsp;<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\/#About_the_Author\" >About the Author<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\/#References_and_Resources\" >References and Resources<\/a><\/li><\/ul><\/nav><\/div>\n\n<p class=\"wp-block-paragraph\"><strong>In today&#8217;s Osmosis blog, Dr. Sean Tackett addresses how to evaluate a course or program by explaining how to design an effective framework and highlighting how to avoid missing important issues. &nbsp;<\/strong>&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We all have blind spots. Recently, when working with colleagues on an article about &#8220;blind spots&#8221; in medical education [1], I was reminded of the parable of the blind men and the elephant. Each person touches a different part of the elephant and wrongly assumes what object is in their hands. Only by combining their perspectives could they understand the elephant before them. &nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Evaluating programs is like trying to &#8220;see the elephant,&#8221; only more challenging. The elephant is not just large and hard to grasp, but the elephant is moving. We&#8217;re trying to understand not just what we&#8217;re observing but in what direction it&#8217;s going at the same time.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It takes many hands and coordination among many individuals to conduct a thorough program evaluation. There are countless frameworks for this, with a movement toward thinking of programs as complex systems [2]. To begin to handle this complexity, it can help to have some guiding principles in mind: &nbsp;<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Find your &#8220;why.&#8221;<\/strong>\u00a0The starting point for any program evaluation is understanding the goals or outcomes the program is expected to achieve, often the learning objectives in educational programs.\u00a0<\/li>\n\n\n\n<li><strong>Stuff happens.<\/strong>\u00a0It&#8217;s not enough to determine to what extent program outcomes were achieved; systematically seeking out the unexpected, whether pleasant surprises or negative unintended consequences, is key.\u00a0<\/li>\n\n\n\n<li><strong>No two minds think alike.<\/strong>\u00a0Everyone will have a different experience in an educational program; there might be people who feel like they won and those who feel like they lost, and someone with an advantage in one respect might have a disadvantage in another.\u00a0<\/li>\n\n\n\n<li><strong>You&#8217;ll never really see the whole elephant.<\/strong>\u00a0We would love to have infinite information, but we will inevitably be blind to some elements of the program. Prioritizing the use of resources is critical.\u00a0<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Starting_Your_Program_Evaluation\"><\/span><strong>Starting Your Program Evaluation&nbsp;<\/strong>&nbsp;<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Let&#8217;s walk through a stepwise approach that can help health professionals get started with program evaluation and avoid missing important issues. These are based on the ten evaluation tasks from the Six-Step Approach for Curriculum Development for Medical Education [3].&nbsp;<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Tasks_1-2_Identify_users_and_uses_of_the_evaluation\"><\/span><strong>Tasks 1-2: Identify users and uses of the evaluation<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Who are the stakeholders? Evaluators and administrators are typically interested to know if something is working. So are the learners. There may be others to consider, such as regulatory bodies (e.g., accreditors) and the needs of patients, caregivers, and communities. Each will have their own interests in what evaluation data you gather [4].<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Task_3_Identify_resources\"><\/span><strong>Task 3: Identify resources<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">How much time, expertise, etc., do you have? Can you advocate for more? Ultimately, your evaluation design should be prioritized based on the available resources, and knowing this upfront will make your design feasible.&nbsp;<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Task_4_Identify_evaluation_questions\"><\/span><strong>Task 4: Identify evaluation questions<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Once you have a clearer understanding of the purpose(s) of evaluation (i.e., users and uses) and what&#8217;s possible with the available resources, you are ready to consider specifically what questions your evaluation should answer. As mentioned above, you&#8217;ll want to make sure that evaluation questions align with program objectives (e.g., Have learners achieved the expected level of performance?) and ask about the unexpected (e.g., What else happened during the program?). It&#8217;s often helpful to think through the program&#8217;s aspects along logic models, considering its inputs, processes, and outputs, as well as the outcomes and impact that may be more downstream from the program. &nbsp;<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Tasks_5-6_Choose_evaluation_designs_and_measurement_methods\"><\/span><strong>Tasks 5-6: Choose evaluation designs and measurement methods<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Designs and measures should align with each question. For example, pre-post quantitative measures (e.g., knowledge exams) can be effective for evaluations of performance improvements. Quantitative measures may also lend themselves to comparative designs (e.g., including control groups) to determine if learning improved as a result of the program. Qualitative methods are typically required to capture the emergent aspects of the program, with data collected after some experience in the program or after it has ended. Going back to the users and uses may prompt you to think beyond simply assessing learners and considering other stakeholders. Who else&#8217;s perspectives should you measure? What do other healthcare team members and patients think? &nbsp;<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Task_7_Address_ethical_concerns\"><\/span><strong>Task 7: Address ethical concerns<\/strong>&nbsp;<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Formal ethical approval is needed for anything that is done systematically for scholarly or publication purposes, and there are laws\/regulations in most settings that govern data collection and confidentiality. Ethics will always apply regardless, and it&#8217;s important to be aware of sensitive issues and not collect more information than you need.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Tasks 8-10: Collect and analyze data and report results<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">By now, you&#8217;re ready to gather and analyze data aligned with your chosen designs and methods. You may also consider a variety of ways to report your findings and meet the needs of all interested stakeholders. Seeking stakeholder input in interpreting your findings may be the best way to determine if what you did &#8220;worked&#8221; from the perspectives of everyone involved. &nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">When you&#8217;ve gone through the ten tasks, you&#8217;ll have a sense of whether what you&#8217;re doing is working and should have ideas about what changes need to be made. No curriculum or course is perfect, after all.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Even if you are not starting from scratch to develop a comprehensive program evaluation, the principles described will still apply. For example, it&#8217;s common to want to make a small change, such as using a new technology to teach and then understand its effects. In this case, you still want to understand the purposes of implementing the technology as your starting point; was the intention to improve learning efficiency? Enhance learner&#8217;s convenience and enjoyment? Increase access for more learners? When these purposes are clarified, you can start at Task 1 and think through who the various stakeholders are and what evidence they would want to show that the innovation has value. &nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">You might also try to incorporate frameworks specific to the changes you are making. For example, there are frameworks for educational technology adoption from medical education that recommend paying attention to technological features (e.g., relative advantage, ease of initial adoption, availability), individual factors (e.g., attitudes towards change, capabilities, pedagogical beliefs, control), and contextual factors (e.g., disciplinary and institutional culture) [5]. Or you could explore other fields for ideas. Social studies of science and technology offer a variety of theories to guide evaluation based on whether the interest is the adoption of the technology by an individual, the activity where the technology is being implemented, or multiple dimensions [6].&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Even if you don&#8217;t have time to scour the literature across healthcare, education, and beyond, sticking with the basic principles described here should serve you well. Always evaluate against the expected outcomes. Systematically look for the unexpected (for better or worse). Remember that every individual&#8217;s experience is unique and worth trying to capture. And take some comfort in the reality that you will always be leaving something out \u2013 be resourceful and efficient, but don&#8217;t let perfect be the enemy of good. &nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Finally, remember that every course, curriculum, or program is a work in progress. The key questions are not \u2013 &#8220;Did it work?&#8221; or &#8220;Was I successful?&#8221; Instead, it&#8217;s &#8220;For whom did it work and how?&#8221; and &#8220;What can we do to make it work better?&#8221;&nbsp;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"About_the_Author\"><\/span>About the Author<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\"><strong><strong><a href=\"https:\/\/www.osmosis.org\/profile\/sean-tackett\" target=\"_blank\" rel=\"noreferrer noopener\">Sean Tackett, MD, MPH,<\/a><\/strong><\/strong>&nbsp;is a General Internist at Johns Hopkins, Bayview Medical Center, and Director of Research at Osmosis by Elsevier. His career aspiration is to contribute to improvements in the quality of health professional education internationally. Dr. Tackett completed his residency and a fellowship in Internal Medicine at Johns Hopkins. He was awarded his MD from the University of Pittsburgh School of Medicine and graduated from Notre Dame University magna cum laude with a BS in Biochemistry. [<a href=\"https:\/\/www.osmosis.org\/profile\/sean-tackett\" target=\"_blank\" rel=\"noreferrer noopener\">read more<\/a>]<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"References_and_Resources\"><\/span>References and Resources<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Tackett S, Steinert Y, Whitehead CR, Reed DA, Wright SM. Blind spots in medical education: how can we envision new possibilities? Perspect Med Educ. 2022 Dec;11(6):365-370.\u00a0<\/li>\n\n\n\n<li>Rojas D, Grierson L, Mylopoulos M, Trbovich P, Bagli D, Brydges R. How can systems engineering inform the methods of program evaluation in health professions education? Medical Education. 2018 Apr;52(4):364-75.\u00a0<\/li>\n\n\n\n<li>Thomas PA, Kern DE, Hughes MT, Tackett SA, Chen BY, editors. Curriculum development for medical education: a six-step approach. JHU press; 2022 Aug 30.\u00a0<\/li>\n\n\n\n<li>Norcini J, Anderson MB, Bollela V, Burch V, Costa MJ, Duvivier R, Hays R, Palacios Mackay MF, Roberts T, Swanson D. 2018 Consensus framework for good assessment. Medical teacher. 2018 Nov 2;40(11):1102-9.\u00a0<\/li>\n\n\n\n<li>Grainger R, Liu Q, Geertshuis S. Learning technologies: A medium for the transformation of medical education? Medical education. 2021 Jan;55(1):23-9.\u00a0<\/li>\n\n\n\n<li>Rangel JC, Humphrey\u2010Murto S. Social Studies of Science and Technology: New ways to illuminate challenges in training for health information technologies utilisation. Medical Education. 2023 Aug 9.\u00a0<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Interested in how Osmosis by Elsevier can support clinical education in your program?&nbsp;<\/strong><a href=\"https:\/\/educators.osmosis.org\/schedule-a-call\/?_ga=2.183526689.600873220.1695000305-351100996.1690053029&amp;_gac=1.154732106.1694734993.CjwKCAjw3oqoBhAjEiwA_UaLtqzetqrS0ZYhpYgek2uuZgbLiodafd5AnRLhVeoHqxxgoU96n_p6kRoC3fMQAvD_BwE\" target=\"_blank\" rel=\"noreferrer noopener\"><strong>Schedule a call today<\/strong><\/a><strong>.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In today&#8217;s Osmosis blog, Dr. Sean Tackett addresses how to evaluate a course or program by explaining how to design an effective framework and highlighting how to avoid missing important issues. &nbsp;&nbsp; We all have blind spots. Recently, when working with colleagues on an article about &#8220;blind spots&#8221; in medical education [1], I was reminded [&hellip;]<\/p>\n","protected":false},"author":216,"featured_media":3067,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[17],"tags":[],"class_list":["post-3066","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-educators"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Unlocking the Secrets of Success: Effectively Evaluating Your Course or Program - Osmosis Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Unlocking the Secrets of Success: Effectively Evaluating Your Course or Program - Osmosis Blog\" \/>\n<meta property=\"og:description\" content=\"In today&#8217;s Osmosis blog, Dr. Sean Tackett addresses how to evaluate a course or program by explaining how to design an effective framework and highlighting how to avoid missing important issues. &nbsp;&nbsp; We all have blind spots. Recently, when working with colleagues on an article about &#8220;blind spots&#8221; in medical education [1], I was reminded [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\" \/>\n<meta property=\"og:site_name\" content=\"Osmosis Blog\" \/>\n<meta property=\"article:published_time\" content=\"2023-11-06T14:33:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-10-03T22:19:46+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/unlocking-the-secrets-of-success.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1080\" \/>\n\t<meta property=\"og:image:height\" content=\"1080\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/webp\" \/>\n<meta name=\"author\" content=\"Sean Tackett, MD, MPH\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":[\"Article\",\"BlogPosting\"],\"@id\":\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\"},\"author\":{\"name\":\"Sean Tackett, MD, MPH\",\"@id\":\"https:\/\/www.osmosis.org\/blog\/#\/schema\/person\/0d4c216d4d399602c2eabc96708538bf\"},\"headline\":\"Unlocking the Secrets of Success: Effectively Evaluating Your Course or Program\",\"datePublished\":\"2023-11-06T14:33:00+00:00\",\"dateModified\":\"2025-10-03T22:19:46+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\"},\"wordCount\":1514,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\/\/www.osmosis.org\/blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/unlocking-the-secrets-of-success.webp\",\"articleSection\":[\"Educators\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\",\"url\":\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\",\"name\":\"Unlocking the Secrets of Success: Effectively Evaluating Your Course or Program - Osmosis Blog\",\"isPartOf\":{\"@id\":\"https:\/\/www.osmosis.org\/blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/unlocking-the-secrets-of-success.webp\",\"datePublished\":\"2023-11-06T14:33:00+00:00\",\"dateModified\":\"2025-10-03T22:19:46+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#primaryimage\",\"url\":\"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/unlocking-the-secrets-of-success.webp\",\"contentUrl\":\"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/unlocking-the-secrets-of-success.webp\",\"width\":1080,\"height\":1080},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.osmosis.org\/blog\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Unlocking the Secrets of Success: Effectively Evaluating Your Course or Program\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.osmosis.org\/blog\/#website\",\"url\":\"https:\/\/www.osmosis.org\/blog\/\",\"name\":\"Osmosis Blog\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.osmosis.org\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.osmosis.org\/blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.osmosis.org\/blog\/#organization\",\"name\":\"Osmosis Blog\",\"url\":\"https:\/\/www.osmosis.org\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.osmosis.org\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/07\/OsmosisElsevierStacked.png\",\"contentUrl\":\"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/07\/OsmosisElsevierStacked.png\",\"width\":1276,\"height\":596,\"caption\":\"Osmosis Blog\"},\"image\":{\"@id\":\"https:\/\/www.osmosis.org\/blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.osmosis.org\/blog\/#\/schema\/person\/0d4c216d4d399602c2eabc96708538bf\",\"name\":\"Sean Tackett, MD, MPH\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.osmosis.org\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/8f96b59d29c8e951b319478ec43c5a70811e2eb73fe187322668e64084d8b264?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/8f96b59d29c8e951b319478ec43c5a70811e2eb73fe187322668e64084d8b264?s=96&d=mm&r=g\",\"caption\":\"Sean Tackett, MD, MPH\"},\"description\":\"Author: Sean Tackett, MD, MPH, Associate Professor, Johns Hopkins Bayview Medical Center &amp; Research Director, Osmosis from Elsevier\",\"url\":\"https:\/\/www.osmosis.org\/blog\/author\/seantackett\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Unlocking the Secrets of Success: Effectively Evaluating Your Course or Program - Osmosis Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program","og_locale":"en_US","og_type":"article","og_title":"Unlocking the Secrets of Success: Effectively Evaluating Your Course or Program - Osmosis Blog","og_description":"In today&#8217;s Osmosis blog, Dr. Sean Tackett addresses how to evaluate a course or program by explaining how to design an effective framework and highlighting how to avoid missing important issues. &nbsp;&nbsp; We all have blind spots. Recently, when working with colleagues on an article about &#8220;blind spots&#8221; in medical education [1], I was reminded [&hellip;]","og_url":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program","og_site_name":"Osmosis Blog","article_published_time":"2023-11-06T14:33:00+00:00","article_modified_time":"2025-10-03T22:19:46+00:00","og_image":[{"width":1080,"height":1080,"url":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/unlocking-the-secrets-of-success.webp","type":"image\/webp"}],"author":"Sean Tackett, MD, MPH","twitter_card":"summary_large_image","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":["Article","BlogPosting"],"@id":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#article","isPartOf":{"@id":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program"},"author":{"name":"Sean Tackett, MD, MPH","@id":"https:\/\/www.osmosis.org\/blog\/#\/schema\/person\/0d4c216d4d399602c2eabc96708538bf"},"headline":"Unlocking the Secrets of Success: Effectively Evaluating Your Course or Program","datePublished":"2023-11-06T14:33:00+00:00","dateModified":"2025-10-03T22:19:46+00:00","mainEntityOfPage":{"@id":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program"},"wordCount":1514,"commentCount":0,"publisher":{"@id":"https:\/\/www.osmosis.org\/blog\/#organization"},"image":{"@id":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#primaryimage"},"thumbnailUrl":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/unlocking-the-secrets-of-success.webp","articleSection":["Educators"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program","url":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program","name":"Unlocking the Secrets of Success: Effectively Evaluating Your Course or Program - Osmosis Blog","isPartOf":{"@id":"https:\/\/www.osmosis.org\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#primaryimage"},"image":{"@id":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#primaryimage"},"thumbnailUrl":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/unlocking-the-secrets-of-success.webp","datePublished":"2023-11-06T14:33:00+00:00","dateModified":"2025-10-03T22:19:46+00:00","breadcrumb":{"@id":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#primaryimage","url":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/unlocking-the-secrets-of-success.webp","contentUrl":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/unlocking-the-secrets-of-success.webp","width":1080,"height":1080},{"@type":"BreadcrumbList","@id":"https:\/\/www.osmosis.org\/blog\/unlocking-the-secrets-of-success-effectively-evaluating-your-course-or-program#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.osmosis.org\/blog"},{"@type":"ListItem","position":2,"name":"Unlocking the Secrets of Success: Effectively Evaluating Your Course or Program"}]},{"@type":"WebSite","@id":"https:\/\/www.osmosis.org\/blog\/#website","url":"https:\/\/www.osmosis.org\/blog\/","name":"Osmosis Blog","description":"","publisher":{"@id":"https:\/\/www.osmosis.org\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.osmosis.org\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.osmosis.org\/blog\/#organization","name":"Osmosis Blog","url":"https:\/\/www.osmosis.org\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.osmosis.org\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/07\/OsmosisElsevierStacked.png","contentUrl":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/07\/OsmosisElsevierStacked.png","width":1276,"height":596,"caption":"Osmosis Blog"},"image":{"@id":"https:\/\/www.osmosis.org\/blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/www.osmosis.org\/blog\/#\/schema\/person\/0d4c216d4d399602c2eabc96708538bf","name":"Sean Tackett, MD, MPH","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.osmosis.org\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/8f96b59d29c8e951b319478ec43c5a70811e2eb73fe187322668e64084d8b264?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/8f96b59d29c8e951b319478ec43c5a70811e2eb73fe187322668e64084d8b264?s=96&d=mm&r=g","caption":"Sean Tackett, MD, MPH"},"description":"Author: Sean Tackett, MD, MPH, Associate Professor, Johns Hopkins Bayview Medical Center &amp; Research Director, Osmosis from Elsevier","url":"https:\/\/www.osmosis.org\/blog\/author\/seantackett"}]}},"jetpack_featured_media_url":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/unlocking-the-secrets-of-success.webp","jetpack-related-posts":[{"id":8721,"url":"https:\/\/www.osmosis.org\/blog\/skills-that-set-you-apart-becoming-a-remarkable-clinician","url_meta":{"origin":3066,"position":0},"title":"Skills That Set You Apart: Becoming a Remarkable Clinician","author":"Lynda Malcolm, MD, JD","date":"October 28, 2025","format":false,"excerpt":"What sets a remarkable clinician apart? Beyond medical knowledge, it\u2019s empathy, adaptability, continuous growth, and authentic connection that transform care and inspire patients and teams alike.","rel":"","context":"In &quot;Allopathic Medicine (MD)&quot;","block_context":{"text":"Allopathic Medicine (MD)","link":"https:\/\/www.osmosis.org\/blog\/category\/medicine"},"img":{"alt_text":"Skills That Set You Apart: Becoming a Remarkable Clinician","src":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2025\/10\/Skills_That_Set_You_Apart_Becoming_a_Remarkable_Clinician.png","width":350,"height":200,"srcset":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2025\/10\/Skills_That_Set_You_Apart_Becoming_a_Remarkable_Clinician.png 1x, https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2025\/10\/Skills_That_Set_You_Apart_Becoming_a_Remarkable_Clinician.png 1.5x, https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2025\/10\/Skills_That_Set_You_Apart_Becoming_a_Remarkable_Clinician.png 2x"},"classes":[]},{"id":2470,"url":"https:\/\/www.osmosis.org\/blog\/financial-strategies-for-health-professional-students-to-save-and-manage-money-better","url_meta":{"origin":3066,"position":1},"title":"Financial Strategies for Health Professional Students to Save and Manage Money Better","author":"Fergus Baird, MA","date":"January 8, 2021","format":false,"excerpt":"In today\u2019s guest post from Surviving College, we will be addressing the big elephant in the room that we wish was invisible\u2014money! During medical school, we tend to ignore financials until after graduation, which can be overwhelming and stressful. It\u2019s important to know what you need, how much to borrow,\u2026","rel":"","context":"In &quot;Health &amp; Wellness&quot;","block_context":{"text":"Health &amp; Wellness","link":"https:\/\/www.osmosis.org\/blog\/category\/health-and-wellness"},"img":{"alt_text":"","src":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/financial-strategies-for-health-professional-students-to-save-and-manage-money-better.webp","width":350,"height":200,"srcset":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/financial-strategies-for-health-professional-students-to-save-and-manage-money-better.webp 1x, https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/financial-strategies-for-health-professional-students-to-save-and-manage-money-better.webp 1.5x, https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/financial-strategies-for-health-professional-students-to-save-and-manage-money-better.webp 2x"},"classes":[]},{"id":1953,"url":"https:\/\/www.osmosis.org\/blog\/tips-for-piloting-the-flipped-classroom-in-your-course-or-program","url_meta":{"origin":3066,"position":2},"title":"Tips for Piloting the Flipped Classroom in Your Course or Program","author":"Amin Azzam, MD, MA &amp; Catherine Johnson, MA","date":"July 20, 2020","format":false,"excerpt":"Thinking of piloting a flipped classroom? Discover practical advice on planning, evaluating, and refining your pilot to enhance student learning and gain faculty support.","rel":"","context":"In &quot;Educators&quot;","block_context":{"text":"Educators","link":"https:\/\/www.osmosis.org\/blog\/category\/educators"},"img":{"alt_text":"Tips for Piloting the Flipped Classroom in Your Course or Program","src":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/tips-for-piloting-the-flipped-classroom-in-your-course-or-program.webp","width":350,"height":200,"srcset":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/tips-for-piloting-the-flipped-classroom-in-your-course-or-program.webp 1x, https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/tips-for-piloting-the-flipped-classroom-in-your-course-or-program.webp 1.5x, https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/tips-for-piloting-the-flipped-classroom-in-your-course-or-program.webp 2x"},"classes":[]},{"id":1449,"url":"https:\/\/www.osmosis.org\/blog\/words-matter-the-power-of-inclusive-language-in-medicine","url_meta":{"origin":3066,"position":3},"title":"Words Matter: The Power of Inclusive Language in Medicine","author":"Marina Horiates Kerekes, MD","date":"November 8, 2021","format":false,"excerpt":"As healthcare professionals, you will be called on to continue learning and growing for the duration of your career. Yes, you\u2019ll know more as a seasoned worker than someone fresh out of school. However, you will also build up automatic responses and\u2014yes, it happens even to the best of us\u2014blind\u2026","rel":"","context":"In &quot;Allopathic Medicine (MD)&quot;","block_context":{"text":"Allopathic Medicine (MD)","link":"https:\/\/www.osmosis.org\/blog\/category\/medicine"},"img":{"alt_text":"Words Matter: The Power of Inclusive Language in Medicine","src":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/48.webp","width":350,"height":200,"srcset":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/48.webp 1x, https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/48.webp 1.5x, https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/48.webp 2x"},"classes":[]},{"id":1798,"url":"https:\/\/www.osmosis.org\/blog\/how-to-gain-administrator-and-faculty-support-for-flipped-classrooms","url_meta":{"origin":3066,"position":4},"title":"How to Gain Administrator and Faculty Support for Flipped Classrooms","author":"Amin Azzam, MD, MA &amp; Catherine Johnson, MA","date":"June 8, 2020","format":false,"excerpt":"The flipped classroom has become common in health education programs across the United States. As an administrator, course director, or faculty member in a program that hasn\u2019t yet implemented it, you may want to integrate this teaching strategy into your course or curriculum. But, in order to do that, you\u2026","rel":"","context":"In &quot;Educators&quot;","block_context":{"text":"Educators","link":"https:\/\/www.osmosis.org\/blog\/category\/educators"},"img":{"alt_text":"","src":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/how-to-gain-administrator-and-faculty-support-for-flipped-classrooms.webp","width":350,"height":200,"srcset":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/how-to-gain-administrator-and-faculty-support-for-flipped-classrooms.webp 1x, https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/how-to-gain-administrator-and-faculty-support-for-flipped-classrooms.webp 1.5x, https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/how-to-gain-administrator-and-faculty-support-for-flipped-classrooms.webp 2x"},"classes":[]},{"id":1892,"url":"https:\/\/www.osmosis.org\/blog\/how-to-encourage-self-directed-learning-to-increase-learning-outcomes","url_meta":{"origin":3066,"position":5},"title":"How to Encourage Self-Directed Learning to Increase Learning Outcomes","author":"Jennice Lavergne, MD","date":"January 30, 2023","format":false,"excerpt":"A well-established education practice that's evolved over the years, self-directed learning involves giving students the opportunity to manage their learning experience. Let's take a look at some effective self-directed learning strategies in today's Osmosis blog. Self-directed learning provides students with the agency to construct their knowledge, often in partnership with\u2026","rel":"","context":"In &quot;Educators&quot;","block_context":{"text":"Educators","link":"https:\/\/www.osmosis.org\/blog\/category\/educators"},"img":{"alt_text":"How to Encourage Self-Directed Learning to Increase Learning Outcomes","src":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/69.webp","width":350,"height":200,"srcset":"https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/69.webp 1x, https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/69.webp 1.5x, https:\/\/www.osmosis.org\/blog\/wp-content\/uploads\/sites\/2\/2024\/09\/69.webp 2x"},"classes":[]}],"jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.osmosis.org\/blog\/wp-json\/wp\/v2\/posts\/3066","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.osmosis.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.osmosis.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.osmosis.org\/blog\/wp-json\/wp\/v2\/users\/216"}],"replies":[{"embeddable":true,"href":"https:\/\/www.osmosis.org\/blog\/wp-json\/wp\/v2\/comments?post=3066"}],"version-history":[{"count":1,"href":"https:\/\/www.osmosis.org\/blog\/wp-json\/wp\/v2\/posts\/3066\/revisions"}],"predecessor-version":[{"id":3068,"href":"https:\/\/www.osmosis.org\/blog\/wp-json\/wp\/v2\/posts\/3066\/revisions\/3068"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.osmosis.org\/blog\/wp-json\/wp\/v2\/media\/3067"}],"wp:attachment":[{"href":"https:\/\/www.osmosis.org\/blog\/wp-json\/wp\/v2\/media?parent=3066"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.osmosis.org\/blog\/wp-json\/wp\/v2\/categories?post=3066"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.osmosis.org\/blog\/wp-json\/wp\/v2\/tags?post=3066"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}