MedPharmRes
University of Medicine and Pharmacy at Ho Chi Minh City
Letter to Editor

Evidence-based medicine education improve clinical knowledge of 4th year medical students in the university of medicine and pharmacy at Ho Chi Minh City

Vo Minh Tuana,*, Bui Quoc Thangc,d, Truong Van Datb
aFaculty of Medicine, University of Medical and Pharmacy at University Ho Chi Minh City, Vietnam
bFaculty of Pharmacy, University of Medical and Pharmacy at University Ho Chi Minh City, Vietnam
cDepartment of cardiovascular surgery, Cho Ray Hospital, Ho Chi Minh city, Vietnam
dDepartment of cardiovascular surgery, University of Tsukuba, Tsukuba, Japan
**Address correspondence to this author Vo Minh Tuan at the Faculty of Medicine, University of Medical and Pharmacy at University Ho Chi Minh City, Vietnam; email: vominhtuan@ump.edu.vn

© Copyright 2018 MedPharmRes. This is an Open-Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/4.0/) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Received: Dec 24, 2017; Accepted: Apr 02, 2018; Accepted: Apr 03, 2018

Published Online: Mar 31, 2018

Abstract

Evidence based medicine (EBM) education is a modern method for medical students in clinical training based on the reasonable use of the best evidence in making decisions about individual patient’s treatment. EBM education syllabus teaches medical student how to integrate the clinical experience and patient examination with the simplest out-there analysis data for increasing the utilization of top quality clinical analysis in clinical deciding, this methodology requires new literature looking out and proof evaluating skills. Thus, replacing the recently educated method by EBM has more challenges, the new program ought to analysis fastidiously for evaluating the behavior changes, the development of clinical skills and analysis the ultimate examination score for evaluating the effectiveness of EBM program. The result show that active teaching proves to be statistically completely different and has robust impact toward the ultimate outcome. EBM educated method might improve clinical knowledge and application of PBL/EBM brings concerning higher scores compared to recently educated method.

Keywords: Evidence-based Medicine; Problem-based Learning; Medical Education Conference 2017

Evidence-based Medicine (EBM) has been proposed as the most significant intellectual advance in the process of clinical decision-making through searching and using the best available research information [1, 2]. This approach requires integration of new skills of clinicians, including effective literature searching, application of formal rules of evidence in evaluating the clinical literature and proper, scientific judgment on each individual patient’s health problem. The constant growth of medical knowledge, in particular the rapid development of clinical trials and observational studies, mandates that clinicians apply EBM in their practice [3]. However, it is clear that a large number of practicing clinicians fails to catch up with the explosion of EBM, probably due to lack of access or non-acceptance [4-11]. To address the gap, it is crucial that medical educators, preceptors, health policy makers integrate basic clinical epidemiology, probability and statistics, mega analysis and medical information into undergraduate and graduate curricula.

The growing important role of EBM has been well proven, yet to train students with this skill set is a hard job. Many medical education programs incorporating medical information appraisal and clinical epidemiology have been widely reported in the world [16-21]. The approach is largely employed in medicine residency journal clubs or fundamental reviews of literature [22-28]. The aim is to provide general clinical guidance highly available to health professionals. However, EBM teaching is often found to be disproportional with incomprehensive description of the method, the critical appraisal found insufficient leading to lack of effectiveness. Also, if too much attention is solely paid to basic knowledge on clinical epidemiology, or on critique skill or exploration of medical information from reference materials, then the journal clubs cannot equip medical students with EBM, the method strictly requires clinical expertise and understanding of individual patient’s clinical state, predicament, preferences before any clinical decision is made.

From middle 2007, due to the crowded medical students in hospital for clinical training and the short-age of lecturers, an initial attempt of incorporating EBM into case-based lectures in the Department of Obstetrics and Gynecology of University of Medicine and Pharmacy at Ho Chi Minh city (UMP) designed for 4th year students (Y4), who focus on symptomatology, diagnosis and monitoring with an extensive fund of clinical knowledge and high critical thinking capability. This pedagogical approach was called Problem Based Learning integrated EBM (PBL/EBM). PBL/EBM was based on the list of skills to be taught in replacement of part of lecture-based clinical theories, including self-identification of topics of importance, selfdirected learning, problem-based learning, self-motivation, and access to various sources of information, professional feedback taking and giving.

Despite the fact that EBM has been employed in developed countries for decades, the approach PBL/EBM was first introduced to UMP, this causes challenges in terms of obtaining experiences and expertise from other faculties as well as reference materials available about how EBM affects to clinical knowledge, comparing with recently educated method. To address this question, we applied the new PBL/EBM curriculum of obstetrics and gynecology clinical training on 2009 for Y4 students and then evaluated the behavior changes, the development of clinical skills and analyzed the final examination score for evaluating the effectiveness of EBM.

Surprisingly, Y4 students were taught with more empathy on how to use evidence from clinical studies to solve the clinical problems they were encountering, the behavior changes (question 1 and 2) was a significant increase (table 1). But the development of skills in EBM application in PBL (questions 3,4 and 5) were not statistically significant. It could be possible that the described outcome was due to lack of basic science knowldege such as biostatistics and scientific research methods on the part of student, or resulted from the inconsistency of epidemiology program taught earlier. The weak foundation of basic science knowldege made it difficult for students to build their skills upon because the criteria for a good skill set development include ability to formulate a focused, answerable clinical question when encountering a new clinical case, successfully searching relevant materials on PUBMED/MEDLINE, appraise the information presented in the clinical journals and applying evidence found from literature to the diagnosis of the clinical case of their concern. On the other hands, the three questions shared qualitative nature, thus, development of skills could be hard to measure. It demanded that quantitative survey be taken to assess adequately the skill development, for instance, case control and cohort survey.

Table 1. The behavior changes: n=259 students, scale of 0-6
Assessment questions Mean scores prior to intervention Mean scores post intervention P-value
1. Evidence-based literature reviews are critically important for the diagnosis of a patient’s health problem? 4.98 (±0.99) 5.15 (±1.09) 0.002*
2. Information assessment as a skill should be further prioritized? 4.86 (±1.11) 5.00 (±1.14) 0.050*
3. Self-evaluation of the ability of”interpretation of findings from a study” and adopt of its implication to your patient. 3.39 (±1.61) 3.35 (±1.50) 0.817
4. Do you often search for answers from reference materials to a clinical question? 4.31 (±1.47) 4.31 (±1.44) 0.967
5. Do you pay attention to research methodologies when reading a medical journal? 3.32 (±1.92) 3.43 (±1.83) 0.424

significant difference with p<0.05 Wilcoxon signed-rank test

Download Excel Table

Objective structured clinical examination (OSCE) was used as the standard method of assessment to evaluate the effectiveness of EBM. The results were statistically different between the two teaching methods. On a scale of 0-10 to each of 5 questions, the total PBL/EBM test score was 36.56; while the recently method test score was 32.55. The Y4 students in PBL/EBM curriculum may be increase their level of selfdirection, thus demonstrated better understanding, longer retention and better critical thinking skills in managing clinical cases, appropriate behavior and attitude in learning brought them more motivation to gain higher score. However, the limit of question test bank may affect to the possible answers of the questions in 6 clinical cases which had been introduced to earlier batches of students (table 2).

Table 2. The examination clinical test score: n=259 students, scale of 0-50
PBL/EBM Recently method P-value
OSCE 36.56 (±0.44) 32.55 (±0.42) 0.000*

significant difference with p<0.05

Nonparametric Wilcoxon signed-rank test

Download Excel Table

In summary, these result show that active teaching proves to be statistically different and has strong impact toward the final outcome of Y4 students’ clinical theory test result and evidence-based medicine educated method may improve clinical knowledge of Y4 medical students in UMP, application of PBL/EBM brings about higher scores compared to traditional educated method. With regard to the result from the assessment of behavior and attitude toward the new teaching approach, Y4 students are excited and look forward to expanding the PBL/EBM to all clinical disciplines. Thus, PBL/EBM active method should be standardized among all teaching units, collaborate with other medical schools to develop more PBL cases with higher quality and in more numbers, hold a pre-clinical session on how to analyze a scientific journal and introduce research designs, establish more control groups to assess effectiveness of this active teaching and learning method and school leadership reviews and supports implementation of PBL/EBM in all clinical disciplines.

METHOD

We conducted the outcome research study in Y4 students who underwent obstetrics and gynecology clinical training at the UMP on 2009 and exclude absent or not accepted participating. This type of study is designed for nonrandomized, un-blinded interventions. The choice is based on its strength in assessing effectiveness of a method prior and after an intervention on the same group of subjects. We measured the effectiveness of EBM by measuring the clinical skills and behavior; we used the pre-test questionnaire on the first day of Y4 students’ clinical training and the posttest on the last day of the 10-week clinical practice. For the measurement of learning performance, we employed objective structured clinical examination with a short circuit of 10 stations was set up with different clinical scenarios at each station. The students would be rated with the marking scheme from 0 to 10. The questions constructed for the first 5 stations had their focus on clinical theories using PBL/EBM method. The rest were built upon clinical theories guided in a traditional way. The Y4 students’ mean scores from the two sets of stations would be used as a criterion for comparison outcomes of the two different teaching methods.

REFERENCES

1.

Evidence-Based Medicine Working Group. Evidence-based medicine: a new approach to teaching the practice of medicine. JAMA. 1992; 268:2420-5

2.

Sackett DL, Rosenberg WMC. The need for evidence-based medicine. J R Soc Med. 1995; 88:620-4

3.

Ellis J, Mulligan I, Rowe J, Sackett DL. Inpatient medicine is evidence based. Lancet. 1995; 346:407-10

4.

Ayanian JZ, Hauptman PJ, Guadagnoli E, Antman EM, Pashos CL, McNeil BJ. Knowledge and practices of generalist and specialist physicians regarding drug therapy for acute myocardial infarction. N Engl J Med. 1994; 331:1136-42

5.

Brand DA, Newcomer LN, Freiburger A, Tian H. Cardiologists’ practices compared with practice guidelines: use of beta-blockade after acute myocardial infarction. J Am Coll Cardiol. 1995; 26:1432-6

6.

Soumerai SB, McLaughlin TJ, Spiegelman D, Hertzmark E, Thibault G, Goldman L. Adverse outcomes of underuse of beta-blockers in elderly survivors of acute myocardial infarction. JAMA. 1997; 277:115-21

7.

Covell DG, Uman GC, Manning PR. Information needs in office practice: are they being met?. Ann Intern Med. 1985; 103:596-9

8.

Osiobe SA. Use of information resources by health professionals: a review of the literature. Soc Sci Med. 1985; 21:965-73

9.

McKibbon KA, Haynes RB, Walker-Dilks CJ, et al. How good are clinical MEDLINE searches? A comparative study of clinical end-user and librarian searches. Comput Biomed Res. 1990; 23:583-93

10.

Weiss ST, Samet JM. An assessment of physician knowledge of epidemiology and biostatistics. J Med Educ. 1980; 55:692-7

11.

Berwick DM, Fineberg HV, Weinstein MC. When doctors meet numbers. Am J Med. 1981; 71:991-8

12.

Barondess JA. The future physician: realistic expectations and curricular needs. J Med Educ. 1981; 56:381-9

13.

Rafuse J. Evidence-based medicine means MDs must develop new skills, attitudes, CMA conference told. Can Med Assoc J. 1994; 150:1479-80.

14.

Accreditation Council for Graduate Medical Education. The Graduate Medical Education Directory. 79 Chicago, Ill: American Medical Association. 1997; Program requirements for residency education in internal medicine: special educational requirements.

15.

Physicians for the twenty-first century: report of the project panel on the general professional education of the physician and college preparation for medicine. J Med Educ. 1984; 59(pt 2):127-8 155-67.

16.

Cullinan TR. Teaching concepts in epidemiology. J Epidemiol Community Health. 1980; 34:201-3

17.

Mulvihill MN, Wallman G, Blum S. A seven year retrospective view of a course in epidemiology and biostatistics. J Med Educ. 1980; 55:457-9

18.

Knapp RG, Miller MC. Clinical relevance: an issue in biostatistical training of medical students. Med Educ. 1987; 21:32-7

19.

Radack KL, Valanis B. Teaching critical appraisal and application of medical literature to clinical problem solving. J Med Educ. 1986; 61:329-31

20.

Bennett KJ, Sackett DL, Haynes RB, Neufeld VR, Tugwell P, Roberts R. A controlled trial of teaching critical appraisal of the literature to medical students. JAMA. 1987; 257:2451-4

21.

Landry FJ, Pangaro L, Kroenke K, Lucey C, Herbers J. A controlled trial of a seminar to improve medical student attitudes toward, knowledge about, and use of the medical literature. J Gen Intern Med. 1994; 9:436-9

22.

Linzer M, Mercando A, Hupart KH. Role of a medical journal club in residency training. J Med Educ. 1986; 61:471-3

23.

Sidorov J. How are internal medicine residency journal clubs organized and what makes them successful?. Arch Intern Med. 1995; 155:1193-7

24.

Linzer M, DeLong ER, Hupart KH. A comparison of two formats for teaching critical reading skills in a medical journal club. J Med Educ. 1987; 62:690-2

25.

O’Sullivan PS, Jeremiah J, Wartman SA. Learner centered journal club teaches residents more about assessing the medical literature. Clin Res. 1991; 39:620A.

26.

Seelig CB. Affecting residents’ literature reading attitudes, behaviors, and knowledge through a journal club intervention. J Gen Intern Med. 1991; 6:330-4

27.

Linzer M, Brown JT, Frazier LM, DeLong ER, Siegel WC. Impact of a medical journal club on house-staff reading habits, knowledge, and critical appraisal skills: a randomized controlled trial. JAMA. 1988; 260:2537-41

28.

Woods JR, Winkel CE. Journal club format emphasizing techniques of critical reading. J Med Educ. 1982; 57:799-801