Introduction

The World Health Assembly Resolutions 60.22, 68.15, and 72.16 all highlight the significant gap between the need for and the provision of emergency care that currently exists globally [, , ]. Low-income countries carry more than three times the burden of disease for emergency conditions in terms of disability-adjusted life years (DALYs) than do high-income countries, while emergency usage rates in low-income countries are 3% of those of high-income countries []. As more and more countries experience population and economic growth, globalization, rapid urbanization, and progression through the demographic transition, the demand for strong systems to address both the care and prevention of trauma, communicable diseases, and non-communicable diseases will only continue to grow.

Emergency care systems – which broadly include the provision of both acute and emergency care and services – are comprised of at least five major components: individual and community capacity, preparedness, and resilience; delivery of appropriate out-of-hospital care by laypersons; a means of access to formal services by the public; transport and/or delivery of appropriate pre-hospital care by trained professionals; and clinical care and referral networks [, ]. The specialty of emergency medicine (EM) – a unique discipline with a well-defined and universal set of technical and cognitive skills – has developed over the last 50 years to lead the provision of clinical care by training not only physicians, but also other healthcare personnel at all levels. Additionally, the specialty of EM also serves as a guide for the overall development of emergency care systems through a focus on core concepts and strategies aimed at reducing morbidity and mortality of emergent conditions and to provide secondary disease prevention [, , , , , ].

Although still a relatively young specialty, EM has been expanding rapidly across the globe, and more than 50 national EM organizations are now members of the International Federation for Emergency Medicine (IFEM) []. Although some concepts, such as burden of disease and resource availability, are unique to each local context, the specialty of EM provides a unique opportunity where partnerships can develop to share universal content as well as established resources in education and training relevant to high-resource settings, low-resource settings, or both. To date, the development of EM in many countries has occurred in part because of educational partnerships between nations or regions where one partner has more experience with EM as a specialty. Such partnerships can occur regardless of each country’s income level, but frequently involve partnerships between a high-income country and a low- or middle-income country (LMIC) [, , , ].

Though programs developed from such educational partnerships are increasingly common, there is little to describe their features. One review describes some of the features of training programs in LMICs, but it does not specifically focus on programs resulting from partnerships []. Additionally, there is some guidance in the literature as to how to approach the creation of these training programs as well as the overall development of EM, but this information is now outdated and there is little information specific to training and education [] In this systematic review, we aim to address this gap by highlighting the scope, content, and features of EM programs developed in LMICs through partnerships.

Methods

An electronic search using PubMed, Web of Science, CINAHL, and EMBASE was conducted for all available publications to the date of the search (30 August 2018) without restriction on the scope of the EM content, the training level of the learners (i.e. medical student, nurse, mid-level, physician), or the length of the program (defined here as short duration – up to one month, medium duration – between one month and one year, and long duration – more than one year). The search strings may be found in Supplement 1. We have defined an EM training program as “structured education and/or training in the methods, procedures, and techniques of acute or emergency care”. Inclusion criteria determined a priori were EM training programs developed in the hospital or clinical setting in an LMIC – as defined by the World Bank at the time of the search – and supported by at least one higher-resource international partnership []. In-hospital programs were targeted as, in our experience, partners often seek out institutions given the often more familiar workforce and resources as well as the perception that training is likely to have the highest impact in this setting. Manuscripts focusing only on pre-hospital or non-clinical providers were excluded. Manuscripts with a predominant focus on other specialties (i.e. obstetrics/neonatal care and emergency surgery) were excluded. Only manuscripts in English were considered. Systematic reviews and abstracts/posters were excluded. Two reviewers screened each abstract with conflicts resolved after a third review to determine the included manuscripts.

The included manuscripts were then scored by the reviewers in order to select and more closely examine a high-quality subset. Each manuscript was scored by two reviewers and manuscripts with scores differing by more than three points (n = 13) or that differed between reviewers across the threshold for inclusion (n = 19) were reviewed and scored a third time. Scoring (0–2 points for each category) focused on seven areas: manuscript design, overall quality, overall clarity, ethical considerations, significance, description and/or study of program attributes and/or learner or clinical outcomes, and type of providers (Supplement 2). The methods used for this scoring were adapted from methods established in other reviews in the field of global EM []. The reviewers’ scores were then averaged for a final score on each manuscript. On review of the average scores, the upper quartile was found to be designated by a score of 12 and above. Manuscripts were then labeled as ‘low-scoring’ (below 12) or ‘high-scoring’ (12 or above).

Abstracts were screened using Covidence (Melbourne, Australia). Statistical analyses (Krippendorf’s alpha for nominal and for interval data for two or more reviewers) were done using Microsoft Excel and Stata/IC v15.1 (StataCorp; College Station, Texas USA). The study was registered and approved by PROSPERO (Registration: CRD42018100194).

Results

The search produced 7702 results. A total of 2433 duplicates were removed prior to screening, leaving 5269 studies to be screened by two reviewers. From this, 105 manuscripts met inclusion criteria for scoring. Of these, four were found to be in high income countries, six could not be obtained, and one was found to be a duplicate, leaving 94 manuscripts in the final analysis (Figure 1). Programs in 42 countries are represented in these manuscripts (Figure 2).

Figure 1 

PRISM chart.

Figure 2 

Low- and middle-income countries with programs highlighted in the 94 abstracts.

Of these manuscripts, 30 focus on EM programs with a broad scope, 18 focus on trauma training, 17 on pediatric training, and 16 on ultrasound training. Most programs focus on physician-learners; however, 17 programs train physicians and nurses together, and 15 train multidisciplinary teams (physicians and/or nurses along with other clinical and non-clinical professionals and/or staff). Additionally, eight programs focus solely on nurses and six on medical students. Finally, more than half of the programs are of short duration. Only three are of medium duration, and 15 are of long duration (Table 1).

Table 1

Summary of the 94 included manuscripts.

CharacteristicsNumber of Manuscripts

Content

Broad EM30
Trauma18
Pediatrics17
Ultrasound16
Procedures5
Pediatric Trauma2
Disaster2
Toxicology1
Neurology1
CPR1
Maternal and Child Health1
Learners

Physicians33
Physicians and Nurses17
Multidisciplinary*15
Nurses8
Medical Students6
Health Workers4
Physician Assistants/Nurse Practitioners1
Unspecified10
Program Duration

Short (up to 1 month)51
Medium (>1 month to 1 year)3
Long (>1 year)15
Unspecified25

* Physicians and/or nurses along with other clinical and non-clinical professions and/or staff.

The manuscripts were then scored in order to highlight a high-quality subset. When assessing the inter-rater reliability of the raw scores among the reviewers, the reviewers’ scores agreed +/–2 points 74.7% of the time (Krippendorff’s alpha 0.732). When assessing the inter-rater reliability to distinguish “low-scoring” from “high-scoring” manuscripts, the reviewers agreed 80.0% of the time (Krippendorff’s alpha 0.526). A total 26 manuscripts received an average score of 12 and above.

Overview of High-Scoring Manuscripts

Fifteen of the high-scoring manuscripts focus on seven specific content areas (ultrasound, trauma, pediatrics, pediatric trauma, neurological emergencies, toxicological emergencies). They span the years 2012–2018, are published in twelve journals, and highlight work in thirteen countries (Table 2) [, , , , , , , , , , , , , , ]. Eleven of the manuscripts discuss general EM programs. These span the years 1999–2018, are published in 10 different journals, and highlight work in nine countries (Table 3) [, , , , , , , , , , ]. The components of the eleven manuscripts on broadly focused EM training programs are further highlighted here. Post hoc review of the other 83 included manuscripts demonstrated that results and the conclusions drawn from the 11 high-scoring manuscripts were representative of the larger group.

Table 2

Overview high-scoring manuscripts on content-specific EM programs.

First AuthorJournalYear PublishedLow-resource SettingHigher-resource PartnerLearnersGeneral Overview (short: up to 1 month; medium: >1 month to 1 year; long: >1 year)

BeckerTrop Med Int Health2017GhanaUSAPhysiciansUltrasound, unspecified duration
Cioè-PeñaTrauma2017El SalvadorUSAPhysicians and NursesTrauma, short duration
CrousePediatr Emerg Care2016GuatemalaUSAPhysicians, Nurses, Medical Students, OthersPediatrics, short duration
DennyWorld J Emerg Med2018TanzaniaUSAPhysicians, Students, OthersUltrasound, short duration
HenwoodTrop Med Int Health2016RwandaUSA, CanadaPhysiciansUltrasound, short duration
KapoorEmerg Med J2016GuatemalaUSAPhysicians and NursesPediatric Trauma, short duration
KesingerInjury2014ColombiaUSAPhysiciansTrauma, unspecified duration
MerchantWorld J Surg2015MozambiqueUSAHospital Personnel, OthersTrauma, short duration
McCredieInt Health2018NepalCanada, UK, USAPhysiciansNeurological Emergencies, short duration
MeaneyResuscitation2012BotswanaUSAAll Healthcare ProvidersCPR, short duration
ReynoldsAfJEM2016Tanzania, MexicoUSAPhysiciansUltrasound, short duration
SenarathnaPLoS One2013Sri LankaAustraliaHospital StaffToxicological Emergencies, short duration
StolzTrop Med Int Health2015UgandaUSANursesUltrasound, long duration
TafoyaJ Emerg Med2017GhanaUSAPhysiciansUltrasound, short duration
WanjikuAfJEM2017KenyaUSAMedical StudentsTrauma, short duration

Table 3

Overview high-scoring manuscripts on broad EM programs.

First AuthorJournalYear PublishedLow-resource SettingHigher-resource PartnerLearnersGeneral Overview (short: up to 1 month; medium: >1 month to 1 year; long: >1 year)

AggarwalJ Emerg Trauma Shock2014IndiaUSAPhysiciansComprehensive long residency program
HammerstedtAnn Emerg Med2014UgandaUSANursesComprehensive long course; development of new provider level
KeyesAnn Emerg Med1999Costa RicaUSAPhysiciansComprehensive long residency program
LimAfr J Health Professions Educ2017TanzaniaUSA, South AfricaPhysiciansComprehensive long residency program
MeshkatBMC Med Educ2018EthiopiaCanadaPhysiciansComprehensive long residency program
MahadevanAEM Educ Train2018UgandaUSAMedical StudentsOnline vs classroom-based training; short course
NiyogiAfJEM2015GhanaUSAPhysician AssistantsTask-shifting; short course
PeanAnn Global Health2015HaitiUSAMedical StudentsBilateral exchange; short course
ReynoldsJ Public Health Policy2012TanzaniaUSA, Canada, South AfricaPhysicians and NursesComprehensive training at multiple levels up to residency program level (medium and long)
RouhaniInt J Emerg Med2018HaitiUSAPhysiciansBridging the gap to residency programs; comprehensive medium-duration course
StanleyConfl Health2015Thailand/MyanmarUKNurses (and medics)Primary care setting/front line providers; short course

Broadly-focused EM Training Programs: Program Components

Participants include nurses (two programs), medical students (two programs), physician assistants (one program), physicians (five programs), and nurses and physicians together (one program). All of the manuscripts describe all or a subset of the following components: goals/objectives, program certification/recognition, curriculum outline/content, methods of assessment, funding, logistics, educational resources, outcomes, and challenges (Table 4).

Table 4

Program components from the selected manuscripts on broad EM programs.

First AuthorGoals and ObjectivesCertification/RecognitionCurriculum Outline/ContentMethods of AssessmentFundingLogisticsEducational ResourcesOutcomesChallenges

AggarwalTo provide guidelines for EM curricula in India – residency and medical studentFormal residency trainingCore topics and required procedures for residents outlined; off-service rotations (minimum two weeks); medical student rotation (one month); no specific academic activities for medical students; required Casualty (two weeks) or EM (four weeks) posting during internship; no specific academic activities for interns; academic activities are department-wideThesis requirement; end-of-rotation assessment; log book; final examination with theory and practical components with short-answer questions, short cases, procedural skills (simulated), and OSCEsNot discussedThree-year training program; institutional requirements for ED resources and capacity and EM instructors definedCalls for re-organization/re-structuring of existing resources; lists commonly used books and journals; reports essential list for departmental libraryClear requirements for institutions for the practice of and training in EMOngoing conflict and confusion with other specialty degrees such as trauma and surgery and critical care
HammerstedtTo deliver emergency care through non-physician providers (Emergency Care Practitioners, or ECPs) in rural, low-resource settingsEmergency Care Practitioner certificationGraduated clinical and educational responsibilities; research and quality improvement requirements; weekly conferences comprised of didactic lectures, simulation, and procedural skill laboratories First year (Junior ECP) – 40 hours per week in beside learning; three hours of conference per week Second year (Senior ECP) – lead the junior-level conferences; present morbidity and mortality lectures; bimonthly CME classes on topics such as teachingIntermittent quizzes and final written and oral examinations; procedure and patient follow-up logs; regular feedback with program director; oral case-based remediation test if needed; regular evaluation by visiting emergency physiciansNon-profit organization (Global Emergency Care)Two-year program, train-the-trainer modelCore competencies from Uganda’s Medical Education for Equitable Services to All Ugandans and the US’s Accreditation Council for Graduate Medical Education Outcome Project; content developed by global emergency care physicians, the hospital medical superintendent, and faculty from Mbarara University and the Ministry of HealthEmergency care practitioners trained; plans to monitor patient outcomes and to expand to other sitesTracking outcomes; expansion to other sites; funding; continued international faculty support
KeyesTo develop EM as a specialty in Costa RicaCertificate for the Faculty Preparation Course; formal residency trainingFaculty Preparation Course: review of core EM topics and instruction in teaching techniques – two hours on case review and journal club and four hours of lectures as well as clinical rotations (200 hours) and workshops; two-thirds of lectures in flipped classroom format Residency: overlap with the Faculty Preparation Course as well as a preceptor program and weekly grand roundsWritten and oral examinations monthlyProject HOPE, People-to-people Health Foundation and USAIDFaculty Preparation Course on-site by international faculty (one year) followed by the residency program (three years) supported by the first faculty for at least five years; learners included foreign physiciansACLS, ATLS, PALS; US residency materials adapted to the local setting14 graduates from the residency as of 1999Attrition; payment for/status of physicians after graduation
LimTo determine the acceptability of small-group learning in EM trainingFormal residency trainingInitially a lecture-based format in 2010 and redesigned to include small-group learning (40% of the curriculum) in 2014 including case-based seminars, procedure labs, and resuscitation simulationsDescribed elsewhere – written, oral and practical examinations; quantitative and qualitative surveyDescribed elsewhere – Abbott Fund Tanzania along with a departmental business plan for financial sustainabilitySmall groups done weekly (seminars) or 1–2 times per month (procedure labs, simulations) with an instructor-learner ratio of 4-6:1Described elsewhere – African Federation for Emergency Medicine; International Federation for Emergency MedicineSmall groups more effective at improving clinical practice and preferred for enjoyment of learning and peer- and instructor-relationship building; preferred by learners with more experienceNovel type of learning; some sessions remain too “lecture-like”; relationship building may be difficult across learner levels
MeshkatTo develop and deliver comprehensive EM residency training; specific objectives outlined in the manuscriptFormal residency trainingClinical, Clinical Epidemiology, and EM Administration streams; didactics (separated into blocks), beside teaching, simulation, procedural sessions, and journal club; three half days a week for three months of the year; off-service rotations; formal faculty-resident mentorship program; monthly video conferencingSession and rotation evaluations; written and practical examinationsUniversity-based funding; Grand Challenges Canada; International Development Research Centre; hospital-based fundingThree-year program with annually repeating junior lecture series and bi-annually repeating senior series; three one-month teaching trips by visiting faculty/senior residents; briefings for visiting faculty; curriculum co-director oversightCore content based on facility assessment, learner needs assessment, and evaluation of disease burden; free and open-access EM-specific materials listed; University of Toronto postgraduate medical education documents used to develop evaluation methodsThe program is in its seventh year as of 2018 with 34 graduates, 20 working in EDs throughout Ethiopia, and 25 modules published onlineDevelopment of content by outside experts leads to discordance with local practice and resources; the program was time and resource-intensive in first three years; gaps in visiting faculty led to low morale; internet connection with teleconferencing occasionally poor
MahadevanTo determine differences in knowledge acquisition between online and classroom-based teaching on EM conceptsNone20 modules; 10–15-minute videos or in-person teaching; case-basedMultiple choice and free-response questionsUniversity-based grantThe online course was offered during 10 weeks of the academic year and the classroom-based course was completed over one week during the school breakNovel course developed by Stanford physicians; clips from the show ER Both groups improved their scores on the post-test with no significant difference overall between the two groupsHigh numbers of late enrollees and attrition, especially in online course; the online group post-test was delayed by three months
NiyogiTo increase knowledge and to allow for task-shifting in the delivery of emergency care by teaching physician assistants (PAs) to identify and stabilize patients with acute conditions; focus on ABCsIn-service training in the Ghana Health ServiceDidactic lectures, problem- and case-based small group sessions, skill stations, simulations, laminated algorithms, and a tabletop mass casualty incident exercise; initial training of trainers and supervision of initial trainings by international facultyWritten testing; observation of learners; case review; simulationsNot describedNine-day trainer training with a refresher six months later; five-day in-service trainings led by trainers in groups of 2–3ABCCC approach from the Integrated Management of Adolescent and Adult Illnesses and the Integrated Management of Childhood Illnesses; Ghana Standard Treatment GuidelinesAll post-test scores improved from pre-test scores; the trainer refresher pre-test scores fell nearly to initial pre-test levels, but regional pre-test refresher scores stayed relatively high; 22 initial senior trainers, 39 enrolled in initial regional coursesDecay in knowledge over time; minimal differences in knowledge between trainers and trainees; resource limitations at non-training sites; scope of practice limitations for PAs; lack of familiarity with leading/facilitating case-based methodologies and simulation; refresher courses delayed too long; inability for trainees to leave clinical requirements for the training
PeanTo increase knowledge and confidence in emergency response skills using a near-peer modelBLS certificationBLS (three days); EM Module – lectures and skills sessions (two days)Written examination and observed practical skills examination; fund of knowledge tests and self-efficacy surveys; one-year follow up surveySelf-funded and/or sponsored by private donations as well as Doctor’s Hospital at Renaissance in Edinburg, Texas, and the Icahn School of Medicine at Mount Sinai in New York, New YorkOne week annually for two years; student to instructor ratio 3:1; follow up survey given during the second year; lectures in the morning followed by skills sessions in the afternoonBLS resources supplied by the Regional Emergency Medical Services Council of New York City; STRAKER Translations for translating written material; EM Module from the introductory course at Icahn School of Medicine at Mount SinaiImprovements in fund of knowledge and self-efficacy test scoresUnexpected scheduling changes; language barrier; difficulty with maintaining continuity and connection among cohorts; high levels of non-completion and absenteeism; difficulties in communicating expectations; limited access to electricity
ReynoldsTo provide multiple levels of training to provide emergency careFormal residency training – Master of Medicine trackInternational faculty with transition to local faculty; competency-based; half of the time is spent on rotations in other specialtiesWritten multiple choice questions and essay exam; oral case-based exam; observed clinical exam (OSCE) with case presentation; professional performance auditsAbbott Fund Tanzania along with a departmental business plan for financial sustainability10-module nursing curriculum; 1-year registrar program; 3-year residency programAfrican Federation for Emergency Medicine; International Federation for Emergency Medicine90% of nurses have completed the program; residency graduates since 2013; credentialed registrarsDifferences in scope of practice in low-resource settings – curricula and off-service rotations must be modified accordingly; culture of practice slow to change
RouhaniTo address a gap in human resources and knowledge in EM until more physicians are able to complete formal residency programsFormal certificate with the Ministry of Health and National Medical SchoolDidactic lectures, simulation, journal club, morbidity and mortality conference, skill sessions clinical supervision, and development and delivery of one lecture; learners comprised of physicians from multiple hospitals; international and national facultyAttendance of 75%, 180 supervised clinical hours, written pre- and post-test, completed case and procedure logCourse free of charge; participants retained full salary; non-local participants provided food and housing; subsidized in-country expenses for visiting faculty6-month course; 96-hour didactic program conducted every other week; eight visiting faculty volunteering 3–4 weeksUse of established residency resources; ACLS and PALS resources11/14 graduates still working in Emergency Departments one year later; average improvement of 15 points between pre- and post-test scoresFrequent turn-over of clinical supervisors; resource limitations at non-training sites; views of staff/culture of institution; lack of curriculum flexibility; varied baseline knowledge; language barrier
StanleyTo improve competence in assessment and management of emergent conditionsNoneScenario-based drills/training with whiteboard and reference cards; focus on ABCDEObserved scenarios (OSCE) and feedback form; pre-assessment; 1–2-week post-assessment and 8-week assessmentNot describedThree sites; four days at each site (pre-assessment, training, post-assessment, 8-week assessment) with two identical sessions dailyPreviously used local training tools and instructor experienceAssessment scores and self-reported confidence scores all improved after the interventionAttendance low

Goals and Objectives

Each of the eleven programs conducted formal needs assessments and/or had focus group discussions to identify learning gaps and to determine the content, style, and/or duration of each program, fulfilling the first two steps Kern et al.’s six-step model for curriculum development []. These efforts drew upon the strengths and experiences of the instructors while considering the knowledge level of the learners and using familiar teaching styles and/or providing orientation to new instructional methods. One manuscript highlights a pilot study prior to full implementation of a program []. Three studies highlight instructor (both international and local) development and orientation prior to commencement of the program [, , ].

Certification/Recognition

More than half of the manuscripts discuss alignment with local or national governing bodies, such as the Ministry of Health (MoH) regarding formal recognition, licensing, and/or certification of their respective programs.

Curriculum Outline/Components

The curricula highlighted in these manuscripts span short, foundational programs to medium-length programs with abbreviated, comprehensive EM curricula to full-length residency programs (of at least three years). All offer mixed learning methods ranging from traditional didactic lectures and small group discussions (i.e. journal clubs and case-based sessions) to hands-on practical sessions and workshops, such as simulation and procedural training. Curricula are often organized into blocks or modules by topics or organ systems. Longer programs allocate one to three half-days every one or two weeks for learning sessions in addition to daily bedside clinical teaching. Volunteer patients, mannequins, laminated algorithms, white boards, and other simulation materials as well as video/online materials, handbooks, and textbooks are highlighted as curriculum tools. Many programs incorporate pediatrics as well. All residency programs list the requirement of off-service rotations, such as surgery, anesthesia, and critical care. Only one manuscript offers extensive online access to their curriculum map and resources []. One of the short programs emphasizes the need for refresher courses, particularly when limited curricula are offered and/or baseline knowledge is varied or limited []. One manuscript specifically evaluates the acceptability of a novel-to-context learning modality (small group sessions) within the overall program [].

Methods of Assessment

All programs have a written component of assessment. These examinations consist of multiple-choice questions, short-answer, and/or essay questions. Many manuscripts highlight programs that also have practical examinations – skills stations, oral and/or case-based examinations as well as objective structured clinical examinations (OSCEs). Longer programs also often track attendance and require case and/or procedure logs with minimum required numbers. Minimum passing requirements for examinations and attendance, when specified, range from 70–80%. There are often end-of rotation evaluations and performance audits, especially for residency programs with off-service rotations. There is usually ongoing informal feedback and mentorship. One program mentions requiring a thesis [].

Funding

Three of the 11 manuscripts do not discuss how their programs are supported, while the others note a combination of private donors, non-profit organizations, healthcare organizations, and funding from universities in higher-resource settings. Manuscripts that mention their funding sources note a mix of self-funding or subsidized funding for international faculty. Among the larger funding sources listed are the Abbott Fund, USAID, Grand Challenges, and Project HOPE. Salary for learners in residency programs and fees for learners for non-residency programs are less clear – at least one program notes that there are no fees for their learners, and those who had to travel for the program received room and board [].

Logistics

All of the programs involve international visiting faculty for ongoing full or supervisory support either in person and/or via teleconferencing, messaging, or other methods of remote engagement. Visiting faculty contributions are described as ranging from one week up to multiple years onsite and/or remotely. Longer programs tend to have curricula that repeat one or more times over the course of the program. Train-the-trainer techniques are used in two of the programs [, ]. Two programs mention their learner-to-instructor ratio for hands-on sessions (a range of 3–6:1) [, ]. One program is structured to have two identical sessions daily in order to accommodate the learners, who must provide continuous coverage in the clinical setting [].

Educational Resources

Content for the curricula is drawn from a variety of sources – usually initially from EM content belonging to the high-resource partner. Specific materials and organizations listed among the programs for reference include basic life support (BLS), advanced cardiac life support (ACLS), advanced trauma life support (ATLS), pediatric advanced life support (PALS), textbooks (specifically Tintinalli, Rosen, and Goldfrank, among others), World Health Organization (WHO) resources (such as Integrated Management of Adolescent and Adult Illness and Integrated Management of Childhood Illnesses), Canadian Association of Emergency Physicians (CAEP), American College of Emergency Physicians (ACEP), IFEM, Society for Academic Emergency Medicine (SAEM), African Federation for Emergency Medicine (AFEM), European Society for Emergency Medicine (EuSEM), World Association for Disaster and Emergency Medicine (WADEM), Australasian Society for Emergency Medicine (ASEM), Consortium of Universities for Global Health (CUGH), Johns Hopkins Global Health, international EM journals (i.e. International Journal of Emergency Medicine), and American and Canadian graduate medical education (GME) resources.

Outcomes

Knowledge acquisition, clinical performance, and/or learner confidence/self-assessment are among the outcomes listed for almost all of the programs. All programs conduct immediate assessments; however, many of the programs also assess knowledge retention at a variety of time points: eight weeks, three months, six months, and one year. Additionally, some programs highlight the number of graduates as well as the number of individuals still practicing in EM. None of the program outcomes extend beyond the learner, although future studies of clinical outcomes are mentioned in one manuscript [].

Challenges

Challenges common to many of the programs include establishing the status and culture of practice of EM in low-resource, novel settings. Additionally, the manuscripts describe how differences in scope, practice, and content between the high-resource and low-resource settings as well as among program sites within low-resource settings require translation and adaptation of any shared educational resources and techniques. Overall resource limitations for learning as well as practice materials are frequently noted. Language barriers (for both instruction and materials) as well as issues with remote connection and use of local and remote technologies are also highlighted. Additionally, lack of continuity and connection between learners and the rotating visiting faculty – who may be present in person for as little as one week – leads to reduced engagement and morale. Decay in knowledge, especially after short programs, is also a concern, with re-assessment between 2–3 months highlighted as potentially an ideal time for re-assessment or refresher training. Difficulties with both learner (e.g. attendance given the requirement of ongoing continuous clinical duties still required during many of the programs) and curriculum flexibility leads to attrition for many programs. There are also ongoing concerns regarding sustainable funding highlighted in several of the manuscripts – for the program, for visiting faculty, as well as for learners/graduates.

Discussion

These manuscripts describe many types of EM programs being implemented via partnerships worldwide to train in-hospital personnel critical for the overall development of emergency care systems – from short, focused courses on topics such as ultrasound training or trauma training to full residency programs. The most established programs are those that are of at least one year in duration and those with formal integration into the healthcare and/or medical education system of the country (e.g. supported by the MoH). These programs can then offer official certification and/or credentialing to ensure that graduates will have both potential positions and financial security as well as a career path as EM develops and the culture of practice changes.

All of the programs involve on-site and/or remote international faculty for varying lengths of time; however, programs in which at least a core subset of faculty are involved in face-to-face teaching through the duration of the program foster stronger partnerships and allow for continuity of evaluation as well as continuous improvement and adaptation of the program. Given the differences in resources and culture of practice, all visiting faculty need at least prior experience in education/training and low-resource environments and/or a comprehensive orientation to the site prior to providing instruction. One manuscript describes the challenges of conflicting expectations between instructors and learners due to the limited preparation and experience by the visiting faculty [].

Furthermore, the use of international faculty is rarely sustainable, especially when support for these faculty is not available. Programs that involve a train-the-trainer component as well as faculty development are essential, although limitations of these models (especially dilution of instruction) must be kept in mind and addressed using other mechanisms such as refresher courses and mentorship or preceptor programs. Additionally, given the increasing familiarity with and use of technology, non-traditional training mechanisms such as the use of messaging applications and other mobile technology-based training tools should be considered, especially as they can be effective mechanisms to extend training beyond face-to-face interactions and/or to continue training during protracted and/or complex emergencies [, , ].

These programs also highlight the inability to simply transfer EM curricula from one setting to another. Some fundamental concepts can be shared, as is evidenced by international guidelines for curricula, and there are several groups that have offered open-access materials that are already adapted to low-resource settings to varying degrees (Table 5). In order to be effective, however, the development of curricula – whether abbreviated or a full residency program – must be preceded by needs assessments, focus-group discussions, and knowledge of the epidemiology and burden of disease as well as the culture of practice, instruction, learning, and assessment of the implementation site [, , ]. Additionally, language barriers must be overcome both in instruction as well as in written and electronic materials []. Finally, there must be inter-sectoral engagement and collaboration between the health and education sectors in order to recruit, develop, and sustain a quality workforce that is matched to overall service delivery capacity and population needs [].

Table 5

Sample list of curricula and content resources.

OrganizationResourcesWebsite*

Global Health Emergency Medicine (GHEM)Teaching moduleshttp://ghem.ca/modules/
African Federation for Emergency Medicine (AFEM)Curricula, lecture bank, ultrasound lecture bankhttps://afem.africa/resources/
World Health Organization (WHO)Full short coursehttps://www.who.int/emergencycare/publications/Basic-Emergency-Care/en/
International Student Association of Emergency Medicine (ISAEM) and the International Emergency Medicine Education Project (iEM)Medical student resources https://isaem.net/
https://iem-student.org
International Federation for Emergency MedicineGeneral guidelines; curricula outlineshttps://www.ifem.cc/
OPENPediatricsPediatric-specific resourceshttps://www.openpediatrics.org/
Emergency Ultrasound TeachingUltrasound-specific resourceshttp://emergencyultrasoundteaching.com/
Free, Open-Access Medical Education ResourcesOne list of general resourceshttps://rebelem.com/focused-foamed-the-learners-lens/
American College of Emergency Physicians (ACEP) International SectionGeneral resources from an EM organizationhttps://www.acep.org/how-we-serve/sections/international-emergency-medicine/free-educational-resources/

* Accessed: May 2019; the authors do not specifically endorse any particular resource, nor do they verify the accuracy of the content listed at the sites above.

Finally, in order to continue to advance EM training and the overall provision of emergency care, programs must include training in quality improvement (QI) and research, topics not traditionally taught in many medical and nursing schools in low-resource settings. To illustrate this point, less than half of the programs mention a component of QI and/or research, and only two of the manuscripts have a local first author [, ]. Furthermore, in order to determine which methods of training are most effective, we must move beyond metrics regarding knowledge acquisition and attitude and eventually look to patient-, community-, and population-based outcomes []. Only three of the manuscripts evaluate patient and/or clinical outcomes as a result of their training programs [, , ].

Despite ongoing work to develop metrics and quality indicators for emergency care and research and to provide guidance in the development of emergency care systems (as evidenced by the WHO’s Emergency, Trauma and Acute Care Program), there is still very little research that has focused specifically on the impact of training programs [, , , , , , , , ]. These programs are an integral part of the foundation of a sustainable emergency care system, not only at the facility level, but indirectly within the community and the pre-hospital system as well, therefore, further investigation of and research on these programs is imperative to sustain and to continue to expand EM as a specialty and emergency care systems globally.

Limitations

Overall, we used only four search engines and excluded programs in the gray literature without peer review (i.e. abstracts) – an area in which many more programs are likely highlighted based on an informal review of the excluded abstracts. Also, our results are limited to manuscripts only in English. Additionally, the search terms used to define this rapidly changing and developing field were difficult to specify, leading to one additional manuscript that was identified on informal review that could have been included in this study []. Furthermore, partnerships are also not always made explicit in many manuscripts; since our study focused on programs developed through educational partnerships, we may have missed manuscripts in the screening process where this was not clearly defined []. This challenge further emphasizes the need for standardization of practice and sharing of knowledge and experience in this field. Finally, our scoring process was developed from tools used in other reviews and was not formally tested with our results; however, it has been used to evaluate literature in field of global EM, and post hoc review demonstrated that the conclusions drawn from the high-scoring manuscripts were representative of the larger group []. Despite these limitations, however, this study still identifies a broad range of EM training programs, and it highlights programmatic components essential for effective partnerships and successful implementation.

Conclusions

Training in EM is an essential component to developing strong emergency care systems. This study identifies a broad range of EM training programs developed through partnerships that are representative of the programs that exist globally and highlight programmatic components essential to the development of effective programs. Sharing knowledge and practice across high- and low-resource settings can be an effective mechanism for the global development of programs within a specialty, however significant adaptation to the educational setting as well as true investment and partnership must occur, even for short-term programs. Even when all of the complexities and components are addressed, there are still limitations to this practice. Short-term programs need to expand beyond the few topics that are represented now, and we must invest in comprehensive, long-term emergency care training and professional development programs. Finally, as tools and guidance regarding the development of emergency care systems increase, a strong focus on strengthening educational practices as well as evaluating their impact through research is imperative.

Additional Files

The additional files for this article can be found as follows:

Supplement 1

Search Strings. DOI: https://doi.org/10.5334/aogh.2681.s1

Supplement 2

Scoring Rubric. DOI: https://doi.org/10.5334/aogh.2681.s2