- Research article
- Open access
- Published:
Priority setting in the Brazilian emergency medical service: a multi-criteria decision analysis (MCDA)
BMC Medical Informatics and Decision Making volume 21, Article number: 151 (2021)
Abstract
Background
Despite the proven value of multicriteria decision analysis in the health field, there is a lack of studies focused on prioritising victims in the Emergency Medical Service, EMS. With this, and knowing that the decision maker needs a direction on which choice may be the most appropriate, based on different and often conflicting criteria. The current work developed a new model for prioritizing victims of SAMU/192, based on the multicriteria decision methodology, taking into account the scarcity of resources.
Methods
An expert panel and a discussion group were formed, which defined the limits of the problem, and identified the evaluation criteria for choosing a victim, amongst four alternatives illustrated from hypothetical scenarios of emergency situations—clinical and traumatic diseases of absolute priority. For prioritization, an additive mathematical method was used that aggregates criteria in a flexible and interactive version, FITradeoff.
Results
The structuring of the problem led the researchers to identify twenty-five evaluation criteria, amongst which ten were essential to guide decisions. As a result, in the simulation of prioritization of four requesting victims in view of the availability of only one ambulance, the proposed model supported the decision by suggesting the prioritization of one of the victims.
Conclusions
This work contributed to the prioritization of victims using multicriteria decision support methodology. Selecting and weighing the criteria in this study indicated that the protocols that guide regulatory physicians do not consider all the criteria for prioritizing victims in an environment of scarcity of resources. Finally, the proposed model can support crucial decision based on a rational and transparent decision-making process that can be applied in other EMS.
Background
Multicriteria Decision Analysis, MCDA is a tool capable of supporting decisions utilizing multiple criteria. The use of MCDA as a method to support the definition of priorities in health care is not new, researchers have shown its growing importance in the health field [1,2,3,4] especially within public health systems [5,6,7,8]; including recent studies that highlight the contribution of MCDA in the context of epidemic events such as COVID-19 [9,10,11,12,13,14,15]. The potential for the application of MCDA in the health field is due to the combination of restricted resources and the growing demands that have led decision-makers to address this issue more directly than in the past [16].
Despite the proven value of MCDA’s support in the health field, no models were found that used a multicriteria method to assist in prioritizing victims’ decisions at Emergency Medical Services, EMS. This is one of the most important health services, as it plays a vital role in saving people’s lives and reducing the rate of mortality and morbidity [17].
Despite the fact that the importance and sensitivity of decision-making in the field of EMS has been recognized by Operations Research scientists, emergency medical planners and health professionals who have studied strategic, tactical and operational problems for EMS since the 1960s [18], only monitoring, forecasting and location problems have been widely discussed [19,20,21,22,23]. Carvalho et al. [24] presents two generic approaches to optimize dispatch; and Belanger et al. [25] relocation decisions and thereby maximize the preparation of the system and a recursive simulation-optimization framework; however, it does not take into account fundamental criteria for the ambulance dispatch decision, such as those related to the victim’s severity and conditions, leaving a gap in the literature.
In Brazil, the solution for these problems is still a manual task, with responsibility for the dispatch decision attributed to the regulating physicians of the Mobile Emergency Care Service, SAMU/192, which is the mobile prehospital component of the Emergency Care System and Brazilian emergencies, in municipalities and regions throughout the national territory. The model proposed by the present work supports the decision to prioritize victims of SAMU/192 regulating doctors, and focuses on the so-called level 1 (red code of absolute priority), since they have the highest number of occurrences. Thus, throughout the text we will use SAMU/192 as a term equivalent to the Brazilian EMS.
The SAMU/192 strategy for sending ambulances follows protocols that are formulated based on criteria related to the victim’s severity level. Based on this information, generally, the victim who is closest to the available ambulance is treated. However, in an environment in which the demand exceeds the capacity of the available resources, a greatest number of attributes related to the alternatives ought to be evaluated; given that from a system overview, this decision can lead to a better area coverage, considering not only the immediate situation, but also possible future emergencies.
For instance, on considering two calls, in a scenario of scarcity of resources, in which the victims suffer from epileptic attacks [26, 27]; after assessing the victim’s health status, the regulatory physician (RP) classifies the call as Level 1, red code and authorizes the ambulance to be dispatched. However, only one ambulance is available to assist the victims. Given this scenario, when the regulatory protocols are not sufficient for the decision to prioritize victims, how to make the decision? What are the steps to be followed? Which victim to prioritize? When the protocol advises the ambulance to be sent and the doctor does not have the resources to care for the victims, what criteria would be used to assist this decision? The prioritization of victims must be carried out, making use of guiding criteria (protocols - dealing with criteria related to the victim’s health status) and criteria that influence the decision-making process (criteria related to the health system; support tools; victims’ details and external factors).
In such cases, which involve different criteria, the use of the multicriteria model developed will bring greater clarity, transparency and rationality, maximizing the benefit and minimizing the risk in the SAMU/192 environment. Hence, the current study presented the dispatch problem as a decision to prioritize victims and developed a new model for prioritizing victims of SAMU/192, in an environment of scarcity of resources based on multicriteria decision support methodology. The analysis and structuring of the problem revealed important criteria in the field of EMS. Mathematical modeling, with FITradeoff, suggested the best alternative amongst those analysed. It is believed that the proposed model could improve the efficiency of victim prioritization in the context of SAMU/192.
Multicriteria decision
A multicriteria decision problem occurs when the Decision Maker, DM, an individual over whom power and responsibility over the decision are attributed, is faced with a situation with at least two alternatives for action, so that choice between the courses of action available is driven by the desire to meet multiple objectives, conflicting with each other [28,29,30].
Before selecting and implementing any MCDA method, the limits of the problem to be addressed should be defined, given that the better the problem is defined, the more accurate the analysis result will be [31, 32]. This can be achieved by reviewing the literature on decision-making criteria, conducting qualitative research, and consulting experts [3].
As long as the problem was pre-defined, the objectives and criteria to assist in decision making were identified, and the decision maker’s rationality established, a multicriteria assessment method can be chosen to meet the conditions and needs to address the problem [29, 33].
Multicriteria model of deterministic additive aggregation
An additive model for aggregation uses a single synthesis criterion MCDA method, which presents as the main characteristic the aggregation of multiple criteria in a single synthesis [29], thus being situated in the context of compensatory rationality. In such model, uncertainty is considered in obtaining the vector of consequences x for each alternative a.
For the problem of choice, which defines the class of problems in which the objective is to support the decision through the choice of a subset of the action space, the solution of the additive model consists in the selection of the alternative that presents the highest global value v(a) [30]. As the contribution of the additive model to the single criteria methods of synthesis lies in the process of aggregating the criteria, in these methods the evaluation of the alternatives is carried out through the value function defined on the consequences, considering that each alternative is associated with a consequence vector x [29].
The greatest difficulty faced by the multicriteria decision support methodology lies in the evaluation and modelling of preferences [30]. However, preferences can be modelled by rules and logical relations [34,35,36]. With the knowledge about the preferences of the decision maker, a problem can be solved based on the additive model, being necessary two types of evaluation: the intracriteria and the intercriteria. The intracriteria evaluation aims to evaluate each alternative i for each criterion j, which leads to the value function \(v_j(a_i)\), the construction of the value function for each element is based on the evaluation of the consequences to be obtained. In the Intercriteria evaluation with the information \(v_j(a_i)\), the information that considers the combination of the different criteria is sought, and to find it, it is necessary to choose a method of aggregating criteria [29]. When the criteria are represented by different units, it is necessary to normalize these values, so that they are redefined on a scale from 0 to 1. Prior to the final recommendation, sensitivity analyses can be carried out to investigate whether the preliminary conclusions are robust or whether they are sensitive to changes in aspects of the model [32].
FITradeoff
Almeida et al. [37] proposed the Flexible and Interactive Tradeoff, FITradeoff method to address the problem of eliciting scale constants, which will occasionally be referenced also by criteria weights. In FITradeoff the scaling of the scale constants is based on the tradeoff procedure in which the values tradeoff are to be achieved, which is defined by the moment when the decision maker is indifferent to two consequences and you can be willing to exchange them [29, 37]. This procedure is adopted in the Tradeoff method [38, 39], which makes FITradeoff to be considered an extension of this.
In compensatory methods, the DM considers the compensations by criterion when comparing the alternative consequences [38, 39]. Operationalization through the Decision Support System (DSS), includes the following steps: 1. Intracriteria assessment; 2. Classification of criteria weights; 2.1. Attempt to solve the problem using the set of weights available; 3. The DM’s preferences are evaluated to arrive at the results [37].
The first part allows the weight space to be defined. Subsequently, the second part is started, it is possible to see the difference between the procedure and the traditional model, the DM is not required to define an exact value of \({(x_{l}^{i})}\), which denotes the result of the i criterion for which indifference is obtained between consequences, whereas the traditional method requires this procedure.
If the solution is not found, then the third stage begins, that is, that of assessing the preferences of the DM that can be divided into four stages: 3.1. Define values to test the weight distribution; 3.2. Asking the DM to indicate their preferences; 3.3. LPP computing; and 3.4. Finalization. Upon completion, these four steps constitute the main stage of FITradeoff. Thus, the objective is to find an alternative, based on the vector of the alternatives, which has the maximum value according to the weight of the criteria space [40]. Therefore, LPP is performed until an ideal alternative is found. If it does not occur, the dominated alternatives are eliminated and the process is started again, starting from step 3.1. Now, only the alternatives identified as potentially optimal are considered in the subsequent steps, otherwise the process is finalized [37]. In the finalization step, the weight ranges supporting the solution are computed and produced in a report with the final recommendation.
Methods
Study location and decision-making actors
The current research is based on the specialized knowledge of representatives of the nine states of the Northeast Region of Brazil, which is composed of nine states: Alagoas, Bahia, Ceará, Maranhão, Paraíba, Pernambuco, Piauí, Rio Grande do Norte and Sergipe. An expert panel was formed by fourteen medical regulators who contributed to the structuring of the decision problem through semi-structured questionnaires. Carrying out the structuring phase with a varied group of stakeholders, makes the process more robust, as it provides a common view of the problem and allows the integration of different perspectives [41].
The observations and discussion meetings took place at SAMU/Natal in Rio Grande do Norte, RN, with a discussion group formed by the General Director, the Medical Coordinator, the Regulation Coordinator and one of the most experienced on-call chiefs at the regulation centre. Everyone could express their preferences in relation to the cases presented. The decision maker appointed was the General Director of SAMU/Natal-RN, who is also a regulatory physician. An analyst mediated the decision-making process, thus making unnecessary to use techniques to reach a consensual position amongst the group members. Other stakeholders were selected based on simultaneous participation throughout the study.
Regulatory physicians’ general decision aspects
Throughout the development of the multicriteria decision model, the entire path from the call to the victim’s transport to a health unit was completely mapped, as no information important to the decision, which occurs in real time, could be disregarded.
Assistance to victims begins with the telephone call, when guidance is provided on the first actions. The call is answered by medical regulation assistant technicians “MRAT” who identify the emergency and collect the first information about the victims and their location [42]. After the reception and identification of the calls, requests are judged by the Regulatory Physician, RP, who classifies the level of urgency of each call, defining the necessary resource for their adequate attendance, which can involve from a simple medical advice to the activation of a Radio Operator, RO, who will activate the nearest or most appropriate ambulance, depending on the severity of the situation. After the on-site assessment, the patient will be transported safely to the health services. As shown in Fig. 1.
SAMU functioning is presented on Fig. 1.
The current research follows three main phases: the decision problem is structured and, after selecting the MCDA method, preference modelling is carried out.
Structuring the decision problem
Problem, objective and alternatives of the MCDA model
Two meetings were held at the SAMU/192 Natal Regulation Centre within a six months interval “April to October 2018” with a discussion group. As a result, the delimitation of the decision problem began, definition of the panel of experts and the alternatives were established as: (1) four victims, and (2) four cases (two clinical and two traumas) were selected, classified as Level 1 , red code. The choice of topics was based on the SAMU/192 service history. When analysing a sample of historical data from 2015 to 2018, chosen for convenience, the results revealed the clinical and trauma cases as the most representative specialties, as together they account for 84.77 % of the total number of diagnoses. The cases were prepared based on the literature and on the experience of the regulating physicians at the Natal-RN Regulation Centre [43].
Rating criteria
To identify the evaluation criteria, a mainly qualitative approach was chosen as being more appropriate to the exploratory nature of the study and to address the research question, maximizing credibility, reliability and the findings confirmation. The qualitative research instruments that were employed in this phase included observations, document review, open and semi-structured interviews. The combination of such instruments enabled the most complete and multifaceted examination [44].
Observations and open interviews The non-participant field observation of the daily work practices of the professionals at the SAMU/Natal-RN regulation centre had a greater focus on Regulatory Physicians, RPs. The objective of this initial stage of data collection was to gain an understanding of the organizational context and the decision making of the RPs in practice.
The observation involved conducting open interviews with a number of key Regulatory Central employees (n = 30) to provide an overview of the organization and service delivery (between December 2018 and June 2019). Such individuals included coordinators and medical regulators, whose functions alternated between operational and leadership management. Although the character of the observations was non-participant, the open interviews aimed to capture internal and external perspectives on regulation and systemic influences [45].
Throughout the open interviews it was collected: (1) key demographic information; (2) relevant documentation dealing with policies and procedures; and (3) the empirical experience of the of EMSs victims’ prioritization decision. The data collected in the observations and open interviews were part of the necessary framework for the elaboration of the semi-structured interview, allowing the identification of twenty-one decision criteria that were categorized in five dimensions: (1) health system; (2) healthcare tools; (3) victims’ profile; (4) victim’s health status; and (5) external factors.
Document review The protocols for basic and advanced life support used in the context of the organizational environment were examined [46, 47] together with the pre-established criteria by the support system of the central regulation, the latter being used for the investigation of the presumed severity, during the call. With the analysis of such documents, four of the six criteria related to the victim’s health were extracted. At the end of this stage, amongst the data collected, there were twenty-five decision criteria for the problem of prioritizing victims, subdivided into five dimensions. These data were presented to the discussion group, in a meeting, in which it was agreed that such criteria would undergo a review and a second validation.
Semi-structured interviews The final step in selecting the criteria involved conducting semi-structured interviews with SAMU representatives from the nine states in the Northeast Region in Brazil. An online questionnaire was developed based on the data collected in the observation process, in the open interviews and in the document review (see Additional file 1). A total of fourteen medical specialists participated; amongst them eleven were in leadership positions and had between five to ten years of experience in emergency medical regulation.
Regarding the questionnaire, the presentation of the questions was preceded by the central problem presentation to the participants: a scenario in which doctors receive three calls with the same characteristics, three victims who complain of pain, and to answer them they have only one ambulance is available. There was also the observation that cases should be treated as an urgent priority. After this introduction, doctors were presented with two questions, one that presented the criteria and another discursive question. The first questions stated: What do you need to know to make the decision? What can influence this decision, knowing the protocol advises the dispatch, even though resources are scarce? Mark all the options you need to make this decision, check as many as needed. The second questions asked: At the time of the decision, based on your experience and skills, could any other criterion or dimension not present in the protocols or in this questionnaire be added?
MCDA method selection
For the multicriteria method selection, the basic preference situations were observed, mainly to support the decision maker’s preference modelling, as well as the rationality considered by him to the context under study [36]. The decision support system (DSS) that accompanies FITradeoff was also an important aspect for the selection, as it was built under a concept of flexible elicitation that requires less cognitive effort from the decision-maker because it requires reduced information, without the need for indifference adjustments between its consequences. Thus, it becomes easier for the decision maker to make comparisons of results based on strict preferences and not on indifference [37].
Modelling preferences
Once the criteria list was defined as well as their corresponding scale constants, the intracriteria evaluation was performed, obtaining the functions of value \(v_i(x_i)\) for each criterion i which, in turn, enabled the construction of the decision matrix. Afterwards, the data from the previous stage were analysed in a discussion group meeting; the decision maker’s preference was considered linear for all criteria [48]. For the standardization procedure applied in this work, the scale is from 0 to 1, in which 0 and 1 represent, respectively, the minimum and maximum values of the performances in the criterion [37]. The intercriteria evaluation was carried out using the FITradeoff multicriteria method, in the FITradeoff software for the additive model of choice with sensitivity analysis, (FU-T1EEMO-CT1).
Sensitivity analyses were also performed with all the criteria in order to examine the robustness of the selection and to identify possible weight sensitive criteria. The percentage values for variation of the criteria were \(-20\)% and +20%. The consequence value of each alternative j of the problem for the criterion i assumed a value Sj, i such that \(\left(pj,i\right)\ast \left ( 0,8 \right)\leq Sj,i\leq \left ( pj,i \right)\ast \left ( 1,2 \right )\), where pj, i corresponds to its nominal value (value of the original consequence matrix). To maintain the original limits of the consequence space, the SAD verifies the minimum value of the consequence space generated in the Sensitivity Analysis cycle and assigns the minimum nominal value to it. The same is done for the maximum nominal value.
Results
Structuring the decision problem
Problem, objective and the MCDA model alternatives
Based on the objective of prioritizing victims, the main issue is the choice of which victim to attend first. To this end, the alternatives presented were illustrated based on four occurrence scenarios that brought physicians the main points of pre-hospital care in emergency situations and clinical and traumatic emergencies, these classified as emergencies of absolute priority. The Table 1 presents description of the alternatives presented to the professionals.
The description of the alternatives presented can be seen in Table 1.
Rating criteria
After the observation period, open interviews and document review, it was concluded that the information investigated by the regulating physicians with the potential to influence at the time of the call may be of the following different types:
-
1.
Criteria related to the Health System: access to the doctor, access to the bed, and support from security agencies;
-
2.
Criteria related to Support Tools: location of the ambulance, access to the assistance system, access to support material;
-
3.
Criteria related to the Victim: location of the victim, proper means of transportation, age, time of call, health insurance, sex, refusal, willingness;
-
4.
Criteria related to the Victim’s Health Status: airway and oxygenation, state of consciousness, pulse, traumatization, victim’s health history, alcohol or drug intake;
-
5.
Criteria related to External Factors: road traffic congestion; social commotion; bad weather, hard to reach address, insistence of people close to the victim.
Decision criteria evaluated by the group of experts, of the semi-structured interviews, is presented in Fig. 2.
The results of the semi-structured interviews sent to the panel of experts are presented in Fig. 2, in which it can be observed that the three main ones are related to the victim’s health status, followed by access criteria and the victim’s location. Willingness, refusal, sex, health insurance and access to the bed, in most cases, are not priority information for specialists. The other criteria can be considered important in a decision to prioritize victims as the doctors have shown interest. The answers presented in the second question indicate that the experts agreed with the classes of criteria presented and did not add any other to the list.
Selected criteria
For the cases under evaluation, the discussion group agreed that the list would be complete if it contemplated the ten criteria described in the Tables 2 and 3.
The final list of criteria related to the victim’s health is shown in Table 2.
Access to the service system and support material was considered to be available and would not influence the decision. Regarding the time of the requests, it was pre-established that the calls were registered in the same time interval. Finally, with regard to willingness and refusal (to be attended), it was considered that both the family and the victim wanted care. The location of the ambulance, the intake of alcohol or drugs, the support of security agencies, access to the bed and the sex of the victim were not considered for the evaluation of the four applicants as the discussion group would not find these to be relevant criteria for the cases.
The final list of criteria related to the victim and external factors is shown in Table 3.
The other criteria were included in the model and to facilitate and streamline the decision-making process, those with similarities were grouped: the estimation of access to the victim’s location took into account the difficulties of access created by both roads and vehicles (road traffic congestion + difficulty to reach address), the social commotion analysed information about popular indignation and the climatic conditions to which the victims were exposed and, finally, regarding the criterion of access to the doctor, the MR evaluated if the victim had any condition that would allow him to have access to the doctor safely (health plan + proper means of transportation). Amongst the ten selected criteria, eight are on a verbal scale ranging from 1 to 4.
The objective, criteria and alternatives of the proposed model are presented in Fig. 3.
The Fig. 3 presents the summary of the results found so far: the objective of the decision model, the ten criteria and the alternatives.
MCDA method selected
It was observed that the input information is aligned with the analysed method as the DSS operates with numerical inputs. Furthermore, the decision-maker presented compensatory rationality, in which it is admitted that there may be an absolute compensation between the different evaluations, given that the reality of the structured decision problem, a good performance in ’airways and oxygenation’ can easily counterbalance a poor performance in ’victim’s history’. This rationality profile is in line with that for the application of FITradeoff.
As the decision maker was able to make comparisons between pairs of consequences with strict preference and indifference relations, the preference structure (P,I) was sufficiently adequate for modelling the decision maker’s preferences. As the approach of the single synthesis criteria methods does not accept that there may be good reasons to justify the incomparability between two alternatives, under this circumstance, it was admitted that the alternatives can be compared with each other, therefore, there is no presence of incomparability.
Modelling preferences
The Table 4 evaluated each alternative i for each criterion j, which led to a function of value \(v_j(a_i)\), corresponding to the intracriteria evaluation. The Table shows the format of the input data for the chosen multicriteria method. It was added information to the data on the classification of the criteria (whether continuous or discrete), the type of function that each criterion will assume. In the case of discrete criteria, it was necessary to inform the number of scale levels to be considered.
The decision matrix is shown in Table 4.
After structuring the problem considering an additive model, the data in the Table 4 were utilized and entered into the DSS. Subsequently, the FITradeoff steps were operationalized. After sorting the criteria (see Fig. 4), flexible elicitation started, and two questions to the decision maker were enough for a single solution to be found for the weight space. Figure 5 shows the two pairs of consequences presented to the decision maker, who in the first question preferred scenario A and in the second, B.
The ordering of the criteria is shown in Fig. 4.
The pairs of consequences and the chosen scenarios are shown in Fig. 5.
The recommendation was to prioritize Victim 2. Figure 6 illustrates the departure of the DSS, presenting the space of viable weights for which Victim 2 is pointed out. The breadth of the value range demonstrates the robustness of the result in view of the variety of weights associated with the main criteria, in decreasing order, for which Victim 2 would still be pointed out.
Weight ranges are shown in Fig. 6.
The weight range for each criterion is: Airways and oxygenation (0.75–0.1); State of consciousness (0.5–0.084); Pulse (0.333–0); Traumatization (0.25–0); Victim’s health history (0.2–0); Access to the doctor (0.17–0); Access to the victim’s location (0.14–0); Social commotion (0.13–0); Location (0.11–0); and Age (0.1–0). These weight ranges result from LPP models, considering maximum and minimum weights, subject to restrictions for the development alternatives.
The alternatives found during the performance of the sensitivity analysis are shown in Fig. 7.
The Fig. 7 illustrates a graph with the alternatives that were present in the subset of potentially optimal alternatives during each cycle of Sensitivity Analysis. Among these alternatives, those that were also present in the original subset appear in blue. Those that were present in the subset in some sensitivity analysis cycle, but were not in the nominal subset, are shown in purple. It is also observed the impact of changes in the selected alternative, which suggests that Victim 2 remains consistently the most attractive alternative, whatever the assumed value. These results demonstrate the robustness of the recommendation provided.
Discussion
The present work has developed a multicriteria decision model to support the decision of the regulatory physicians, considering an environment of resources scarcity, whilst MCDA was not yet utilized to assist this type of decision. As a result of the analyses of the specialist doctors and discussion group, different dimensions of criteria were created, guiding criteria, as well as, those that influence the prioritization of victims were analysed and considered. This knowledge from regulatory protocols, and from the experience of specialists, can support the decisions of regulatory physicians who are still newcomers. The conclusions of Perona et al. [49] corroborate with our findings, as he stated that there is a difference in the processes of thinking and storing information between specialists and novices.
It was also observed that the structuring of the problem facilitated the decision makers’ learning and understanding about the problem faced, about their own priorities, values and objectives of other parties. The exploration of this context was able to guide them in the identification of a course of action, and made it possible to learn about the twenty-five evaluation criteria. However, for prioritization in the four cases presented, only ten would be necessary, which were criteria related to the victim’s health status, the victim’s details and external factors. These criteria do not invalidate the others, as they may be necessary in different contexts, for prioritization, for instance in a psychiatric case, the criterion “support from security agencies” will be part of the decision.
After structuring the decision problem, the specialists analysed four cases. In this phase, the results indicated that the decision maker would be able to identify relations of preference and indifference between the pairs of consequences. In this decision making situation, it was found that the alternatives can be compared with each other, therefore, there is no presence of incomparability. The modelling of preferences performed with the multicriteria FITradeoff method, pointed at victim 2 as the best choice, a result that was supported by experts and decision makers. Thus, the flexible and interactive Tradeoff process proved to be effective for prioritizing victims in this context. This result attested that the model was well structured and that the method was adequate to the problem specificities. Almeida et al. [29] explains that a decision model corresponds to a simplified formal representation of the problem faced, supported by a multicriteria method. Mathematically, the sensitivity analysis showed that Victim 2 has consistently remained the most attractive alternative, whatever the assumed value.
No studies were found using the MCDA to support decisions in this specific area involving the participation of medical specialists. The recent findings in the literature on decision-making in EMS focus on the following points? (1) managing ethical aspects of advance directives in emergency care services; (2) decision support for patient admission; (3) presentation of a structure that provides healthcare professionals with a just-in-time basis; and (4) exploration of the main challenges and barriers that affect clinical decision-making [49,50,51,52]. In summary, these studies determine paramedics’ decision-making styles, and also question how decision-making is carried out in this context [53,54,55,56,57].
Other quantitative studies question the idle dispatch policy and propose a multi-verse optimizer algorithm for repositioning ambulances in emergency medical services systems, for which states are defined based only on the locations of idle ambulances waiting at stations, and the occupied ambulance locations were approximated based on customer arrival rates [58, 59]. Furthermore, it could be mentioned other relevant works that seek solutions to localization problems [21,22,23, 25].
These works focus on a single criterion and/or the methodology used is not adequate to take into account several criteria simultaneously when supporting the decision maker. Their analyses enrich the literature, however, the decision maker needs not only the analysis, but also, a direction on which choice may be the most appropriate, based on different and often conflicting criteria.
The present study has some limitations; for instance, the methodology is validated through only four cases analysis (two clinicians and two trauma victims). As a result, some criteria are left out of the model. New cases must be studied to validate the list of criteria and/or add new ones, necessary for similar or different cases.
Several performance dimensions can be considered when estimating victim prioritization criteria. These criteria may include the location of the ambulance, access to the doctor, the age and state of consciousness of the victim, as well as whether the case is characterized by social commotion. However, in the current study, it was not possible to determine a universal set of victim assessment criteria for a single model because each case has specific performance criteria.
It was also observed that the majority of the evaluation criteria are common to all cases, although they are adapted to the special characteristics of different priorities (for instance, the meaning of access to the doctor may differ if the criterion refers to the health system and not the victim). This common set of criteria allows the development of a uniform evaluation structure as well as additional comparative analyses. However, there are some criteria that differ according to each case. For instance, the support attribute of security agencies would be a priority in cases of psychiatric emergency.
The model, if more evident, can then be used in planning, training and even online devices for decision making in this area. Here, the positive character of the methodology used is emphasized due to the possibility of revising the previous steps before making the recommendation to the decision maker.
Therefore, the flexibility of the MCDA process and the importance of the stage of structuring the problem are highlighted, considering its impact on the successor stages and its critical character regarding the application of the chosen method. In many cases, the efficacy of the multicriteria approach is due precisely to the discussions and a greater degree of understanding of the problem; given that the problem structuring phase has presented to all those involved, criteria unknown to the decision regulation protocols, albeit important for the regulating physicians.
Thus, it is evident that there is a vast field of research exploration for Multicriteria Decision Analysis in prioritizing victims of pre-hospital emergency care, improving the sector. Thus, future research is recommended to explore the efficiency of the model in different scenarios.
Conclusions
This work contributed significantly to the rational, transparent and impartial practice of prioritizing victims of SAMU/192, using the multicriteria methodology to support the decision making process. After the formalization of the model, reproducibility and validation seem to be possible, which are two important parameters when dealing with the challenge of regulating physicians’ decisions.
Selecting the criteria in the current study led to the realization that the protocols that guide regulatory physicians do not take into account all the criteria for prioritizing victims in an environment of resource scarcity. The structuring of the problem made it possible to learn about twenty-five evaluation criteria. The prioritization of victims must be carried out, using criteria that guide (protocols) and criteria that influence the decision-making process. For mathematical modelling, the flexible and interactive tradeoff process proved effective for prioritizing victims.
Lastly, the current authors sustain, based on the evidence collected, that the developed model has the potential to support the SAMU/192’s regulatory physician to direct resources to victims who need support the most, and can be used in other pre-hospital emergency care units.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Abbreviations
- MCDA:
-
Multicriteria decision analysis
- EMS:
-
Emergency medical services
- Samu/192:
-
Mobile emergency care service
- DM:
-
Decision maker
- FITradeoff:
-
Flexible and interactive tradeoff method
- DSS:
-
Decision support system
- RN:
-
Rio Grande do Norte
- RPs:
-
Regulating physicians
- TARMs:
-
Medical regulation technicians
- RO:
-
Radio operator
- USA:
-
Advanced support unit
References
Marsh K, Lanitis T, Neasham D, Orfanos P, Caro J. Assessing the value of healthcare interventions using multi-criteria decision analysis. A review of the literature. Pharmacoeconomics. 2014;32:345–65. https://doi.org/10.1007/s40273-014-0135-0.
Thokala P, Devlin N, Marsh K, Baltussen R, Boysen M, Kalo Z, Longrenn T, Mussen F, Peacock S, Watkins J, Ijzerman M. Multiple criteria decision analysis for health care decision making—an introduction: report 1 of the ISPOR MCDA emerging good practices task force. Value Health. 2016;19(1):1–13. https://doi.org/10.1016/j.jval.2015.12.003.
Frazão TDC, Camilo DGG, Cabral ELS, Souza RP. Multicriteria decision analysis (MCDA) in health care: a systematic review of the main characteristics and methodological steps. BMC Med Inform Decis Mak. 2018;1:1–16. https://doi.org/10.1186/s12911-018-0663-1.
Moreno-Calderón A, Tong TS, Thokala P. Multi-criteria decision analysis software in healthcare priority setting: a systematic review. PharmacoEconomics. 2020. https://doi.org/10.1007/s40273-019-00863-9.
Mühlbacher AC, Kaczynski A. Making good decisions in healthcare with multi-criteria decision analysis: the use, current research and future development of MCDA. Appl Health Econ Health Policy. 2016;14(1):29–40. https://doi.org/10.1007/s40258-015-0203-4.
Inotai A, Nguyen HT, Hidayat B, Nurgozhin T, Huy P, Kiet T, Campbell JD, Németh B, Maniadakis N, Brixner D, Wijaya K, Kaló Z. Guidance toward the implementation of multicriteria decision analysis framework in developing countries. Expert Rev Pharmacoecon Outcomes Res. 18(6):585–92. https://doi.org/10.1080/14737167.2018.1508345.
Chen T. A novel VIKOR method with an application to multiple criteria decision analysis for hospital-based post-acute care within a highly complex uncertain environment. Neural Comput Appl. 2019;31:3969–99. https://doi.org/10.1007/s00521-017-3326-8.
Camilo DGG, de Souza RP, Frazão TDC. Multi-criteria analysis in the health area: selection of the most appropriate triage system for the emergency care units in natal. BMC Med Inform Decis Mak. 2020. https://doi.org/10.1186/s12911-020-1054-y.
Mohammed TJ, Albahri AS, Zaidan AA, Albahri OS, Al-Obaidi JR, Zaidan BB, Larbani M, Mohammed RT, Hadi SM. Convalescent-plasma-transfusion intelligent framework for rescuing COVID-19 patients across centralised/decentralised telemedicine hospitals based on AHP-group TOPSIS and matching component. Appl Intell (Icci). 2021. https://doi.org/10.1007/s10489-020-02169-2.
Albahri AS, Hamid RA, Albahri OS, Zaidan AA. Detection-based prioritisation: framework of multi-laboratory characteristics for asymptomatic covid-19 carriers based on integrated entropy-topsis methods. Artif Intell Med. 2021;111:101983. https://doi.org/10.1016/j.artmed.2020.101983.
Alamoodi AH, Zaidan BB, Zaidan AA, Albahri OS, Mohammed KI, Malik RQ, Almahdi EM, Chyad MA, Tareq Z, Albahri AS, Hameed H, Alaa M. Sentiment analysis and its applications in fighting COVID-19 and infectious diseases: a systematic review. Expert Syst Appl. 2021;167:114155. https://doi.org/10.1016/j.eswa.2020.114155.
Albahri OS, Al-Obaidi JR, Zaidan AA, Albahri AS, Zaidan BB, Salih MM, Qays A, Dawood KA, Mohammed RT, Abdulkareem KH, Aleesa AM, Alamoodi AH, Chyad MA, Zulkifli CZ. Helping doctors hasten covid-19 treatment: towards a rescue framework for the transfusion of best convalescent plasma to the most critical patients based on biological requirements via ml and novel MCDM methods. Comput Methods Progr Biomed. 2020;196:105617. https://doi.org/10.1016/j.cmpb.2020.105617.
Albahri AS, Al-Obaidi JR, Zaidan AA, Albahri OS, Hamid RA, Zaidan BB, Alamoodi AH, Hashim M. Multi-biological laboratory examination framework for the prioritization of patients with COVID-19 based on integrated AHP and group VIKOR methods. Int J Inf Technol Decis Mak. 2020;19(05):1247–69. https://doi.org/10.1142/S0219622020500285.
Albahri OS, Zaidan AA, Albahri AS, Zaidan BB, Abdulkareem KH, Al-qaysi ZT, Alamoodi AH, Aleesa AM, Chyad MA, Alesa RM, Kem LC, Lakulu MM, Ibrahim AB, Rashid NA. Systematic review of artificial intelligence techniques in the detection and classification of COVID-19 medical images in terms of evaluation and benchmarking: taxonomy analysis, challenges, future solutions and methodological aspects. J Infect Public Health. 2020;13(10):1381–96. https://doi.org/10.1016/j.jiph.2020.06.028.
Albahri AS, Hamid RA, Alwan JK, Al-qays ZT, Zaidan AA, Zaidan BB, Albahri AOS, AlAmoodi AH, Khlaf JM, Almahdi EM, Thabet E, Hadi SM, Mohammed KI, Alsalem MA, Al-Obaidi JR, Madhloom HT. Role of biological data mining and machine learning techniques in detecting and diagnosing the novel coronavirus (COVID-19): a systematic review. J Med Syst. 2020. https://doi.org/10.1007/s10916-020-01582-x.
Ham C. Priority setting in health care: learning from international experience. Health Policy. 1997;42(1):49–66. https://doi.org/10.1016/S0168-8510(97)00054-7.
OTONI T. Regimento Interno—Jequitinhonha 2012.
Aringhieri R, Bruni ME, Khodaparasti S, van Essen JT. Emergency medical services and beyond: Addressing new challenges through a wide literature review. Comput Oper Res. 2017;78(August 2016):349–68. https://doi.org/10.1016/j.cor.2016.09.016.
Aringhieri R, Bruni ME, Khodaparasti S, van Essen JT. Emergency medical services and beyond: addressing new challenges through a wide literature review. Comput Oper Res. 2017;78:349–68. https://doi.org/10.1016/j.cor.2016.09.016.
Reuter-Oppermann M, van den Berg PL, Vile JL. Logistics for emergency medical service systems. Health Syst. 2017;6:187–208.
Bélanger V, Ruiz A, Soriano P. Recent optimization models and trends in location, relocation, and dispatching of emergency medical vehicles. Eur J Oper Res. 2019;272(1):1–23. https://doi.org/10.1016/j.ejor.2018.02.055.
Reuter-Oppermann M, Richards D. Decision support for EMS policy making using data analytics and real-time alerts. In Proceedings—2019 IEEE world congress on services, SERVICES 2019; 2019. pp. 266–271. https://doi.org/10.1109/SERVICES.2019.00079
Andersson H, Granberg TA, Christiansen M, Aartun ES, Leknes H. Using optimization to provide decision support for strategic emergency medical service planning—three case studies. Int J Med Inform. 2020;133(July 2019):103975. https://doi.org/10.1016/j.ijmedinf.2019.103975.
Carvalho AS, Captivo ME, Marques I. Integrating the ambulance dispatching and relocation problems to maximize system’s preparedness. Eur J Oper Res. 2020;283(3):1064–80. https://doi.org/10.1016/j.ejor.2019.11.056.
Belanger V, Lanzarone E, Nicoletta V, Ruiz A, Soriano P. A recursive simulation-optimization framework for the ambulance location and dispatching problem. Eur J Oper Res. 2020;286(2):713–25. https://doi.org/10.1016/j.ejor.2020.03.041.
Siddiqui MK, Islam MZ, Kabir MA. A novel quick seizure detection and localization through brain data mining on ECoG dataset. Neural Comput Appl. 2019;31(9):5595–608. https://doi.org/10.1007/s00521-018-3381-9.
Siddiqui MK, Huang X, Morales-Menendez R, Hussain N, Khatoon K. Machine learning based novel cost-sensitive seizure detection classifier for imbalanced EEG data sets. Int J Interact Des Manuf. 2020;14(4):1491–509. https://doi.org/10.1007/s12008-020-00715-3.
Keeney RL, Raiffa H. Decisions with multiple objectives: preferences and value tradeoffs. Cambridge: Cambridge University Press; 1993.
Almeida ADT. Processo de decisão nas organizações: construindo modelos de decisão multicritério. São Pulo: Atlas; 2013.
Roy B. Multicriteria Methodology for Decision Aiding, 1996;303
Diaby V, Goeree R. How to use multi-criteria decision analysis methods for reimbursement decision-making in healthcare: a step-by-step guide. Expert Rev Pharmacoecon Outcomes Res. 2014;14(1):81–99. https://doi.org/10.1586/14737167.2014.859525.
Belton V, Stewart T. Multiple criteria decision: an integrated approach. New York: Springer; 2002.
Dolan J. Multi-criteria clinical decision support. Patient Patient Centered Outcomes Res. 2010;3:229–48.
Roy B. Methodologie multicritere D aide a la decision economica. Columbia: University of South Carolina Press; 1985. p. 179–201.
Zeleny M. An essay into a philosophy of MCDM: a way of thinking or another algorithm. Comput Oper Res. 1992;7(19):563–6.
Guitouni A, Martel J-M. Tentative guidelines to help choosing an appropriate MCDA method. Eur J Oper Res. 1998;109(2):501–21. https://doi.org/10.1016/S0377-2217(98)00073-3.
Almeida AT, Almeida JA, Costa APCS, De Almeida-Filho AT. A new method for elicitation of criteria weights in additive models: flexible and interactive tradeoff. Eur J Oper Res. 2016;250(1):179–91. https://doi.org/10.1016/j.ejor.2015.08.058.
Keeney RL. Value-focused thinking: a path to creative decision making. London: Harvard University Press; 1992.
Keeney RL, Raiffa H. Decisions with multiple objectives. New York: Wiley; 1976.
Gusmão APH, Medeiros CP. A model for selecting a strategic information system using the FITradeoff. London: Hindawi Publishing; 2016.
Hongoh V, Michel P, Gosselin P, Samoura K, Ravel A, Campagna C, Cissá HD, Waaub JP. Multi-stakeholder decision aid for improved prioritization of the public health impact of climate sensitive infectious diseases. Int J Environ Res Public Health. 2016. https://doi.org/10.3390/ijerph13040419.
Brasil MdS. Serviço de Atendimento Móvel de Urgência. 2014. www.saude.gov.br.
Reis FM, Martins DM, Arruda AD, Linhares AOM. Manual De Atendimento Pré-hospitalar. EDITORA SANAR, 2018. https://books.google.com.br/books?id=RKQJwwEACAAJ
Johnson M, O’Hara R, Hirst E, Weyman A, Turner J, Mason S, Quinn T, Shewan J, Siriwardena AN. Multiple triangulation and collaborative research using qualitative methods to explore decision making in pre-hospital emergency care. BMC Med Res Methodol. 2017;17(1):11. https://doi.org/10.1186/s12874-017-0290-z.
Hammersley M, Atkinson P. Ethnography principles in practice. New York: Routledge; 2019.
Brasil MdS. Protocolos de Suporte Avançado de Vida. 2016.
Brasil MdS. Protocolos de Suporte Básico de Vida. 2016.
Edwards W, Barron FH. SMARTS and SMARTER: Improved simple methods for multiattribute utility measurement. Org Behav Human Decis Process. 1994;60(3):306–25.
Perona M, Rahman MA, O’Meara P. Paramedic judgement, decision-making and cognitive processing: a review of the literature. Aust J Paramed. 2019;16:1–12.
Poveda-Moral S, Rodríguez-Martín D, Codern-Bové N, José-María P, Sánchez-Valero P, Pomares-Quintana N, Vicente-García M, Falcó-Pegueroles A. Managing ethical aspects of advance directives in emergency care services. Nurs Ethics. 2021;28(1):91–105. https://doi.org/10.1177/0969733020952112.
Thies N, Urban B, Kraus M, Kohlmann T, Niedermirtl F, Prückner S. Decision support for patient admission in case of suspicion of COVID-19: for use in the Bavarian ambulance service. Notfall Rettungsmedizin. 2021. https://doi.org/10.1007/s10049-021-00855-3.
Bijani M, Abedi S, Karimi S, Tehranineshat B. Major challenges and barriers in clinical decision-making as perceived by emergency medical services personnel: a qualitative content analysis. BMC Emerg Med. 2021;21(1):1–12. https://doi.org/10.1186/s12873-021-00408-4.
Ryan L, Halliwell D. Paramedic decision-making—how is it done? J Paramed Pract. 42012(6):343–51. https://doi.org/10.12968/jpar.2012.4.6.343.
Jensen JL, Bienkowski A, Travers AH, Calder LA, Walker M, Tavares W, Croskerry P. A survey to determine decision-making styles of working paramedics and student paramedics. Can J Emerg Med. 2016;18(3):213–22. https://doi.org/10.1017/cem.2015.95.
Jones CMC, Cushman JT, Lerner EB, Fisher SG, Seplaki CL, Veazie PJ, Wasserman EB, Dozier A, Shah MN. Prehospital trauma triage decision-making: a model of what happens between the 9-1-1 call and the hospital. Prehosp Emerg Care. 2016;20(1):6–14. https://doi.org/10.3109/10903127.2015.1025157.
Anderson NE, Slark J, Gott M. Prehospital resuscitation decision making: a model of ambulance personnel experiences, preparation and support. Emerg Med Aust. 2021. https://doi.org/10.1111/1742-6723.13715.
Sy A, Moglia B, Aragunde G, Derossi P. La urgencia bajo la lupa: una revisión de la producción científica sobre servicios de emergencia en hospitales desde la etnografía. Cadernos Saúde Pública. 2021. https://doi.org/10.1590/0102-311x00026120.
Jagtenberg CJ, Bhulai S, van der Mei RD. Dynamic ambulance dispatching: is the closest-idle policy always optimal? Health Care Manag Sci. 2017;20(4):517–31. https://doi.org/10.1007/s10729-016-9368-0.
Golabian H, Arkat J, Tavakkoli-Moghaddam R, Faroughi H. A multi-verse optimizer algorithm for ambulance repositioning in emergency medical service systems. J Ambient Intell Hum Comput. 2021. https://doi.org/10.1007/s12652-021-02918-2.
Acknowledgements
Not applicable.
Author information
Authors and Affiliations
Contributions
TDCF and RPS conceived the study. TDCF, RPS and AFAS wrote and edited the manuscript. TDCF and RPS participated in data collection and analysis. TDCF and RPS participated in interpretation of results. TDCF, JFCJ and DGGC participated in the review and translation of the text. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1.
Victims Prioritization - Semi-structured interviews.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Frazão, T.D.C., Santos, A.F.A., Camilo, D.G.G. et al. Priority setting in the Brazilian emergency medical service: a multi-criteria decision analysis (MCDA). BMC Med Inform Decis Mak 21, 151 (2021). https://doi.org/10.1186/s12911-021-01503-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12911-021-01503-z