 Research
 Open access
 Published:
Fuzzy constraintbased agent negotiation framework for doctorpatient shared decisionmaking
BMC Medical Informatics and Decision Making volume 22, Article number: 218 (2022)
Abstract
Background
The clinical practice of shared decisionmaking (SDM) has grown in importance. However, most studies on SDM practice concentrated on providing auxiliary knowledge from the thirdparty standpoint without consideration for the value preferences of doctors and patients. The essences of these methods are complete and manual negotiation, and the problems of high cost, time consumption, delayed response, and decision fatigue are serious.
Methods
In response to the above limitations, this article proposes a fuzzy constraintdirected agentbased negotiation and recommendation framework for bilateral and multiissue preference negotiation in SDM (PNSDM). Its purpose is to provide preference information and intellectualize PNSDM to promote SDM practice. We modeled PNSDM problems as distributed fuzzy constraint satisfaction problems and designed the doctor agent and patient agent to negotiate on behalf of the doctor and patient. The negotiation result was then transformed into treatment plans by the recommendation model. The proposed negotiation and recommendation models were introduced in detail by an instance.
Results
The proposed method with different strategies and negotiation pairs achieves good performance in terms of negotiation running time, negotiation rounds, and combined aggregated satisfaction value. Specifically, it can feasibly and effectively complete multiple rounds of PNSDM in a few seconds and obtain higher satisfaction.
Conclusion
The experimental results indicate that the negotiation model can effectively simulate preference negotiation and relieve the pressure of increasing issues. The recommendation model can assist in decisionmaking and help to realize SDM. In addition, it can flexibly cope with various negotiation scenarios by using different negotiation strategies (e.g., collaborative, win–win, and competitive).
Introduction
Shared decisionmaking (SDM) is gradually being advocated as an ideal treatment decisionmaking method in medical practice. It refers to doctor and patient reaching agreements on how to diagnose, treat and administer drugs and whether to carry out special examinations or operations after full consultation [1]. It aims to help patient play an active role in the decisionmaking process and pay attention to their health, which is the ultimate goal of patientcentered care [2]. SDM was first proposed in 1972 [3], and that expected to satisfy the demands of medical ethics, clinical practice, and disease management [4]. Furthermore, it is designed to relieve the growing tension between doctor and patient [5] and improve patient compliance [6] and treatment effects [7, 8].
However, the clinical application of SDM faces a variety of challenges [9, 10]. For example, the lack of communication awareness and skills of doctors or patients, the limited time of doctors, and the lack of patients’ medical knowledge. To better implement SDM, numerous experts and scholars have explored SDM in detail and presented many feasible solutions. For instance, the development of patient decision aid tools [11, 12], skills training for SDM [13], and continuing medical education [14]. Although these measures can solve the above problems to some extent, the essence of SDM is still complete manual negotiation. Problems such as high cost, time consumption, delayed response, and decision fatigue still exists and are serious. Psychological studies show that individuals may have decision fatigue when making decisions. In particular, this phenomenon is more likely to occur in a clinical environment that faces a large number of medical decisions every day [15]. Decision fatigue not only reduces individual willpower, selfdiscipline, and selfcontrol but also leads to low decisionmaking quality [16].
Some scholars have also developed clinical decisionsupport systems [17,18,19]. It aims to establish human–machine interactive medical systems through data or models to assist doctors and patients in clinical decisions [20]. These systems include knowledge base systems such as Quick Medical Reference [21], UpToDate [22], and BMJ Best Practice [23] and nonknowledge base systems such as Archimedes Model [24] and Watson for Oncology [25]. The knowledge base systems provide decision support through a knowledge base, inference engine, and human–machine interface. The nonknowledge base systems adopt artificial intelligence methods to summarize and clarify knowledge during human–machine interaction and continuous training and provide suggestions to users. Knowledge base systems have higher accuracy but cannot fill in data, while the opposite is true for nonknowledge base systems. However, both methods provide decision support for users through thirdparty knowledge without considering the value orientations or preferences of users.
Therefore, focusing on the above two limitations, this paper concerns the behavior and preferences of the doctor and patient and proposes an intelligent preferences negotiation and assistant decisionmaking method. For SDM, the committed steps are as follows: (1) doctor inform patient for whom a decision needs to be made and value the opinions of patient; (2) doctor explain the options and their merits and demerits; (3) doctor and patient discuss the preferences of patient and support patient in thinking carefully; and (4) doctor and patient discuss the decision wishes of patient, make or postpone decisions, and discuss followup [26]. According to the third point in this definition, doctor and patient are the most obvious contacts in SDM, and they need to integrate preferences related to issues of mutual concern. Therefore, the problems of preference negotiation in SDM (PNSDM) can be seen as interactive problems formed by doctor and patient. As independent individuals in this interactive process, doctor and patient can share information partially but not fully. Each side has its own knowledge, beliefs, obligations, and intentions, can communicate with others, and is managed independently but is affected by the other parties and constrained by society. The above factors can be matched with the definition of an agent in “Intelligent Agents: Theory and Practice” [27], written by Wooldridge in 1995. Hence, as shown in Fig. 1, we can regard the direct participants, doctor, and patient in the PNSDM as agents that are independent, interrelated, and restrained by the environment. Moreover, we can regard the communication of preferences between doctor and patient as the negotiation between agents. Accordingly, we can solve the problems of the PNSDM by solving the preference negotiation problems between agents.
Agentbased autonegotiation technology is a basic and useful method for cooperative problemsolving. It has been widely developed and used in the fields of resource allocation and task solving [28, 29], ecommerce [30], cloud computing [31, 32], etc. From a technical point of view, the research on agent negotiation can be summarized into four types: game theorybased agent negotiation [33, 34], heuristicbased agent negotiation [35, 36], argumentationbased agent negotiation [37], and distributed constraintbased agent negotiation [38, 39]. Of the four approaches, the game theorybased agent negotiation method provides some descriptive concepts for the optimal solution, but the calculation method is unclear. Although heuristicbased agent negotiation relaxes the completely rational setting compared with the game theorybased agent negotiation method, the negotiation result is not optimal. It is impossible to cover the whole negotiation space with this method. Argumentationbased agent negotiation can overcome various problems caused by the lack of information exchange in the negotiation process. However, the design of the negotiation protocol, communication language, and information identification are more complex. Distributed constraintbased agent negotiation is an effective method for agents to reach an agreement and can ensure Paretooptimal negotiation and the lowest information disclosure.
Considering the advantages and disadvantages of the above methods, we aim to develop a negotiation model based on the theory of distributed constraint to solve the problems of PNSDM. In addition, it provides a treatment recommendation framework to assist doctors and patients in SDM based on their preferences. From a theory perfection perspective, it is the first attempt to provide an agentbased PNSDM method of realizing PNSDM intelligence and quantifying preference information. In terms of actual application, it helps to improve the efficiency of negotiation in SDM, provide treatment plans reference of decisionmaking, and promote the clinical application of SDM.
Methods
Modeling the PNSDM as a DFCSP
For SDM, PNSDM problems involve doctor and patient discussing preferences for multiple issues related to treatment. In the process of bilateral PNSDM, doctor and patient express their own value orientation and negotiation in the form of iterative interaction. Based on the description in the background section, the PNSDM is modeled as an agentbased PNSDM, and it can solve PNSDM problems by resolving conflicts between the doctor agent (DA) and patient agent (PA). Accordingly, the exchange of an offer and counteroffer is the interaction form between agents in agentbased PNSDM. As shown in Fig. 2, negotiation for treatment issues in PNSDM can be modeled as a triple \(({\mathcal {D}}, {\mathcal {P}}, {\mathcal {I}})\), where \({\mathcal {D}}\) and \({\mathcal {P}}\) represent DA and PA, respectively, and \({\mathcal {I}}\) is the interrelationship between the two types of agents. In addition, we structure a recommendation framework that transforms the negotiation results into treatment plans to assist SDM.
In the practical PNSDM, a great deal of uncertain and imprecise information exists. For example, for doctor and patient, the satisfaction and priorities of different issues are imprecise, the aggregated satisfaction for all issues is uncertain, and the influence of the opponent in the negotiation process is unclear. That is, in the autoagent negotiation of the PNSDM, there are many possible constraints between agents and between issues that cannot be accurately obtained by each other but can directly affect the final negotiation result. Therefore, we need to improve the negotiation efficiency of the DA and PA by using imprecise and uncertain information effectively to acquire knowledge. Some studies have shown that fuzzy theory aids proper handling of uncertainty [40]. From this perspective, we can model these incomplete, uncertain, and interlinked information as fuzzy constraints to acquire and express knowledge as flexibly as possible. Then, the PNSDM problems can be represented as a distributed fuzzy constraint satisfaction problem (DFCSP) that causes a mutually acceptable negotiation result received by both the DA and the PA. In addition, the behavior model of agents can be built by fuzzy constraints. For the PNSDM, the constrained interrelation between agents determines whether there is a solution that satisfies all the constraints of DFCSPs. A DFCSP can be expressed as a distributed fuzzy constraint network in which fuzzy relationships are assigned by each agent and among agents. A distributed fuzzy constraint network can be defined as follows:
Definition 1
A distributed fuzzy constraint network (U, X, C) in an PNSDM \(({\mathcal {D}}, {\mathcal {P}}, {\mathcal {I}})\) can be defined as a set of fuzzy constraint networks \(\{N^1,\ldots ,\ N^l,\ldots ,\ N^L\}\), where \(N^l=(U^l, X^l, C^l)\) is from agent l. There are two kinds of fuzzy constraint networks in the PNSDM, that is, \(N^{{\mathcal {D}}}=(U^{{\mathcal {D}}}, X^{{\mathcal {D}}}, C^{{\mathcal {D}}})\) and \(N^{{\mathcal {P}}}=(U^{{\mathcal {P}}}, X^{{\mathcal {P}}}, C^{{\mathcal {P}}})\), which belong to the DA and PA, respectively. Where
\(U^l\) is the universe of discourse for the fuzzy constraint network, \(N^l\);
\(X^l=(U_{i=1}^nX_i^l)\) is a tuple of all nonrecurring objects of an agent in a fuzzy constraint network; and
\(C^l=(U_{i=1}^nX_i^l)\) is a set of all fuzzy constraints in the fuzzy constraint network, which includes the internal constraints among objects in X and external constraints between an agent and its opponent.
U is the universe of discourse for a distributed fuzzy constraint network;
\(X=(U_{l=1}^LX_l)\) is a tuple of all nonrecurring objects in the distributed fuzzy constraint network; and
\(C=(U_{l=1}^LC_l)\) is a set of all fuzzy constraints in the distributed fuzzy constraint network.
As stated in Definition 1, nonrecurring objects \(X^l\) represent the beliefs, environmental cognition (e.g., deadline and medical resources), and other attributes of agent l. Fuzzy constraint set \(C^l\) includes all constraints of agent l, for instance, priority constraints (e.g., the priority of issues), objective constraints (e.g., the desire of cost, effectiveness, and other objectives), and constraints with other agents. The solution to \(X^l\), a fuzzy constraint network, can be seen as intention \(\Pi _{N^l}\), which expresses that fuzzy set \(X^l\) of nonrecurring objects satisfies all fuzzy constraints \(C^l\). The \(\Pi _{N^l}\) of agent l can also be regarded as \(\Pi _l\). Given issues set \(I=\{I_1,I_2,\ldots ,I_i,\ldots ,I_n\}\) and feasible solution \(S\epsilon \Pi _l\),the aggregated satisfaction value (ASV) for S of agent l is:
where \(F_i\left( S\right)\) is the \(i_{th}\) fuzzy membership function of S. It can be obtained directly through the doctor and patient and will flexibly and effectively represent their preferences on certain issues. n is the number of issues that need to be negotiated by the DA and PA, and \(w_i\) is the corresponding weight factor for issue \(i_{th}\).
Negotiation and recommendation model for PNSDM
The negotiation and recommendation models for the PNSDM are presented in this section. The negotiation model of the PNSDM is named the fuzzy constraintdirected agentbased negotiation (FCAN) model, which includes the behavior framework of the DA and PA and the negotiation protocol by which negotiators need to abide. The recommendation model of the PNSDM is mainly used to transmute the negotiation result into specific treatment plans for doctor and patient to choose and reference. Furthermore, we introduce an instance to illustrate the mechanism of negotiation and recommendation models of agentbased PNSDM in detail.
Negotiation model for PNSDM
The presented FCAN model for PNSDM is mainly composed of the negotiation process and the negotiation protocol.
Negotiation process Within the limits of time, the DA and PA will comply with the negotiation protocol to solve their own DFCSP through the exchange of an offer and counteroffer. The FCAN model provides a negotiation framework for the DA and PA. The agent negotiation steps include concession calculation, feasible set generation, offer generation, and negotiation terminals. Before negotiation terminates, the above process will be repeated.
Step 1 (Concession calculation) For an agent, the response state of its opponent, its internal state, and the environmental state reflect the intention of the opponent, the desire of the agent, and the environmental constraint of the agent. Therefore, the agent can decide whether to concede and determine the value of the concession by evaluating the three states.
The opponent’s responsive state \({\textbf {O}}\) represents the degree of difference between the last offer A and the most recently received counteroffer B, which can be defined as follows:
where \(A_0\) is the initial offer and \(B_0\) is the first counteroffer from its opposing agent. \(G\left( A, B\right)\) is the distance measurement of offer A and counteroffer B on issue \(I_i\epsilon X\). The calculation formula is as follows:
where \(A_i\) and \(B_i\) are the possibility distributions of offer A and counteroffer B for issue \(I_i\epsilon I\), respectively.
The internal state \({\textbf {I}}\) of the agent includes the satisfaction level \(\rho\) and the tightness \(\delta\) related to the last offer A and a set of alternative solutions:
where, \(S^*\in \Pi\) is the prospective solution of the agent in the last negotiation round, \(\Psi \left( S^*\right)\) is the agent’s satisfaction with \(S^*\), and \(\varepsilon\) is the aggregated satisfaction threshold.
In the PNSDM, the major environmental constraints \({\textbf {E}}\) of the DA and PA are time constraints. Thus, we can use a function [41] to describe the constraints of time:
where \(r_{now}\) is the current negotiation round, \(r_{max}\) is the deadline of negotiation, and parameter t represents the constraint of negotiation time. k and \(\beta\) in formula (6) are constant, while \(1>\beta >0\) and \(0\le k\le 1\).
Through Eqs. (2–6), we can obtain the responsive state \({\textbf {O}}=\{\sigma \}\) of the opponent, internal state \({\textbf {I}}=\{\rho ,\ \delta \}\) of the agent, and environmental state \({\textbf {E}}=\{t\}\). Then, the concession value \(\Delta \varepsilon\) of the agent when it negotiates can be calculated as follows:
where \(\mu _\sigma (\sigma )\), \(\mu _\rho (\rho )\), \(\mu _\delta (\delta )\) and \(\mu _t(t)\) denote the desire for concession about the degree of difference, satisfaction level, degree of tightness, and time constraint, respectively. Parameter \(\omega\) is associated with the negotiation strategy, and it can adjust the negotiation strategy used in the calculation of the concession value, namely, (i) collaborative strategy, when \(\omega <1\); (ii) winwin strategy, when \(\omega =1\); and (iii) competitive strategy, when \(\omega >1\).
Given the concession value \(\Delta \varepsilon\) and the behavior state \(\varepsilon\) in the last round, the new behavior state \(\varepsilon ^*\) of the agent can be calculated by the following:
Step 2 (Feasible solution generation) Given a fuzzy constraint network N, intension \(\Pi\), and new behavior state \(\varepsilon ^*\), feasible solutions can be acquired. The definition of a feasible solution P is as follows:
where \(\Psi \left( S\right)\) is the ASV of the agent about objectives. Given counteroffer B and feasible solution P, the selection of prospective solution \(S^*\) is as follows:
where H(S, B) is a utility function that is used to evaluate the preference for feasible solution \(S\epsilon P\) and the similarity between counteroffer B and feasible solution S. Its definition is as follows:
where \(W_1\) is a preference function on issue i, and \(W_2\) is a similarity function that measures the preference distance between solution S and counteroffer B on the \(i_{th}\) issue. Parameters \(\omega _1\) and \(\omega _2\) are weights related to preference and similarity, respectively. The different negotiation strategies represent different negotiation behaviors related to the selection of solutions and the speed of conflict resolution. Thus, the parameters associated with various negotiation strategies are defined as follows:
Collaborative strategy: \(\omega _1\le 1.0\), \(\ \omega _2\le 1.0\), \(\ \omega _1<\omega _2\)
Win–win strategy: \(\omega _1\le 1.0\), \(\ \omega _2\le 1.0\), \(\ \omega _1=\omega _2\)
Competitive strategy: \(\omega _1\ge 1.0\), \(\ \omega _2\ge 1.0\), \(\ \omega _1>\omega _2\)
With the collaborative strategy, an agent tends to reach an agreement in the least time, and it will concede to a solution that captures more benefits for the opposing agent. In a negotiation using the winwin strategy, the negotiation result will satisfy the desire of both parties if the agent fully cares about its own interests and those of its opponent. The agent will care only about its own interests during the negotiation if the competitive strategy is adopted.
Step 3 (Offer generation) Given feasible solution P and prospective solution \(S^*\), the generation of a new offer \(A^*=\{A_1^*,A_2^*,\ldots ,A_i^*,\ldots ,A_n^*\}\) for a set of issues \(I\epsilon X\) is defined as:
where S(S, B) is a similarity function that is used to evaluate the similarity between counteroffer B and prospective solution S on the value of issues, and its formula is:
In formula (13), k is a constant, and \(k>0\), \(S_i\) and \(B_i\) are the values of S and B on issue i.
Step 4 (Negotiation terminal) The negotiation will be continued until the agent reaches an agreement or until no new offer or counteroffer is generated. Given feasible solution P and counteroffer B, negotiation will be terminated with two states, one of which is agreed upon and the other of which fails, where the condition of a successful negotiation is as follows:
and the condition of a failed negotiation is as follows:
If the ASV of the agent to counteroffer B is greater than the aggregated satisfaction threshold \(\varepsilon ^*\) in the new round, this indicates that the agent agrees to accept the offer from its opponent and that DFCSPs are solved because the DA and PA reach an agreement. Otherwise, the negotiation is terminated in a failed state, possibly because the new satisfaction threshold is less than zero or the set of feasible solutions is empty.
Negotiation protocol The negotiation protocol is the definition, representation, processing, and semantic explanation of agent communication language, which is mainly used to deal with interactions between agents during negotiation. In fact, it is the rule by which all agents must abide. It defines all interactions among agents and determines the sequence and structure of messages. Concerning the problems of PNSDM, the DA and PA can negotiate by sending and receiving various types of messages, including the following:
Ask (negotiator, opponent, offer) the DA sends an offer to its opponent to query the value of the issues concerning the treatment plan.
Tell (negotiator, opponent, counteroffer) the PA transmits the counteroffer to its opponent.
Accept (negotiator, opponent, offer) the negotiator accepts the offer presented by its opponent and terminates the negotiation.
Reject (negotiator, opponent) the negotiator sends a rejection message to its opponent if there are no offers sent to the opponent.
Agree (negotiator, opponent, counteroffer) the negotiator temporarily accepts the offer from its opponent and waits for the affirmation of the opponent.
Abort (negotiator, opponent) the negotiator aborts this negotiation for certain reasons.
In the formal negotiation process, as shown in Fig. 3, the DA will first send the Ask () message with an initial offer to the PA. When the offer is received from the DA, the PA evaluates the offer to determine whether this initial offer meets its own constraints. If the constraints are not met, then a counteroffer is generated according to formulas (2–13), and a Tell () message is sent to the DA. When the DA receives the PA’s counteroffer, it needs to evaluate and check whether it meets the negotiation requirements of the DA. If the counteroffer does not meet these requirements, then the concession value will be calculated, and an offer will be generated by the DA. Then, the DA will readjust the requirements for the negotiation items in step 7 and send an Ask () message with a new offer to the PA in step 8. Next, an exchange of the offer and counteroffer between the DA and PA will be carried out iteratively according to steps 2–9.
When the offer or counteroffer for all negotiated issues is accepted by the agent in step 2 or step 6, an Agree () message will be sent to the opponent’s agent. Then, in steps 11 or 13, if and only if the solution set of all negotiation issues satisfies formula (14), that is, all received messages are Agree (), the agent will send an Accept () message to its opponent, which means that the negotiation has reached an agreement. Otherwise, the DA or PA will send an Abort () message to its opponent, and the negotiation will fail because the satisfaction threshold of both parties is too low or the feasible solution set of an agent on some negotiation issues is null. Of course, there is another situation that also represents negotiation failure: the current negotiation time exceeds the agreedupon negotiation time. In the negotiation process between the DA and the PA, if the negotiation time does not exceed the specified deadline, then both parties will continue to negotiate. However, if it exceeds the deadline, then the negotiation will be terminated in a failed state.
Recommendation model for PNSDM
The negotiation result between a DA and a PA is an agreement on the value of all issues’ preferences, such as the approximate value of treatment cost, the estimated value of effectiveness, and the possible value of sideeffects. However, the motivation of PNSDM is to better complete SDM in clinical practice. Moreover, it aims to service for obtaining treatment plans that meet the preferences of both sides and conform to the actual patient’s condition. Therefore, we propose a recommendation model that can transform the negotiation result into feasible treatment plans and accomplish the recommendation of treatment plans.
In this model, first, basic information is shared between a doctor and a patient, and the patient’s condition is diagnosed by the doctor. Then, treatment plans that fit the patient’s condition are selected from the treatment guidelines. Next, the recommendation scores between selected treatment plans and the negotiation result are calculated, and the scores are then sorted. Finally, treatment plans with recommendation information are sent to agents. Of course, the recommendation results are reasonable and explainable. The concepts related to this recommendation model are shown in Fig. 4.
Suppose that a DA and a PA agree on the value of each issue through negotiation. Then, it is necessary to calculate the similarity value between solution \(S^*\) and each treatment plan and match the solution with each treatment plan chosen. The recommendation is defined as follows:
where n is the number of negotiation issues, i.e., negotiation objects, and \(w_i\) is the weight of the relevant issues concerning treatment plans (e.g., a DA’s issue preference weight, a PA’s issue preference weight, or the average issue preference weight of the DA and PA). In formula (16), \({\widetilde{S}}_i\) is the possibility distribution of the value of \(S^*\) on the \(i_{th}\) issue, and \(S_i\left( {\widetilde{S}}_i\right) \in [0,1]\) is the similarity calculation of the negotiation issue level, that is, the fuzzy membership function corresponding to each negotiation issue related to treatments. Based on this, we can obtain the final list of recommended treatment plans.
An illustration
In clinical practice, the PNSDM applies to the treatment decisionmaking method for various chronic diseases. For example, in the PNSDM for childhood asthma, the main task of doctor and patient is to negotiate with each other and integrate the preferences of cost, effectiveness, sideeffects, risk, and convenience, which are issues of concern for both negotiation parties. Therefore, based on agent technology, taking the PNSDM concerning childhood asthma as an example, our bilateral multiissue negotiation model is adopted to negotiate the issues involved in the treatment plan to solve the PNSDM problems.
This section provides a case to illustrate how the proposed negotiation and recommendation models work for the asthma PNSDM. We present an example of an PNSDM, a case of an 8yearold child whose asthma severity reached grade 4. By obtaining the preferences of doctor and patient for each issue and applying the FCAN model, the DA and PA can be constructed to solve the PNSDM problems and better complete the PNSDM. Notably, the preferences of doctor and patient are obtained by the questionnaire. In this case, the negotiated issues include cost (0–8 thousand RMB), effectiveness (1–10 rank), sideeffects (0–100 %), risks (0–100 %), and convenience (1–10 rank). The value range of each issue is given under the guidance of medical experts to restrict the solution space.
In the negotiation process, the preferences of the DA and PA will be different due to the different considerations of doctor and patient. These preferences can be constructed into fuzzy membership functions as described above. In this case, all preferences (e.g., the preference of value and weight) of DA and PA regarding every issue can be set as in Tables 1 and 2, respectively. Indeed, these preferences may change with information sharing between DA and PA. However, changeable preferences will affect the quality and speed of negotiation and decision. Thus, we assume negotiations are conducted on the premise of parties’ preferences fixed. If the preferences change, the negotiation can be restarted.
For this negotiation, the initial satisfaction thresholds of the DA and PA are set to 1.0, the reservation values of satisfaction are all 0.0, and the negotiated issues concerning treatment are cost, effectiveness, sideeffects, risk, and convenience. To ensure successful PNSDM within a small number of rounds, suppose that the DA and PA tend to reach an agreement as quickly as possible. That is, the collaborative negotiation strategy (i.e.,\(\ \omega _1<\omega _2\); \(\omega _1\), \(\ \omega _2\le 1.0\)) is used for the DA and PA in the illustrative case. According to Eqs. (14) and (15), the negotiation is terminated when the DA reaches an agreement with the PA or a negotiator withdraws from the negotiation. To summarize this negotiation, the data changes for the DA and PA are given in Tables 3 and 4.
In these tables, the concession value \(\Delta \varepsilon\), threshold \(\varepsilon ^*\), the size of feasible set P, and the size of prospective set \(S^*\) are listed. In addition, the offer for each round of DA and PA, as well as the relevant ASV, are shown in the tables. Each activity is specified by the expected value of the issues. Through the detailed negotiation steps described previously, DA and PA finally reach an agreement in the 7th round of negotiation, that is, [Cost: 3.79, Effective: 9, Sideeffects: 0.07, Risk: 0.07, Convenience: 9]. In the last round, the ASV of DA is greater than its threshold, which satisfies Eq. (14). Finally, the ASVs of DA and PA with the offer are 0.5337 and 0.7730, respectively.
According to the age of asthmatic children and the severity of asthma, feasible treatments for children can be obtained by the guidelines of bronchial asthma in children [42], as shown in Table 5. Table 5 presents the corresponding relationships between the four optional treatment options and the value of the issues under the set scenario. In clinical practice, this table is given based on big data analytics and medical experts’ opinions. In fact, it is not universal and only used for the experimental data of the case in reference. However, based on this, we can match the negotiation results of the DA and PA with the selected treatment plans determined by the children’s age and asthma control level. Table 6 shows the three possible pieces of information on the weight of each issue in formula (16), which is used for the similarity calculation with treatment plans.
Referencing the content shown in Tables 5 and 6 and according to our recommendation model, the similarity value, that is, the recommendation score of the negotiation result and each treatment plan, can be calculated, as shown in Fig. 5.
In the case of fully weighing the three possible weights, the similarity value between the negotiation result and the treatment plans is different under scenarios with different weight information. However, overall, the order of similarity (e.g., recommendation score) between the negotiation result and the treatment plan is consistent, as follows:
Enhigh dose ICS / LABA + Sustainedrelease THP \(\succ\) Enhigh dose ICS / LABA + LTRA \(\succ\) Enhigh dose ICS / LABA \(\succ\) Enhigh dose ICS + LTRA \(\succ\) Enhigh dose ICS + Sustainedrelease THP
This result has been fully affirmed by doctor and patient. From the above description, the treatment plans recommended by our recommendation model are consistent regardless of whether they are based on DA preferences, PA preferences, or a mix of both. It indicates that the recommendation results obtained by our recommendation model are unambiguous from any point of view.
Results and discussion
Experimental setup
Objective To better verify the efficiency of our negotiation model, performance comparisons of different strategies and different negotiation pairs (that is, different doctor and patient) are demonstrated in this section. The evaluation indicators include the combined ASV, running time in seconds, and negotiation rounds. Be noted that there are few agentbased methods to solve the PNSDM problems. Thus, the comparative experiments of this paper are limited.
Environment The program was written and compiled by Java. In addition, the behavior framework of agents and the negotiation between agents in this article are all provided by the Genius [43] platform.
Dataset The problems of PNSDM are common medical preferences problems that involve a number of issues and negotiator pairs. Thus, taking childhood asthma as an example, the negotiation issues include cost, effectiveness, sideeffects, risk, convenience, treatment time, prognosis, recurrence rate, and complications. The preference data of doctor and patient on issues were collected by questionnaires in the Department of Pediatrics at Xiamen Hospital of Traditional Chinese Medicine. The preferences data consist of the value preferences and weight preferences of the issues.
Parameter setup In the experiments, the numbers of DAs and PAs in a negotiation are all set to 1. The maximum negotiation round is set to 15 (if the negotiation rounds of the DA and PA, that is, doctor and patient, exceed 15, then the negotiation fails). We set the preference weight of each issue of the DA and PA to the same value to effectively verify the problemsolving ability of our negotiation model when the number of issues increases. In addition, all the experimental results in this paper are the average values after 200 repeated experiments.
Performance comparisons among different FCAN strategies
Different negotiation strategies represent different negotiation behaviors. To evaluate the impact of various negotiation strategies for PNSDM problems, including collaborative, winwin, and competitive, different issue numbers are used to compare performance. The negotiation strategies of the FCAN model are related to parameters \(\omega _1\) and \(\omega _2\) in formula (11), so in the experimental process, the strategy parameters are set to (i) a collaborative strategy, when \(\omega _1=0.8\) and \(\omega _2=1\); (ii) a winwin strategy, when \(\omega _1=\omega _2=1\); and (iii) a competitive strategy, when \(\omega _1=1.2\) and \(\omega _2=1\).
To test the performance of our negotiation model with different strategies when the problem size increases, the performance of the three negotiation strategies is compared with the Time model [41] when the number of issues increases. In the experiment, the number of negotiation issues is changed (the initial number of issues is set to 1, and two issues are added every time) to simulate different PNSDM scenarios.
The changes in the combined ASV values of the DA and PA using different strategies during the process of increasing the number of negotiation issues from 1 to 9 are represented in Table 7. It can be seen from this table that with the increase in negotiation issues, the trend of combined ASV values of the DA and PA is not fixed. This means that with the increase in the number of negotiation issues, the combined ASV obtained by the DA and PA may increase or decrease. On each negotiation issue scale, we know that the combined ASV value of the Time model is less than that of the FCAN model with any negotiation strategy. For FCAN, it achieves better performance with a competitive strategy than a winwin strategy or a collaborative strategy in terms of the combined ASV and when the number of issues increases. The data of FCAN with a competitive strategy are marked in bold in this table. However, the FCAN with a competitive strategy requires more running time and negotiation rounds, as shown in Tables 8 and 9.
The running time and negotiation rounds required by the DA and PA with different negotiation strategies of the FCAN model when the number of negotiation issues increases from 1 to 9 are compared in Tables 8 and 9. The data marked in bold in these tables indicates the best performance. With the increase in the number of issues, the number of running time and negotiation rounds all gradually increase, which is more in line with reality. When the scale of the issue increases, both sides need to spend more time negotiating to reach an agreement. However, no matter how the running time increases, it can be counted in seconds, and regardless of how much the number of negotiation rounds increases, it will not exceed the maximum number of negotiation rounds. At the same time, the number of negotiation rounds required for different negotiation strategies can be ranked as Time > FCAN with competitive > FCAN with Wwin–win > FCAN with collaborative, which is in line with actual negotiation. Although the negotiation running time of Time is less than that of the FCAN model, our negotiation run time is no more than one minute. During the negotiation process, our presented model will search the possible solution space, resolve conflict between the DA and the PA, and finally find the optimal solution for solving PNSDM problems. However, human beings will still be free from complex and trivial preference negotiation tasks with our models.
Tables 7, 8 and 9 reveal that the performance of the FCAN model is better than that of the Time model in terms of combined ASV and negotiation rounds. Although the FCAN model needs more time to explore the solution space, the running time of FCAN is still a few seconds. For FCAN, the competitive strategy results in the highest combined ASV but the highest number of negotiation rounds. The collaborative strategy results in the lowest combined ASV and number of negotiation rounds. The value of the combined ASV obtained and negotiation rounds required for the winwin strategy are somewhere in between. In addition, the running time of FCAN with a winwin strategy is often less than that of FCAN with a collaborative strategy or competitive strategy. The purpose of negotiation is to obtain the highest possible result for combined ASV with the lowest possible running time and fewest negotiation rounds. Therefore, the overall performance of the winwin strategy is best when the number of negotiation issues increases.
Performance evaluations among different negotiation pairs
For different doctor and patient, the processes and results of PNSDM may be different. Because their understanding of the same disease is different, their preference for the same negotiation issues may be different. However, our proposed negotiation is dynamic to a certain extent and can flexibly adapt to the real situation. To further evaluate the performance of the FCAN model, we simulated 10 doctor and 10 patient as experimental subjects and randomly set their preferences to compare the combined ASV, running time and negotiation rounds. There are 100 pairs of negotiations after permutation because each negotiation included one doctor and one patient. In the negotiation process, both sides used the winwin strategy to negotiate. The final results are shown in Figs. 6, 7, and 8.
Figure 6 shows the average combined ASV distribution of different negotiation pairs under different issues. As we can see from this figure, the distribution of the combined ASV on 1 to 9 issues is scattered. Specifically, the combined ASV obtained by DA and PA negotiation is not fixed and the value fluctuates between 02 regardless of the number of negotiation issues. This is because when the number of negotiation issues increases, the satisfaction of the DA and PA with the new negotiation issues is not fixed, which will directly affect the final combined ASV.
Figures 7 and 8 show the distribution of average running time and average negotiation rounds of different negotiation pairs under different issues, respectively. It can be seen from these two figures that the distribution of running time and negotiation rounds is relatively concentrated on different issues. In addition, when the number of issues increases from 1 to 9, the running time and negotiation rounds required for negotiation increase accordingly. The distribution of running time and negotiation rounds increases with the increase in the number of negotiation issues.
Furthermore, the results of Fig. 9 are consistent with the conclusions above. Figure 9a–c shows the average combined ASV obtained by 100 groups of negotiation pairs (that is, 100 groups of DA and PA) and the average running time and negotiation rounds required for negotiation under different numbers of negotiation issues. It can clearly be observed that as the number of negotiation issues increases, more running time and negotiation rounds will be needed, but the combined ASV obtained will not be fixed.
The results of Figs. 6, 7, 8 and 9 all show that our negotiation model can effectively address the negotiation pressure caused by the increase in issues. More specifically, our model can effectively simulate negotiations between different doctor and patient and obtain satisfactory negotiation results in a limited amount of time. In these figures, the average combined ASV obtained by 100 pairs of DA and PA negotiation is greater than 1.0, while the running time required for negotiation is less than 4 s and the number of rounds required for negotiation is no more than 15.
Conclusions
In this paper, we proposed a fuzzy constraintdirected agentbased multiissue negotiation and recommendation framework to solve the bilateral PNSDM problems. Compared with the artificial PNSDM, the agentbased PNSDM can complete multiple preferences negotiation in a few seconds. More importantly, our method can achieve satisfactory negotiation results in fewer negotiation rounds. The experimental results demonstrate that the presented FCAN model can flexibly deal with complex and realworld clinical situations through different strategies. It can usefully reduce the influence of multiple issues, timespace, and individual emotions to improve preferences negotiation efficiency. In addition, the proposed recommendation model can translate the negotiation results into treatment plans that achieve the purpose of treatment plan recommendations. In summary, this framework helps to realize PNSDM intelligence and quantify preference information. It reduces the probability of high cost, time consumption, delayed response and decision fatigue. Relatedly, the method helps to improve the efficiency of negotiation in SDM and promote the clinical application of SDM with consideration of the value preferences of doctors and patients.
Although the proposed model is helpful for the completion of the PNSDM process, it can still be further improved. In future work, the negotiation model will be improved by additional information sharing and the recommendation model will be enriched by more treatment data. In addition, the model proposed in this paper can be extended to more complex PNSDM scenarios, such as a multiagent system with an agent coalition. Moreover, the negotiation model and recommendation model will be tested by real doctors and patients in clinical practice. For example, we can also specifically study whether this method can indirectly improve patient compliance, improve the treatment effectiveness of diseases, or solve PNSDM problems corresponding to other diseases.
Availability of data and materials
All data generated or analysed during this study are included in this published article.
Abbreviations
 SDM:

Shared decisionmaking
 PNSDM:

Preferences negotiation in shared decisionmaking
 FCAN:

Fuzzy constraintdirected agentbased negotiation
 DFCSPs:

Distributed fuzzy constraint satisfaction problems
 DA:

Doctor agent
 PA:

Patient agent
 ASV:

Aggregated satisfaction value
References
Charles C, Gafni A, Whelan T. Shared decisionmaking in the medical encounter: what does it mean? (or it takes at least two to tango). Social Sci Med. 1997;44(5):681–92.
Barry MJ, EdgmanLevitan S. Shared decision makingthe pinnacle of patientcentered care. N Engl J Med. 2012;366(9):780–1.
Veatch RM. Models for ethical medicine in a revolutionary age. What physicianpatient roles foster the most ethical relationship? Hastings Cent Rep. 1972;2(3):5–7.
Moulton B, King JS. Aligning ethics with medical decisionmaking: the quest for informed patient choice. J Law Med Ethics. 2010;38(1):85–97.
JinQing G, XuZhi M, Wei Y. Discussing the emergence of contradiction between doctors and patients and development of harmonious relationship. Chin Health Serv Manage. 2011;28(3):181–3.
Hack T F, Degner L F, Watson P, Sinha L. Do patients benefit from participating in medical decision making? longitudinal followup of women with breast cancer. PsychoOncol J Psychol Soc Behav Dimens Cancer. 2006;15(1):9–19.
Gravel K, Légaré F, Graham ID. Barriers and facilitators to implementing shared decisionmaking in clinical practice: a systematic review of health professionals’ perceptions. Implement Sci. 2006;1(1):1–12.
Joosten EA, DeFuentesMerillas L, De Weert G, Sensky T, Van Der Staak C, de Jong CA. Systematic review of the effects of shared decisionmaking on patient satisfaction, treatment adherence and health status. Psychother Psychosom. 2008;77(4):219–26.
Ortendahl M. Shared decisionmaking based on different features of risk in the context of diabetes mellitus and rheumatoid arthritis. Ther Clin Risk Manag. 2007;3(6):1175.
Godolphin W. Shared decisionmaking. Healthc Q. 2009;12(12):186–90.
Agoritsas T, Heen AF, Brandt L, AlonsoCoello P, Kristiansen A, Akl EA, Neumann I, Tikkinen KA, Van Der Weijden T, Elwyn G. Decision aids that really promote shared decision making: the pace quickens. BMJ. 2015;350:7624.
Cameron M, Tan J, McLellan C, O’Neil A, Reed A, Henderin C, Dellavalle R, Boyal S. Development of patient decision aids for plaque psoriasis and acne. Dermatol Online J. 2018;24(27):13030.
Mahmood S, Hazes JM, Veldt P, van Riel P, Landewé R, Moens HB, Pasma A. The development and evaluation of personalized training in shared decisionmaking skills for rheumatologists. J Rheumatol. 2020;47(2):290–7.
Wagner A, Radionova N, Rieger MA, Siegel A. Patient education and continuing medical education to promote shared decisionmaking. A systematic literature review. Int J Environ Res Publ Health. 2019;16(14):2482.
Allan JL, Johnston DW, Powell DJ, Farquharson B, Jones MC, Leckie G, Johnston M. Clinical decisions and time since rest break: an analysis of decision fatigue in nurses. Health Psychol. 2019;38(4):318.
Persson E, Barrafrem K, Meunier A, Tinghög G. The effect of decision fatigue on surgeons’ clinical decision making. Health Econ. 2019;28(10):1194–203.
Kaplan B. Evaluating informatics applicationsclinical decision support systems literature review. Int J Med Informatics. 2001;64(1):15–37.
Das S, Ghosh PK, Kar S. Hypertension diagnosis: a comparative study using fuzzy expert system and neuro fuzzy system. In: 2013 IEEE International Conference on Fuzzy Systems (FUZZIEEE), 2013;1–7
Das S, Kar S. Group decision making in medical system: an intuitionistic fuzzy soft set approach. Appl Soft Comput. 2014;24:196–211.
Musen MA, Middleton B, Greenes RA. Clinical decisionsupport systems. In: Shortliffe EH, Cimino JJ, editors. Biomedical informatics: computer applications in health care and biomedicine. Cham: Springer; 2021. p. 795–840.
Miller R, Masarie F. Use of the Quick Medical Reference (QMR) program as a tool for medical education. Methods Inf Med. 1989;28(4):340–5.
Fox GN, Moawad NS. UpToDate: a comprehensive clinical database. J Fam Pract. 2003;52(9):706–10.
Protus BM. BMJ best practice. J Med Libr Assoc. 2014;102(3):224–5.
Schlessinger L, Eddy DM. Archimedes: a new model for simulating health care systemsthe mathematical formulation. J Biomed Informatics. 2002;35(1):37–50.
Jie Z, Zhiying Z, Li L. A metaanalysis of Watson for Oncology in clinical application. Sci Rep. 2021;11(1):1–13.
Elwyn G, Tsulukidze M, Edwards A, Légaré F, Newcombe R. Using a ‘talk’ model of shared decision making to propose an observationbased measure: observer OPTION5 item. Patient Educt Couns. 2013;93(2):265–71.
Wooldridge M, Jennings NR. Intelligent agents: theory and practice. Knowl Eng Rev. 1995;10(2):115–52.
Shakshuki E, Koo HH, Benoit D, Silver D. A distributed multiagent meeting scheduler. J Comput Syst Sci. 2008;74(2):279–96.
Yanrui RHZ. A flexible job shop scheduling system based on agent negotiation. Microcomput Inf. 2011;27(1):14–6.
Agent based negotiation in ecommerce. In2010 International Symposium on Information Technology 2010 (Vol. 2, pp. 861–868).
Sim KM. Agentbased cloud computing. IEEE Trans Serv Comput. 2011;5(4):564–77.
Rajavel R, Thangarathanam M. Agentbased automated dynamic SLA negotiation framework in the cloud using the stochastic optimization approach. Appl Soft Comput. 2021;101:1568–4946.
Rajavel R, Ravichandran SK, Nagappan P, Ramasubramanian Gobichettipalayam K. Cloud service negotiation framework for realtime ecommerce application using game theory decision system. J Intell Fuzzy Syst. 2021;41(5):5617–28.
Fatima SS, Wooldridge M, Jennings NR. An agendabased framework for multiissue negotiation. Artif Intell. 2004;152(1):1–45.
Rajavel R, Thangarathanam M. Adaptive probabilistic behavioural learning system for the effective behavioural decision in cloud trading negotiation market. Future Gener Comput Syst. 2016;58:29–41.
Rajavel R, Iyer K, Maheswar R, Jayarajan P, Udaiyakumar R. Adaptive neurofuzzy behavioral learning strategy for effective decision making in the fuzzybased cloud service negotiation framework. J Intell Fuzzy Syst. 2019;36(3):2311–22.
Marey, OI. A framework for argumentationbased agent negotiation in uncertain settings. Ph.D. thesis 2016, Concordia University.
Kowalczyk R, Bui, V. On fuzzy enegotiation agents: autonomous negotiation with incomplete and imprecise information. InProceedings 11th International Workshop on Database and Expert Systems Applications, 2000 (pp. 1034–1038).
Lai KR, Lin MW. Modeling agent negotiation via fuzzy constraints in ebusiness. Comput Intell. 2004;20(4):624–42.
Krishankumaar R, Mishra AR, Gou X, Ravichandran K. New ranking model with evidence theory under probabilistic hesitant fuzzy context and unknown weights. Neural Comput Appl. 2022;34(5):3923–37.
Zulkernine FH, Martin P. An adaptive and intelligent SLA negotiation system for web services. IEEE Trans Serv Comput. 2011;4(1):31–43.
The Respiratory Group, C.M.A. The Society of Pediatrics: guidelines for diagnosis, prevention and treatment of bronchial asthma in children. Chin J Pediatr 2016;54(3), 167–181
Lin R, Kraus S, Baarslag T, Tykhonov D, Hindriks K, Jonker CM. Genius: an integrated environment for supporting the design of generic automated negotiators. Comput Intell. 2014;30(1):48–70.
Acknowledgements
We would like to express our gratitude to the Department of Pediatrics in Xiamen Hospital of Traditional Chinese Medicine for providing the research environment.
Funding
This work was supported by the Science Foundation of Fujian Province (No. 2021J011188), the Xiamen Science and Technology Planning Project (No. 3502Z20206073), the Research Project of Xiamen Overseas Students (No. XRS202017206), the Open Fund of Key Laboratory of Ecological Environment and Information Atlas, Fujian Provincial University (ST18004), the Open Fund of Engineering Research Center of Big Data Application in Private Health Medicine, Fujian Provincial University (KF2020003), and the XMUT Scientific Research Project (No. YSK20002R, No. YKJCX2019108).
Author information
Authors and Affiliations
Contributions
KL conceived and designed the study. YL validated the study and was a major contributor in writing the manuscript. KL and PL managed the quality and progress of the whole study. YY, HF, and FH collected and analyzed some resources and data. All authors read and approved the final manuscript.
Corresponding authors
Ethics declarations
Ethics approval consent to participate
This study was approved by the Medical Ethics Committee of Xiamen Hospital of Traditional Chinese Medicine, China, and the approval number is 2021K06501. All methods were performed in accordance with the relevant guidelines and regulations of the institutional and/or national research committee and with the Declarations of Helsinki. In addition, all participants and their parents or legal guardian provided written informed consent after a complete description of the study.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Lin, K., Liu, Y., Lu, P. et al. Fuzzy constraintbased agent negotiation framework for doctorpatient shared decisionmaking. BMC Med Inform Decis Mak 22, 218 (2022). https://doi.org/10.1186/s1291102201963x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s1291102201963x