Comparing Options with Argument Schemes Powered by Cancellation
Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence. Main track. Pages 1537-1543.
https://doi.org/10.24963/ijcai.2019/213
Keywords
- Knowledge Representation and Reasoning: Computational Models of Argument
- Knowledge Representation and Reasoning: Preference Modelling and Preference-Based Reasoning
- Knowledge Representation and Reasoning: Knowledge Representation and Decision ; Utility Theory
Abstract
We introduce a way of reasoning about preferences represented as pairwise comparative statements, based on a very simple yet appealing principle: cancelling out common values across statements. We formalize and streamline this procedure with argument schemes. As a result, any conclusion drawn by means of this approach comes along with a justification. It turns out that the statements which can be inferred through this process form a proper preference relation. More precisely, it corresponds to a necessary preference relation under the assumption of additive utilities. We show the inference task can be performed in polynomial time in this setting, but that finding a minimal length explanation is NP-complete.
- [Amgoud and Prade, 2009] Leila Amgoud and Henri Prade. Using arguments for making and explaining decisions. Ar- tificial Intelligence, 173:413-436, 2009.
- [Amor et al., 2016] Nahla Ben Amor, Didier Dubois, Hela Gouider, and Henri Prade. Graphical models for pref- erence representation: An overview. In Proceedings of the 10th International Conference on SUM, pages 96-111, 2016.
- [Bouyssou et al., 2009] Denis Bouyssou, Didier Dubois, Marc Pirlot, and Henri Prade. Decision Making Process: Concepts and Methods. Wiley ISTE, 2009.
- [Cailloux and Endriss, 2014] Olivier Cailloux and Ulle En- driss. Eliciting a suitable voting rule via examples. In Proceedings of the 21st ECAI'14 , pages 183-188, 2014.
- [Destercke, 2018] Sébastien Destercke. A generic frame- work to include belief functions in preference handling and multi-criteria decision. International Journal of Ap- proximate Reasoning, 98:62 -77, 2018.
- [Dubois et al., 2008] Didier Dubois, Hélène Fargier, and Jean-Fraccois Bonnefon. On the qualitative comparison of decisions having positive and negative features. J. Artif. Intell. Res., 32:385-417, 2008.
- [Fishburn, 1967] Peter C. Fishburn. Interdependence and additivity in multivariate, unidimensional expected util- ity theory. International Economic Review, 8(3):335-342, 1967.
- [Fishburn, 1970] Peter C. Fishburn. Utility Theory for Deci- sion Making. J. Wiley & Sons, 1970.
- [Fisher, 1892] Irving Fisher. Mathematical investigations in the theory of value and prices, and appreciation and inter- est. 1892.
- [Gonzales, 2000] Christophe Gonzales. Two factor conjoint measurement with one solvable component. Journal of Mathematical Psychology, 44(2):285-309, 2000.
- [Greco et al., 2008] Salvatore Greco, Vincent Mousseau, and Roman Słowiński. Ordinal regression revisited: multi- ple criteria ranking using a set of additive value functions. EJOR, 191(2):416-436, 2008.
- [Greco et al., 2014] Salvatore Greco, Vincent Mousseau, and Roman Słowiński. Robust ordinal regression for value functions handling interacting criteria. EJOR, 239(3):711- 730, 2014.
- [Hammond et al., 1998] John Hammond, Ralph Keeney, and Howard Raiffa. Even Swaps: a rational method for mak- ing trade-offs. Harvard Business Review, pages 137-149, 1998.
- [Jacquet-Lagrèze and Siskos, 1982] Eric Jacquet-Lagrèze and Yanis Siskos. Assessing a set of additive utility functions for multicriteria decision making: the UTA method. EJOR, 10:151-164, 1982.
- [Karp, 1972] Richard M. Karp. Reducibility among combi- natorial problems. In Complexity of Computer Computa- tions: Proceedings of a symposium on the Complexity of Computer Computations, pages 85-103. 1972.
- [Krantz et al., 1971] David H. Krantz, Duncan R. Luce, Patrick Suppes, and Amos Tversky. Foundations of mea- surement, volume 1: Additive and Polynomial Represen- tations. Academic Press, 1971.
- [Kroll et al., 2017] Joshua A. Kroll, Joanna Huey, Solon Barocas, Edward W. Felten, Joel R. Reidenberg, David G. Robinson, and Harlan Yu. Accountable algorithms. Uni- versity of Pennsylvania Law Review, 165, 2017.
- [Labreuche, 2011] Christophe Labreuche. A general frame- work for explaining the results of a multi-attribute prefer- ence model. AIJ, 175:1410-1448, 2011.
- [Miller, 2019] Tim Miller. Explanation in artificial intelli- gence: Insights from the social sciences. Artif. Intell., 267:1-38, 2019.
- [Mitchell, 1982] Tom M. Mitchell. Generalization as search. Artificial Intelligence, 18(2):203-226, 1982.
- [Mousseau et al., 2003] Vincent Mousseau, Luis C. Dias, José Figueira, Carlos Gomes, and João N. Clímaco. Re- solving inconsistencies among constraints on the parame- ters of an MCDA model. EJOR, 147(1):72-93, 2003.
- [Ouerdane, 2011] Wassila Ouerdane. Multiple criteria deci- sion aiding: a dialectical perspective. 4OR, 9:429-432, 2011.
- [Procaccia, 2019] Ariel D. Procaccia. Axioms should ex- plain solutions. In Laslier, Moulin, Sanver, and Zwicker, editors, Future of Economic Design. 2019.
- [Ribeiro et al., 2016] Marco T. Ribeiro, Sameer Singh, and Carlos Guestrin. "why should I trust you?": Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD, pages 1135-1144, 2016.
- [Toulmin, 1958] Stephen Toulmin. The uses of Arguments. Cambridge University Press, 1958.
- [Ustun and Rudin, 2016] Berk Ustun and Cynthia Rudin. Supersparse linear integer models for optimized medical scoring systems. Mach. Learn., 102(3):349-391, 2016.
- [Wakker, 1989] Peter Wakker. Additive Representations of Preferences: A New Foundation of Decision Analysis. Theory and Decision Library C. 1989.
- [Walton, 1996] Douglas Walton. Argumentation schemes for Presumptive Reasoning. Mahwah, N. J.,Erlbaum, 1996.
- [Wilson, 2009] Nic Wilson. Efficient inference for expres- sive comparative preference languages. In Proceedings of the 21st International Joint Conference on Artificial Intel- ligence, pages 961-966, 2009.
- [Zhong et al., 2019] Qiaoting Zhong, Xiuyi Fan, Xudong Luo, and Francesca Toni. An explainable multi-attribute decision model based on argumentation. Expert Systems with Applications, 117:42-61, 2019.
References were extracted automatically from the PDF and may contain errors.
Full text extracted automatically from the PDF; figures, tables and equations may differ. The PDF is the version of record.
1 Introduction
In his famous letter to his friend Joseph Priestley, Benjamin Franklin suggested a procedure to decide upon difficult decision cases: draw two columns, list pros and cons, and delete (sets of) arguments from both sides when they are of "equal weight". It is remarkable that Franklin's "Moral Algebra" is sometimes seen as a pioneer technique to both argumentative approaches [Toulmin, 1958] which aims at formalizing, visualizing (and eventually criticizing) reasoning steps; as well as techniques to elicitate and reason about preferences based on trade-offs (even swaps, [Hammond et al., 1998]). The bipolar nature of his algebra also proved to be influential in KR in general [Dubois et al., 2008; Bouyssou et al., 2009]. In this paper we build on the legacy of this approach, by relying on its core principle of cancellation, but without considering the weighting of different attributes - that is, only similar values can be crossed. We consider comparative preference statements whereby a user expresses unambiguously holistic judgments over alternatives described according to several points of view. From a set of such comparative statements, we wish to maintain the set of all valid consequences in order to make new inferences (under the form of further holistic comparative statements), and at the same time keep track of the reasoning steps involved. Thus, our objective is to know, for any preference query, whether it can be derived, but also how it can be derived.
∗Contact Author
We begin by introducing informally, through an example, a way of reasoning about preferences under the form of pairwise preference statements, then we propose a research agenda concerning this reasoning engine, and we outline the remainder the paper.
Example 1. Hotels are compared according to the points of view of comfort, offer of a restaurant, commute time and cost. We are given monotonicity conditions according to each point of view (shared by all stakeholders), e.g. the larger the comfort the better; it is better to have a restaurant; the smaller the commute time the better; and the smaller the price the better. We are also given the following preference information:
- π1 : a hotel with features (4*, no, 15 min, 180 $) is preferred to a hotel with features (2*, yes, 45 min, 50 $).
- π2 : a hotel with features (4*, no, 45 min, 50 $) is preferred to a hotel with features (4*, yes, 15 min, 100 $).
Monotonicity along each point of view allows for inferring comparative statements outside of the knowledge base.
Example 2. (Ex. 1 continued) From π1, thanks to the monotonicity w.r.t to cost, we can deduce that (4*, no, 15 min, 180 $) is preferred to (2*, yes, 45 min, 80 $).
Reasoning ceteris paribus offers another venue to extend our knowledge about valid preferences.
Example 3. (Ex. 2 continued) In π2, both hotels share the same comfort rating 4∗, and we propose to interpret this statement as: comfort being equal, we prefer (no, 45 min, 50 $) to (yes, 15 min, 100 $). Taking value 2∗, we obtain for instance that (2*, no, 45 min, 50 $) is preferred to (2*, yes, 15 min, 100 $).
These two principles are too weak to deduce many entailments from the preference information, and therefore will not allow comparing many alternatives. We therefore propose a way to combine several preference information statements. The notion of ceteris paribus reasoning can be generalized throughout statements by cancelling a similar value appearing in the left hand side (LHS) of a statement and in the right hand side (RHS) of another statement.
Example 4. (Ex. 3 continued) For instance, the cost value 50 $ appears both in the LHS of π2 and the RHS of π1. This extended principle can be used to infer new statements, as illustrated in the following table. The first three lines of the table introduce the premises: the preference information statements π1 and π2, as well as the ceteris paribus monontonicity statement dfood according to which, everything else being equal, a hotel with a restaurant is at least as good as a hotel without one. In each column representing a feature, we strike out individual values appearing simultaneously on the LHS and the RHS-when a value is repeated, we are careful to strike out as many values from the LHS as from the RHS. At the end, we notice that there is only one value left in each column, that we report on the last line of the table-the conclusion-forming what we consider a valid preference statement inferred from the premises.
We are now in a position to set out several research questions concerning the procedure we just informally described, that we shall address in this paper:
- Modeling (see Section 2). To what extent this procedure can be formalized into a reasoning model?
- Templating (see Section 2). Can the template for presenting the arguments supporting a claim be streamlined? How can these bundles be efficiently validated?
- Properties (see Section 3). The set of statements that can be inferred from a given preference information form a binary relation between alternatives. What are the properties of this relation? Importantly, is it a proper preference relation?
- Inference (see Section 3). Is there an efficient way to assess if a given pairwise preference statement can be inferred from a given preference information?
- Explanations (see Section 4). Given a pairwise preference statement, is it possible to find a cognitively simple certificate supporting or informing its validity?
- Critique (see Section 5). This reasoning engine is built upon several fundamental assumptions, that need to be discussed.
2 The ReasoningModel
We address in this section the first research question, namely: can the intuition presented in the introduction be formalized?
2.1 Features and Alternatives
We consider a set N of points of view, each one i ∈ N expressed by a feature taken in the set Xi. Alternatives are described as tuples of features, and belong to the Cartesian product X = ∏i∈N Xi.
For an alternative x ∈ X and a point of view i ∈ N, we denote by xi the evaluation of x according to i. For any nontrivial subset of points of view A ⊂ N and any two alternatives a, b ∈ X, we denote a-AbA the (fictitious) alternative which is equivalent to a according to each point of view not in A, and equivalent to b according to the points of view in A.
2.2 Preference Information
We are interested in providing a principled way of reasoning that allows us to infer preference and answer preference queries of the type 'is alternative a preferred to alternative b?'. The reasoning shall be based on preference information, coming in two distinct flavors:
- explicit pairwise statements P ⊂ X2 , where (x, y) ∈ P means that x is at least as good as y for the decision maker;
- implicit dominance-we assume that each feature set corresponding to a point of view i ∈ N is totally ordered by a relation ≿i⊂ X2i , and we denote D := ∏i∈N ≿i, the Pareto dominance relation between alternatives stemming from the ordering of each feature set, i.e. ∀x, y ∈ X, xDy ⇐⇒ ∀i ∈ N, xi ≿i yi.
2.3 Cancellation Axioms
The inductive principle based on ceteris paribus sketched in Ex. 3 can be formalized thanks to the concept of cancellation. The cancellative axioms are well-known in the preference literature [Krantz et al., 1971; Wakker, 1989], and we briefly recall their definition.
Definition 1 (First-order cancellation). For all A ⊂ N, with A ̸= ∅ and all x, y, z, z ′ ∈ X,x-AzA ≿ y-AzA ⇒ x-Az′A ≿ y-Az′A.
In Ex. 3, according to the first-order cancellation, π2 implies that (2*, no, 45 min, 50 $) is preferred to (2*, yes, 15 min, 100 $).
We also have seen in the introduction cancellation across preference statements. It can be formalized in the following definition.
Definition 2 (High-order cancellation). Consider m+ 1 alternatives x(0) , . . . , x(m) in X. Let y(0) , . . . , y(m) be m+ 1 alternatives in X such that, for every point of view i ∈ N, (y(0) i , . . . , y(m) i ) is a permutation of (x(0) i , . . . , x(m) i ). Then,[x(k) ≿ y(k) , ∀k ∈ {1, . . . , m}] ⇒ y(0) ≿ x(0) .
In order to conveniently represent concatenations of premises, maybe with repetition, modulo permutation, we represent the tuples of alternatives or values as multisets. The multiset containing the elements z1, repeated m1 times, . . . , zk repeated mk times has support {z1, . . . , zk}, cardinality ∑ mj and is denoted 〈z1 : m1, ..., zk : mk〉.
2.4 The Syntactic Cancellative Argument Scheme
We formalize the way of reasoning about preference statements illustrated in the introduction through an argument scheme [Walton, 1996], an operator tying premises satisfying some conditions, to a conclusion. This scheme is closely related to the high-order cancellation axiom described previously. We slightly alter it in order to allow for a repetition of the conclusion (we defer an example and the discussion of the importance of this alteration to Section 3.5).
Definition 3 (Syntactic cancellative argument scheme). Given two positive integers m ≥ n, and a pair of alternatives (x, y) ∈ X × X, we say the multiset of pairs of alternatives 〈(a(1) , b(1) ) : r1, . . . , (a(k) , b(k) ) : rk〉 ∈ (X×X)N of cardinality m = ∑ki=1 ri is a syntactic cancellative explanation of length m with n repetitions of the pair (x, y) if, for each point of view i ∈ N, the multisets 〈a(1) i : r1, . . . , a(k) i : rk, yi : n〉 and 〈b(1) i : r1, . . . , b(k) i : rk, xi : n〉 are equal.
This definition is illustrated in Ex. 4.
Validation. Checking if a given tuple of pairs of alternatives is an argument of a given pair of alternatives with a given number of repetitions can be performed in O(|N| · k lnk), where k is the cardinality of the support set of the explanation.
2.5 The Elliptic Cancellative Argument Scheme
In this section, we propose to streamline the syntactic cancellative argument scheme by omitting the dominance statements. As the resulting scheme is based on an omission (an ellipsis), we dub it the elliptic cancellative scheme.
Definition 4 (Elliptic cancellative explanation scheme). Given a dominance relation D, we say the multiset of pairs of alternatives 〈(a(1) , b(1) ) : r1, . . . , (a(k) , b(k) ) : rk〉 ∈ (X × X)N of cardinality m = ∑ki=1 ri is a syntactic cancellative explanation of length m with n repetitions of the pair (x, y) if there exists a multiset of cardinality m′ of dominance statements 〈(c(1) , d(1) ) : r′1 , . . . , (c(k′ ) , d(k′ ) ) : r′k′〉 ∈ DN such that 〈(a(1) , b(1) ) : r1, . . . , (a(k) , b(k) ) : rk〉 ∪ 〈(c(1) , d(1) ) : r′1 , . . . , (c(k′ ) , d(k′ ) ) : r′k′〉 is a syntactic cancellative explanation of length m+m′ with n repetitions of the pair (x, y).
Example 5. (Ex. 4 continued) The syntactic cancellative explanation of Ex. 4 can be simplified by removing the last statement d, yielding:
Validation. It is a little more subtle to check the validity of an elliptic cancellative argument scheme than of a syntactic one. Indeed, when considering the point of view i ∈ N and comparing the two multisets Li := 〈a(1) i : r1, . . . , a(k) i : rk, yi : n〉 and Ri := 〈b(1) i : r1, . . . , b(k) i : rk, xi : n〉 there are missing elements corresponding to the implicit dominance relations that are not mentioned. Adding these missing dominance relations would have added "good" elements in Li and "bad" elements in Ri - yielding two lexicographically equivalent vectors. As this is not the case, Ri contains better elements than Li in the lexicographic sense. In Ex. 5, we obtain Lfood = 〈yes : 1, no : 2〉 and Rfood = 〈yes : 2, no : 1〉, so that the previous dominance is verified (as Rfood contains more "yes" values than Lfood ). Hence the validation of an elliptic cancellative argument scheme simply consists in ordering each Li and Ri, and checking that, for every j, the j th best elements in Ri is not lesser than the j th best elements in Li w.r.t. to the order relation ≿i. Thus, the validation can also be performed in O(|N| · k ln k).
3 The Inferred Preference Structure
In this section, we are interested in the description and the computation of the binary relation over alternatives potentially obtained by applying the reasoning engine to the facts of the preference information.
Definition 5. Given preference information P and a dominance relation D, we denote NP,D the set of pairs of alternatives for which there is a syntactic cancellative explanation of any length with pairs of alternatives in P ∪ D.
3.1 Inference as Closure
We note that N· is a closure operator: if new preference statements NP,D can be inferred from P and D, adding them to the knowledge base would not yield additional inference.
Lemma 1.
Sketch of proof. The inclusion NP,D ⊂ NNP,D,D is a consequence of the fact that 〈s : 1〉 is an explanation of s for any statement in P. As for NP,D ⊃ NNP,D,D, let (X, Y ) ∈ NNP,D,D. There is an syntactic explanation of length m with n repetitions of the pair (X, Y ), say 〈(x(1) , y(1) ) : r1, . . . , (x(K) , y(K) ) : rK〉 ∈ (X × X)N where each pair (x(k) , y(k) ) is in NP,D, and is therefore supported by an explanation Ek of length mk with nk repetitions, with statements in P ∪ D. We claim the tuple obtained by concatenating each explanation Ek repeated ∏k′∈[m],k′ ̸=k nk′ is an explanation with ∏k∈[m] nk repetitions of the pair (X, Y ), with statements in P ∪ D.
3.2 ADetour viaModel-Based Inference
In order to state the main result of this paper, we need to recall the basic principles of model-based inference. The goal of inference is extend some (limited) preference information to a richer preference relation R, with 'good' properties, such as R being a reflexive and, transitive binary relation over X, and maybe complete.
When preference information is given as P ∪ D, where P is the explicit part, given in so-called holistic form, i.e. P ⊂ X2 is a set of reference pairwise statements, and D is the dominance relation stemming from the ordering of the features, the relation R is said to be consistent when P ∪D ⊂ R.
In order to describe R, which is potentially a very complicated combinatorial object, in a simple language, it is customary to rely on some kind of parameterization of the target set. For instance, numeric models [Jacquet-Lagr`eze and Siskos, 1982] in the field of multiple criteria decision making, or graphical languages [Wilson, 2009; Amor et al., 2016] from KR. A popular paradigm consists in considering value-based preferences, where the target preference relation is parameterized by a numeric scoring function u : X → R, so that xRuy ⇐⇒ u(x) ≥ u(y). (this assumption is made without loss of generality as soon as R is assumed to be transitive and complete). The target set is still very large and complex, and a common additional assumption is to restrict the scoring function to be additive w.r.t. the features, i.e. there is a decomposition such that ∀x ∈ X, u(x) = ∑i∈N ωi(xi).
Definition 6 (preferences based on additive value). The parameter set of the additive value model is ΩΣ := ∏i∈N RXi , and for a given value ω := 〈ωi〉i∈N of the parameter, the corresponding preference relation R∑ ω ⊂ X2 is defined by:
For such an additive value, that we denote R∑ ω, the condition D ⊂ R∑ ω translates to the following monotonicity conditions: for all features i, the function ωi : (Xi,≿i) → (R,≥) is nondecreasing.
The most prevalent approach in model-based inference consists in determining the most adequate value of the parameter in the sense of some loss function L: ω⋆ = argminΩΣ L, and returning the corresponding preference relation R∑ ω⋆. Meanwhile, the robust approach consists in considering the intersection of all the consistent preference relations, assuming it is not empty:
The robust approach yields the version space [Mitchell, 1982] of the model. Equivalently, it can be understood as assuming that the preference information P is incomplete (as there might be several value of the parameter that are consistent with it), and drawing skeptical conclusions with respect to all the possible completions.
3.3 Cancellative-Powered Deductions are Robust Inferences under Additive Values
We are now able to state an important result concerning the preference structure NP,D.
Theorem 1.
The inferred preference structure is exactly the necessary preference relation under the assumption of an additive value model. This result has an important corollary concerning the inferred relation:
Corollary 1 (Properties of the inferred structure). NP,D is a transitive and reflexive binary relation.
The proof of Th. 1 relies on the fact that, under the assumption of an additive value model, a preference statement can be represented by a linear form operating over the vector space ΩΣ.
Definition 7. Given some preference information P ⊂ X2 , alternatives x, y ∈ X, and a point of view i ∈ N, for any value xi ∈ Xi, let ϵi,xi : RXi → R, ωi ↦→ ωi(xi), and
φ(x,y) = ∑i∈N ϵi,xi - ϵi,yi a linear form over RX. Also, let ̂Xi := {t ∈ Xi : ∃(a, b) ∈ P, t = ai or t = bi}∪{xi}∪{yi} and ̂X := ∏i∈N ̂Xi.
Lemma 2.
Proof of NP,D ⊂ R⋆ΩΣ .
Let (x, y) ∈ NP,D. By definition, there is a syntactic cancellative explanation of length m with n repetitions of the pair (x, y), say 〈(a(1) , b(1) ), . . . , (a(m) , b(m) )〉 ∈ (P ∪ D)m. Therefore, for each point of view i ∈ N, (yi, . . . , yi, a(1) i , . . . , a(m) i ) is a permutation of (xi, . . . , xi, b(1) i , . . . , b(m) i ). In particular, for any parameter ω ∈ ΩΣ, nωi(yi) + ωi(a(1) i ) + · · · + ωi(a(1) i ) = nωi(xi) + ωi(b(1) i ) + · · · + ωi(b(1) i ), so nφ(x,y)(ω) = ∑mj=1 φ(a(j) ,b(j) )(ω). Now, if ω is consistent, (P ∪D) ⊂ Rω and φ(a(j) ,b(j) )(ω) ≥ 0. Thus nφ(x,y)(ω) is nonegative as the sum of m nonnegative terms, and x is necessarily preferred to y under the assumption of an additive value model.
Proof of NP,D ⊃ R⋆ΩΣ . Let (x, y) ∈ R⋆ΩΣ . For any parameter ω ∈ ΩΣ such that ∀s ∈ (P ∪ D), φs(ω) ≥ 0, φ(x,y)(ω) ≥ 0. This property concerns linear forms in RX, which is a vector space of infinite dimension, but also holds in R̂X.Indeed, ̂X ⊂ X, is of finite dimension, and any additive parameter function ̂ω : ̂X → R such that (P ∪ D) ∩ ̂X2 ⊂ R̂ω can be extended into an additive function ω : X → R describing a consistent relation R∑ ω. By Farkas' lemma, the linear form φ(x,y) is a conical combination of the 〈φs〉s∈(P∪D)∩̂X2. As the coefficients of all these linear forms are integers-they are, indeed, in {-1, 0, 1}-the coefficients of the conical combinations can be chosen rational, and by multiplying by the lesser common multiple of their denominators, yield an identity: n φ(x,y) = ∑s∈(P∪D)∩̂X2 ms φs, with a positive integer n and nonnegative integer coefficients 〈ms〉s∈(P∪D)∩̂X2. We claim the tuple 〈s : ms〉s∈(P∪D)∩̂X2 is a syntactic cancellative explanation of length n of the pair (x, y), with statements in P ∪ D, thus (x, y) ∈ NP∪D.
3.4 Efficient Inference Procedures
The necessary relation assuming an additive value model R⋆ΩΣ is defined and studied by [Greco et al., 2008]. In particular, Greco et al. propose a linear program permitting to solve the decision problem corresponding to our research question concerning inference: given a pair of alternative, decide if it is in the inferred preference relation. This linear program is expressed in the primal space R ̂X of the values ωi(xi) given to each relevant value of the attributes. These values are of little interest concerning our cancellative argument schemes, so we propose to formulate the dual problem.
Corollary 2 (Polytime inference via conical decomposition). For all pairs of alternatives (x, y) ∈ X2 , (x, y) ∈ NP,D if, and only if, the following linear program is feasible: find nonnegative real numbers 〈λs〉s∈(P∪D)∩ ̂X2 such that
Would the decision variables λ be integers, they could directly be interpreted as a multiset 〈s : λs〉 serving as a syntactic cancellative explanation for (x, y). As the elliptic scheme tells us that the coefficients corresponding to the dominance statements are eventually irrelevant, this formulation ought to be further streamlined. Unfortunately, the conical span of the dominance statements is not easy to characterize in the dual base (ϵi,xi ). This obstacle can be lifted by representing the preference statements in an alternative decomposition, that focuses on differences of values, rather than values.
Definition 8. Given a finite binary relation A ⊂ X2 , for all points of view i ∈ N we denote {̂ xi,1 ≾ ̂ xi,2 ≾ · · · ≾ ̂ xi,|̂Xi| } = ̂Xi . For any integer k, 1 ≤ k < |̂Xi|, let δ̂X,i,k := ϵi,̂ xi,k+1 - ϵi,̂ xi,k .
Lemma 3. For any statement (x, y) ∈ A and any point of view i ∈ N,
This lemma has two important consequences:
- Corollary 2 can be expressed in terms of 〈δ ̂X2〉 rather than 〈ϵ〉; and
- ii) dominance statements in A are exactly the conical span of the 〈δA〉.
This leads to a leaner reformulation of the inference problem. Definition 9. For all x, y ∈ X, i ∈ N and k ∈ N : 1 ≤ k < |̂Xi|, let
Theorem 2 (Inference via LP). For all pairs of alternatives (x, y) ∈ X2 , (x, y) ∈ NP,D if, and only if, the following linear program is feasible:
find nonnegative real numbers 〈λs〉s∈P such that the inequality ϕ(i,k) (x,y) ≥ ∑s∈P λsϕ(i,k) s holds for every indices i ∈ N and 1 ≤ k < |̂Xi|.
3.5 Repetition of the Conclusion
The presence of repetition of the conclusion makes the explanation scheme cumbersome. One may wonder whether it is possible to get rid of the repetition of the conclusion.
Theorem3. It is not possible to cover all possible inferences obtained by the robust additive model by restricting the cancellation explanation schema with n = 1 repetition.
Proof. We provide a counter-example with |N| = 6 features, X = {0, 1}6 and 1 ≿i 0 (statement di) for all i ∈ N. The preference information is:
We can infer from the preference information that (0, 0, 1, 0, 1, 0) is preferred to (1, 1, 0, 1, 0, 1) (statement πC). One can readily see that π1 + π2 + π3 + π4 = 2 πC.
Assuming by contradiction that there exist Farkas coefficients with coefficient 1 associated to πC: πC = ∑6i=1 λiπi+ ∑6i=1 µi di, where λi, µi ∈ N leads to an infeasible linear system.
One could also want to trim down the potential complexity of the explanations by limiting the number of premises. Unfortunately, this might lead to loss of transitivity for the inferred relation.
4 Explanations for Valid Preference Statements
It seems reasonable to believe that an explanation is easier to process by a cognitive agent-'simpler'-when it is short. In the case of cancellative explanations, the actual cognitive burden mainly comes from three factors: the number of points of view |N|, that we consider as mostly exogenous; the length m of the premises; and the number n of repetitions of the conclusion. Without any experimental evidence, we consider the problem of finding an explanation for a given pair (x, y) ∈ NP which is as simple as possible as a bi-objective integer linear minimization problem:
Integer linear programs offer a powerful language permitting to describe difficult combinatorial problems. These formulations can be given wholesale to dedicated solvers, that eschews the need for developing a dedicated piece of software and benefits from state-of-the-art refinements in the solving of such problems. Nevertheless, it would be unwise to delegate the search for a short explanation of a given pair of alternatives to such a solver, if this search were not, intrinsically, a difficult combinatorial problem. The following theorem addresses this issue.
Theorem 4. The problem of deciding, for a given input (x, y, n,m) ∈ X×X×N⋆ ×N⋆ if there is an elliptic cancellative explanation of the pair (x, y) of length at most m with at most n repetitions is NP-complete. This remains true even if the number n of repetitions is set to one.
Proof. Membership to NP is ensured, as checking the validity of an elliptic scheme is polyomial in the number of distinct premises, which is upper bounded by the cardinality of P.
Hardness can be established e.g. by reduction from VERTEX COVER [Karp, 1972]. Formally, a vertex cover V ′ of an undirected graph G = (V,E) is a subset of V such that uv ∈ E ⇒ u ∈ V ′ ∨ v ∈ V ′ , that is to say it is a set of vertices V ′ where every edge has at least one endpoint in the vertex cover V ′ . The VERTEX COVER problem consists in, given an instance (G, k) where G = (V, E) is a graph and k a positive integer, to decide whether G has a vertex cover of size at most k, or not. Given an instance of VERTEX COVER, we map it to a gadget instance of our problem:
- the set of points of view is N = V ∪E;
- an alternative is a subset of N;
- each point of view is evaluated on a binary scale, with presence preferred to absence;
- the preference information contains all statements of the form ({(u, v)}, {u, v})-any edge is preferred to the set of its endpoints-for all edges (u, v) ∈ E.
Any elliptic cancellative explanation without repetition of the pair (E, V )-the pros are the edges, the cons are the vertices-of length k is a subset of E that forms a vertex cover of size k of of the graph G, and reciprocally.
5 Discussion and Perspectives
In the current quest for "explainable A.I.", the additive value (i.e. linear) model might be seen as occupying the very end of the spectrum -an obviously interpretable model [Ribeiro et al., 2016]. Even though recent advances have been made towards providing "simpler" models, e.g. [Ustun and Rudin, 2016], most of these approaches ignore the perspective of the decision maker [Miller, 2019], and the need to provide her with a way of challenging the decision [Kroll et al., 2017].
Several works have explored the interplay between argumentation and decision aiding. In [Amgoud and Prade, 2009], argumentation is used as a mean make a decision and justify it, while in [Zhong et al., 2019], it is shown that the outcomes of a simple decision model are similar to the extension of the corresponding argumentation framework.
Here, the preference information is considered exogenous. It might have been obtained through dialog, by considering domain knowledge-reference cases, jurisprudence, or inferred by some means-learning from similar situations, or previous interactions with the user.
5.1 Contributions
We introduced the notion of cancellative explanations, based on the accrual of premises to obtain a conclusion. We studied this explanative framework in the light of the principles stated in introduction. This contrasts with approaches in decision theory [Fishburn, 1970; Gonzales, 2000], where cancellation is seen as a property of the preference relation, not a mean to infer new preference statements and justify them. Our main contributions are as follows:
Completeness. Every preference statement that can be skeptically inferred from the preference information and the way of reasoning corresponding to the additive value model is supported by a cancellative explanation.
Soundness. Every preference statement that is supported by a cancellative explanation can be skeptically inferred from the preference information and the way of reasoning corresponding to the additive value model;
Simplicity. We provided several ways of presenting cancellative explanations, in the form of tables, diagrams, or argument schemes, and proposed to ground them on a syntactic check, or alternatively to keep implicit the information tied to dominance, which can easily be restored by the recipient, in the spirit of enthymemes. We provided formalizations that lend themselves to an efficient implementation. We proposed an intuitive partial ordering of explanations according to their alleged complexity, and formulated the problem of finding explanations as simple as possible.
Computation. Remarkably, while adjudicating necessary preference is a polynomial problem, explaining it concisely is NP-complete.
5.2 Perspectives
Providing an argument scheme along with the result of a comparative statement opens the possibility to discuss or challenge this result. This is made possible through what is called critical questions [Walton, 1996], a tool associated with argument schemes representing attacks or criticisms that, if not answered adequately, falsify the argument fitting the scheme.
In our setting, the criticism may point out (implicitly or explicitly) elements perceived as missing or wrong in the reasoning steps. Indeed, for instance, the decision maker (DM) may challenge the fact that a preference between two alternatives is not the right one. The consequence is that either it is possible to derive a new conclusion with this new information, or the DM's statements express conflicting preferences. Thus, the challenge of finding a principled way to deal with inconsistency in an accountable manner, needs to be addressed. Several promising approaches have been proposed: considering maximally consistent subsets of statements [Mousseau et al., 2003]; relaxing the aggregation model until a model sufficiently expressive to accommodate for the preference information is found [Ouerdane, 2011; Greco et al., 2014]; or using a numerical estimation of inconsistency such as a belief function [Destercke, 2018].
Another situation is that the DM's reasoning is incompatible with the principles and properties underlying the preference model. For instance, expressing a preference dependency may defeat the fundamental feature (ceteris paribus) of an additive model [Fisher, 1892]. In this situation, relaxing the preference model could be a solution [Ouerdane, 2011]. Many models account for interactions between the influence of the points of view, such as Generalized additive models (GAI) [Fishburn, 1967]. An underlying question that has been less investigated (for notable exceptions, see e.g. [Labreuche, 2011] and [Cailloux and Endriss, 2014]), and remains difficult [Procaccia, 2019], is the question of the accountability of recommendations based on an induced model.
Acknowledgements
This work is partially supported by the ANR project 14CE24-0007-01- CoCoRICo-CoDec.
@inproceedings{ijcai2019p213,
title = {Comparing Options with Argument Schemes Powered by Cancellation},
author = {Belahcene, Khaled and Labreuche, Christophe and Maudet, Nicolas and Mousseau, Vincent and Ouerdane, Wassila},
booktitle = {Proceedings of the Twenty-Eighth International Joint Conference on
Artificial Intelligence, {IJCAI-19}},
publisher = {International Joint Conferences on Artificial Intelligence Organization},
editor = {Sarit Kraus},
pages = {1537--1543},
year = {2019},
month = {8},
note = {Main track},
doi = {10.24963/ijcai.2019/213},
url = {https://doi.org/10.24963/ijcai.2019/213},
}
TY - CPAPER TI - Comparing Options with Argument Schemes Powered by Cancellation AU - Belahcene, Khaled AU - Labreuche, Christophe AU - Maudet, Nicolas AU - Mousseau, Vincent AU - Ouerdane, Wassila T2 - Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19 PB - International Joint Conferences on Artificial Intelligence Organization PY - 2019 SP - 1537 EP - 1543 DO - 10.24963/ijcai.2019/213 UR - https://doi.org/10.24963/ijcai.2019/213 ER -Copied
Machine-readable versions of this paper, for tools and AI agents: