Accept & Reject Statement-Based Uncertainty Models · 2020-04-19 · Gamble set operations & hulls...

1
1 Context Agent faced with uncertainty; Possibility space Ω, e.g., set of experimental outcomes; Gambles real-valued functions f on Ω; interest in a linear space of gambles L. Example format used for illustrations: Ω ∶={ω, ϖ}, and L is the linear space of all gambles on Ω. f f (ω) f (ϖ) Gamble set operations & hulls Let f ∈L and K, K⊆L, then: • negation -K∶={-g g ∈K}, • ray ¯ f ∶={λ f λ R0}, • positive scalar hull K ∶= f ∈K ¯ f , • Minkowski addition: K+K∶={g+h g ∈K, h ∈K}, • positive linear hull posi K ∶= {∑g∈K′′ ¯ g ∶K′′ ⊆K, K′′N} 2 Accepting & rejecting The agent gives an assessment by making statements about gambles f : Accepting () implies a commitment: (i) outcome ω Ω is determined, (ii) he receives the payoff f (ω). Rejecting () implies that he consid- ers accepting f unreasonable; this is relevant when combining assessments. An assessment is a pair A ∶= A; A in A ∶= 2L × 2L of sets of acceptable respectively dispreferred gambles. Unresolved gambles belong to neither category: A ∶=(A∪A) c ; Confusing gambles belong to both categories: A∶=A∩A. No confusion is present in an assessment A if and only if A=. The set of assessments without confusion is A. Indifferent gambles are acceptable and have an acceptable negation: A ∶=-A∩A; Favorable gambles are acceptable and have a dispreferred negation: A ∶=-A∩A; Incomparable gambles are unresolved and have an unresolved negation: A ∶=-A∩A. 3 Deductive closure We assume gamble payoffs are expressed in a linear precise utility. This implies: Positive scaling If f is acceptable, then all gambles in the ray ¯ f are acceptable; Combination If f and g are accept- able, then f +g is acceptable. So we can extend an assessment A: Deductive extension extDA ∶= posi A; A; extension legend: included (border) ray acceptable (hull) gambles Deductive closure of an assessment D if and only if extDD=D or posi D =D. The deductively closed assessments form the set DA; those without confusion form the set D∶= DA. Deductively closable assessments are those that remain without confusion; they form the set A + ∶={A∈ AextDA∈ D}. Removing confusion from an assessment D in D can be done automatically: both extDD D; D D and D; DD belong to D. 4 No limbo Let D in D and f in D, then without increasing confusion f can • always be rejected, • can be accepted if and only if f inaD ∶= ( DD)-(D∪{0}). Limbo is the set of unresolved gambles (inaD)D that cannot additionally be accept- able without increasing confusion under deductive closure. Reckoning extension extMD ∶= D; DinaD; extension legend: included favorable (border) ray favorable (hull) gambles included dispreferred (border) ray dispreferred (hull) gambles No limbo is present in a deductively closed assessment Mif and only if extMM=M or inaM⊆M. Models Mare deductively closed assessments without limbo. Models form the set MD; those without confusion form the set M∶= MA. 5 Model properties Given a model Min M, then inaM=M-(M∪{0}), M =M and posi M =M, M+M =M. 6 Set relations & operations ‘Less committal than’-relation is an assessment re- lation derived from inclusion: A⊂B⇔A⊆B∧A≠B and A⊆B⇔A ⊆B∧A ⊆B. Assessment union is componentwise set union; Assessment intersection is componentwise set intersection; The sets A, A +, D, D, and M are closed under arbitrary non-empty intersections, but M is not, as is attested by the counterexample below: = 7 Order-theoretic results The ‘less committal than or equal’- relation engenders a partial ordering of the assessments. Dominating assessments in a set of assessments B A: BA ∶={B∈ B ∶A⊆B}. (B = B with ∶=; ) Maximal assessments ˆ B are the undominated ones in B; ˆ A= ˆ D= ˆ M={} with ∶=L; L, ˆ A={K; L K ∶ K ⊆ L}, and ˆ M= ˆ D= ˆ A + = ˆ AA +. ˆ M ˆ A {} M M D D A + A A extD extD extM extM Intersection structures is what the posets (A, ⊆), (A, ⊆), (A +, ⊆), (D, ⊆), (D, ⊆), and (M, ⊆) are, because the sets are closed under intersection. Closure operators are associated to each intersection structure (B, ⊆) by clBA ∶= BA with =; clB = id on B∪{}, clD = extD and clA returns outside of A, clA+ = id, clD = extD, and clM= extMextD on A + and it returns elsewhere, Complete lattices is what the posets (A, ⊆), (A∪{}, ⊆),(A + ∪ {}, ⊆),(D, ⊆),(D ∪ {}, ⊆), and (M∪{}, ⊆) become with as the infimum operator and clBas the supremum operator; • deductive union ∶= clD, • reckoning union ∶= clM. 8 Dominating models The agent specifies an assessment A; if it is an element of A +, then it can be extended to a model without confusion: M ∶= clMA= extM(extDA) ∈ M. Therefore knowing whether A is in A + is important. Characterization of A + using the set of dominating maximal elements ˆ MA: A∈ A + ˆ MA . This means that if all assessments in some family are dominated by a common model in M, then their reckon- ing union is a model in M. Inferences can be drawn from any assessment A as well using ˆ MA: clMA= ˆ MA. Our models in Mare compatible with AGM-style belief change and revision. 9 Smallest models Some a priori assumptions can be captured by positing a smallest model S in M that replaces : so we work in MS instead of M. (All the results above remain valid, mutatis mutandis.) Natural extension of an assessment A is its reckoning union with the smallest model: AS. Coherent models Mcoincide with their natural extension: MS=M or S⊆M. 11 Partitions All models Min M partition gamble space L into nine elements—some possi- bly empty—depending on whether a gamble and its negation are acceptable, dispre- ferred, or neither. M M M -M M -M M -M The model is maximal if and only if the more grayish partition elements are empty. M M -M M M -M M -M The framework can be simplified by replac- ing rejection by favorability: -M ⊆M. 10 Universal a priori assumption Given the commitments implied by accepting gambles, there is one assumption we judge reasonable to posit. Indifference to status quo corresponds to the zero gamble 0 being acceptable, and therefore indifferent: O⊆S, where O ∶= {0}; . 12 Basic gamble relations Fix a model Min MO, then we can define the following relations between gambles f and g in L: f is accepted in exchange for g f g f -g 0 f -g ∈M; . —no confusion, deductive closure, no limbo, and indifference to status quo—can Transitivity f gg h f g, f gh g f h, Mixture independence for all ∈{, } and 0 < μ 1: f g μ f +(1-μ)hμg+(1-μ)h. So we can conclude: • acceptability is reflexive and transitive, and thus a non-strict preorder and a vector ordering, • dispreference is irreflexive. 13 Derived gamble relations A number of other useful gamble relations follow from the basic ones: Indifference between f and g f g f gg f f -g ∈M; f -g ∈A; . We can then conclude using the ‘axioms’ regulating —no confusion, reflexivity, transitivity, and mixture independence—that: is reflexive, transitive, and symmetric, and thus an equivalence relation, preference is irreflexive and transitive, and thus a strict partial order ideally suited for decision making, • incomparability is irreflexive, symmetric, and in general intransitive. 14 Smallest models Associate the relations and with the smallest model S in MO, then a necessary condition for coherence is Monotonicity f g f g and f g f g. 15 Desirability Strict preference desirability is a simplification with Min MO such that M =M∪S. -M -M Nonstrict preference desirability with M= clMM∪S; S. M M S S M -M 16 Comparison with the literature Forms of what we call strict preference desirability have gotten the most attention in the literature: Smith (1961, §14) talks about ‘exchange vectors’ (finite Ω), works with S ∶=L>0, and imposes that M is open; Seidenfeld et al. (1990, §IV) talk about ‘favorable’ gambles (finite Ω) and work with S ∶=L>0; Walley (1991, §3.7.8) discusses ‘strictly desirable’ gambles, works with S ∶=L>0, and imposes an openness axiom MS ⊆M+R>0; Walley (2000, §6) drops the openness axiom and advocates a desirability framework with S ∶=L>0; De Cooman & Quaeghebeur (2009–2011) build on this, but are the first with a nontrivial S, i.e., the gambles expressing exchangeability. Occurrences of the nonstrict case are also important: Williams (1974) talks about ‘acceptable bets’ and works with an S defined by S ∶={ f ∈L∶ inf f > 0}, so there is no default indifference to status quo; Walley (1991, §3.7.3) discusses ‘almost desirable’ gam- bles, works with S ∶= L0; { f ∈L∶ sup f < 0}, and imposes a closure axiom f +R>0 ⊆M f ∈M; Walley (1991, App. F) talks about ‘really desirable’ gam- bles and works with S ∶= L0; { f ∈L∶ sup f < 0}. Accept & reject statement-based uncertainty models Generalizing nonstrict & strict preference desirability CONFUSED? not dealing with your indifference ? falling in a limbo ? WE CAN HELP ! two easy questions: Accept? Reject? NEW three guiding principles: No confusion Deductive closure No limbo NEW two straightfor- ward steps: Deduction Reckoning NEW Our framework orders & infers for you ! Simplified version available Includes nice relations for free! Cheap upgrade path from other frameworks h Erik Quaeghebeur, Gert de Cooman & Filip Hermans SYSTeMS Research Group g Ghent University

Transcript of Accept & Reject Statement-Based Uncertainty Models · 2020-04-19 · Gamble set operations & hulls...

Page 1: Accept & Reject Statement-Based Uncertainty Models · 2020-04-19 · Gamble set operations & hulls ... We can then conclude using the `axioms' regulating the basic relationskandh

1 ContextAgent faced with uncertainty;

Possibility space Ω ,e.g., set of experimental outcomes;

Gambles real-valued functions f on Ω ;interest in a linear space of gambles L.

Example format used forillustrations: Ω ∶= ω,ϖ,and L is the linear spaceof all gambles on Ω .

f

f (ω)f (ϖ)

Gamble set operations & hullsLet f ∈L and K,K′ ⊆L, then:

• negation −K ∶= −g ∶ g ∈K,• ray f ∶= λ f ∶ λ ∈R>0,• positive scalar hull K ∶=⋃ f ∈K f ,• Minkowski addition:K+K′ ∶= g+h ∶ g ∈K,h ∈K′,• positive linear hull

posiK ∶=⋃∑g∈K′′ g ∶K′′ ⊆K, ∣K′′∣ ∈N

2 Accepting & rejectingThe agent gives an assessment bymaking statements about gambles f :

Accepting (⊕) implies a commitment:

(i) outcome ω ∈Ω is determined,(ii) he receives the payoff f (ω).

Rejecting (⊖) implies that he consid-ers accepting f unreasonable;this is relevant when combiningassessments.

An assessment is a pair A ∶= ⟨A⪰;A≺⟩in A ∶= 2L × 2L of sets of acceptablerespectively dispreferred gambles.

Unresolved gambles belong toneither category: A ∶= (A⪰∪A≺)c;

Confusing gambles belong to bothcategories: A∶=A⪰∩A≺.

⊕⊕⊖

⊕⊖

⊕⊕ ⊖⊖

No confusion is present in an assessment Aif and only if A=∅.

The set of assessments without confusion is A.

Indifferent gambles are acceptable and havean acceptable negation: A≃ ∶= −A⪰∩A⪰;

Favorable gambles are acceptable and havea dispreferred negation: A≻ ∶= −A≺∩A⪰;

Incomparable gambles are unresolved and havean unresolved negation: A≍ ∶= −A∩A.

3 Deductive closureWe assume gamble payoffs areexpressed in a linear precise utility.This implies:

Positive scaling If f is acceptable,then all gambles in the ray f areacceptable;

Combination If f and g are accept-able, then f +g is acceptable.

So we can extend an assessment A:

Deductive extension

extDA ∶= ⟨posiA⪰;A≺⟩;extension legend:

included(border) ray

acceptable(hull) gambles

⊕⊕⊖

⊕⊖

⊕⊕ ⊖⊖Deductive closure of an assessment D

if and only ifextDD =D or posiD⪰ =D⪰.

The deductively closed assessments form the set D ⊂A;those without confusion form the set D ∶=D∩A.

Deductively closable assessments are thosethat remain without confusion; they formthe set A+ ∶= A ∈A ∶ extDA ∈D.

Removing confusion from an assessment D in D canbe done automatically: both extD⟨D⪰ ∖D;D≺ ∖D⟩and ⟨D⪰;D≺∖D⟩ belong to D.

4 No limboLet D in D and f in D, then withoutincreasing confusion f can

• always be rejected,

• can be accepted if and only iff ∉ inaD ∶= (D≺∖D⪰)−(D⪰∪0).

Limbo is the set of unresolvedgambles (inaD)∖D≺that cannot additionally be accept-able without increasing confusionunder deductive closure.

Reckoning extension

extMD ∶= ⟨D⪰;D≺∪ inaD⟩;extension legend:

⊕⊕⊖

⊕⊖

⊕⊕ ⊖⊖

included favorable(border) ray

favorable(hull) gambles

included dispreferred(border) ray

dispreferred(hull) gambles

No limbo is present in a deductively closed assessmentM if and only ifextMM =M or inaM ⊆M≺.

ModelsM are deductively closed assessmentswithout limbo.

Models form the set M ⊂ D; those without confusionform the set M ∶=M∩A.

5 Model propertiesGiven a modelM in M, then

• inaM =M≺−(M⪰∪0),•M≺ =M≺ and posiM≻ =M≻,•M≻+M⪰ =M≻.

6 Set relations & operations‘Less committal than’-relation ⊂ is an assessment re-

lation derived from inclusion: A ⊂ B⇔A ⊆ B∧A ≠ Band A ⊆ B⇔A⪰ ⊆ B⪰∧A≺ ⊆ B≺.

⊕⊖

⊖⊂ ⊕⊕

⊖⊖

⊈ ⊕⊕ ⊖⊖

Assessment union ⋃ is componentwise set union;

Assessment intersection ⋂ is componentwiseset intersection;

The sets A, A+, D, D, and M are closed under arbitrarynon-empty intersections, but M is not, as is attested bythe counterexample below:

⊕⊕⊖

⊖∩ ⊕

⊕⊖

⊖= ⊕

⊕⊖

7 Order-theoretic resultsThe ‘less committal than or equal’-relation ⊆ engenders a partialordering of the assessments.

Dominating assessments in a setof assessments B ⊆A:

BA ∶= B ∈B ∶A ⊆ B.(B =B with ∶= ⟨∅;∅⟩)

Maximal assessments B are theundominated ones in B;

• A = D = M = ⊺ with ⊺ ∶= ⟨L;L⟩,• A = ⟨K;L∖K⟩ ∶K ⊆L, and• M = D = A+ = A∩A+.

MA⊺ M

MD

DA+

AA

extD

extD

extM

extM

Intersection structures is what the posets (A,⊆),(A,⊆), (A+,⊆), (D,⊆), (D,⊆), and (M,⊆) are,because the sets are closed under intersection.

Closure operators are associated to each intersectionstructure (B,⊆) by clBA ∶=⋂BA with ⋂∅ = ⊺;

• clB = id on B∪⊺,• clD = extD and clA returns ⊺ outside of A,• clA+ = id, clD = extD, and clM = extMextD on A+

and it returns ⊺ elsewhere,

Complete lattices is what the posets (A,⊆),(A∪⊺,⊆),(A+ ∪ ⊺,⊆),(D,⊆),(D ∪ ⊺,⊆),and (M ∪ ⊺,⊆) become with ⋂ as the infimumoperator and clB⋃ as the supremum operator;

• deductive union ⊎ ∶= clD⋃,• reckoning union 2 ∶= clM⋃.

8 Dominating modelsThe agent specifies an assessment A; if it is anelement of A+, then it can be extended to a modelwithout confusion:M ∶= clMA = extM(extDA) ∈M.Therefore knowing whether A is in A+ is important.

Characterization of A+ using the set of dominatingmaximal elements MA: A ∈A+⇔ MA ≠∅.

This means that if all assessments in some family aredominated by a common model in M, then their reckon-ing union is a model in M.

Inferences can be drawn from any assessment A aswell using MA:

clMA =⋂MA.Our models inM are compatible with AGM-style beliefchange and revision.

9 Smallest modelsSome a priori assumptions can be captured by positinga smallest model S in M that replaces : so we work inMS instead of M.(All the results above remain valid, mutatis mutandis.)

Natural extension of an assessment A is its reckoningunion with the smallest model: AFS.

Coherent modelsM coincide with their naturalextension: MFS =M or S ⊆M.

11 PartitionsAll modelsM in M partition gamblespace L into nine elements—some possi-bly empty—depending on whether a gambleand its negation are acceptable, dispre-ferred, or neither.

M≃ M≻

M≍

−M≻

M⪰

−M⪰

M≺

−M≺

The model is maximal if and only if themore grayish partition elements are empty.

M≃ M≻

−M≻M≍

M⪰

−M⪰

M≺

−M≺

The framework can be simplified by replac-ing rejection by favorability: −M≺ ⊆M⪰.

10 Universal a priori assumptionGiven the commitments implied by accepting gambles,there is one assumption we judge reasonable to posit.

Indifference to status quo corresponds to the zerogamble 0 being acceptable, and therefore indifferent:

O ⊆ S,where O ∶= ⟨0;∅⟩.

12 Basic gamble relationsFix a modelM in MO, then we can define the followingrelations between gambles f and g in L:

f is accepted in exchange for gf ⪰ g⇔ f −g ⪰ 0⇔ f −g ∈M⪰;

f is dispreferred to gf ≺ g⇔ f −g ≺ 0⇔ f −g ∈M≺.

The ‘axioms’ defining MO—no confusion, deductiveclosure, no limbo, and indifference to status quo—canthen be reformulated:

No confusion f ã g∨ f ⊀ g,

Reflexivity f ⪰ f ,

Transitivity f ⪰ g∧g ⪰ h⇒ f ⪰ g,f ≺ g∧h ⪰ g⇒ f ≺ h,

Mixture independence for all ◻ ∈ ⪰,≺ and 0 < µ ≤ 1:

f ◻g⇔ µ f +(1−µ)h◻µg+(1−µ)h.So we can conclude:

• acceptability ⪰ is reflexive and transitive, and thusa non-strict preorder and a vector ordering,

• dispreference ≺ is irreflexive.

13 Derived gamble relationsA number of other useful gamble relations follow fromthe basic ones:

Indifference between f and gf ≃ g⇔ f ⪰ g∧g ⪰ f ⇔ f −g ∈M≃;

f is preferred to gf ≻ g⇔ f ⪰ g∧g ≺ f ⇔ f −g ∈A≻;

f and g are incomparablef ≍ g⇔ f −g ∈A≍.

We can then conclude using the ‘axioms’ regulatingthe basic relations ⪰ and ≺—no confusion, reflexivity,transitivity, and mixture independence—that:

• indifference ≃ is reflexive, transitive, and symmetric,and thus an equivalence relation,

• preference ≻ is irreflexive and transitive, and thus astrict partial order ideally suited for decision making,

• incomparability ≍ is irreflexive, symmetric, andin general intransitive.

14 Smallest modelsAssociate the relations ⊵ and ⊲ with the smallest modelS in MO, then a necessary condition for coherence is

Monotonicity f ⊵ g⇒ f ⪰ g and f ⊲ g⇒ f ≺ g.

15 DesirabilityStrict preference desirability is

a simplification withM in MOsuch thatM⪰ =M≻∪S≃.

S≃ M≻

−M≻M≍

M⪰

−M⪰

M≺

−M≺

Nonstrict preference desirabilitywithM = clM⟨M⪰∪S⪰;S≺⟩.

M≃

M≍S≺

S⪰M⪰

−M⪰

16 Comparison with the literatureForms of what we call strict preference desirability havegotten the most attention in the literature:

Smith (1961, §14) talks about ‘exchange vectors’(finite Ω ), works with S≻ ∶=L>0, and imposes thatM≻ is open;

Seidenfeld et al. (1990, §IV) talk about ‘favorable’gambles (finite Ω ) and work with S≻ ∶=L>0;

Walley (1991, §3.7.8) discusses ‘strictly desirable’gambles, works with S≻ ∶=L>0, and imposes anopenness axiomM≻∖S≻ ⊆M≻+R>0;

Walley (2000, §6) drops the openness axiom andadvocates a desirability framework with S≻ ∶=L>0;

De Cooman & Quaeghebeur (2009–2011) build on this,but are the first with a nontrivial S≃, i.e., the gamblesexpressing exchangeability.

Occurrences of the nonstrict case are also important:

Williams (1974) talks about ‘acceptable bets’ and workswith an S defined by S≻ ∶= f ∈L ∶ inf f > 0, so thereis no default indifference to status quo;

Walley (1991, §3.7.3) discusses ‘almost desirable’ gam-bles, works with S ∶= ⟨L≥0; f ∈ L ∶ sup f < 0⟩, andimposes a closure axiom f +R>0 ⊆M⪰⇒ f ∈M⪰;

Walley (1991, App. F) talks about ‘really desirable’ gam-bles and works with S ∶= ⟨L≥0; f ∈L ∶ sup f < 0⟩.

Accept & reject statement-based uncertainty modelsGeneralizing nonstrict & strict preference desirability

CONFUSED?not dealing withyour indifference?

falling ina limbo?WE CAN HELP!

two easyquestions:

Accept?Reject?

NEW

three guiding principles:No confusion

Deductive closureNo limbo NEW

two straightfor-ward steps:

DeductionReckoning

NEW

Our framework orders & infers for you!Simplified version

availableIncludes nice

relations for free!Cheap upgrade path from

other frameworks

h Erik Quaeghebeur, Gert de Cooman &Filip Hermans

SYSTeMS Research Group g

Ghent University