Logicist Machine Ethics Can Save Us

Transcription

1 Logicist Machine Ethics Can Save Us Selmer Bringsjord et al. Rensselaer AI & Reasoning (RAIR) Lab Department of Cognitive Science Department of Computer Science Lally School of Management & Technology Rensselaer Polytechnic Institute (RPI) Troy, New York USA Are Humans Rational? 10/16/2017

2 Logicist Machine Ethics Can Save Us Selmer Bringsjord et al. Rensselaer AI & Reasoning (RAIR) Lab Department of Cognitive Science Department of Computer Science Lally School of Management & Technology Rensselaer Polytechnic Institute (RPI) Troy, New York USA Are Humans Rational? 10/16/2017

3 Not quite as easy as this to use logic to save the day

4 Logic Thwarts Nomad! (with the Liar Paradox)

5 The Threat If future robots behave immorally, we are killed, or worse.

6 The Threat If future robots behave immorally, we are killed, or worse.

7 The Threat If future robots behave immorally, we are killed, or worse.

8 The Threat If future robots behave immorally, we are killed, or worse.

9 At least supposedly, long term:

10 At least supposedly, long term: We re in very deep trouble.

11 At least supposedly, long term: We re in very deep trouble.

12 At least supposedly, long term: We re in very deep trouble.

13 Actually, it s quite simple: Equation for Why Stakes are High

14 Actually, it s quite simple: Equation for Why Stakes are High 8x : Agents

15 Actually, it s quite simple: Equation for Why Stakes are High 8x : Agents Autonomous(x) + Powerful(x) + Highly_Intelligent(x) = Dangerous(x)

16 Actually, it s quite simple: Equation for Why Stakes are High 8x : Agents Autonomous(x) + Powerful(x) + Highly_Intelligent(x) = Dangerous(x)

17 Actually, it s quite simple: Equation for Why Stakes are High 8x : Agents Autonomous(x) + Powerful(x) + Highly_Intelligent(x) = Dangerous(x) u(aia i ( j )) > + 2 Z or 2 Z

18 Actually, it s quite simple: Equation for Why Stakes are High 8x : Agents Autonomous(x) + Powerful(x) + Highly_Intelligent(x) = Dangerous(x) u(aia i ( j )) > + 2 Z or 2 Z

19 Actually, it s quite simple: Equation for Why Stakes are High 8x : Agents Autonomous(x) + Powerful(x) + Highly_Intelligent(x) = Dangerous(x) u(aia i ( j )) > + 2 Z or 2 Z

20 Actually, it s quite simple: Equation for Why Stakes are High 8x : Agents Autonomous(x) + Powerful(x) + Highly_Intelligent(x) = Dangerous(x) u(aia i ( j )) > + 2 Z or 2 Z

21 Actually, it s quite simple: Equation for Why Stakes are High Autonomous(x) + Powerful(x) + Highly_Intelligent(x) = Dangerous(x) 8x : Agents (We use the jump technique in relative computability.) u(aia i ( j )) > + 2 Z or 2 Z

22 I. Cognitive Calculi

23 Hierarchy of Ethical Reasoning DCEC CL DCEC ADR M U UIMA/Watsoninspired DIARC

24 Hierarchy of Ethical Reasoning DCEC CL DCEC ADR M U UIMA/Watsoninspired DIARC

25 Hierarchy of Ethical Reasoning DCEC CL DCEC ADR M U UIMA/Watsoninspired DIARC

26 Hierarchy of Ethical Reasoning Not deontic logics. DCEC CL DCEC ADR M U UIMA/Watsoninspired DIARC

27 II. Early Progress With Our Calculi: Non-Akratic Robots

28 Informal Definition of Akrasia An action a f is (Augustinian) akratic for an agent A at t a f iff the following eight conditions hold: (1) A believes that A ought to do a o at t ao ; (2) A desires to do a f at t a f ; (3) A s doing a f at t a f entails his not doing a o at t ao ; (4) A knows that doing a f at t a f entails his not doing a o at t ao ; (5) At the time (t a f ) of doing the forbidden a f, A s desire to do a f overrides A s belief that he ought to do a o at t a f. (6) A does Comment: the forbidden Condition action(5) a f isathumbling, t a f ; pure and (7) A s doing a f results from A s desire to do a f ; (8) At some time t after t a f, A has the belief that A ought to have done a o rather than a f.

29 Informal Definition of Akrasia An action a f is (Augustinian) akratic for an agent A at t a f iff the following eight conditions hold: (1) A believes that A ought to do a o at t ao ; (2) A desires to do a f at t a f ; (3) A s doing a f at t a f entails his not doing a o at t ao ; (4) A knows that doing a f at t a f entails his not doing a o at t ao ; (5) At the time (t a f ) of doing the forbidden a f, A s desire to do a f overrides A s belief that he ought to do a o at t a f. (6) A does Comment: the forbidden Condition action(5) a f isathumbling, t a f ; pure and (7) A s doing a f results from A s desire to do a f ; (8) At some time t after t a f, A has the belief that A ought to have done a o rather than a f.

30 Informal Definition of Akrasia Regret An action a f is (Augustinian) akratic for an agent A at t a f iff the following eight conditions hold: (1) A believes that A ought to do a o at t ao ; (2) A desires to do a f at t a f ; (3) A s doing a f at t a f entails his not doing a o at t ao ; (4) A knows that doing a f at t a f entails his not doing a o at t ao ; (5) At the time (t a f ) of doing the forbidden a f, A s desire to do a f overrides A s belief that he ought to do a o at t a f. (6) A does Comment: the forbidden Condition action(5) a f isathumbling, t a f ; pure and (7) A s doing a f results from A s desire to do a f ; (8) At some time t after t a f, A has the belief that A ought to have done a o rather than a f.

31 r will note is quite far down the dimensio ty that ranges from expressive extension OL), to logics with intensional operators fo obligation (so-called philosophical logics; fo Cast in 2001). Intensional operators like these a he language for DC EC. This language this becomes

32

33 KB rs [KB m1 [ KB m2...kb mn ` D 1 : B(I,now,O(I,t a F,happens(action(I,a),t a ))) D 2 : D(I,now,holds(does(I,a),t a )) D 3 : happens(action(i,a),t a ) ) happens(action(i,a),t a ) happens(action(i,a),t a ) ) D 4 : K I, now, happens(action(i,a),t a ) D 5 : I(I,t a,happens(action(i,a),t a )^ I(I,t a,happens(action(i,a),t a ) D 6 : happens(action(i,a),t a ) D 7a : G[{D(I,now,holds(does(I,a),t))} ` happens(action(i,a),t a ) D 7b : G {D(I,now,holds(does(I,a),t))} 6` happens(action(i,a),t a ) D 8 : B I,t f,o(i,t a,f,happens(action(i,a),t a ))

34 Demos

35 Demos

36 III. But, a twist befell the logicists

37 Chisholm had argued that the three old 19th-century ethical categories (forbidden, morally neutral, obligatory) are not enough and soulsearching brought me to agreement.

38 heroic morally neutral deviltry civil forbidden uncivil obligatory

39 Leibnizian Ethical Hierarchy for Persons and Robots: EH deviltry morally neutral uncivil forbidden obligatory civil heroic

40 Leibnizian Ethical Hierarchy for Persons and Robots: EH deviltry morally neutral uncivil forbidden obligatory civil the supererogatory heroic

41 Leibnizian Ethical Hierarchy for Persons and Robots: EH deviltry morally neutral uncivil forbidden obligatory civil the supererogatory heroic

42 Leibnizian Ethical Hierarchy for Persons and Robots: EH the subererogatory the supererogatory deviltry morally neutral uncivil forbidden obligatory civil heroic

43 Leibnizian Ethical Hierarchy for Persons and Robots: EH (see Norwegian crime fiction) the subererogatory the supererogatory deviltry morally neutral uncivil forbidden obligatory civil heroic

44 deviltry Leibnizian Ethical Hierarchy for Persons and Robots: EH (see Norwegian crime fiction) 19th-Century Triad the subererogatory the supererogatory morally neutral uncivil forbidden obligatory civil heroic

45 Leibnizian Ethical Hierarchy for Persons and Robots: EH (see Norwegian crime fiction) the subererogatory the supererogatory deviltry morally neutral uncivil forbidden obligatory civil heroic

46 Leibnizian Ethical Hierarchy for Persons and Robots: EH (see Norwegian crime fiction) the subererogatory the supererogatory deviltry morally neutral uncivil forbidden obligatory civil heroic

47 Leibnizian Ethical Hierarchy for Persons and Robots: EH (see Norwegian crime fiction) the subererogatory the supererogatory deviltry morally neutral uncivil forbidden obligatory civil heroic focus of others

48 Leibnizian Ethical Hierarchy for Persons and Robots: EH (see Norwegian crime fiction) the subererogatory deviltry morally neutral uncivil forbidden obligatory civil the supererogatory heroic But this portion may be most relevant to military missions. focus of others

49 19th Century Triad

50 19th Century Triad

51 19th Century Triad

52 19th Century Triad

53 19th Century Triad

54 Arkin Pereira Andersons Powers Mikhail 19th Century Triad

55 19th Century Triad

56 19th Century Triad

57 19th Century Triad

58 Bert Heroically Saved? Courtesy of RAIR-Lab Researcher Atriya Sen

59 Bert Heroically Saved? Courtesy of RAIR-Lab Researcher Atriya Sen

60 2 Supererogatory Robot Action Courtesy of RAIR-Lab Researcher Atriya Sen

61 Courtesy of RAIR-Lab Researcher Atriya Sen

62 Bert Heroically Saved!! Courtesy of RAIR-Lab Researcher Atriya Sen

63 Bert Heroically Saved!! Courtesy of RAIR-Lab Researcher Atriya Sen

64 Courtesy of RAIR-Lab Researcher Atriya Sen

65 K (nao, t1, lessthan (payo (nao, dive, t2 ), threshold)) K (nao, t1, greaterthan (payo (nao, dive, t2 ), threshold)) K (nao, t1, O (nao, t2, lessthan (payo (nao, dive, t2 ), threshold), happens (action (nao, dive), t2 ))) ) K nao, t1, S UP2 (nao, t2, happens (action (nao, dive), t2 )) ) I (nao, t2, happens (action (nao, dive), t2 )) ) happens (action(nao, dive), t2 ) Courtesy of RAIR-Lab Researcher Atriya Sen

66 K (nao, t1, lessthan (payo (nao, dive, t2 ), threshold)) K (nao, t1, greaterthan (payo (nao, dive, t2 ), threshold)) K (nao, t1, O (nao, t2, lessthan (payo (nao, dive, t2 ), threshold), happens (action (nao, dive), t2 ))) ) K nao, t1, S UP2 (nao, t2, happens (action (nao, dive), t2 )) ) I (nao, t2, happens (action (nao, dive), t2 )) ) happens (action(nao, dive), t2 ) Courtesy of RAIR-Lab Researcher Atriya Sen

67 In Talos (available via Web interface); & ShadowProver Prototypes: Boolean lessthan Numeric Numeric Boolean greaterthan Numeric Numeric ActionType not ActionType ActionType dive Axioms: lessorequal(moment t1,t2) K(nao,t1,lessThan(payoff(nao,not(dive),t2),threshold)) K(nao,t1,greaterThan(payoff(nao,dive,t2),threshold)) K(nao,t1,not(O(nao,t2,lessThan(payoff(nao,not(dive),t2),threshold),happens(action(nao,dive),t2)))) provable Conjectures: happens(action(nao,dive),t2) K(nao,t1,SUP2(nao,t2,happens(action(nao,dive),t2))) I(nao,t2,happens(action(nao,dive),t2))

68 In Talos (available via Web interface); & ShadowProver Prototypes: Boolean lessthan Numeric Numeric Boolean greaterthan Numeric Numeric ActionType not ActionType ActionType dive Axioms: lessorequal(moment t1,t2) K(nao,t1,lessThan(payoff(nao,not(dive),t2),threshold)) K(nao,t1,greaterThan(payoff(nao,dive,t2),threshold)) K(nao,t1,not(O(nao,t2,lessThan(payoff(nao,not(dive),t2),threshold),happens(action(nao,dive),t2)))) provable Conjectures: happens(action(nao,dive),t2) K(nao,t1,SUP2(nao,t2,happens(action(nao,dive),t2))) I(nao,t2,happens(action(nao,dive),t2))

69 Theories of Law Making Moral Machines Making Meta-Moral Machines Ethical Theories $11M Natural Law Shades of Utilitarianism Utilitarianism Deontological Divine Command Legal Codes Confucian Law Particular Ethical Codes Virtue Ethics Contract Egoism

70 Theories of Law Making Moral Machines Making Meta-Moral Machines Ethical Theories $11M Natural Law Shades of Utilitarianism Utilitarianism Deontological Divine Command Legal Codes Confucian Law Particular Ethical Codes Virtue Ethics Contract Egoism

71 Theories of Law Making Moral Machines Making Meta-Moral Machines Ethical Theories $11M Natural Law Shades of Utilitarianism Utilitarianism Deontological Divine Command Legal Codes Confucian Law Particular Ethical Codes Virtue Ethics Contract Egoism Step 1 1. Pick a theory 2. Pick a code 3. Run through EH.

72 Theories of Law Making Moral Machines Making Meta-Moral Machines Ethical Theories $11M Natural Law Shades of Utilitarianism Utilitarianism Deontological Divine Command Legal Codes Confucian Law Particular Ethical Codes Virtue Ethics Contract Egoism Step 1 1. Pick a theory 2. Pick a code 3. Run through EH.

73 Theories of Law Making Moral Machines Making Meta-Moral Machines Ethical Theories $11M Natural Law Shades of Utilitarianism Utilitarianism Deontological Divine Command Legal Codes Confucian Law Particular Ethical Codes Virtue Ethics Contract Egoism Step 1 Step 2 1. Pick a theory 2. Pick a code 3. Run through EH. Automate Prover Spectra

74 Theories of Law Making Moral Machines Making Meta-Moral Machines Ethical Theories $11M Natural Law Shades of Utilitarianism Utilitarianism Deontological Divine Command Legal Codes Confucian Law Particular Ethical Codes Virtue Ethics Contract Egoism Step 1 Step 2 1. Pick a theory 2. Pick a code 3. Run through EH. Automate Prover Spectra

75 Theories of Law Making Moral Machines Making Meta-Moral Machines Ethical Theories $11M Natural Law Shades of Utilitarianism Utilitarianism Deontological Divine Command Legal Codes Confucian Law Particular Ethical Codes Virtue Ethics Contract Egoism Step 1 Step 2 Step 3 1. Pick a theory 2. Pick a code 3. Run through EH. Automate Prover Ethical OS Spectra

76 Theories of Law Making Moral Machines Making Meta-Moral Machines Ethical Theories $11M Natural Law Shades of Utilitarianism Utilitarianism Deontological Divine Command Legal Codes Confucian Law Particular Ethical Codes Virtue Ethics Contract Egoism Step 1 Step 2 Step 3 1. Pick a theory 2. Pick a code 3. Run through EH. Automate Prover Ethical OS Spectra

77 Theories of Law Making Moral Machines Making Meta-Moral Machines Ethical Theories $11M Natural Law Shades of Utilitarianism Utilitarianism Deontological Divine Command Legal Codes Confucian Law Particular Ethical Codes Virtue Ethics Contract Egoism Step 1 Step 2 Step 3 1. Pick a theory 2. Pick a code 3. Run through EH. Automate Prover Ethical OS Spectra

78 Theories of Law Making Moral Machines Making Meta-Moral Machines Ethical Theories $11M Natural Law Shades of Utilitarianism Utilitarianism Deontological Divine Command Legal Codes Confucian Law Particular Ethical Codes Virtue Ethics Contract Egoism Step 1 Step 2 Step 3 DIARC 1. Pick a theory 2. Pick a code 3. Run through EH. Automate Prover Ethical OS Spectra

79 Theories of Law Making Moral Machines Making Meta-Moral Machines Ethical Theories $11M Natural Law Shades of Utilitarianism Utilitarianism Deontological Divine Command Legal Codes Confucian Law Particular Ethical Codes Virtue Ethics Contract Egoism Step 1 Step 2 Step 3 DIARC 1. Pick a theory 2. Pick a code 3. Run through EH. Automate Prover Spectra Ethical OS A real military robot

80 V. But We Need Ethical Operating Systems

81

82 Pick the Better Future!

83 Pick the Better Future! Govindarajulu, N.S. & Bringsjord, S. (2015) Ethical Regulation of Robots Must Be Embedded in Their Operating Systems in Trappl, R., ed., A Construction Manual for Robots Ethical Systems (Basel, Switzerland), pp

84 Pick the Better Future! Only obviously dangerous higher-level AI modules have ethical safeguards. All higher-level AI modules interact with the robotic substrate through an ethics system. Robotic Substrate } Ethical Substrate Robotic Substrate Higher-level cognitive and AI modules Future 1 Future 2 Govindarajulu, N.S. & Bringsjord, S. (2015) Ethical Regulation of Robots Must Be Embedded in Their Operating Systems in Trappl, R., ed., A Construction Manual for Robots Ethical Systems (Basel, Switzerland), pp

85 Pick the Better Future! Walter-White calculation may go through after ethical control modules are stripped out! Only obviously dangerous higher-level AI modules have ethical safeguards. All higher-level AI modules interact with the robotic substrate through an ethics system. Robotic Substrate } Ethical Substrate Robotic Substrate Higher-level cognitive and AI modules Future 1 Future 2 Govindarajulu, N.S. & Bringsjord, S. (2015) Ethical Regulation of Robots Must Be Embedded in Their Operating Systems in Trappl, R., ed., A Construction Manual for Robots Ethical Systems (Basel, Switzerland), pp

86 Pick the Better Future! Walter-White calculation may go through after ethical control modules are stripped out! Only obviously dangerous higher-level AI modules have ethical safeguards. All higher-level AI modules interact with the robotic substrate through an ethics system. Robotic Substrate } Ethical Substrate Robotic Substrate } (& formally verify!) Higher-level cognitive and AI modules Future 1 Future 2 Govindarajulu, N.S. & Bringsjord, S. (2015) Ethical Regulation of Robots Must Be Embedded in Their Operating Systems in Trappl, R., ed., A Construction Manual for Robots Ethical Systems (Basel, Switzerland), pp

87 End (Extra slides follow.)