Façade. Drama. Interactive. Prosemimar Human Computer Interaction Presentation by Ole Rehmsen. by Michael Mateas and Andrew Stern

Transcription

1 Façade by Michael Mateas and Andrew Stern An Interactive Drama Prosemimar Human Computer Interaction Presentation by Ole Rehmsen

2

3 VS Who is the one? How is it done? What is to come?

4 Today s Games Façade vs

5 Interactivity Free Natural Language Predefined Sentences Immediate Reaction Multiple Dialog Partners VS Turn-based Conversation One Person at a Time Actions and Speech Either talk, or shoot Dialog and Personality VS Go here, Activate that

6 No matter what you say, it s going to be a drama.

7 Other Applications Sales Agents Intercultural Skills Tutors

8 Getting Technical How does it work?

9 Drama Manager Bag of Beats Beat Grace s Father calls Preconditions Grace s and Trip s Behavior Effects Fix Drinks Trip s Mother calls Room Decoration Story Tension 5 Barkeeper Past 4 Sofa Scene Italian Landscape t

10 Natural Language Processing Text Input Template Rules Discourse Act Beat-specific Rules Specific Reaction Fallback: Global Rules General Purpose Reaction

11 The Active Behavior Tree Sequential Behaviors Motor System Answer the door sequential behavior AnswerTheDoor(){ WME w; with(success_test { w = (KnockWME)}) wait; act sigh(); subgoal OpenDoor(); subgoal GreetGuest(); mental_act { deletewme(w) } }

12 The Active Behavior Tree Sequential Behaviors Motor System Answer the door sequential behavior AnswerTheDoor(){ WME w; with(success_test { w = (KnockWME)}) wait; act sigh(); subgoal OpenDoor(); subgoal GreetGuest(); mental_act { deletewme(w) } }

13 The Active Behavior Tree Sequential Behaviors Motor System Answer the door sequential behavior AnswerTheDoor(){ WME w; with(success_test { w = (KnockWME)}) wait; act sigh(); subgoal OpenDoor(); subgoal GreetGuest(); mental_act { deletewme(w) } }

14 The Active Behavior Tree Sequential Behaviors Motor System Open Door Answer the door sequential behavior AnswerTheDoor(){ WME w; with(success_test { w = (KnockWME)}) wait; act sigh(); subgoal OpenDoor(); subgoal GreetGuest(); mental_act { deletewme(w) } }

15 The Active Behavior Tree Sequential Behaviors Motor System Open Door Answer the door sequential parallel behavior OpenDoor(){ AnswerTheDoor(){ WME subgoal w; checkifdooropens(); with(success_test with(persistent) subgoal { w = (KnockWME)}) YellForGuest(); wait; } act sigh(); subgoal OpenDoor(); subgoal GreetGuest(); mental_act { deletewme(w) } } has knocked? too far? Open Door 1 Specificity: 2 has knocked? Open Door 2 Specificity: 1...

16 The Active Behavior Tree Sequential Behaviors Motor System Open Door Open Door 1 Answer the door sequential parallel behavior OpenDoor(){ AnswerTheDoor(){ WME subgoal w; checkifdooropens(); with(success_test with(persistent) subgoal { w = (KnockWME)}) YellForGuest(); wait; } act sigh(); subgoal OpenDoor(); subgoal GreetGuest(); mental_act { deletewme(w) } } has knocked? too far? Specificity: 2 has knocked? Open Door 2 Specificity: 1...

17 The Active Behavior Tree Parallel Behaviors Motor System Open Door Answer the door parallel behavior OpenDoor(){ subgoal checkifdooropens(); with(persistent) subgoal YellForGuest(); } Open Door 1 checkifdooropens YellForGuest

18 The Active Behavior Tree Parallel Behaviors Motor System Open Door Answer the door parallel behavior OpenDoor(){ subgoal checkifdooropens(); with(persistent) subgoal YellForGuest(); } Open Door 1 checkifdooropens YellForGuest

19 The Active Behavior Tree Result Propagation Motor System Open Door Answer the door parallel behavior OpenDoor(){ subgoal checkifdooropens(); with(persistent) subgoal YellForGuest(); } Open Door 1 checkifdooropens YellForGuest CheckIfDoorOpens failed YellForGuest

20 The Active Behavior Tree Result Propagation Motor System Open Door Answer the door parallel behavior OpenDoor(){ subgoal checkifdooropens(); with(persistent) subgoal YellForGuest(); } Open Door 1 checkifdooropens failed CheckIfDoorOpens YellForGuest YellForGuest

21 The Active Behavior Tree Result Propagation Motor System Open Door Answer the door parallel behavior OpenDoor(){ subgoal checkifdooropens(); with(persistent) subgoal YellForGuest(); } Open failed Door 1 checkifdooropens YellForGuest CheckIfDoorOpens YellForGuest

22 The Active Behavior Tree Alternative Behavior Motor System Answer the door Open Door Open Door 1 failed has knocked? Open Door 2...

23 The Active Behavior Tree Alternative Behavior Motor System Answer the door Open Door Open failed Door 21 has knocked?...

24 The Active Behavior Tree Alternative Behavior Motor System Answer the door Open Door Open Door 2 success

25 The Active Behavior Tree Alternative Behavior Motor System Answer the door Open Door success Open Door 2

26 Joint Goals and Behaviors Synchronizing autonomous Agents It s time that Trip finally admits... Grace, stop......admits that our marriage... You don t have to is not...

27 Joint Goals and Behaviors Synchronizing autonomous Agents... joint parallel behavior DiscussMarriage{ teammembers Grace, Trip; precondition{... } subgoal SayFirstLine(); subgoal LookAtTrip(); }... Discuss Marriage Discuss Marriage?

28 Joint Goals and Behaviors Synchronizing autonomous Agents... Discuss Marriage joint parallel behavior DiscussMarriage{ teammembers Grace, Trip; precondition{... } subgoal SayFirstLine(); subgoal LookAtTrip(); }... Discuss Marriage OK! joint parallel behavior DiscussMarriage{ teammembers Grace, Trip; precondition{... } subgoal InterruptGrace(); subgoal Gesture(); }

29 Joint Goals and Behaviors Aborting Joint Behaviors It s time that Trip finally admits... Grace, stop......admits that our marriage... You don t have to is not... Grace, I love you!

30 Joint Goals and Behaviors Aborting Joint Behaviors Discuss Marriage Discuss Marriage Let s abort!

31 Joint Goals and Behaviors Aborting Joint Behaviors Discuss Marriage Discuss Marriage Ok.

32 Outlook What can be improved?

33 Easier and Faster Authoring

34 Speech Synthesis

35 Better Natural Language Processing

36 speech recognition

37 VS Who is the one? How is it done? What is to come?

38 Thank you! Any Questions?