Mixed Reality Interactive Storytelling

Interactive Storytelling aims at immersing users in fantasy worlds where they can play a part in an evolving narrative responding to their intervention. Implementing such a concept involves a wide range of computing technologies: the recreation of an artificial world is generally achieved using virtual or mixed reality, while the real-time generation of a narrative including virtual characters makes uses of Artificial Intelligence techniques and formalisms. 

- System Architecture -

If the user is to play a role as a character in the interactive narrative, s/he will have to communicate with virtual characters in a way which should reflect traditional acting. This brings a novel, specific context for multi-modal communication as well as a number of technical challenges. Acting involves a number of attitudes and body gestures that are highly significant both for drama presentation and for communication with virtual actors. At the same time, spoken communication is an essential aspect of a realistic interactive narrative. Dealing with such form of multi-modal communication is faced with several difficulties in terms of real-time performance, coverage and accuracy.