spirit: a structure for mobile heritage storytelling

Structuring Location-Aware Interactive Narratives for Mobile Augmented Reality

ABSTRACT: IN THE ONGOING PROJECT SPIRIT, WE DESIGN ENTERTAINING FORMS OF HERITAGE COMMUNICATIONS THROUGH MOBILE AUGMENTED REALITY. THE SPIRIT CONCEPT IS BASED UPON A STRONG STORYTELLING METAPHOR. BY USING MOBILE DEVICES (SMARTPHONES, TABLETS) AS 'MAGIC EQUIPMENT‘, USERS CAN MEET THE RESTLESS SPIRITS OF HISTORICAL CHARACTERS. THE PAPER DESCRIBES THE OVERALL NARRATIVE AND TECHNICAL CONCEPT. IN PARTICULAR, IT EXPLORES THE NARRATIVE STRUCTURES THAT ARE SPECIALIZED FOR THE INTENDED KIND OF EXPERIENCE. FURTHER, WE SHOW OUR FIRST USE SCENARIO AND DEMONSTRATOR.
KEYWORDS: LOCATION-BASED INTERACTIVE STORYTELLING, CULTURAL HERITAGE COMMUNICATION, AUGMENTED REALITY, NARRATIVE METAPHOR, NARRATIVE STRUCTURE.

IN THIS article researchers share THEIR STRUCTURE FOR 'SPIRIT', a LOCATION AWARE augmented reality MOBILE HERITAGE on-site STORYTELLING prototype.
- In 'spirit' mobiles are framed as magical devices, through which users can meet the virtual spirits of historical characters at a roman fort.  virtual characters, rather than objects on site tell stories.
- MOST HERITAGE TOURS TEND TO BE STRUCTURED AROUND EFFORTS TO LINK PLACES AND OBJECTS, taking advantage of the fact that context aware devices can track location, and environmental data such as time, noise, orientation, concurrent tasks or social environments, plus the proximity of objects, or sites. augmented information CAN enhance physical remains, and provide views into the past.
- following on from geist (2001) which explored the metaphor of magical devices, by augmenting outdoor stages with 3d animated figures, plus rexplorer (2008), which used the device metaphor of magic wands to cast spells in a pervasive game for tourists, and voices of oakland (2005), which made fictionalised voices of deceased inhabitants audible to graveyard visitors, THE mobile INTERFACE of 'spirit' IS PART OF THE STORY, FRAMED AS MAGICAL EQUIPMENT THAT USERS NEED TO MASTER IN ORDER TO ENCOUNTER GHOSTS (EXPLAINING AWAY FAULTS AS USER FAULT).  It also avoids the problem of unbelievable AR floor contact, since ghosts are expected to float in thin air. 

-- IN RESPONSE TO THE DIFFICULTY CREATING BELIEVABLE AR 3D CHARACTERS THE RESEARCHERS DECIDED TO INCORPORATE VIDEO ANIMATIONS, RATHER THAN CARTOON FIGURES.
- WHEN THE DEVICE INDICATES THE PRESENCE OF A 'SPIRIT' IN THE VICINITY, USERS CAN ACTIVATE HALF TRANSPARENT VIDEO PLAYBACK IN THEIR SCREENFINDER BY WALKING CLOSER TO A TARGET LOCATION.  - THE SPIRIT IS INITIALLY STARTED BY HUMAN PRESENCE, BUT THROUGH SMALL TRUST-BUILDING INTERACTIONS THE RELATIONSHIP DEVELOPS OVER TIME, AND THE SYSTEM REMEMBERS WHAT WENT BEFORE.
- IT IS EXPECTED THAT USERS CAN INTERACT WITH THE APPLICATION BY CHANGING LOCATION, PHYSICAL MOVEMENTS, TOUCH, VIDEO RECOGNITION AND VOICE INPUT.
- RESEARCHERS SUGGEST THAT MOBILE INTERACTIVE NARRATIVE IS COMPLICATED BY PACE, SINCE MOBILE INTERACTIONS ALSO INVOLVE REAL TIME WALKING AND EXPLORATION.  SINCE USERS CAN WALK ANYWHERE IT IS IMPORTANT THAT THE NARRATIVE SIGNALS WHERE THEY SHOULD AND CAN WALK.
- THERE IS A DISTINCTION BETWEEN THE STORYWORLD, WHICH REFERS to ALL THE NARRATIVE ELEMENTS AVAILABLE ON SITE AND THE USER'S "PLOT", WHICH ARE THOSE ELEMENTS WHICH THEY TRIGGER IN ORDER AS THEY MOVE AROUND.
- USERS CAN BE ASKED TO LOOK FOR GHOSTS AND ALSO APPROACHED BY GHOSTS AS THEY MOVE AROUND.
- CONVERSATIONS BETWEEN USERS AND GHOSTS EVOLVE IN TURNS, RESULTING IN A VIDEO PLAYLIST.  EACH SPIRIT TURN INVOLVES A DIALOG ACT SUCH AS 'GREET' 'LEAVE' 'LOCATION' 'CHARACTER' 'INFO' 'QUEST GOAL'.  THESE TAGS CAN BE USED WHEN MATCHING APPROPRIATE RESPONSES TO USER INPUT.  EACH USER TURN INVOLVES A PHYSICAL ACT, INVOLVING EITHER 'FEEDBACK' OR 'IDLE' MODE.  EACH ACT NEEDS TO CORRESPOND TO AT LEAST ONE MEDIA ELEMENT (USUALLY A VIDEO FILE).
- THE USER IS MODELLED AS PART OF THE STORYWORLD, WITH VARIABLE STATES CONCERNING LOCATION, INFORMATION PROCESSED AND ACHIEVEMENTS EARNED IN THE MOBILE GAME.

SPIERLING, U. AND KAMPA, A., 2014, NOVEMBER. STRUCTURING LOCATION-AWARE INTERACTIVE NARRATIVES FOR MOBILE AUGMENTED REALITY. IN INTERNATIONAL CONFERENCE ON INTERACTIVE DIGITAL STORYTELLING (PP. 196-203). SPRINGER, CHAM.