Tag Archives: Storytelling

A Therapeutic Rocking Chair

Following on from our pop-up exhibition of audio stories, produced from our winter visit to the MShed (see Memories and Museums) we have been developing another auditory experience using chairs, and inspiration drawn from venturing outdoors. Here I introduce the concept of a therapeutic rocking chair for older people with dementia.

Early on in the Tangible Memories project, we recognised that access to the outdoors, and specifically to the natural world, was very limited for many care home residents, often due to a decline in their physical mobility, or particularly if they were suffering from the more advanced stages of dementia. Equally, when we asked ourselves as a team, ‘what would we want in a care home of the future?’, we identified the simple routine of being able to go outside and experience the elements as something that would be of great importance to us all.

So throughout the project, we have been seeking different ways to incorporate aspects of life outside the care home environment into our technologies and prototypes, for those who are not able to venture out independently, or as often as they might like.

To begin with, we explored virtual travel using the Oculus Rift VR headset (see Virtual Reality Storytelling), with 360˚ stitched photographs of local places and museums:

SWNS_ARAB_ROOM_11small
Example of one of the 360˚ photographs for use in the Oculus Rift headset. The technology provides an opportunity for virtual visits to museums and other local places.

We also offered VR experiences using moving imagery, sending residents to a virtual Tuscan villa, up in a hot air balloon, and even into the solar system on an animated space journey. Closer to home, we had previously recorded a kind of video postcard that reflects on the beauty of springtime in the countryside:

In this short film, as we focused on the many calming and uplifting effects of nature, such as birdsong or the sound of a river, we felt that adopting such a therapeutic approach would be particularly beneficial to residents living in the specialist dementia care home. Anxiety, agitation and memory loss are recurring symptoms of advanced dementia, so rather than placing the onus on an individual to remember past realities, we wondered whether it would prove more positive to provide an evocative soundscape of the natural world, without visual stimuli, where a person’s imagination could wander freely, and enjoy fact or fiction, in a peaceful listening experience.

With this in mind, the concept of a therapeutic rocking chair evolved, and was partly in response to Pete Bennett’s brilliant Resonant Bits harmonic user interface. This app triggers sound content on an iPhone or an iPad using a kind of rocking movement from simple subtle gestures and a slow meditative motion response. In his research, Pete asks:

How can interfaces support slow and meditative interaction in a fast paced world?  How would it feel to be able to ‘tune in’ and interact directly with digital ‘bits’ of data?

Thinking about the meditative field recordings that I had already captured from nature, and wanting to combine these with Pete’s app to create a calming user experience and interaction, the traditional rocking chair seemed like an appropriate medium for a therapeutic listening experience, simply by embedding some speakers in the headrests. Rocking chairs can be a familiar item of furniture for many older people, the type of chair which provides an opportunity to dwell, ponder and relax, with its motion considered to be very comforting. (Perhaps why babies and young children are typically rocked to sleep).

In essence, this therapeutic rocking chair would play calming, comforting sound content triggered by the rocking motion. The soundscapes of nature, poetry or music would fade away and change track as the rocking motion stops and starts again, making the interaction as simple and intuitive as possible. (The chair would be silent when it was not moving). Here’s a quick demo, using just the app on an iPhone:

The rocking chair would offer this spontaneous and relaxing listening experience through hidden stereo speakers in the headrests, connected to the Harmonic User Interface app on an iPhone.

Alongside this concept development, what a bonus it was to discover a medical study published in the American Journal of Alzheimer’s Disease and other dementias which cites the psychosocial and physical benefits for dementia patients who regularly rock in a platform rocking chair:

Rocking therapy study - cover page

Read the findings online here: Rocking chair therapy

The US study used traditional platform rocking chairs and their rocking motion alone as a form of therapy, which researchers found could improve balance, muscle tone, emotional well-being, and resulted in a reduction in the number of requests for medication to treat aches and pains in the majority of older people they tested.

If such results could be achieved with support and persistence, using a traditional piece of furniture, what more might we be able to offer residents by embedding therapeutic sounds triggered by the rocking motion? One of our key aims on the Tangible Memories project is to develop assistive technologies that enhance the social, personal and emotional well-being of older people, in addition to addressing their physical needs.

So I set to work, hacking an existing platform rocking chair in order to integrate stereo speakers into the headrests and create a quick iteration of our initial prototype so we could test the idea and get it working:

Table of tools mid hack_Small
Hackspace: DIY table of tools for adapting an existing platform rocking chair to incorporate stereo speakers
Rocking Chair prototype
Speakers fitted into the headrests of the rocking chair, visible from the back only. In future prototypes, these speakers would be completely hidden.

The next step required uploading an adapted version of Pete’s Harmonic User Interface app (currently called ‘SoundChair’) to my iPhone and then adding the sound content via iTunes.

SoundChair icon-02
SoundChair icon

The app can play any m4a, mp3 or aac file which is triggered by the rocking movement.

In addition to the sounds of nature, I’ve added other content known to be beneficial for dementia patients, which includes the rhythmic repetition of poetry, as well as classical music. Here are a few examples to give a flavour:

‘Sailing By’, Radio 4 shipping forecast theme:

The sound of waves on the seashore:

‘The Daffodils’ by William Wordsworth:

Next, the speakers were crudely connected to a battery power pack and my iPhone….

Rocking Chair prototype

…..and we’re ready to test it out!

From Conch to Code

As the augmented reality develops for the interactive books and app, Stand + Stare have been working with talented illustrator Hugh Cowling, to produce a series of beautiful shell drawings that trigger audio stories when they are scanned, functioning in a similar way to a QR code.

Here are some of Hugh’s wonderful illustrations, much more aesthetically appealing and poetic than a typical QR code:

A4 15 Shells_01

Alongside the application of these drawings to the book/app prototypes, we are also exploring their potential for use on fabrics and textiles, while textured surfaces and soft objects such as cushions are considered to have some therapeutic uses for those living with dementia. Here are some examples of early tests using hand printed methods on cotton:

Shell cushions

and a digitally printed version,  on a tactile faux suede:

Shell digital print. Tangible Memories.

Evolving partly from the ButtonTuner musical cushion, we look forward to testing out the tech for these pillow cases and cushion covers, as well as developing the user experience.

TopoTiles paper accepted for CHI 2015

Examples of the completed 3D and 2D ‘TopoTiles’
Examples of the completed 3D and 2D ‘TopoTiles’

The Tangible Memories team was delighted to hear news today that our work-in-progress paper ‘TopoTiles: Storytelling in Care Homes with Topographic Tangibles’ has been accepted into CHI 2015, the Human Computer Interaction conference, to be held in Seoul later this year.

Here’s more about this international HCI event, which is on the theme of ‘Crossings’, appropriate to our interdisciplinary project: http://chi2015.acm.org

Read more about the development of the TopoTiles in this previous blog post: http://tangible-memories.com/topotiles-and-other-tales-of-topographic-tangibles/

Memories and Museums

Recently, we held a group session with residents that focused on the theme of favourite walks. For some of the older people we are working with, access to the outdoors represents a physical challenge or a rare treat, while the residents of this particular assisted living location generally enjoy a much greater level of independence and freedom to go outside.

The participants in this lively group discussion came prepared with a significant walk in mind from any point in their lives, and seemed to relish sharing their experiences about a walk, or pattern of walks, that had memorable meaning. One gentleman remembered the familiarity of his walk to infant school, made suddenly dramatic one day in 1927, when a bi-plane landed in a field next to the primary school. This was the first aeroplane he had ever seen. One lady took the opportunity to advertise a sponsored walk she had planned for the very next day, to raise money in aid of the resident’s activity fund. She was hoping to make two circuits around the building where the group live, but promised that if she could get a skateboard, she would be able to make it three! There were reminiscences about walks in Blaise Castle and the Hamlet, that seemed ‘like walking in a fairyland’, while others fondly recalled walks with a husband or wife amongst snowdrops or bluebells in the Springtime. For another lady, walking on land was significant in itself, as she and her family had lived on board a boat and her daughter had learnt to walk while they were at sea.

One of the outcomes of this session, exploring favourite walks and nearby locations, was the desire to revisit some of these places in real life, in order to re-experience them and have the chance of uncovering more distant memories. Adopting the more curatorial approach on offer (see post re TopoTiles), the group decided that they would enjoy visiting the MShed, a local museum about Bristol, its places, people and their stories, which effectively seemed to represent several of the locations that they had been discussing.

Tangible memories visit to M-Shed at Bristol docks. 7 Nov 2014

As a result, one blustery cold morning, we gathered into a minibus and travelled to Bristol’s harbourside to explore the MShed, and the many intriguing objects on display there.

Tangible memories visit to M-Shed at Bristol docks. 7 Nov 2014
View from inside the MShed over Bristol’s harbourside

In addition to the curated exhibitions that stretched across three floors of the museum and were complemented by wintery harbourside views, the residents particularly enjoyed a guided tour of the museum’s stores, known as the LShed.

Behind-the-scenes, in a dimly-lit warehouse, these uncurated and large-scale artefacts seemed all the more enticing somehow, stacked on shelving, without labels or glass cases, or peeking out from underneath plastic sheeting and behind cupboard doors.

Tangible memories visit to M-Shed at Bristol docks. 7 Nov 2014

In this unordered space, it felt as if there was more to discover in a serendipitous way, and this led to a greater number of memories being evoked for the residents, in response to the historic objects they observed among the aisles of storage.

Tangible memories visit to M-Shed at Bristol docks. 7 Nov 2014

The spontaneous discovery and revelation of items within the LShed collections seemed to vividly reflect the way in which we store our memories, as well as the manner in which we tend to recall them. Jumbled and disorderly, sometimes hidden from view, our past is usually recollected in a non-linear fashion, leaping from one event to another, bounding across years and back again.

Tangible memories visit to M-Shed at Bristol docks. 7 Nov 2014
A dentist’s chair with its foot-pedal drill evoked some teeth-clenching memories for the residents. (Museum visit photos: Jonathan Rowley)

The visit to the MShed and LShed, and the stories which the day evoked, were captured through a series of photographic images and sound recordings. Initially, the residents have chosen to use this material in a temporary exhibition in one of the communal living areas at their home:

IMG_4677a
An audio-visual exhibition of the residents’ visit to MShed, currently on display in the foyer.

Five images were selected from the museum visit, with accompanying sound recordings that related to the objects in the photos.

Using three push-button sound systems already available in the foyer, we recorded short excerpts of narrative, into each of the three units:

IMG_4672
The mechanics of the sound system available for playing back and sharing stories from the MShed visit.

Here is an example, featuring one of the LShed mangles:

Tangible memories visit to M-Shed at Bristol docks. 7 Nov 2014

The residents now have further plans to share different aspects of their museum visit, including a slideshow for friends and neighbours (to be held later this month) and the suggestion of a ‘virtual museum’ to be installed at the home. This would involve using some of the images of the objects in store, within the Oculus Rift virtual reality headset, so that those residents who are physically unable to travel to the museum itself, might be able to enjoy a similar, serendipitous discovery of the LShed and reminisce around the artefacts for themselves.

‘TopoTiles’ and other tales of topographic tangibles

Over the past few months, we have been seeking to develop the group making sessions in another of the care homes, working alongside residents to co-produce proxy objects and ‘objects of exchange’ as design prototypes that capture and represent personal and collective stories.

Evolving from the creative workshops where residents produced ‘tokens of value’ – inscribing wax tablets with a representation of significant memories that were later cast into bronze – we initially offered the same materials and making-based approach to residents of the second care home. We suggested that these tokens could then be exchanged amongst the group with the stories they represented (with or without embedded technologies), thus sharing residents’ experiences with each other and strengthening the home’s community in the process, using these unique personalised objects as a focus.

To begin with, we proposed a theme of ‘favourite walks’ as a topic and trigger for creative making. Participants were asked to recall a memorable route in advance of the sessions, giving them time to reflect on any walk they chose to remember. The aim was then to find the location on the iPad using Google Street View for a virtual visit, and identify it using OS maps online, before tracing over the route, and inscribing a line drawing of the walk onto one of the prepared wax hexagons, ready for casting:

Hexagonal walking route_edited
An example of a wax hexagon ready for casting. The surface has been inscribed with the route of a favourite or significant walk, traced from Ordnance Survey maps online. Google Street View was used to revisit the locations virtually.

The reaction to this activity was mixed. The theme proved successful and generated one of the most animated and dynamic discussions that had taken place during the project. However, this success came at the cost of participants not engaging with the tools, materials or other creative processes on offer.

These sessions were subsequently adapted in order to introduce a more curatorial method into the process of co-production. One outcome of the favourite walks theme was some lively story-swopping between the residents, about local Bristol landmarks and historic places of interest. Rather than the residents inscribing the wax hexagons with these walking routes by hand, they gave us permission instead, to transform the subjects of their conversations into miniature topographies of the various locations discussed. We used Autodesk Fusion modelling software and a milling machine to achieve a more tactile, 3D topographic hexagon, and laser etching to transpose detailed photographic images of the landmarks into 2D. These hexagonal tiles representing miniature topographies became known as ‘TopoTiles’:

3D modelling the TopoTiles ready for the milling machine
3D modelling the TopoTiles ready for the milling machine
Examples of the completed 3D and 2D ‘TopoTiles’
Examples of the completed 3D and 2D ‘TopoTiles’

The series of TopoTiles has been shared with small groups of residents, and tested as narrative prompts, tangible user interfaces designed to aid reminiscence and storytelling. Some of our research questions around these manufactured artefacts include:

How can landscape tangibles be used as proxy objects, standing in for landscape and objects unavailable to the storyteller?

Can miniature landscapes aid recollection and storytelling through embodied interaction?

Are ambiguous depictions conducive to more diverse use in storytelling, and can topographic tangibles encourage inclusivity in group sharing situations?

While the TopoTiles represent places of personal significance to the residents, (either specific or ambiguous), the tessellation of these miniature topographies seems to symbolise the network of shared histories across the care home, connecting the individual’s experience with their immediate community, united by a common encounter in the landscape.

 

2014 International Autobiography Conference, Stockholm

I have just attended the 2014 International Autobiography Conference in Stockholm, where I presented a paper on the life storytelling and life writing strategies of 3 of our elder co-researchers in the project, focusing on the interplay between orality and writing and their different conceptions of time and truth, particularly where play challenges conventional chronology in the creation of stories that remain personally true.

One of our co-researchers uses writing as a means to rehearse or anchor his oral accounts as accurately as he can, departing from the written word when he is confident his memory will yield the essential details in their proper order, allowing him to bring in asides and reflections to enrich his account.

The second narrator deliberately plays with her life’s timeline, taking events that are all true for her and mixing their order in the creation of a new tale that allows her to reflect and comment on her experiences in a new way.

The third co-researcher creates children’s stories, following a tradition she started several years ago writing postscripts from a beloved pet bird to entertain an adult sister in long-term care and, by extension, the other sisters caring for her. Her protagonist, a spider, must learn not only to face, but also actively seek out new challenges and figure out his place in the world. Her stories allow her to reflect and comment on life as she has lived it so far with a view to where she would like to go in the future.

Our group was small because there were 5 simultaneous panels, but discussion was lively and I was pleased that my paper, grounded in our project, featured the work of unpublished authors. Autobiography as life writing (inscribing?) needs to work more closely with oral history in order to appreciate the multiplicity of ways extraordinary everyday stories are told. Likewise, oral history might benefit from some of autobiography’s approaches to literature-as-life-history. As a folklorist, being a child of the issue that — as ballad scholar Tristram P. Coffin is famously credited with saying — ” Anthropology got off English” I keep firm hold of the hands of both my reluctant and slightly abashed parents and see no shame in my intellectual lineage. Textual studies and ethnography can enrich each other.

From the conference In particular, I was struck by Andrew Miller’s (Flinders University, Australia) presentation on autoethnography in digital storytelling and wondered if there was scope in a future direction of the project for Intergenerational work between seniors and youth that could create sites of digital life storytelling, where young people could mediate the technology as needed but also listen to and help put together elders’ stories and perhaps even vice versa, if an interface could be devised that was accessible for people with fine motor problems and sight issues. While young and old alike could also be authors in solitude, the project has clearly shown that stories have their greatest power in shared contexts. Perhaps this is one area where the project’s emphasis on scalable interactive books could really shine, in the development of elder-centred tools for storytelling.

Likewise, a paper by Hertha D. Sweet Wong (Berkeley) on the artist books of Julie Chen, beautiful hand-crafted and deliberately non-digitally interactive books that compel the reader to confront narratives about our relationship to the passage of time, got me thinking about whether the technology underpinning the interactive books and whether future iterations could be published combining digital and essentially mechanical interaction (think of the difference between a video or an e book and a fold out pop up book or one with “secrets” that must be physically unlocked in reading). On the face of it, my feeling is yes, since this conference has brought up a question we asked ourselves early in the project: “What about writing as well as audio? What about texts-as-artefacts as well as objects-as-texts?”

Perhaps as with many stories, we will find we end at the beginning, wiser for the journey and ready to go in a new direction.

(Header Image from Wikimedia)

The Story is the Thing is the Story

(Some opening thoughts from a presentation I recently gave with Helen in the GSoE that I am developing into a larger presentation for the Brunelcare Forum on 21 May):

In everyday language, we speak about objects and stories in very similar ways. Stories possess weight, colour, form, context, history/provenance, value and meaning, just as objects do. We can talk about “the object of a story” just as easily as we can discuss “the story of an object.” In both cases, we are referring to “the point,” or “the essential meaning or core” of the narrative or artefact concerned. Somewhat analogous to the universal variables of energy and mass, stories and objects are at least metaphorically interchangeable as signifiers. On the one hand, sometimes we acquire an object and build stories around it: the cherished gift, the inherited heirloom, the chance-discovered treasure. On the other, we can also create, seek out or find ourselves immersed in stories and build collections around them: the holiday photos, the handmade craft, the kitchy souvenir. Value may be attributed at any point, but it too is always open to change as our experiences, memories and ongoing interpretation and curation of our lives change over time. Continue reading

Virtual Reality Storytelling

We played around with using the Oculus Rift today as a means for creating a virtual space for storytelling. Our first two testers M & B both enjoyed the experience. We firstly tried out stepping into a 3D snapshot of the Bristol Museum Foyer, and then took a trip up Cabot Tower. M had a look around a virtual Tuscan Villa whilst B opted for a whistle-stop tour of the Solar System. The next step is to customise the virtual scenes and introduce the possibility of handling objects relevant to the scene during the experience. An interesting finding was that binaural audio recordings played at the same time proved to be a distraction from the visual material.

VR-M Continue reading