Interactive Storytelling

The project explores possibilities of storytelling and speech interaction by making a simple digital illustrated story book for children that animates when being read out loud. As a proof of concept, we’ve built an application that contains 4 frames which depict an event in the story. User can control the progress and narrative of this graphical novel using a cloud hosted speech API that recognise user speech input.

Date November 2016 - January 2017
Course DT2140 Multimodal Interaction and Interfaces
Team 4 People
Tools Phaser, Google Web Speech API
My Role I worked on the visual parts and animations in Phaser