Social media is rife with tacit design knowlege—including content from creators with disabilities. In this work, we chased play potentials on TikTok from creators with disabilities to inspire accessible and playful everyday technology. We design better technology for everyone when we include the perspectives of people with disabilities early and often in the design process. This project was led by Jared Duval and co-authored with Ferran Altarriba Bertran, SIP High School Interns, and Katherine Isbister. (#Disability #GamesandPlayDesign)
Vulnerability is a common experience in everyday life and is frequently perceived as a flaw to be excised in technology design. Yet, research indicates it is an essential aspect of wholehearted living among others. In this project we co-designed and deployed "True Colors", a novel wearable device intended to support social interaction in a live action roleplay game (LARP) setting. We followed a Research-through-Design process that helped us to discover and articulate the possibility space of vulnerability in the design of social wearables, as support for producing a sense of social empowerment and connection among wearers within the LARP. Our conclusions may be of value to others designing wearables and related technologies aimed at supporting co-located social interaction in games/play. This project was led by Ella Dagan and co-authored with Elena Márquez Segura, Ferran Altarriba Bertran, Miguel Flores, and Katherine Isbister. We collaborated with Event Horizon Larp crew. (#SocialAugmentation #GamesandPlayDesign)
Designing wearable technology that supports physical and social engagement in a collocated setting is challenging. In this research, we reached out to an expert community of crafters of social experiences: larpers (live action role players). Larpers and larp designers have a longstanding tradition of designing and making use of a variety of elements, such as costumes, physical objects, environments, and recently also digital artifacts. These are crafted in support of co-experience values that we argue can inform the design of social wearables. We engaged in a co-design process with a game designer and co-founder of a larp production company, and embedded the resulting social wearables in a larp. Here, we present the results of this design and implementation process, and articulate design affordances that resonate with our larp designer's values. This work may inspire and inform researchers and designers creating wearable technology that is aimed at supporting collocated engagement. (#SocialAugmentation #GamesandPlayDesign)
As part of our ongoing research into social wearables and combining them with the collaborative problem-solving nature of Live Action Role Play, we are designing an Educational LARP camp, aimed at a full-scale deployment by 2021. We aim to capitalize on the creative adaptation that comes from Live Action Role Play and the creation of social wearables to channel it into increased interest in Technology and Making in middle school girls, including those from lower socio-economic status and diverse backgrounds who are frequently left out of STEM. We have explored hardware and IDE options within the interconnected network of Maker ecosystems and created a prototype kit built around the BBC Micro:Bit ecosystem with an additional string of RGB LEDs. We have worked to find a form factor that offers a zero soldering fabrication and robust prototypes that are more suitable to wearable prototyping. In this paper, we discuss this early prototype and the motivation for the Educational LARP Camp. (#SocialAugmentation #GamesandPlayDesign)
In this work we propose a strong concept for interaction design: Synergistic Social Technology (SST). This concept describes systems in which technology is designed with its own need for interaction. As a result of responding to these needs, people who use the system may benefit from social interaction with others who use the system. This concept arose through the design, prototyping, and study of a social wearable design that we called Robo-Shoe-Flies. We articulate the core principles of the SST concept. We also describe the Research-through-Design process that inspired its development and associated design-focused observations. This work may inspire those in the IxD or HCI communities focused on the design and development of technology intended to support so-cial interaction, particularly in the sense of encouraging collective, mutually-beneficial action. This project was led by Ella Dagan and co-author Katherine Isbister. (#SocialAugmentation #GamesandPlayDesign)
In this project, we created a pictorial where we explore the potential of social media to help inspire ideas for future drone design applications that support playful and social experiences. Drawing from a Situated Play Design approach, we turn to social media posts to identify recurring playful and social instances of drone use in social settings. We present the results of collecting 143 posts found on Instagram, TikTok, and YouTube, from which we identified a non-exhaustive list of drone-based play potentials, i.e. existing ways in which people already appropriate drones to playfully augment social situations. We present these play potentials as potentially valuable and inherently situated intermediate-level knowledge with generative power. We argue they might inspire the design of future drone technologies and experiences in Human-Drone Interaction (HDI), in directions that increasingly respond to people’s desires for play and social connection. This project was led by Alexandra Pometko and co-authored with Ella Dagan, Ferran Altarriba Bertran, and Katherine Isbister. (#SocialAugmentation #GamesandPlayDesign #DesignMethods)
User involvement is well established in game and play design. But in a time when play design is becoming relevant in domains beyond pure entertainment, and play blends into everyday activity in diverse ways, we need to revisit old, and develop new, user involvement methods. Using a situated perspective and Research through Design, we presented Situated Play Design (SPD), a novel approach for the design of playful interventions aimed at open-ended, everyday activities that are non-entertainment based. Like user-centered game and play design methods, our contribution leverages user engagement; like Participatory Design methods, our method acknowledges the co-creating role of end users. SPD extends those approaches by focusing on uncovering existing manifestations of contextual playful engagement and using them as design material. Through two case studies, we illustrated our approach and the design value of using existing and emergent playful interactions of users in context as inspirations for future designs. This allowed us to provide actionable strategies to design for in-context playful engagement. This project was led by Ferran Altarriba Bertran and co-authored with Elena Márquez Segura, Jared Duval, and Katherine Isbister. (#DesignMethods #GamesandPlayDesign)
Despite the capacity of play to spontaneously emerge in our daily life, the scope of application of play design in HCI is generally narrower, specifically targeting areas of pure leisure, or wholly utilitarian and productive play. Here we focused on the value of play design to respond to and support our natural gravitation towards emergent play that helps to meet our social and emotional needs. We developed a bridging concept: Technology for Situated and Emergent Play, i.e. technology design that supports playful engagement that emerges interwoven with our everyday activities outside leisure, and that enriches these activities with socioemotional value. Our intermediate-level contribution has value as a synthesis piece: it weaves together theories of play and play design and bridges them with concrete design examples. As a bridging concept, it contributes: i) theoretical grounding; ii) inspiring design exemplars that illustrate the theory and foreground its value; and iii) design articulations in the form of valuable experiential qualities and design features. Our work can help to focus design agendas for playful technology and inspire future designs in this space. This project was led by Ferran Altarriba Bertran and co-authored with Elena Márquez Segura and Katherine Isbister. (#GamesandPlayDesign)
Play and playfulness permeate our daily lives and are often the target of interaction de-signers. Yet, designing for play while embracing the idiosyncrasies of users and their con-texts is challenging. Here we addressed recent calls for new situated and emergent play de-sign methods by turning to social media, which is currently a source of inspiration for arts, crafts, fashion, and more. We presented an exploration of how Instagram may help designers capture and share instances of mundane playful engagement to inspire design. We reported on the findings of a pilot study where we experimented with the tool, and raise a challenges and open questions we plan to address in the future. Our work can trigger discussions among researchers about the potential of social media as a design tool, and can inspire and invite action towards collectively defining strategies to leverage that potential. This project was led by Ferran Altarriba Bertran and co-authored with Ella Dagan, Laia Turmo Vidal, Elena Márquez Segura, Jared Duval, and Katherine Isbister. (#DesignMethods #GamesandPlayDesign)
Activity in Human-Food Interaction (HFI) research is skyrocketing across a broad range of disciplinary interests and concerns. The dynamic and heterogeneous nature of this emerging field presents a challenge to scholars wishing to critically engage with prior work, identify gaps and ensure impact. It also challenges the formation of community. We conducted a Systematic Mapping Study of HFI research and developed an online data visualisation tool, the HFI Lit Review app, to respond to these issues. The tool allows researchers to engage in new ways with the HFI literature, propose modifications and additions to the review, and thereby actively engage in communitymaking. Our contribution is threefold: (1) we characterize the state of HFI, reporting trends, challenges and opportunities; (2) we provide a taxonomy and tool for diffractive reading of the literature; and (3) we offer our approach for adaptation by research fields facing similar challenges, positing value of the tool and approach beyond HFI. This project was led by Ferran Altarriba Bertran and Danielle Wilde (University of Southern Denmark), and co-authored with Samvid Jhaveri, Rosa Lutz, and Katherine Isbister. Following, we did a systematic review of a subset of HFI works that we call Playful HFI—interventions that use game- or play-inspired mechanisms to add value to foodrelated experiences. To support our review, we offer a conceptual model of Playful HFI informed by: (i) the 34 publications in our dataset; (ii) theories of play, games and HFI; and (iii) previous reviews of play-related HCI. Our conceptual model and review characterise the current state of Playful HFI, highlight resemblances and differences with the broader field of HFI as a whole and surface challenges and opportunities in this new and exciting design space. Our contribution will help HFI scholars to explore new and increasingly playful avenues for the future of food technology and will empower the HFI community to better position (and critically reflect on) future research at the intersection of play, technology and food. This project was led by Ferran Altarriba Bertran and Danielle Wilde (University of Southern Denmark), and co-authored with Ernö Berezvay (Open University) and Katherine Isbister. (#GamesandPlayDesign)
In this project, we turned to culture and traditions to produce an annotated portfolio of play-food potentials, i.e. interesting design qualities and/or interaction mechanisms that could help promote playful and social engagement in food practices. Our portfolio emerged from a one-day workshop where we played with and analyzed a collection of 27 food traditions from diverse cultural backgrounds and historical periods. We highlight play forms and experiential textures that are underexplored in Human-Food Interaction (HFI) research. Our contribution is intended to inspire designers to broaden the palette of play experiences and emotions embraced in HFI. This project was led by Ferran Altarriba Bertran and co-authored with: Jared Duval, Elena Márquez Segura, Laia Turmo Vidal (Uppsala University), Yoram Chisik (Independent Researcher), Marina Juanet Casulleras (Freelance Illustrator), Katherine Isbister, and Danielle Wilde (University of Southern Denmark). (#GamesandPlayDesign)
Socialisation, eating and play are core activities that make us human. While they are often brought together, play theory suggests that their combination has unexplored potential in the context of gastronomy. Our research also indicates that a chef’s desire to control the meal may be a key impediment to developing dining experiences in which the diner’s playful engagement impacts taste, texture and flavour combination. In this project, we investigate if combining participatory Research through Design and play theory might better situate chefs to diversify their approach to playful gastronomy. This project is led by Ferran Altarriba Bertran, and co-authored by Danielle Wilde (University of Southern Denmark), Rosa Lutz, and Katherine Isbister. (#GamesandPlayDesign #DesignMethods)
SpokeIt addresses the needs of a large community of people who receive, do not receive, or provide speech therapy. SpokeIt is a serious game for heatlh designed to provide at-home speech therapy and engaging activites. Speech practice at home is usually hindered by a lack of intrinsic motivation due to the tedious and repetitive idiosyncratic nature of speech therapy curriculums. Parents and caretakers experience major difficulties prompting individuals to complete speech exercises at home, especially when young. They often lack the expertise of a speech therapist and report a general low sense of competence in facilitating curriculum. Medical professionals have little insight into the (lack of) progress outside of their practice and would benefit from reports. SpokeIt is intended to be used by children aged 4-10 with cleft speech, as well by parents, caretakers, and medical professionals for curriculum customization, progress reports, and integrated at-home play. (#GamesandPlayDesign)
Astaire is an asymmetric collocated virtual reality (VR) game designed with the intent to encourage pro-social play in festival/home settings and provide a better spectator experience than other games. The overall goal of the game is to get the highest score possible by tagging musical notes and footsteps as quickly as you can with your controller, as they appear on beat with the music. Players are rewarded with more points the faster they tag the notes, and each interactable object within the world has a generous hitbox to create a more fluid experience, in that players should not have to struggle because the controllers are not attached to their feet or hands. It is designed to allow for 2 players to use 1 system simultaneously to play, both with different objectives and roles to consider (hence the asymmetry). The players have distinct sources of information. The player with the controller attached to their leg uses the television for guidance, as the view there is from an overhead camera above the map that shows notes that are only interactable with the controller attached to the other player 1 second before they spawn. The player inside VR can see both players’ notes, but not with the foresight or breadth of the other player. They see the footstep notes only interactable for the player outside VR, which they can then guide them to. (#SocialAugmentation #GamesandPlayDesign)
SceneSampler pushes the boundaries of local multi-player games. We’ve created our own gadgets –a wearable ‘camera’ and a handheld sound ‘sampler’– that players use collaboratively to capture brief slices of the scene (people hanging out, enjoying games, catching up) as the festival goes on. The core mechanic –seeking out particular kinds of sounds– pushes players to move around together in the social space in a playful way that’s different than they might otherwise. The game leaves traces of the festival in the form of player snapshots shared digitally –these create a secondary kind of play in the social media surrounding the festival. Overall, SceneSampler is meant to enhance the social experience of being at a game festival like IndieCade, making a game of exploring the human landscape and capturing moments for others to enjoy and remember. (#SocialAugmentation #GamesandPlayDesign)
This project is called All the Feels, which is a tool that provides an overlay of biometric and webcam-derived data onto the interface of the popular video game streaming service, Twitch. The overlay provides visualization of heart rate, skin conductance, and facial emotion recognition. It is intended to enhance the spectator experience and improve streamer-spectator connection. This work opens up opportunities to improve stream quality and spectator engagement through the introduction of an interface that includes biometric signals. Janell Mora was responsible for the all the art used in the overlay, and April Grow provided consultation on the research. (#SocialAugmentation #GamesandPlayDesign)
Social closeness is important for health and well-being, but is difficult to maintain over a distance. Games can help connect people by strengthening existing relationships or creating new ones through shared playful experiences. The name of this project/game is, 'In the Same Boat' (ITSB), which is a two-player infinite runner designed to foster social closeness in distributed dyads. ITSB leverages the synchronization of both players' input to steer a canoe down a river and avoid obstacles. We created two versions: embodied controls, which use players' physiological signals (breath rate, facial expressions), and standard keyboard controls. This was was a collaboration between UCSC and the University of Saskatchewan. Elizabeth Reid implemented the game, James Fey built the hardware, and Ansgar Depping provided design consultation. (#SocialAugmentation #GamesandPlayDesign)
In this project, we conducted a comparative analysis of several emotional reporting techniques for assessing gameplay experience. We compared newer feedback methods, such as the Sensual Evaluation Instrument (SEI) and recent tools for capturing physiological data, with more traditional techniques such as think-aloud, the Immersive Experience Questionnaire (IEQ), and retrospective interviews. Findings suggested that mixed methods offer complementary strengths in registering player emotion, are useful at different moments of play, and help to accommodate differences in the ways players' emotions manifest. We argue for the value of using multiple methods in evaluating players' emotional response to games. This work was done in collaboration with John Murray. (#SocialAugmentation #GamesandPlayDesign)