Tracking Expressions and Emotions: The Experience of Virtual Youtubers in Building Their Avatars
摘要
Vtuber is the term used to define YouTubers and virtual influencers (Lee et al., 2022). This simplified definition relates the activity of digital content production to the use of 2d or 3d avatars modeled to respond to the physical and bodily reactions of these influencers. The content produced by Vtubers and the aesthetics of the avatars used visual and behavioral elements from Japanese Idol and Otaku culture (Regis et al, 2024; Azuma, 2009). The universe of Vtuber content creators and production agencies is intrinsically related to the technological development of sensors for tracking physical and body movements (Lehtovirta, 2023) in parallel with the improvement of 3D modeling software. Content producers and their followers relate the expressive potential of characters to the quality of tracking their visual reactions and the detailed modeling of the avatar. This has aroused the curiosity of vtubers in the development of 3D avatars and the acquisition of Head Mounted Devices to reproduce full body interactions and feel closer to their audience. The Vtuber market has expanded in recent years led by the emergence of agencies such as Vshojo, Hololive and Nijisanji (Regis et al, 2024) responsible for managing the careers of a growing number of this type of creators and structuring a content production model (Regis et al 2024). Together with the consolidation of agency vtubers, a growing number of autonomous Vtubers, called in this universe as Independent Vtubers (Lehtovirta, 2023), who produce their own content and engage in the creation and modeling of their avatars. Independent vtubers present themselves as a consumer niche for modeling applications and mixed reality devices (XR). The objective of this article is to present how Independent Vtubers develop and relate to their avatars, from the perspective of UX Design, the article discusses the values constructed by performers and the main difficulties encountered by users engaged in this new field of content production. In this way, the relationship between Vtuber, creator and user, with their avatar is understood as an object, which articulates the expressive capacity desired by users and the difficulties they encounter in modeling and performing with their avatars. This particularity places Vtubers’ activity as a new form of content production that synthesizes work on digital platforms such as YouTube, new forms of artistic expression and technological development and innovation. This research was organized in two phases. Firstly, we entered social media groups and started monitoring the profiles of famous Vtubers and their communities on platforms such as X, Reddit and Youtube. In the second phase, we immersed ourselves in the experience of Independent Vtubers by conducting nine interviews with people who work as independent vtubers. These semi-structured interviews (Gil, 2021) allowed the collection of in-depth information about their daily lives and the challenges they faced, especially in their process of building and refining their avatars and their expectations related to reality technologies. Mixed. The results found reveal how the avatar used by Vtuber is understood as a tool of personal expression, which allows the user to elaborate and express feelings and emotions that they are unable to express in their daily lives (Lee et al., 2022). It not only represents the image of the vtuber but circumscribes the construction of a new identity. Avatars are an ongoing project of vtubers this type of user is continually engaged in improving and refining their avatar's personality and 2D/3D model. In parallel, the research mapped opportunities for introducing emerging mixed reality technologies, identifying situations and usage scenarios in which these technologies can help these users’ experiences. From the vtuber's point of view, there is always a level of improvements to be made, whether in the degree of complexity of body expressions, the type of avatar chosen, or the content formats generated. The vtubers interviewed revealed that they already intended to purchase XR devices or were studying the idea of editing their avatar into a 3D model to use immersive tools and applications. This is a desire fueled not only by large companies that already use studios equipped with sensors to promote live shows, but also by independent vtubers who use XR devices to interact closely with their audience through 3D virtual platforms. The article demonstrated the existence of a variety of opportunities for the development of digital products aimed at solving the daily problems of Independent Vtubers, with the intention of enhancing their experience by making it simpler and more expressive, by offering more customizable and easy-to-model forms. of your avatars.