HackerHero is an educational game designed to teach children, especially those from marginalized backgrounds, computation thinking skills needed for STEAM fields. It also teaches children about social injustice. This project was focused on creating an audio visualization for an AI character within the HackerHero game. The audio visualization consisted of a static silhouette of a face and a wave-like form to represent the mouth. Audio content analysis was performed on audio sampled from the character’s voice lines. Pitch and amplitude derived from the analysis was used to animate the character’s visual features such as it’s brightness, color, and mouth movement. The mouth’s movement and color was manipulated with the audio’s pitch. The lights of Wave were controlled by the amplitude of the audio. Design considerations were made to accommodate those with visual disabilities such as color blindness and epilepsy. Overall the final audio visualization satisfied the project sponsor and built upon existing audio visualization work. User feedback will be a necessity for improving the audio visualization in the future.

This thesis is based on bringing together three different components: non-Euclidean geometric worlds, virtual reality, and environmental puzzles in video games. While all three exist in their own right in the world of video games, as well as combined in pairs, there are virtually no examples of all three together. Non-Euclidean environmental puzzle games have existed for around 10 years in various forms, short environmental puzzle games in virtual reality have come into existence in around the past five years, and non-Euclidean virtual reality exists mainly as non-video game short demos from the past few years. This project seeks to be able to bring these components together to create a proof of concept for how a game like this should function, particularly the integration of non-Euclidean virtual reality in the context of a video game. To do this, a Unity package which uses a custom system for creating worlds in a non-Euclidean way rather than Unity’s built-in components such as for transforms, collisions, and rendering was used. This was used in conjunction with the SteamVR implementation with Unity to create a cohesive and immersive player experience.

Video playback is currently the primary method coaches and athletes use in sports training to give feedback on the athlete’s form and timing. Athletes will commonly record themselves using a phone or camera when practicing a sports movement, such as shooting a basketball, to then send to their coach for feedback on how to improve. In this work, we present Augmented Coach, an augmented reality tool for coaches to give spatiotemporal feedback through a 3-dimensional point cloud of the athlete. The system allows coaches to view a pre-recorded video of their athlete in point cloud form, and provides them with the proper tools in order to go frame by frame to both analyze the athlete’s form and correct it. The result is a fundamentally new concept of an interactive video player, where the coach can remotely view the athlete in a 3-dimensional form and create annotations to help improve their form. We then conduct a user study with subject matter experts to evaluate the usability and capabilities of our system. As indicated by the results, Augmented Coach successfully acts as a supplement to in-person coaching, since it allows coaches to break down the video recording in a 3-dimensional space and provide feedback spatiotemporally. The results also indicate that Augmented Coach can be a complete coaching solution in a remote setting. This technology will be extremely relevant in the future as coaches look for new ways to improve their feedback methods, especially in a remote setting.

Party on Wall Street is a web-based video game developed by Maroon and Gold Game Studios. As an educational entrepreneurship video game, Party on Wall Street provides a refreshing and exciting new experience for the tycoons in society who want a little more of that entrepreneurial lifestyle. With proper research on customer demographics, Maroon and Gold Game Studio’s brand identity consists of a modern game with multiple use cases. With strong partnerships with multiple creatives and built from scratch game development, Party on Wall Street implements a fun, high intensity business competitive environment for players and students to engage in. This thesis consists of building an interactive experience through the use of AirConsole, a third party platform that hosts the game and allows players to join it by connecting to the same website on their mobile device. The primary user has access to hosting a game which can be casted to a larger screen, typically a television. When hosting a game, a room code is generated which can be typed in on the mobile device to connect to the game. When all players have joined the game, the host can initiate it. Players go through 6 rounds of pitch style investing presentations and have the opportunity to invest in other products with the ultimate goal of earning the most money. In the end, the game was successfully implemented, extensively user tested, and is under review by the AirConsole game team. Over the last year, the team successfully brought an idea through the entire product development process, learned to build a game in Unity, made practice of extensible testing and validation methods, and leveraged customer research and feedback to design a game that is ultimately both enjoyable and educational.

Party on Wall Street is a web-based video game developed by Maroon and Gold Game Studios. As an educational entrepreneurship video game, Party on Wall Street provides a refreshing and exciting new experience for the tycoons in society who want a little more of that entrepreneurial lifestyle. With proper research on customer demographics, Maroon and Gold Game Studio’s brand identity consists of a modern game with multiple use cases. With strong partnerships with multiple creatives and built from scratch game development, Party on Wall Street implements a fun, high intensity business competitive environment for players and students to engage in. This thesis consists of building an interactive experience through the use of AirConsole, a third party platform that hosts the game and allows players to join it by connecting to the same website on their mobile device. The primary user has access to hosting a game which can be casted to a larger screen, typically a television. When hosting a game, a room code is generated which can be typed in on the mobile device to connect to the game. When all players have joined the game, the host can initiate it. Players go through 6 rounds of pitch style investing presentations and have the opportunity to invest in other products with the ultimate goal of earning the most money. In the end, the game was successfully implemented, extensively user tested, and is under review by the AirConsole game team. Over the last year, the team successfully brought an idea through the entire product development process, learned to build a game in Unity, made practice of extensible testing and validation methods, and leveraged customer research and feedback to design a game that is ultimately both enjoyable and educational.

For the average person, when they use a computer, they interact with two main groups: the Computer Input, which consists of a keyboard and a mouse, and the Computer Output, which consists of a monitor and speakers. For those with physical disabilities, traditional Computer Input and Output methods can be difficult or uncomfortable to use. I believe VR Technology can make using computers much more accessible for those individuals, and my application demonstrates that belief.