Roles: Recording Technician, Proprietary Labeling Specialist, AI Training Manager
Core Expression: English
Whisper Expression: English
Power Expression: English
Core Expression: Japanese
Callie York DSv0 is an AI vocal synthesis model made to sing the lyrics and melody provided by the user. This required handling audio hardware and using Conda environments while troubleshooting errors on my own. The main challenges were mostly due to needing to remake the environments due to the framework getting frequent updates. I also ran into issues that no one else had documented solutions for. I had to learn how to find my own answers, manage dependencies, and communicate with others to help them fix their own projects.
Austin York Standard is built on a custom script for obtaining the necessary syllable for concatenative vocal synthesis, which is based on more direct resampling than AI. Labelling is more intricate to account for the need to crossfade samples to make the synthesis sound smoother. The main challenges came from the proprietary labelling and custom script writing. This required a process of learning the labelling process and various aspects of phonology and how they affect how I speak English.
3. Rode NT-1 Podcast
Roles: Recording Technician, Voiceover Artist, Sound Engineer, Writer, Video Editor
The goal for this was to make a podcast episode based on a business I made up, which was all about microphones. The main challenges came from writing the script to fit the time limit. I had to learn how to fit my writing in a time limit without having it feel rushed and handle audio normalization.
4. VR Environment
Roles: Sound Designer, Sound Engineer, 3D modeler, Unity Developer
I put a lot of emphasis on sound for this environment. Despite its small size and simplicity, the sound made the environment seem much larger and gloomier. This was further enhanced by the VR and 3D audio capabilities of the Unity game engine and Meta Quest 2. I also had to handle troubleshooting any issues I had within Unity on my own. This project was part of the reason why I was given the opportunity to join Arcvale.