Unity development spanning rhythm gameplay, physics-based VR interaction, character IK, custom editor tools, shaders, and audio systems.
Open galleryHarmony VR is an RTE Lab project intended to support therapist-guided educational and developmental activities for children on the autism spectrum. Its public presentation centers on music, rhythm, emotional recognition, and calm virtual environments.
As the primary Unity developer on a project-specific contract, I built application systems and interactive activities from November 2024 to September 2025. My work extended from rhythm playback and scoring to physical interaction, character animation, graphics, and development tools.
I also handled application startup and transitions, asynchronous task lifecycles, localized dialogue, VR onboarding, and standalone Quest optimization. Alongside the application, I created an AI-assisted tool for voiceover production.
Tools and disciplines behind the project.
Developed application startup, scene loading, pause and reset behavior, and transitions between activities. Worked on asynchronous initialization, cancellation, and cleanup so interrupted activities could exit and restart correctly.
Built rhythm playback, count-ins, instrument sequencing, and scoring for music-based activities. Implemented evaluation of player timing and instrument responses, configurable difficulty, and results feedback.
Created a Unity editor for composing rhythm patterns and instrument tracks. Added editing controls and undo support, alongside editor shortcuts for launching and working on scenarios.
Developed physics-driven position and rotation following for interaction tools, integrated interaction behavior with XR controls, and refined instrument hit detection and controller feedback.
Developed timed character drum-playing motion, hand and look targeting, and animation blending. Connected character movement and talking animation to activity and audio events.
Built music playback and dialogue integration, handled audio lifecycle and bank loading, and connected gameplay with music timing and track events. Integrated sound feedback throughout interactive activities and UI.
Developed custom sprite-outline and screen-fade effects, and worked on transitions and rendering performance for Quest. Refined scene, lighting, material, and visual-effect settings for standalone VR.
Implemented localized text and dialogue support, language-change handling, VR menus, control explanations, and replayable tutorials. Maintained translation and voiceover updates across the application.
Developed activity flow, answer selection, target interactions, animated feedback, and result displays. Refined reset and navigation behavior across interactive exercises and the relaxation space.
Created a supporting tool with AI assistance to generate ElevenLabs voiceovers from spreadsheet content through its API, including batch processing of language-specific content.