Dolphin Experience VR
Date 22 November 2024
22.11.2024An insight into the production of a Virtual Reality application that creates a calming underwater experience featuring a coral reef and sea creatures developed by University staff and students.
Dr. Mu Mu, Andy Debus, and I (David Nicholls) have been working on a prototype for VR Therapies based in Northampton to help relieve anxieties in patients. “The NHS is currently under immense pressure, and it can be hard for patients to get treatment. We saw this as an opportunity to deliver digital health innovation to improve the delivery and access to life-changing treatment. Partnering with health institutions and local business such as VR Therapies, we’re hoping this will help improve availability of treatment options” said Dr. Mu Mu regarding the project. Andy Debus; a Senior Lecturer in Games at University of Northampton composed the environment using corals and reefs assets developed by Finley Powell – a games art student here at the university.
“Having been a game developer in the industry for almost 30 years, it’s great to use my skills in a new direction on a project that will have a positive influence on people’s mental well-being” Andy said.
Swimming with Dolphins VR – Copyright 2024
Continuing from an initial project by the game’s team here at Northampton several years ago, we are recreating this using brand-new technologies that have advanced significantly in recent years. The original project was also created in collaboration with VR Therapies. With this interaction we are planning on adding more interactive elements for a more fulfilling experience.
We had a great opportunity to not just help others with anxieties with the implementation, but we also used it as an opening to hire the Games Art students to help create some assets. This gives them a real live project brief to work on and gives them experience in the industry to help them get their first commercial roles once they graduate.
Finley had this to say: “Being able to use the skills that I have learnt in a professional setting is invaluable for learning practices readying myself for industry. It great to work alongside professional developers in a real game studio environment.”
Finley worked on creating the models of the coral and the sea-creatures such as the dolphins, turtles, and crabs.
Sea creatures from Swimming with Dolphins VR – Copyright 2024
My involvement has been developing the interactions and the AI technologies along with Dr. Raghad Zenki. Using the Unity game engine, we have added 3D audio and AI pathing for the sea creatures to help immersion. Currently, Dolphins and other larger sea creatures work on a track system with random variation.
Development screenshot of pathing in Swimming with Dolphins VR – Copyright 2024
Whilst the smaller fish use AI to simulate schools of fish swimming in a group. We are now working on using Oculus hand tracking to add gestures to interact with the sea creatures. The calming environment combined with the sedate movement of the sea-creature with soothing audio will help relive stresses and relax users. Whilst we continue development on this app, we are searching for new partners in the community to work with on new projects for use in the field of mental health.
Programme Leader for Games Design, Senior Lecturer in Games Programming and Games Design.