3D Modelling Software for Mental Disorder Treatment
About the Customer
A North American healthcare research organization working in the field of population and mental health.
As a part of their recent mental disorder research, the Customer needed a desktop application to assist patients and their therapists during therapy sessions. The solution was to transform a therapist’s voice and, in some cases, visualize it as a 3D-modelled image to simulate a patient’s communication with their inner voices and / or personalities. Such tech-run dialogues between the patient and the model were to help the patient to gain certain control over their imaginary personality.
Pre-session setup process
Before the first session, a patient and their therapist together shape the patient’s inner personality. The patient describes it, and the therapist reflects this information by checking the following boxes in the application:
- Character (human / non-human)
If the character is human, the following attributes are available:
- Gender (male / female)
Then, the therapist can transform their voice to resemble patient’s inner personality. If the imaginary character is human, and the patient has a clear idea of inner personality's appearance, the therapist then creates a 3D model to visualize it. When the patient finds the visualization accurate, the session can start.
The patient and their therapist sit down in separate rooms in front of their computers. During the session, patient will hear their inner voice, but the therapist is who actually talks now. If patient’s imaginary character is human, they will also be able to see the image of this personality moving its lips according to what the therapist says (thanks to integrated lip sync functionality).
The therapist can see the patient via the webcam window within the application and can react to patient’s face expressions, micro expressions and gestures combined, accordingly changing the session’s direction.
Each session will be recorded and archived in order to then evaluate patient’s treatment progress.
ScienceSoft’s healthcare software development team tackled the advanced challenge of creating an innovative research and treatment desktop app to help patients with various mental disorders. The application allows to transform therapist’s voice, create a 3D model of patient’s imaginary personality and allows lip-syncing function, so that patient could speak directly to their inner voice, not a therapist. Video chat functionality allows the therapist to see patient’s reactions and change session progress accordingly.