3D Modelling Software for Mental Disorder Treatment
About the Customer
A North American healthcare research organization working in the field of mental health.
Challenge
As a part of their recent mental disorder research, the Customer needed a desktop application to assist patients and their therapists during therapy sessions. The solution was to transform a therapist’s voice and, in some cases, visualize it as a 3D-modelled image to simulate a patient’s communication with their inner voices and / or personalities. Such tech-run dialogues between the patient and the model were to help the patient gain certain control over their imaginary personality.
Solution
Pre-session setup process
Before the first session, a patient and their therapist together shape the patient’s inner personality. The patient describes it, and the therapist reflects this information by checking the following boxes in the application:
- Character (human or non-human)
If the character is human, the following attributes are available:
- Gender (male or female)
- Age
- Height
- Ethnicity
Then, the therapist can transform their voice to resemble the patient’s inner personality. If the imaginary character is human, and the patient has a clear idea of the inner personality's appearance, the therapist then creates a 3D model to visualize it. When the patient finds the visualization accurate, the session can start.
Session process
The patient and their therapist sit down in separate rooms in front of their computers. During the session, the patient hears their inner voice, but the therapist actually talks now. If the patient’s imaginary character is human, they are also able to see the image of this personality moving its lips according to what the therapist says (thanks to integrated lip sync functionality).
The therapist can see the patient via the webcam window within the application and can react to the patient’s facial expressions, micro-expressions, and gestures combined, accordingly changing the session’s direction.
Each session is recorded and archived to evaluate the patient’s treatment progress.
Results
ScienceSoft’s healthcare software development team tackled the advanced challenge of creating an innovative research and treatment desktop app to help patients with various mental disorders. The application helps transform therapist’s voice, creates a 3D model of patient’s imaginary personality, and provides a lip-syncing function so that the patient can speak directly to their inner voice, not a therapist. Video chat functionality allows the therapist to see the patient’s reactions and change session progress accordingly.
