en flag +1 214 306 68 37
3D Modelling Software for Mental Disorder Treatment

3D Modelling Software for Mental Disorder Treatment

Industry
Healthcare
Technologies
C/C++

About the Customer

A North American healthcare research organization working in the field of population and mental health.

Challenge

As a part of their recent mental disorder research, the Customer needed a desktop application to assist patients and their therapists during therapy sessions. The solution was to transform a therapist’s voice and, in some cases, visualize it as a 3D-modelled image to simulate a patient’s communication with their inner voices and / or personalities. Such tech-run dialogues between the patient and the model were to help the patient to gain certain control over their imaginary personality.

Solution

Pre-session setup process

Before the first session, a patient and their therapist together shape the patient’s inner personality. The patient describes it, and the therapist reflects this information by checking the following boxes in the application:

  • Character (human / non-human)

If the character is human, the following attributes are available:

  • Gender (male / female)
  • Age
  • Height
  • Ethnicity

Then, the therapist can transform their voice to resemble patient’s inner personality. If the imaginary character is human, and the patient has a clear idea of inner personality's appearance, the therapist then creates a 3D model to visualize it. When the patient finds the visualization accurate, the session can start.

Session process

The patient and their therapist sit down in separate rooms in front of their computers. During the session, patient will hear their inner voice, but the therapist is who actually talks now. If patient’s imaginary character is human, they will also be able to see the image of this personality moving its lips according to what the therapist says (thanks to integrated lip sync functionality).

The therapist can see the patient via the webcam window within the application and can react to patient’s face expressions, micro expressions and gestures combined, accordingly changing the session’s direction.

Each session will be recorded and archived in order to then evaluate patient’s treatment progress.

Results

ScienceSoft’s healthcare software development team tackled the advanced challenge of creating an innovative research and treatment desktop app to help patients with various mental disorders. The application allows to transform therapist’s voice, create a 3D model of patient’s imaginary personality and allows lip-syncing function, so that patient could speak directly to their inner voice, not a therapist. Video chat functionality allows the therapist to see patient’s reactions and change session progress accordingly.

Technologies and Tools

C++, Qt / QML, OpenGL, FaceGen SDK, VoIP, SQLite, Git, QBS

Have a question to our team or need help with your project?

Our team is ready to provide client references, estimate your project, or answer any other question related to your IT initiative.

Upload file

Drag and drop or to upload your file(s)

?

Max file size 10MB, up to 5 files and 20MB total

Supported formats:

doc, docx, xls, xlsx, ppt, pptx, pps, ppsx, odp, jpeg, jpg, png, psd, webp, svg, mp3, mp4, webm, odt, ods, pdf, rtf, txt, csv, log

More Case Studies