Automatic Conversation-Based Mood Caster (ACMC)

A solution by Sensifai submitted to Pack Services – Espace Senior

In this project, we develop a conversation-based mood caster in the form of a mobile application, which collects the mood of elderly people from their normal vocal conversation with a simple and user-friendly application in their mobile set and cast it to the considered social action centre and optionally their relatives. Our product reassures both elderly people and social service centres that reactive services are provided in a timely manner if necessary. We have a plan to further extend and improve the product after the pilot phase and scale to the global markets due to high demand of the market and exceptional potential of the product to address the monitoring and assistive needs of the seniors.

(Pitched: 15/04/2018)

One Page Summary

In this project, we develop a conversational system for elderly people in the form of a mobile application. The mobile app would be normally in sleep mode and automatically get awake and starts working when the user says “Hello My Assistant”. Then the system start a pleasant vocal conversation with the user and automatically ask him/her different questions regarding the health condition and the mood of the user. For examples the system asks “Good morning, how are you today?” or “how do you feel in this nice evening?”. The conversation starts from general questions and it could be as long as the user expects till covering specific questions. The system then,
(1) Transcribes the answers through an internal speech to text system,
(2) Identifies important keywords in the transcripts which best describe the health condition of the user to increase the speed of reviewing the transcripts,
(3) Encrypts the transcripts,
(4) Sends the transcripts and moods to the considered social centre and/or relatives.
This project will be carried out by Sensifai, which is specialized in advanced audio and visual data processing tools including a state-of-the-art speech-to-text software. Therefore, the implementation of the system is pretty straightforward.
This product is innovative in several aspects:
(1) It casts the mood of thousands of seniors without any need to any technical knowledge.
(2) It uses a pleasant vocal conversation to collect the mood of elderly people and hence is very user friendly.
(3) Social action centre can collect the mood of all elderly people of the city without calling or meeting them one or several times a day.
(4) Social action centre can create a data bank of health condition of all seniors. This data bank facilitates analyzing the cause of some disorders and predict the risk of problems for isolated elderly people.
(5) This system would be very scalable and can be extended to help millions of elderly people around the world with different languages and from different demographic backgrounds.
(6) This system would be also technically extended to automatically recognize the mood and health condition from visual data (such as facial images) as well as audio data.
This project considerably impacts the life standard, engagement and monitoring of seniors in several aspects:
(1) As a result of this project, the health condition and mood of elderly people will be casted to the social service centre and the relatives of seniors. This reassures elderly people that they will receive required help and treatment whenever they require it.
(2) Since this project collects the mood data of seniors everyday, the social centre can analyze the trend of the user health and predict potential future disorders. This helps a right intervention in a right time before disorder actually occurs.
(3) This project yields the health condition of the elderly population. This data can be used to analyze the number of people with specific problem and the cause of the problems.
We strongly believe that this project not only improves the life standards of seniors but also can lead to a successful and sustainable business by engaging relevant stakeholders such as insurance companies, social service providers, municipalities, post office, and assistive technology companies. After turning this pilot phase into a success, we intend to continue development and marketing of this innovative product and register a new company as an spin-off of Sensifai.