Breath, Pauses, and Tone of Voice: How Meta's AI Works to Track Our Emotions

Meta has obtained a patent describing an artificial intelligence system designed to continuously monitor users' emotional states through voice analysis. The document, published on July 2, illustrates a technology capable of recording vocal communications, transcribing them, and analyzing them through machine learning algorithms to identify a person's emotions.

According to the patent, the system does not only process the spoken words but also takes into account elements such as sighs, laughter, speech rhythm, pauses, and breathing. All this information is combined with various contextual data, including the time of day, the user's location, the activity being performed, and even the times medications are taken.

The goal described is to create a continuous record of emotional state, capable of identifying any correlations between mood and daily habits. The patent speculates, for example, the possibility of detecting an improvement in mood during specific timeframes or coinciding with the intake of certain medications.

Meta and the New Technology Dedicated to Fitness (and Beyond)

Meta presents this technology as a tool intended for the fitness sector. According to the document, an AI-based system could provide personalized suggestions during workouts, correct posture, and adapt guidance more accurately than a traditional personal trainer. However, the architecture described seems to extend well beyond the sports domain. The patent indeed talks about continuous emotional monitoring through devices used in daily life, leveraging data from multiple synchronized sensors.

In 2020, Amazon introduced the Halo Band, equipped with a microphone for voice tone analysis. After facing criticism over privacy issues, Amazon removed the microphone from the next generation in 2021 and permanently discontinued the product line in 2023.

For Meta, the privacy issue is particularly sensitive in light of already existing discussions surrounding the company's smart glasses, which have been the subject of controversies related to content recording and two lawsuits in the United States regarding the management of footage taken with these devices. A Meta spokesperson told 404 Media that the patents filed by the company often describe ideas that may not even be transformed into commercial products. We will see if and when this technology will be commercialized.