A new depth of immersion in games.
entertAIn play is a Unity plugin,
enabling you to use emotions as input.

more

EMOTION RECOGNITION FOR UNITY

TAP INTO PLAYERS’ FEELINGS

Bring immersion to the next levelentertAIn play detects your players‘ emotions through audio. Realtime analysis gives you the possibility to implement novel gameplay scenarios.

entertAIn play provides you with six default emotions. Our drag-and-drop-integration is done in no-time. entertAIn play performs on any platform, from a VR headset to a casual mobile phone. Join us and make sure that the future of gaming is not only bound by buttons.

6 DEFAULT EMOTIONS

INFINITE POSSIBILITIES

Based on established psychological models, entertAIn play provides you with six default emotion categories: Anger, excitement, happiness, relaxation, boredom and sadness. In addition, the core AI features allow you to create customized emotion categories.

NEW DEPTH OF IMMERSION

FULL VR INTEGRATION

Emotion input brings unchallenged depth of immersion into your games, espacially in a VR scenario. Using embedded microphones is a non-invasive way to capture your players’ feelings. entertAIn play performs excellent on mobile VR as well as stand-alone HMDs.


FIDO’S MEMORIES


EMOTIONAL PET GAME

Fido is the first virtual pet, controlled by your emotions. Train Fido in our free demo level.

ELISES DESTINY

FANTASY TPS GAME

Download the winner of GaCha 2019 for free.  Join the goddess Elise on her task to defend then nexus against evil powers.

GAME CHALLANGE

EMOTIONAL GAMES

Download the winner of GaCha 2019 for free.  Join the goddess Elise on her task to defend then nexus against evil powers.

EMOTION FROM AUDIO

THE DIRECT WAY TO THE PLAYERS’ FEELINGS

The human voice is the most natural way to communicate. It carries a lot of information. Beyond language, the expression of feelings is a universal manner of interaction. Let your games use emotions to their advantage.

1.LISTEN

Voice Activity Detection (VAD) automatically caputres your players voice via any microphone.

2.DETECT

entertAIn play AI model analyzes over 6,000 voice features. It identifies the players’ emotions and their intensity in realtime.

3.INTERACT

Based on the output values, you can now trigger events in the game fitted to the players mood.

LIGHTWEIGHT PLUG IN

DRAG AND DROP INTEGRATION

entertAIn play is lightweight and easy to integrate into any game design. 
Find more information in our technical documentation. 


VAD: Voice activity detection

  SPEAKER ID possible

  5 MB IN TOTAL: ultra lightweigt PlugIn

Customizable Emotion sensity

  Multiplatform: Windows, MacOS, iOS and Android

INFORMATION TO-GO

DOWNLOAD HERE

entertAIn play

FACT SHEET

entertAIn play brings imersion to the next level by detecting your players’ emotion. 
Find more information the factsheet.

TECHNICAL

DOCUMENTATION

entertAIn play is a lightweight unity plugin, easy to integrate into any project.  Download  our technical documentation for more information.

CUSTOMER SUCESS

the simulation crew

Emotion AI enhances a VR game into a highly realistic simulation.  “The simulation crew”  uses entertAIn play for the characters in an VR-Training program.

contact-information

PERSONAL CONTACT

GET IN TOUCH WITH audEERING

Are you interested in how entertAIn play can accelerate your product and business? Our team at audEERING is ready to help!

YOUR PERSONAL CONTACT

Bernd Zeilmaier
Director Business Development

bzeilmaier@audeering.com
+49 8105 775 615 0

contact-information

ERIC JUTTEN

CEO, The Simulation Crew

"Emotions are an integral part of our interactions."

"A future where interactions with computers and virtual characters are emotionless was not an option for us. So, we were glad to find audEERING and use their entertAIn solution for emotion AI in our Virtual Reality product."

"A future where our interactions with computers and virtual characters are emotionless was not an option for us. So, we were glad to find audEERING and use their entertAIn solution for emotion AI in our Virtual Reality product. It helped us add a new layer of emotional interaction to our scenarios in VR."

"A future where our interactions with computers and virtual characters are emotionless was not an option for us. So, we were glad to find audEERING and use their entertAIn solution for emotion AI in our Virtual Reality product. It helped us add a new layer of emotional interaction to our scenarios in VR."

VR Health Project from 2020
The Simulation Crew, NL

AMIRREZA MOEINI-YEGANE

Leading Developer, Elise's Destiny

"I wasn't even aware that emotion AI was so accessible. I could drag and drop the plugin and use it in Unity. My game could implement a new idea of using the player's emotion as the ultimate weapon and I'm glad that I had the chance to bring it to life."

"I got the chance to work with entertAIn play in audEERING Game Challenge (GaCha2019).

I wasn't even aware that emotion AI was so accessible that I could drag and drop the plugin and use it in Unity. My TPS game, Elise's Destiny, could implement a new idea of using the player's emotion as the ultimate weapon and I'm glad that I had the chance to bring it to life."

"I got the chance to work with entertAIn play in audEERING Game Challenge (GaCha2019).

I wasn't even aware that emotion AI was so accessible that I could drag and drop the plugin and use it in Unity. My TPS game, Elise's Destiny, could implement a new idea of using the player's emotion as the ultimate weapon and I'm glad that I had the chance to bring it to life."

"Elise's Destiny"
2019, IRN

previous arrow
next arrow
Slider

MORE PRODUCTS ?

THE entertAIn FAMILY

entertAIn observe

AI for play-testing

How does your player feel about your game? entertAIn observe gives you insight into your players’ emotions.

entertAIn family

AI for parental control

Healthy gaming for children of any age. entertAIn family keeps you informed 
on your children’s emotions while playing.

QUESTIONS ON entertAIn play?

FIND ANSWERS IN OUR FAQ

How many emotions can entertAIn play distinguish ?

The emotions are categorized based on latest psychological models. In this models, we have an emotional space based on “pleasantness, urgency, dominance”. From these core dimensions, all other states can be identified. entertAIn play model distinguishes between six different core emotions which are most common for the game industry. Other models in the SDK can distinguish up to 48 emotions.

  • Dimensions with confidence level:
    • Pleasantness
    • Urgency
    • Dominance (Control)
  • Emotions
    • Sadness
    • Boredom
    • Anger
    • Excitement
    • Relaxation
    • Happiness

Mixture of these numbers can result in identifying any emotional state.
For example, high urgency, low pleasantness and low control means fear.

Which microphone quality is needed for entertAIn play?

audEERING’s technology has been tested on a variety of embedded microphones and headsets. As a rule-of-thumb, the better the quality and lower the noise, the higher the accuracy. The ADC sampling rate should be at least 16 kHz, with min. depth 8-bit (u-law).  The processing of audio captured via remote wireless microphones is also possible.

How long must an audio sample be for emotion detection?

From a technical perspective, the model is returning the result in real-time (every frame). The longer the audio received by the emotion model, the higher is the accuracy of the result. Very long utterances, however, balance themselves out, as the emotional reaction of a human does not last infinitely.
In practice, the return interval should be at least half a second for reliable emotion detection, and no longer than 12 seconds. This can be totally adjusted to the scenario in the game. Another practice is to get the values in short 1 second intervals and sum them up to see if they reach a threshold.

How can I test entertAIn play?

There are developer licences available. Do not hesitate to contact our Director Business Development Bernd Zeilmaier. He is glad to help you with business solutions,  licencing options and details.

Can you combine emotions?

You can freely create new values by combining available emotions into new emotional states. For example, Happiness and Urgency can be combined into Motivation.
This creates almost infinite possibilities for any gaming scenario.

From a technical perspective, you get a JSON object with emotion results in every frame. Each emotion has a value and you can set a threshold for it based on your scenario.