we will teach computers emotion by having them watch movies
Moviegoer AI is dedicated to advancing artificial intelligence by unlocking the enormous wealth of knowledge hidden inside cinema
Why Movies?
Cinema contains an enormous amount of emotional data, waiting to be unlocked. They’re a document of how we have conversations, how we live, and how we interact with one another.
After all, think back to your childhood. On some level, didn’t movies impact your own development, teaching you how the world works?
Movies as a Dataset
By turning movies into structured data, we can begin to train better emotional AI. Movies have it all: facial expressions, voice tone, word choice, etc. And on a societal level, they contain a perfect record of our rituals.
Once overlooked by researchers, movies are the ultimate dataset for humanistic emotions and anthropological behaviors.
Prototype
We’ve built a working prototype that allows a machine to “watch” a movie: identifying individual scenes, parsing conversation dialogue, and recognizing characters.
The Python-based prototype was built atop several general machine learning libraries, as well as specialized libraries for computer vision, NLP, and other tasks.