Premium Partner

Session Information

Deep Learning for Visual Classification of Adjective Noun Pairs and its Application


Dr. Damian Borth (German Research Center for Artificial Intelligence)
Back to last page:
Nowadays the Web, as a major platform for communication and information exchange, is shifting towards visual content. Unfortunately, visual content in form of images or videos is limited in its accessibility as compared to textual content. With recent advances in deep learning we are able to analyze the content of images and videos as not seen before. This talk will present the first framework able to extract sentiment from visual content by introducing the Visual Sentiment Ontology (VSO). This ontology consists of thousands of Adjective Noun Pair (ANP) concepts able to capture such polarities. Further, the talk introduces SentiBank, the associated deep convolutional neural network (CNN) used to detect the presence of up to 2089 ANPs in images. Originally designed to assess sentiment in visual content, SentiBank was already shown to have a broad spectrum of application domains ranging from aesthetic assessment, image popularity prediction, filtering explicit content, analysis of live-streamed video games. Finally, the talk will close with the Yahoo Flickr Creative Common 100 million (YFCC100m) dataset which is the largest available dataset in the academic community and challenges associated with large-scale training of CNNs.
Audience adressed: 


Session Type: 
Code / Platforms / Tools
Experience level adressed: 
Time slot: 
2016-04-19 15:00
Channel 5

Event Sponsors

Sponsor Partners

No sponsors in this category have been announced yet.

Media and Partners

Edit User