Maybury M.T. (ed.) Multimedia Information Extraction. Advances in Video, Audio, and Imagery Analysis for Search, Data Mining, Surveillance, and Authoring

Springer, 2012. — 476 p.The advent of increasingly large consumer collections of audio (e.g., iTunes), imagery (e.g., Flickr), and video (e.g., YouTube) is driving a need not only for multimedia retrieval but also information extraction from and across media. Furthermore, industrial and government collections fuel requirements for stock media access, media preservation, broadcast news retrieval, identity management, and video surveillance. While significant advances have been made in language processing for information extraction from unstructured multilingual text and extraction of objects from imagery and video, these advances have been explored in largely independent research communities who have addressed extracting information from single media (e.g., text, imagery, audio). And yet users need to search for concepts across individual media, author multimedia artifacts, and perform multimedia analysis in many domains.
This collection is intended to serve several purposes, including reporting the current state of the art, stimulating novel research, and encouraging cross-fertilization of distinct research disciplines. The collection and integration of a common base of intellectual material will provide an invaluable service from which to teach a future generation of cross disciplinary media scientists and engineers.Multimedia Information Extraction: History and State of the Art
Section 1 Image Extraction
Visual Feature Localization for Detecting Unique Objects in Images
Entropy-Based Analysis of Visual and Geolocation Concepts in Images
The Meaning of 3D Shape and Some Techniques to Extract It
A Data-Driven Meaningful Representation of Emotional Facial Expressions
Section 2 Video Extraction
Visual Semantics for Reducing False Positives in Video Search
Automated Analysis of Ideological Bias in Video
Multimedia Information Extraction in a Live Multilingual News Monitoring System
Semantic Multimedia Extraction Using Audio and Video
Analysis of Multimodal Natural Language Content In Broadcast Video
Web-Based Multimedia Information Extraction Based on Social Redundancy
Information Fusion and Anomaly Detection with Uncalibrated Cameras in Video Surveillance
Section 3 Audio, Graphics, and Behavior Extraction
Automatic Detection, Indexing, and Retrieval of Multiple Attributes from Cross-Lingual Multimedia Data
Information Graphics in Multimodal Documents
Extracting Information from Human Behavior
Section 4 Affect Extraction from Audio and Imagery
Retrieval of Paralinguistic Information in Broadcasts
Audience Reactions for Information Extraction about Persuasive Language in Political Communication
The Need for Affective Metadata in Content-Based Recommender Systems for Images
Affect-Based Indexing for Multimedia Data
Section 5 Multimedia Annotation and Authoring
Multimedia Annotation, Querying, and Analysis in Anvil
Toward Formalization of Display Grammar for Interactive Media Production with Multimedia Information Extraction
Media Authoring with Ontological Reasoning: Use Case for Multimedia Information Extraction
Annotating Significant Relations on Multimedia Web Documents