Unstructured Information Management from Multimedia Data Sources

Semantic Indexing of Multimedia Content Using Visual, Audio, and Text Cues

We present a learning-based approach to the semantic indexing of multimedia content using cues derived from audio, visual, and text features. We approach the problem by developing a set of statistical models f...

Authors: W. H. Adams, Giridharan Iyengar, Ching-Yung Lin, Milind Ramesh Naphade, Chalapathy Neti, Harriet J. Nock and John R. Smith

A Probabilistic Multimedia Retrieval Model and Its Evaluation

We present a probabilistic model for the retrieval of multimodal documents. The model is based on Bayesian decision theory and combines models for text-based search with models for visual search. The textual m...

Authors: Thijs Westerveld, Arjen P. de Vries, Alex van Ballegooij, Franciska de Jong and Djoerd Hiemstra

Robust Techniques for Organizing and Retrieving Spoken Documents

Information retrieval tasks such as document retrieval and topic detection and tracking (TDT) show little degradation when applied to speech recognizer output. We claim that the robustness of the process is be...

Authors: James Allan

A Statistical Approach to Automatic Speech Summarization

This paper proposes a statistical approach to automatic speech summarization. In our method, a set of words maximizing a summarization score indicating the appropriateness of summarization is extracted from au...

Authors: Chiori Hori, Sadaoki Furui, Rob Malkin, Hua Yu and Alex Waibel

Probabilistic Aspects in Spoken Document Retrieval

Accessing information in multimedia databases encompasses a wide range of applications in which spoken document retrieval (SDR) plays an important role. In SDR, a set of automatically transcribed speech docume...

Authors: Wolfgang Macherey, Hans Jörg Viechtbauer and Hermann Ney

Editorial

Authors: Jing Huang, Mukund Padmanabhan and Savitha Srinivasan

Discriminative Feature Selection via Multiclass Variable Memory Markov Model

We propose a novel feature selection method based on a variable memory Markov (VMM) model. The VMM was originally proposed as a generative model trying to preserve the original source statistics from training ...

Authors: Noam Slonim, Gill Bejerano, Shai Fine and Naftali Tishby

Structuring Broadcast Audio for Information Access

One rapidly expanding application area for state-of-the-art speech recognition technology is the automatic processing of broadcast audiovisual data for information access. Since much of the linguistic informat...

Authors: Jean-Luc Gauvain and Lori Lamel

Automatic Hierarchical Color Image Classification

Organizing images into semantic categories can be extremely useful for content-based image retrieval and image annotation. Grouping images into semantic classes is a difficult problem, however. Image classific...

Authors: Jing Huang, S. Ravi Kumar and Ramin Zabih

Search the Audio, Browse the Video—A Generic Paradigm for Video Collections

The amount of digital video being shot, captured, and stored is growing at a rate faster than ever before. The large amount of stored video is not penetrable without efficient video indexing, retrieval, and br...

Authors: Arnon Amir, Savitha Srinivasan and Alon Efrat

Motion Pattern-Based Video Classification and Retrieval

Today′s content-based video retrieval technologies are still far from human′s requirements. A fundamental reason is the lack of content representation that is able to bridge the gap between visual features and...

Authors: Yu-Fei Ma and Hong-Jiang Zhang

Summarizing Audiovisual Contents of a Video Program

In this paper, we focus on video programs that are intended to disseminate information and knowledge such as news, documentaries, seminars, etc, and present an audiovisual summarization system that summarizes ...

Authors: Yihong Gong