Abstract

Search in and presentation of multimedia collections is an important and complex task. Often it involves various search strategies and the visualization of found object collections. Technically, search strategies can be formulated using distance measures between object pairs. In this paper we propose the use of a projection based method to dynamically arrange a set of objects (here images) given a notion of image similarity (an interactive user choice). This approach uses the previously introduced Hyperbolic Multidimensional Scaling method (HMDS) in order to find spatial layouts of the objects in the hyperbolic plane IH 2 based on pairwise dissimilarity data. The circular Poincaré model of the IH 2 allows effective human-computer interaction: by moving the “focus ” via mouse the user can navigate in the images without loosing the “context ” around the center, which appears with gradually lower resolution. The exponential growth of area around each point in the IH 2 makes this non-Euclidean projection space extraordinary for the layout- also for images. We use the HMDS technique to interactively mix various concepts of “image similarity ” (based on visual and annotation information). Depending on the preferences and the actual task the user can modulate the distance metric while observing the resulting rearrangement of the images in IH 2. The concept can be generalized to any kind of multimedia content, given suitable similarity functions on the content, e.g. distances in ontologies, sound features, or multimedia descriptions etc. 1.

Citations