• Documents
  • Authors
  • Tables
  • Log in
  • Sign up
  • MetaCart
  • DMCA
  • Donate

CiteSeerX logo

Advanced Search Include Citations
Advanced Search Include Citations | Disambiguate

Integrating visual and semantic contexts for topic network generation and word sense disambiguation. (2009)

by J Fan, H Luo, Y Shen, C Yang
Venue:ACM CIVR’09,
Add To MetaCart

Tools

Sorted by:
Results 1 - 4 of 4

Hudelot: "Ontology Matching for the Semantic Annotation of Images

by Nicolas James , Konstantin Todorov , Céline Hudelot - IEEE International Conference on Fuzzy Systems, WCCI Conference , 2010
"... Abstract-The linguistic description, i.e. semantic annotation of images can benefit from representations of useful concepts and the links between them as ontologies. Recently, several multimedia ontologies have been proposed in the literature as suitable knowledge models to bridge the well known se ..."
Abstract - Cited by 3 (0 self) - Add to MetaCart
Abstract-The linguistic description, i.e. semantic annotation of images can benefit from representations of useful concepts and the links between them as ontologies. Recently, several multimedia ontologies have been proposed in the literature as suitable knowledge models to bridge the well known semantic gap between low level features of image content and its high level conceptual meaning. Nevertheless, these multimedia ontologies are often dedicated to (or initially built for) particular needs or a particular application. Ontology matching, defined as the process of relating different heterogeneous models, could be a suitable approach to solve several interoperability issues that coexist in semantic image annotation and retrieval. In this paper, we propose an original and generic instance-based ontology matching approach and a methodology to extract a minimal ontology defined as the common reference between different heterogeneous ontologies. Then, this approach is applied to two dif ferent semantic image retrieval issues: the bridging of the semantic gap by the matching of a multimedia ontology with a common-sense knowledge ontology and the matching of different multimedia ontologies to extract a common reference knowledge model dedicated to several multimedia applications.
(Show Context)

Citation Context

...C IMAGE ANNOTATION Over the last five years, many multimedia concept ontologies3 (or more precisely lexica) have been proposed to assist multimedia search and retrieval by providing an effective representation and interpretation of multimedia concepts [28], [27]. These ontologies are also critical resources for the navigation and the exploration of large multimedia collections [8]. They can be classified into three major groups: (1) visual concept hierarchy (or network) inferred from interconcept visual similarity contexts (e.g. VCNet based on Flickr Distance [36] and the Topic Network of Fan [9]), (2) specific multimedia lexicons often composed of a hierarchy of semantic concepts with associated visual concept detecto rs used to describe and to detect automatically the semantic concepts of multimedia documents (e.g. LSCOM [27], multimedia thesaurus [28]) and (3) generic ontologies based on existing semantic concept hierarchies, such as WordNet, populated with annotated images or multimedia documents (e.g. ImageNet [5] and LabelMe [25]). In the following, we propose to use the ontology matching framework presented in Section II to: • fill the semantic gap by the alignment of multimedi...

Social Computing for Collaborative Image Understanding

by Jianping Fan, William Ribarsky, Ramesh Jain
"... With the advance of the Internet and the increasing accessibility of computing resources, humans and computer systems are now brought together in powerful new ways. In this paper, we propose a human-centered computing framework to harness the essential characteristics of both humans and computers fo ..."
Abstract - Cited by 1 (1 self) - Add to MetaCart
With the advance of the Internet and the increasing accessibility of computing resources, humans and computer systems are now brought together in powerful new ways. In this paper, we propose a human-centered computing framework to harness the essential characteristics of both humans and computers for achieving collaborative image understanding (i.e., training large numbers of inter-related classifiers collaboratively for automatic object and concept detection from images), where groups of volunteers may collaborate on: (a) giving their timely guidances for supporting collaborative classifier training; (b) using their personal computing resources such as PCs for training large numbers of inter-related classifiers collaboratively; and (c) assessing the correctness of learning results (classifiers and their decision boundaries) and the effectiveness of hypotheses for classifier training.

Building Semantic Hierarchies Faithful to Image Semantics

by Hichem Bannour, Céline Hudelot
"... Abstract. This paper proposes a new image-semantic measure, named "Semantico-Visual Relatedness of Concepts " (SVRC), to estimate the semantic similarity between concepts. The proposed measure incorpo-rates visual, conceptual and contextual information to provide a measure which is more me ..."
Abstract - Add to MetaCart
Abstract. This paper proposes a new image-semantic measure, named "Semantico-Visual Relatedness of Concepts " (SVRC), to estimate the semantic similarity between concepts. The proposed measure incorpo-rates visual, conceptual and contextual information to provide a measure which is more meaningful and more representative of image semantics. We also propose a new methodology to automatically build a semantic hierarchy suitable for the purpose of image annotation and/or classifica-tion. The building is based on the previously proposed measure SVRC and on a new heuristic, named TRUST-ME, to connect concepts with higher relatedness till the building of the final hierarchy. The built hie-rarchy explicitly encodes a general to specific concepts relationship and therefore provides a semantic structure to concepts which facilitates the semantic interpretation of images. Our experiments showed that the use of the constructed semantic hierarchies as a hierarchical classification framework provides a better image annotation. 1
(Show Context)

Citation Context

...sed a method based on visual features and tags to automatically build the "semantivisual" image hierarchy. A Semantic hierarchy based on contextual and visual similarity is proposed in [9]. Fan & al. =-=[10]-=- proposed an algorithm to integrate the visual similarity contexts between the images and the semantic similarity contexts between their tags for topic network generation. Flickr distance is proposed ...

Enabling Interoperability between Multimedia Resources: An Ontology Matching Perspective

by Nicolas James, Konstantin Todorov
"... Abstract. The semantic annotation of images can benefit from repre-sentations of useful concepts and the links between them as ontologies. Recently, several multimedia ontologies have been proposed in the lit-erature as suitable knowledge models to bridge the well known seman-tic gap between low lev ..."
Abstract - Add to MetaCart
Abstract. The semantic annotation of images can benefit from repre-sentations of useful concepts and the links between them as ontologies. Recently, several multimedia ontologies have been proposed in the lit-erature as suitable knowledge models to bridge the well known seman-tic gap between low level features of image content and its high level conceptual meaning. Nevertheless, these multimedia ontologies are of-ten dedicated to (or initially built for) particular needs or a particular application. Ontology matching, defined as the process of relating differ-ent heterogeneous models, we will argue, is a suitable approach to solve interoperability issues in semantic image annotation and retrieval. We propose a generic instance-based ontology matching approach, applied to an important semantic image retrieval issue: the bridging of the se-mantic gap by matching a multimedia ontology against a common-sense knowledge resource. 1
(Show Context)

Citation Context

...EG-7, reviewed in [1] (2) visual concept hierarchies (or networks) inferred from inter-concept visual similarity contexts (among which VCNet based on Flickr Distance [15] and the Topic Network of Fan =-=[3]-=-), (3) specific multimedia lexicons often composed of a hierarchy of semantic concepts with associated visual concept detectors used to describe and to detect automatically the semantic concepts of mu...

Powered by: Apache Solr
  • About CiteSeerX
  • Submit and Index Documents
  • Privacy Policy
  • Help
  • Data
  • Source
  • Contact Us

Developed at and hosted by The College of Information Sciences and Technology

© 2007-2019 The Pennsylvania State University