Results 1 - 10 of 29

Natural-language retrieval of images based on descriptive captions

by Eugene J. Guglielmo, Neil C. Rowe - ACM Transactions on Information Systems , 1996
"... We describe a prototype intelligent information retrieval system that uses natural-language understanding to efficiently locate captioned data. Multimedia data generally require captions to explain their features and significance. Such descriptive captions often rely on long nominal compounds (strin ..."
Abstract - Cited by 27 (4 self) - Add to MetaCart
We describe a prototype intelligent information retrieval system that uses natural-language understanding to efficiently locate captioned data. Multimedia data generally require captions to explain their features and significance. Such descriptive captions often rely on long nominal compounds

NLP for indexing and retrieval of captioned photographs

by Katerina Pastra, Horacio Saggion, Yorick Wilks - In EACL03: 10th Conference of the European Chapter of the Association for Computational Linguistics , 2003
"... We present a text-based approach for the automatic indexing and retrieval of digital photographs taken at crime scenes. Our research prototype, SOCIS, goes beyond keyword-based approaches and methods that extract syntactic relations from captions; it relies on advanced Natural Language Processing te ..."
Abstract - Cited by 2 (0 self) - Add to MetaCart
We present a text-based approach for the automatic indexing and retrieval of digital photographs taken at crime scenes. Our research prototype, SOCIS, goes beyond keyword-based approaches and methods that extract syntactic relations from captions; it relies on advanced Natural Language Processing

Semantic Restructuring of Natural Language Image Captions to Enhance Image Retrieval

by Kraisak Kesorn, Stefan Poslad - In Journal of Multimedia
"... Abstract—The rapid growth in the volume of visual information can make the task of finding and accessing visual information of interest, overwhelming for users. Semantic analysis of image captions can be used in conjunction with image retrieval systems (IMR) to retrieve selected images more precisel ..."
Abstract - Cited by 1 (0 self) - Add to MetaCart
precisely. To do this, we first exploit a Natural Language Processing (NLP) framework in order to extract concepts from image captions. Next, an ontology-based framework is deployed in order to resolve natural language ambiguities. The novelty of the proposed framework is that the combination of LSI

Image2Text: A Multimodal Caption Generator

by Chang Liu , Changhu Wang , Fuchun Sun , Yong Rui
"... ABSTRACT In this work, we showcase the Image2Text system, which is a real-time captioning system that can generate human-level natural language description for any input image. We formulate the problem of image captioning as a multimodal translation task. Analogous to machine translation, we presen ..."
Abstract - Add to MetaCart
ABSTRACT In this work, we showcase the Image2Text system, which is a real-time captioning system that can generate human-level natural language description for any input image. We formulate the problem of image captioning as a multimodal translation task. Analogous to machine translation, we

Generating Images from Captions with Attention

by Elman Mansimov , Emilio Parisotto , Jimmy Lei Ba , Ruslan Salakhutdinov
"... Abstract Motivated by the recent progress in generative models, we introduce a model that generates images from natural language descriptions. The proposed model iteratively draws patches on a canvas, while attending to the relevant words in the description. After training on MS COCO, we compare ou ..."
Abstract - Add to MetaCart
Abstract Motivated by the recent progress in generative models, we introduce a model that generates images from natural language descriptions. The proposed model iteratively draws patches on a canvas, while attending to the relevant words in the description. After training on MS COCO, we compare

Overview of Natural Language Processing

by Of Captions For, Eugene J. Guglielmo - Proc. Conf. on Applied Natural Language Processing , 1992
"... This paper briefly describes the current implementation status of an intelligent information retrieval system, MARIE, that employs natural language processing techniques. Descriptive captions are used to iden- tify photographic images concerning various military projects. The captions are parsed to ..."
Abstract - Add to MetaCart
This paper briefly describes the current implementation status of an intelligent information retrieval system, MARIE, that employs natural language processing techniques. Descriptive captions are used to iden- tify photographic images concerning various military projects. The captions are parsed

AUTOMATIC CAPTION GENERATION FOR NEWS IMAGES USING EXTRACTIVE AND ABSTRACTIVE MODELS

by Sushma Patwardhan, Harjeet Kaur
"... Automatic image caption generation is of great interest to many image related applications. Now a day’s, whenever retrieving images from the search Engines that retrieves images without analyzing their content, simply by matching user queries against the image’s file name and format, user-annotated ..."
Abstract - Add to MetaCart
-annotated tags, captions, and, generally, text surrounding the image. Also the retrieved image does not contain any textual data along with the images. We introduced the task of automatic caption generation for news images. The task fuses insights from computer vision and natural language processing and holds

Noname manuscript No. (will be inserted by the editor) Interpreting Spatial Language in Image Captions

by unknown authors
"... the date of receipt and acceptance should be inserted later Abstract The map as a tool for accessing data has become very popular in recent years, but a lot of data does not have the necessary spatial meta-data to allow for that. Some data such as photographs however have spatial information in thei ..."
Abstract - Add to MetaCart
in their captions and if this could be extracted, then they could be made available via map-based interfaces. Towards this goal we introduce a model and spatio-linguistic reasoner for interpreting the spatial information in image captions that is based upon quantitative data about spatial language use acquired

Multilingual Thesauri in Cross-Language Text and Speech Retrieval

by Dagobert Soergel - In Working Notes of AAAI Spring Symposium on Cross-Language Text and Speech Retrieval , 1997
"... This paper sets forth a framework for the use of thesauri as knowledge bases in cross-language retrieval. It provides a general introduction to thesaurus functions, structure, and construction with particular attention to the problems of multilingual thesauri. 1 Thesaurus functions A thesaurus is a ..."
Abstract - Cited by 21 (0 self) - Add to MetaCart
This paper sets forth a framework for the use of thesauri as knowledge bases in cross-language retrieval. It provides a general introduction to thesaurus functions, structure, and construction with particular attention to the problems of multilingual thesauri. 1 Thesaurus functions A thesaurus

Image Retrieval Using Natural Language and Content-Based Techniques

by Kate Byrne, Ewan Klein , 2003
"... This paper deals with the application of Natural Language Processing and Content-Based Image Retrieval to the practical problem of finding database images to answer user queries. The data collection used contains about 50,000 digital images linked to a large text database, but typically not having i ..."
Abstract - Cited by 1 (0 self) - Add to MetaCart
This paper deals with the application of Natural Language Processing and Content-Based Image Retrieval to the practical problem of finding database images to answer user queries. The data collection used contains about 50,000 digital images linked to a large text database, but typically not having
Results 1 - 10 of 29