Abstract. This paper describes a corpus annotation project to study issues in the manual annotation of opinions, emotions, sentiments, speculations, evaluations and other private states in language. The resulting corpus annotation scheme is described, as well as examples of its use. In addition, the manual annotation process and the results of an inter-annotator agreement study on a 10,000-sentence corpus of articles drawn from the world press are presented.

This paper presents this algorithm, gives demonstrations of an implemented system, and describes the results of some preliminary empirical studies, which lend support to the algorithm

Part of understanding fictional narrative text is determhfing for each sentence whether it takes some c, haracter's point of view and, if it does, identifying the character whose point of view is taken. This paper presents part of an algorithm for performing the latter. When faced with a sentence that takes a character's point of view, the reader has to decide whether that character is a previously mentioned character or one mentioned in the sentence. We give particular consideration to sentences about private states, such as seeing and wanting, for which both possibilities exist. Our algorithm is based on regulafities in the ways that texts initiate, continue, and resume a character's point of view, found during extensive examinations of published novels and short stories.

The propositional content of a reference is the proposition attributing to the referent the properties that correspond to the nouns and modifiers in the reference (for example, the propositional content of `Mary' is that the referent is named `Mary'). During language comprehension, the hearer or reader must determine the set of beliefs with respect to which the propositional content of a reference is to be understood. In the prototypical case, this set consists of the propositions that she believes that the speaker or writer believes that she and the speaker or writer mutually believe. This paper identifies two contexts in which the propositional content of a specific reference is not understood with respect to this set--- subjective and objective sentences in third-person fictional narrative text---and identifies some implications of this for understanding specific references in these contexts. 1 Introduction Specific references are references to particular entities, for example, `a...

William J. end Shapiro, Stuart C. (1984), "Quasi-lndexical Reference in Propositional Semantic Networks, " Proceedings of the loth International Conference on Computational Linguistics ( COLING-84 ; Stanford Univ.) (Morristown, NJ: Assoc. for Computational Linguistics): 65-70. Rapaport, William J. (1986), "Logical Foundations for Belief Representation," Cognitiv e Science 10: 371-422. Reiser, Brian J. (1981), "Character Tracking and the Understanding of Narrative," Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI-81; Van. couver) (Los Altos, CA: Morgen Kanhmmn): 209-211. Roach, Eleanor and Lloyd, B.B. (1978). Cognition and Categorization (Hillsdale, NJ: Lawrence Erlbaum Associ- ates). Shapiro, Smart C. (1979). "The SNePS Sementic Network Processing System," in N.V. Findlet (ed.), Associative Network. v (New York: Academic): 179-203. Shapiro, Stuart C. end Rapaport, William J. (1987). "SNePS Considered as a Fully Intensional Propositional S

This paper describes extensions to a corpus annotation scheme for the manual annotation of attributions, as well as opinions, emotions, sentiments, speculations, evaluations and other private states in language. It discusses the scheme with respect to the "Pie in the Sky" Check List of Desirable Semantic Information for Annotation. We believe that the scheme is a good foundation for adding private state annotations to other layers of semantic meaning.