Results 1 - 10
of
36
Detecting Wikipedia vandalism with active learning and statistical language models
- In Proceedings of the 4th workshop on Information credibility (WICOW '10). ACM
, 2010
"... ABSTRACT This paper proposes an active learning approach using language model statistics to detect Wikipedia vandalism. Wikipedia is a popular and influential collaborative information system. The collaborative nature of authoring, as well as the high visibility of its content, have exposed Wikiped ..."
Abstract
-
Cited by 25 (4 self)
- Add to MetaCart
(Show Context)
ABSTRACT This paper proposes an active learning approach using language model statistics to detect Wikipedia vandalism. Wikipedia is a popular and influential collaborative information system. The collaborative nature of authoring, as well as the high visibility of its content, have exposed Wikipedia articles to vandalism. Vandalism is defined as malicious editing intended to compromise the integrity of the content of articles. Extensive manual efforts are being made to combat vandalism and an automated approach to alleviate the laborious process is needed. This paper builds statistical language models, constructing distributions of words from the revision history of Wikipedia articles. As vandalism often involves the use of unexpected words to draw attention, the fitness (or lack thereof) of a new edit when compared with language models built from previous versions may well indicate that an edit is a vandalism instance. In addition, the paper adopts an active learning model to solve the problem of noisy and incomplete labeling of Wikipedia vandalism. The Wikipedia domain with its revision histories offers a novel context in which to explore the potential of language models in characterizing author intention. As the experimental results presented in the paper demonstrate, these models hold promise for vandalism detection.
End-User Development and Meta-Design: Foundations for Cultures of Participation
"... The first decade of the World Wide Web predominantly enforced a clear separation between designers and consumers. New technological developments, such as the cyberinfrastructure and Web 2.0 architectures, have emerged to support a participatory Web and social computing. These developments are the fo ..."
Abstract
-
Cited by 24 (10 self)
- Add to MetaCart
(Show Context)
The first decade of the World Wide Web predominantly enforced a clear separation between designers and consumers. New technological developments, such as the cyberinfrastructure and Web 2.0 architectures, have emerged to support a participatory Web and social computing. These developments are the foundations for a fundamental shift from consumer cultures (specialized in producing finished goods to be consumed passively) to cultures of participation (in which all people are provided with the means to participate actively in personally meaningful activities). End-user development and meta-design provide foundations for this fundamental transformation. They explore and support new approaches for the design, adoption, appropriation, adaptation, evolution, and sharing of artifacts by all participating stakeholders. They take into account that cultures of participation are not dictated by technology alone: they are the result of incremental shifts in human behavior and social organizations. The design, development, and assessment of five particular applications that contributed to the development of our theoretical framework are described and discussed.
So you know you’re getting the best possible information: A tool that increases Wikipedia credibility
- In Proceeding of the Twenty-Seventh Annual SIGCHI Conference on Human Factors in Computing Systems
, 2009
"... An experiment was conducted to study how credibility judgments about Wikipedia are affected by providing users with an interactive visualization (WikiDashboard) of article and author editing history. Overall, users who self-reported higher use of Internet information and higher rates of Wikipedia us ..."
Abstract
-
Cited by 21 (3 self)
- Add to MetaCart
(Show Context)
An experiment was conducted to study how credibility judgments about Wikipedia are affected by providing users with an interactive visualization (WikiDashboard) of article and author editing history. Overall, users who self-reported higher use of Internet information and higher rates of Wikipedia usage tended to produce lower credibility judgments about Wikipedia articles and authors. However, use of WikiDashboard significantly increased article and author credibility judgments, with effect sizes larger than any other measured effects of background media usage and attitudes on Wikiepedia credibility. The results suggest that increased exposure to the editing/authoring histories of Wikipedia increases credibility judgments.
WikipediaViz: Conveying Article Quality for Casual Wikipedia Readers
- PACIFICVIS '10: IEEE PACIFIC VISUALIZATION SYMPOSIUM (2010) 215-222
, 2010
"... As Wikipedia has become one of the most used knowledge bases worldwide, the problem of the trustworthiness of the information it disseminates becomes central. With WikipediaViz, we introduce five visual indicators integrated to the Wikipedia layout that can keep casual Wikipedia readers aware of imp ..."
Abstract
-
Cited by 20 (7 self)
- Add to MetaCart
As Wikipedia has become one of the most used knowledge bases worldwide, the problem of the trustworthiness of the information it disseminates becomes central. With WikipediaViz, we introduce five visual indicators integrated to the Wikipedia layout that can keep casual Wikipedia readers aware of important metainformation about the articles they read. The design of WikipediaViz was inspired by two participatory design sessions with expert Wikipedia writers and sociologists who explained the clues they used to quickly assess the trustworthiness of articles. According to these results, we propose five metrics for Maturity and Quality assessment of Wikipedia articles and their accompanying visualizations to provide the readers with important clues about the editing process at a glance. We also report and discuss about the results of the user studies we conducted. Two preliminary pilot studies show that all our subjects trust Wikipedia articles almost blindly. With the third study, we show that WikipediaViz significantly reduces the time required to assess the quality of articles while maintaining a good accuracy.
Social Use of Computer-Mediated Communication by Adults on the Autism Spectrum
"... The defining characteristics of autism, including difficulty with nonverbal cues and need for structure, and the defining characteristics of computer-mediated communication (CMC), including reduction of extraneous cues and structured exchange, suggest the two would be an ideal match. Interviews and ..."
Abstract
-
Cited by 16 (1 self)
- Add to MetaCart
(Show Context)
The defining characteristics of autism, including difficulty with nonverbal cues and need for structure, and the defining characteristics of computer-mediated communication (CMC), including reduction of extraneous cues and structured exchange, suggest the two would be an ideal match. Interviews and observations of 16 adults on the high-functioning end of the autism spectrum reveal that many seek greater social connectedness and take advantage of interest-based online communities to foster successful, supportive relationships. However, CMC intensifies problems of trust, disclosure, inflexible thinking, and perspective-taking, making it difficult for some to maintain relationships. Interventions in the form of information visualization and CMC-specific social skills training are presented. Intervention considerations and participatory design opportunities are discussed. Author Keywords Computer-mediated communication, online communities,
Distributed Sensemaking: Improving Sensemaking by Leveraging the Efforts of Previous Users
"... We examine the possibility of distributed sensemaking: improving a user’s sensemaking by leveraging previous users ’ work without those users directly collaborating or even knowing one another. We asked users to engage in sensemaking by organizing and annotating web search results into “knowledge ma ..."
Abstract
-
Cited by 12 (0 self)
- Add to MetaCart
(Show Context)
We examine the possibility of distributed sensemaking: improving a user’s sensemaking by leveraging previous users ’ work without those users directly collaborating or even knowing one another. We asked users to engage in sensemaking by organizing and annotating web search results into “knowledge maps, ” either with or without previous users ’ maps to work from. We also recorded gaze patterns as users examined others ’ knowledge maps. Our findings show the conditions under which distributed sensemaking can improve sensemaking quality; that a user’s sensemaking process is readily apparent to a subsequent user via a knowledge map; and that the organization of content was more useful to subsequent users than the content itself, especially when those users had differing goals. We discuss the role distributed sensemaking can play in schema induction by helping users make a mental model of an information space and make recommendations for new tool and system development. Author Keywords Sensemaking, search, collaboration, knowledge mapping.
Don’t Hide in the Crowd! Increasing Social Transparency Between Peer Workers Improves Crowdsourcing Outcomes
"... This paper studied how social transparency and different peer-dependent reward schemes (i.e., individual, teamwork, and competition) affect the outcomes of crowdsourcing. The results showed that when social transparency was increased by asking otherwise anonymous workers to share their demographic i ..."
Abstract
-
Cited by 10 (1 self)
- Add to MetaCart
(Show Context)
This paper studied how social transparency and different peer-dependent reward schemes (i.e., individual, teamwork, and competition) affect the outcomes of crowdsourcing. The results showed that when social transparency was increased by asking otherwise anonymous workers to share their demographic information (e.g., name, nationality) to the paired worker, they performed significantly better. A more detailed analysis showed that in a teamwork reward scheme, in which the reward of the paired workers depended only on the collective outcomes, increasing social transparency could offset effects of social loafing by making them more accountable to their teammates. In a competition reward scheme, in which workers competed against each other and the reward depended on how much they outperformed their opponent, increasing social transparency could augment effects of social facilitation by providing more incentives for them to outperform their opponent. The results suggested that a careful combination of methods that increase social transparency and different reward schemes can significantly improve crowdsourcing outcomes. Author Keywords Crowdsourcing; human computation; social transparency;
The impact of social information on visual judgments
- Proc. CHI
, 2011
"... Social visualization systems have emerged to support collective intelligence-driven analysis of a growing influx of open data. As with many other online systems, social signals (e.g., forums, polls) are commonly integrated to drive use. Unfortunately, the same social features that can provide rapid, ..."
Abstract
-
Cited by 10 (0 self)
- Add to MetaCart
Social visualization systems have emerged to support collective intelligence-driven analysis of a growing influx of open data. As with many other online systems, social signals (e.g., forums, polls) are commonly integrated to drive use. Unfortunately, the same social features that can provide rapid, high-accuracy analysis are coupled with the pitfalls of any social system. Through an experiment involving over 300 subjects, we address how social information signals (social proof) affect quantitative judgments in the context of graphical perception. We identify how unbiased social signals lead to fewer errors over non-social settings and conversely, how biased signals lead to more errors. We further reflect on how systematic bias nullifies certain collective intelligence benefits, and we provide evidence of the formation of information cascades. We describe how these findings can be applied to collaborative visualization systems to produce more accurate individual interpretations in social contexts.
Augmented Social Cognition: Using Social Web technology to enhance the ability of groups to remember, think, and reason
, 2009
"... We are experiencing a new Social Web, where people share, communicate, commiserate, and conflict with each other. As evidenced by systems like Wikipedia, twitter, and delicious.com, these environments are turning people into social information foragers and sharers. Groups interact to resolve conflic ..."
Abstract
-
Cited by 6 (0 self)
- Add to MetaCart
We are experiencing a new Social Web, where people share, communicate, commiserate, and conflict with each other. As evidenced by systems like Wikipedia, twitter, and delicious.com, these environments are turning people into social information foragers and sharers. Groups interact to resolve conflicts and jointly make sense of topic areas from "Obama vs. Clinton " to "Islam." PARC's Augmented Social Cognition researchers-- who come from cognitive psychology, computer science, HCI, CSCW, and other disciplines-- focus on understanding how to "enhance a group of people's ability to remember, think, and reason". Through Social Web systems like social bookmarking sites, blogs, Wikis, and more, we can finally study, in detail, these types of enhancements on a very large scale. Here we summarize recent work and early findings such as: (1) how conflict and coordination have played out in Wikipedia, and how social transparency might affect reader trust; (2) how decreasing interaction costs might change participation in social tagging systems; and (3) how computation can help organize usergenerated content and metadata.
rv you're dumb: identifying discarded work in Wiki article history
- In Proceedings of the 5th international Symposium on Wikis and Open Collaboration
"... Wiki systems typically display article history as a linear sequence of revisions in chronological order. This representation hides deeper relationships among the revisions, such as which earlier revision provided most of the content for a later revision, or when a revision effectively reverses the c ..."
Abstract
-
Cited by 6 (2 self)
- Add to MetaCart
(Show Context)
Wiki systems typically display article history as a linear sequence of revisions in chronological order. This representation hides deeper relationships among the revisions, such as which earlier revision provided most of the content for a later revision, or when a revision effectively reverses the changes made by a prior revision. These relationships are valuable in understanding what happened between editors in conflict over article content. We present methods for detecting when a revision discards the work of one or more other revisions, a means of visualizing these relationships in-line with existing history views, and a computational method for detecting discarded work. We show through a series of examples that these tools can aid mediators of wiki content disputes by making salient the structure of the ongoing conflict. Further, the computational tools provide a means of determining whether or not a revision has been accepted by the community of editors surrounding the article.
