Results 1 - 10
of
42
Soylent: A Word Processor with a Crowd Inside
- IN PROC UIST'10
, 2010
"... This paper introduces architectural and interaction patterns for integrating crowdsourced human contributions directly into user interfaces. We focus on writing and editing, complex endeavors that span many levels of conceptual and pragmatic activity. Authoring tools offer help with pragmatics, but ..."
Abstract
-
Cited by 227 (42 self)
- Add to MetaCart
(Show Context)
This paper introduces architectural and interaction patterns for integrating crowdsourced human contributions directly into user interfaces. We focus on writing and editing, complex endeavors that span many levels of conceptual and pragmatic activity. Authoring tools offer help with pragmatics, but for higher-level help, writers commonly turn to other people. We thus present Soylent, a word processing interface that enables writers to call on Mechanical Turk workers to shorten, proofread, and otherwise edit parts of their documents on demand. To improve worker quality, we introduce the Find-Fix-Verify crowd programming pattern, which splits tasks into a series of generation and review stages. Evaluation studies demonstrate the feasibility of crowdsourced editing and investigate questions of reliability, cost, wait time, and work time for edits.
Example-Centric Programming: Integrating Web Search into the Development Environment
, 2010
"... The ready availability of online source-code examples has fundamentally changed programming practices. However, current search tools are not designed to assist with programming tasks and are wholly separate from editing tools. This paper proposes that embedding a task-specific search engine in the d ..."
Abstract
-
Cited by 74 (5 self)
- Add to MetaCart
(Show Context)
The ready availability of online source-code examples has fundamentally changed programming practices. However, current search tools are not designed to assist with programming tasks and are wholly separate from editing tools. This paper proposes that embedding a task-specific search engine in the development environment can significantly reduce the cost of finding information and thus enable programmers to write better code more easily. This paper describes the design, implementation, and evaluation of Blueprint, a Web search interface integrated into the Adobe Flex Builder development environment that helps users locate example code. Blueprint automatically augments queries with code context, presents a code-centric view of search results, embeds the search experience into the editor, and retains a link between copied code and its source. A comparative laboratory study found that Blueprint enables participants to write significantly better code and find example code significantly faster than with a standard Web browser. Analysis of three months of usage logs with 2,024 users suggests that task-specific search interfaces can significantly change how and when people search the Web.
Design Lessons from the Fastest Q&A Site in the West
- CHI 2011
, 2011
"... This paper analyzes a Question & Answer site for programmers, Stack Overflow, that dramatically improves on the utility and performance of Q&A systems for technical domains. Over 92 % of Stack Overflow questions about expert topics are answered — in a median time of 11 minutes. Using a mixed ..."
Abstract
-
Cited by 68 (1 self)
- Add to MetaCart
This paper analyzes a Question & Answer site for programmers, Stack Overflow, that dramatically improves on the utility and performance of Q&A systems for technical domains. Over 92 % of Stack Overflow questions about expert topics are answered — in a median time of 11 minutes. Using a mixed methods approach that combines statistical data analysis with user interviews, we seek to understand this success. We argue that it is not primarily due to an a priori superior technical design, but also to the high visibility and daily involvement of the design team within the community they serve. This model of continued community leadership presents challenges to both CSCW systems research as well as to attempts to apply the Stack Overflow model to other specialized knowledge domains.
Data-driven suggestions for creativity support in 3d modeling
- In Proc. SIGGRAPH Asia, ACM
, 2010
"... Figure 1: 3D models created using data-driven suggestions, starting from simple shapes for which suggestions were generated. We introduce data-driven suggestions for 3D modeling. Datadriven suggestions support open-ended stages in the 3D modeling process, when the appearance of the desired model is ..."
Abstract
-
Cited by 31 (1 self)
- Add to MetaCart
Figure 1: 3D models created using data-driven suggestions, starting from simple shapes for which suggestions were generated. We introduce data-driven suggestions for 3D modeling. Datadriven suggestions support open-ended stages in the 3D modeling process, when the appearance of the desired model is ill-defined and the artist can benefit from customized examples that stimulate creativity. Our approach computes and presents components that can be added to the artist’s current shape. We describe shape retrieval and shape correspondence techniques that support the generation of data-driven suggestions, and report preliminary experiments with a tool for creative prototyping of 3D models.
Syntactic and Functional Variability of a Million Code Submissions in a Machine Learning MOOC
"... Abstract. In the first offering of Stanford’s Machine Learning Massive Open-Access Online Course (MOOC) there were over a million programming submissions to 42 assignments — a dense sampling of the range of possible solutions. In this paper we map out the syntax and functional similarity of the subm ..."
Abstract
-
Cited by 14 (4 self)
- Add to MetaCart
(Show Context)
Abstract. In the first offering of Stanford’s Machine Learning Massive Open-Access Online Course (MOOC) there were over a million programming submissions to 42 assignments — a dense sampling of the range of possible solutions. In this paper we map out the syntax and functional similarity of the submissions in order to explore the variation in solutions. While there was a massive number of submissions, there is a much smaller set of unique approaches. This redundancy in student solutions can be leveraged to “force multiply ” teacher feedback. Fig.1. The landscape of solutions for “gradient descent for linear regression ” representing over 40,000 student code submissions with edges drawn between syntactically similar submissions and colors corresponding to performance on a battery of unit tests (red submissions passed all unit tests). 1
LemonAid: selection-based crowdsourced contextual help for web applications
- Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems, ACM
, 2012
"... Web-based technical support such as discussion forums and social networking sites have been successful at ensuring that most technical support questions eventually receive helpful answers. Unfortunately, finding these answers is still quite difficult, since users ’ textual queries are often incomple ..."
Abstract
-
Cited by 11 (6 self)
- Add to MetaCart
(Show Context)
Web-based technical support such as discussion forums and social networking sites have been successful at ensuring that most technical support questions eventually receive helpful answers. Unfortunately, finding these answers is still quite difficult, since users ’ textual queries are often incomplete, imprecise, or use different vocabularies to describe the same problem. We present LemonAid, a new approach to help that allows users to find help by instead selecting a label, widget, link, image or other user interface (UI) element that they believe is relevant to their problem. LemonAid uses this selection to retrieve previously asked questions and their corresponding answers. The key insight that makes LemonAid work is that users tend to make similar selections in the interface for similar help needs and different selections for different help needs. Our initial evaluation shows that across a corpus of dozens of tasks and thousands of requests, LemonAid retrieved a result for 90% of help requests based on UI selections and, of those, over half had relevant matches in the top 2 results. ACM Classification: H.5.2 [Information interfaces and presentation]: User Interfaces. Graphical user interfaces.
Codewebs: scalable homework search for massive open online programming courses
- In Proceedings of the 23rd international conference on World wide web, International World Wide Web Conferences Steering Committee
, 2014
"... Massive open online courses (MOOCs), one of the latest internet revolutions have engendered hope that constant it-erative improvement and economies of scale may cure the “cost disease ” of higher education. While scalable in many ways, providing feedback for homework submissions (par-ticularly open- ..."
Abstract
-
Cited by 7 (3 self)
- Add to MetaCart
(Show Context)
Massive open online courses (MOOCs), one of the latest internet revolutions have engendered hope that constant it-erative improvement and economies of scale may cure the “cost disease ” of higher education. While scalable in many ways, providing feedback for homework submissions (par-ticularly open-ended ones) remains a challenge in the online classroom. In courses where the student-teacher ratio can be ten thousand to one or worse, it is impossible for instructors to personally give feedback to students or to understand the multitude of student approaches and pitfalls. Organizing and making sense of massive collections of homework solu-tions is thus a critical web problem. Despite the challenges, the dense solution space sampling in highly structured home-works for some MOOCs suggests an elegant solution to pro-viding quality feedback to students on a massive scale. We outline a method for decomposing online homework submissions into a vocabulary of “code phrases”, and based on this vocabulary, we architect a queryable index that al-lows for fast searches into the massive dataset of student homework submissions. To demonstrate the utility of our homework search engine we index over a million code sub-missions from users worldwide in Stanford’s Machine Learn-ing MOOC and (a) semi-automatically learn shared struc-ture amongst homework submissions and (b) generate spe-cific feedback for student mistakes. Codewebs is a tool that leverages the redundancy of densely sampled, highly structured homeworks in order to force-multiply teacher effort. Giving articulate, instant feedback is a crucial component of the online learning process and thus by building a homework search engine we hope to take a step towards higher quality free education.
Automatically locating relevant programming help online
- In VL/HCC’12
"... Abstract—While maintaining software systems, developers of-ten encounter compilation errors and runtime exceptions that they do not know how to solve. Solutions to these errors can often be found through discussions with other developers on the Internet. Unfortunately, many of these online discussio ..."
Abstract
-
Cited by 6 (0 self)
- Add to MetaCart
(Show Context)
Abstract—While maintaining software systems, developers of-ten encounter compilation errors and runtime exceptions that they do not know how to solve. Solutions to these errors can often be found through discussions with other developers on the Internet. Unfortunately, many of these online discussions do not contain relevant answers. We have developed an approach to automatically query and analyze online discussions to locate relevant solutions to programming problems. Our tool, called Dora, is integrated into Visual Studio and allows developers to query and evaluate solutions within their development environ-ment, enabling them to reduce context switching between their development tasks and their search sessions. We have performed a semi-controlled experiment to validate the utility of our search approach with 18 tasks, finding that our approach provides 55% more relevant results than traditional web searching approaches. I.
SnipMatch: Using Source Code Context to Enhance Snippet Retrieval and Parameterization
"... Programmers routinely use source code snippets to increase their productivity. However, locating and adapting code snippets to the current context still takes time: for example, variables must be renamed, and dependencies included. We believe that when programmers decide to invest time in creating a ..."
Abstract
-
Cited by 5 (0 self)
- Add to MetaCart
(Show Context)
Programmers routinely use source code snippets to increase their productivity. However, locating and adapting code snippets to the current context still takes time: for example, variables must be renamed, and dependencies included. We believe that when programmers decide to invest time in creating a new code snippet from scratch, they would also be willing to spend additional effort to make that code snippet configurable and easy to integrate. To explore this insight, we built SnipMatch, a plug-in for the Eclipse IDE. SnipMatch introduces a simple markup that allows snippet authors to specify search patterns and integration instructions. SnipMatch leverages this information, in conjunction with current code context, to improve snippet search and parameterization. For example, when a search query includes local variables, SnipMatch suggests compatible snippets, and automatically adapts them by substituting in these variables. In the lab, we observed that participants integrated snippets faster when using SnipMatch than when using standard Eclipse. Findings from a public deployment to 93 programmers suggest that SnipMatch has become integrated into the work practices of real users. ACM Classification: H.5.2. Information interfaces and
IP-QAT: in-product questions, answers, & tips
- Proceedings of the 24th annual ACM symposium on User interface software and technology, ACM
, 2011
"... We present IP-QAT, a new community-based question and answer system for software users. Unlike most community forums, IP-QAT is integrated into the actual software application, allowing users to easily post questions, answers and tips without having to leave the application. Our in-product implement ..."
Abstract
-
Cited by 4 (1 self)
- Add to MetaCart
(Show Context)
We present IP-QAT, a new community-based question and answer system for software users. Unlike most community forums, IP-QAT is integrated into the actual software application, allowing users to easily post questions, answers and tips without having to leave the application. Our in-product implementation is context-aware and shows relevant posts based on a user’s recent activity. It is also designed with minimal transaction costs to encourage users to easily post, include annotated images and file attachments, as well as tag their posts with relevant UI components. We describe a robust cloud-based system implementation, which allowed us to release IP-QAT to 37 users for a 2 week field study. Our study showed that IP-QAT increased user contributions, and subjectively, users found our system more useful and easier to use, in comparison to the existing commercial discussion board. ACM Classification: H5.2 [Information interfaces and
