Posts Tagged ‘crowds ’
These slides are from a presentation I gave in Sep Kamvar’s Computational Methods in Data Mining (old website link here). In the presentation, I presented TurKit, a programming framework created by Greg Little and others at MIT that allows for programmatic iteration over tasks in Mechanical Turk. Essentially, that means that instead of the familiar paradigm of sending out a bunch of HITs and waiting for the responses, TurKit will ping AMT for answers and these answers can be used in future HITs. This allows for the use of an “improve and vote” loop, where Turkers continually improve on and validate the work of other Turkers. They had some impressive results in the paper, getting fairly high quality responses to a wide range of tasks (including image labeling, handwriting recognition, and brainstorming) for under $0.50.
I’ve been interested a bit in looking at how to help people find high-quality information on the web – recently, I have been exploring how to help people make better credibility judgments about the information they find. One paper I was reading, “Statement Map: Assisting Information Credibility Analysis by Visualizing Arguments” by Koji Murakami and others at the Nara Institute of Science and Technology in Japan, uses as a motivating example the recent movement against vaccinations for children, specifically the MMR (Measles, Mumps, and Rubella), as the result of fears that these vaccines could cause autism.
