Our research on communitysourcing brings crowdsourcing work to experts through physical kiosks. As an example, we implemented Umati, the Communitysourcing Vending Machine, a vending kiosk with a touchscreen interface. We placed Umati within a specific community (e.g., students), provide work that fits their skill-set (e.g., grading intro-level exams), and reward them with items they find personally valuable (e.g., candy). We found that Umati was able to generate more consistent and accurate grades than those we could generate using Mechanical Turk, at less cost than paid expert graders.
More information is at http://represent.berkeley.edu/umati/
View Link [youtu.be]