Turk-Life in India

Gupta, Neha; Martín, David; Hanrahan, Benjamin V.; O’Neill, Jacki

doi:10.1145/2660398.2660403

Cited by 91 publications

(78 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…First, college students are often required to do research studies for course credit, which they receive regardless of the quality of their data. In contrast, MTurk workers are primarily motivated by being paid for their work (Antin & Shaw, 2012) and are therefore concerned about protecting their online reputation so that they can get access to good, high-paying work (Gupta, Martin, Hanrahan, & O'Neill, 2014). As a result, we think MTurk workers may take studies more seriously.…”

Section: Study 1 Methodsmentioning

confidence: 99%

Is sadness blue? The problem of using figurative language for emotions on psychological tests

2016

View full text Add to dashboard Cite

Psychological tests sometimes include figurative language like I feel blue. However, figurative language may not mean the same thing cross-culturally. Previous research found cross-cultural evidence for 14 conceptual metaphors and metonymies for emotions (e.g., sadness is blue). Our two studies asked participants (total n = 795) in the USA and India whether happiness, sadness, anger, and fear are associated with certain descriptors (blue, down, bright, etc.). Most participants in both countries endorsed ten of the 14 hypothesized associations; however, the percentage of participants endorsing an association was often far from 100 %. For example, in the USA, only 71.7 % associated hot with anger and only 65.9 % associated blue with sadness. Moreover, descriptors were often associated with more than one emotion. Furthermore, only two associations (happiness is up and bright) were endorsed by more than 90 % of participants in both countries and had descriptors that were not associated with additional emotions. We conclude that figurative language is often ambiguous and should be used with caution on psychological tests unless there is evidence the language is understood cross-culturally. Advice to this effect is currently lacking from psychometrics textbooks and should be added.

show abstract

Section: Study 1 Methodsmentioning

confidence: 99%

Is sadness blue? The problem of using figurative language for emotions on psychological tests

2016

View full text Add to dashboard Cite

show abstract

“…En particulier, Amazon Mechanical Turk ne prévoit pas de phase de formation en tant que telle. Les travailleurs (Turkers), qui sont à la merci d'un Requester qui pourrait décider de les exclure doivent se former par eux-mêmes, en se préparant à la tâche sans être rémunérés, ce qui génère un important travail caché mis au jour dans [20]. 54 Enfin, si les participants à ces expériences deviennent, on l'a vu, des experts de la tâche, ils ne sont pas des chercheurs ou des spécialistes, ni du domaine, ni de la démarche.…”

Section: Corela Hs-21 | 2017unclassified

“…15 Amazon Mechanical Turk ne propose aucun moyen symétrique pour bannir les Requesters qui se comportent de manière inacceptable, payant mal ou en retard, bannissant des Turkers sans raison valable ou définissant mal les tâches 7 . La relation de travail est par conséquent totalement déséquilibrée, ce qui est détaillé dans [20].…”

unclassified

“…Il est donc fondamental de mieux décrire le type d'expert nécessaire, notamment pour l'annotation de corpus, afin de proposer des solutions alternatives permettant de produire des données de qualité de manière éthique. 20 Les jeux ayant un but représentent de ce point de vue une solution prometteuse.…”

unclassified

“…» Si l'expertise des participants est rarement celle de spécialistes du domaine ou de l'annotation portée, les joueurs, les travailleurs ou les bénévoles deviennent rapidement des experts de la tâche, mettant en oeuvre toutes sortes de stratégies et créant parfois leurs propres outils, afin d'être plus efficaces [20]. La coopération qui peut se créer autour de la tâche et des outils entre les joueurs (notamment via le forum du jeu) participe de ce savoir-faire, tel que détaillé par Christophe Dejours dans [14].…”

unclassified

See 2 more Smart Citations