Measuring Motivations of Crowdworkers

Posch, Lisa; Bleier, Arnim; Lechner, Clemens M.; Danner, Daniel; Flöck, Fabian; Strohmaier, Markus

doi:10.1145/3335081

Cited by 21 publications

(10 citation statements)

References 55 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To bolster the crowdworkers' motivation, reward setting is one of the most important issues (Posch et al, 2019). In this paper, we tested two types of rewards: fixed or variable.…”

Section: Reward Settingsmentioning

confidence: 99%

NTT Neural Machine Translation Systems at WAT 2019

Morishita

Suzuki

Nagata

2019

Proceedings of the 6th Workshop on Asian Translation

View full text Add to dashboard Cite

In this paper, we describe our systems that were submitted to the translation shared tasks at WAT 2019. This year, we participated in two distinct types of subtasks, a scientific paper subtask and a timely disclosure subtask, where we only considered English-to-Japanese and Japanese-to-English translation directions. We submitted two systems (En-Ja and Ja-En) for the scientific paper subtask and two systems (Ja-En, texts, items) for the timely disclosure subtask. Three of our four systems obtained the best human evaluation performances. We also confirmed that our new additional web-crawled parallel corpus improves the performance in unconstrained settings.

show abstract

“…To bolster the crowdworkers' motivation, reward setting is one of the most important issues (Posch et al, 2019). In this paper, we tested two types of rewards: fixed or variable.…”

Section: Reward Settingsmentioning

confidence: 99%

NTT Neural Machine Translation Systems at WAT 2019

Morishita

Suzuki

Nagata

2019

Proceedings of the 6th Workshop on Asian Translation

View full text Add to dashboard Cite

show abstract

“…The results of the three approaches also provided evidence for convergent validity (i.e., if the items converge and have a high proportion of variance in common). Posch et al (2019) indicated that significant factor loadings and an AVE less than CR is evidence of convergent validity. For the three subscales, all of the factor loadings were significant, and, in all instances, AVE < CR.…”

Section: Discussionmentioning

confidence: 99%

The PSI-20: Development of a Viable Short Form Alternative of the Problem Solving Inventory Using Item Response Theory

Pretorius,

Heppner,

Padmanabhanunni

et al. 2023

Sage Open

View full text Add to dashboard Cite

In previous studies, problem solving appraisal has been identified as playing a key role in promoting positive psychological well-being. The Problem Solving Inventory is the most widely used measure of problem solving appraisal and consists of 32 items. The length of the instrument, however, may limit its applicability to large-scale surveys consisting of several instruments. This study investigated the possibility of reducing the number of items in the inventory using item response theory. We used the automated item selection procedure in Mokken analysis which identified 12 items as unscalable or loading on a separate scale or violating invariant item ordering. Rasch analysis, Mokken analysis, and classical test theory were then used to investigate the psychometric properties of the shorter version of the instrument. The results supported the reliability, validity, and dimensionality of the three subscales in the shortened version. The shortened version of the Problem Solving Inventory (PSI-20) and its subscales had very strong relationships with the original scale and its subscales, and the correlation of the total scale and the subscales of the shortened version with related variables was very similar to the relationships that the original scale and the subscales had with those same variables. The PSI-20 is thus beneficial in identifying changes in metacognition related to problem solving ability and can provide a basis for further intervention.

show abstract

“…Convergent validity of the VAX was demonstrated through significant factor loadings [ 45 , 46 ], AVE > 0.50, and AVE < CR [ 46 ]. The latter indices indicated that the variance explained by the scale (or subscales) is greater than cross-loadings or measurement error [ 47 ].…”

Section: Discussionmentioning

confidence: 99%

Validation of the vaccination attitudes examination scale in a South African context in relation to the COVID-19 vaccine: quantifying dimensionality with bifactor indices

Padmanabhanunni,

Pretorius,

Isaacs

2023

BMC Public Health

View full text Add to dashboard Cite

Background The COVID-19 pandemic represented a global public health emergency. Existing studies support the view that vaccination and mass immunization are among the most effective means of containing the outbreak and promoting health. However, negative attitudes toward vaccination and the related vaccine hesitancy among many groups have created a significant barrier to effectively managing the health crisis. Having a valid and reliable tool to assess attitudes toward vaccination remains imperative so that factors underlying vaccine refusal can be identified and public health interventions can be facilitated. The current study examined the psychometric properties of the Vaccination Attitudes Examination Scale (VAX) in South Africa. Methods Participants (n = 322) completed the VAX. Confirmatory factor analysis and ancillary bifactor indices were used to examine the hypothesized factor structure (a total scale and four subscales) of the scale. Inter-item correlations, factor loadings, and average variance extracted were used to examine the validity of the scale. Predictive validity was examined by comparing those who had received the COVID-19 vaccine and those who had not. The reliability of the scale was examined in terms of both Cronbach’s alpha and composite reliability. Results Confirmatory factor analysis provided support for the conceptualization of the scale as consisting of a total scale and four subscales, and ancillary bifactor indices indicated that the subscales accounted for a sufficient amount of variance (44%) after the variance explained by the total scale was considered. Overall, the analysis indicated that the scale had satisfactory reliability (alpha and composite reliability = 0.70) and provided evidence for the construct, convergent, and predictive validity of the VAX. Conclusions The sound psychometric qualities of the scale, when used in a low- to middle-income country, have the potential to advance research and immunization policy within these settings and facilitate more targeted interventions to promote vaccine uptake.

show abstract

Measuring Motivations of Crowdworkers

Cited by 21 publications

References 55 publications

NTT Neural Machine Translation Systems at WAT 2019

NTT Neural Machine Translation Systems at WAT 2019

The PSI-20: Development of a Viable Short Form Alternative of the Problem Solving Inventory Using Item Response Theory

Validation of the vaccination attitudes examination scale in a South African context in relation to the COVID-19 vaccine: quantifying dimensionality with bifactor indices

Contact Info

Product

Resources

About