COCA: Cost-Effective Collaborative Annotation System by Combining Experts and Amateurs

Lei, Jiayu; Zhang, Zheng; Zhang, Lan; Li, Xiangyang

doi:10.1109/icde53745.2022.00055

Cited by 5 publications

(1 citation statement)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, using experts to annotate all the data can be costly by selecting correct actions from a set of discrete commands: {continue, left, straight, and right}. On the other hand, amateurs are cheaper but unable to give precise action labels (Lei et al, 2022). Annotators with professional domain knowledge are rare, while the amateurs are cheaper and numerous because they are regular crowds like part-time students (Li et al, 2016).…”

Section: Introductionmentioning

confidence: 99%

USN: A Robust Imitation Learning Method against Diverse Action Noise

Yu,

Han,

Tsang

2024

jair

View full text Add to dashboard Cite

Learning from imperfect demonstrations is a crucial challenge in imitation learning (IL). Unlike existing works that still rely on the enormous effort of expert demonstrators, we consider a more cost-effective option for obtaining a large number of demonstrations. That is, hire annotators to label actions for existing image records in realistic scenarios. However, action noise can occur when annotators are not domain experts or encounter confusing states. In this work, we introduce two particular forms of action noise, i.e., state-independent and state-dependent action noise. Previous IL methods fail to achieve expert-level performance when the demonstrations contain action noise, especially the state-dependent action noise. To mitigate the harmful effects of action noises, we propose a robust learning paradigm called USN (Uncertainty-aware Sample-selection with Negative learning). The model first estimates the predictive uncertainty for all demonstration data and then selects sampleswith high loss based on the uncertainty measures. Finally, it updates the model parameters with additional negative learning on the selected samples. Empirical results in Box2D tasks and Atari games show that USN consistently improves the final rewards of behavioral cloning, online imitation learning, and offline imitation learning methods under various action noises. The ratio of significant improvements is up to 94.44%. Moreover, our method scales to conditional imitation learning with real-world noisy commands in urban driving

show abstract

Section: Introductionmentioning

confidence: 99%