Interpreting quality assessment re-imagined: The synergy between human and machine scoring

Han, Chao; Lu, Xiaolei

doi:10.1177/27523810211033670

Cited by 9 publications

(2 citation statements)

References 56 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Second, while VidAAS significantly aids educators, it is not a replacement for human judgment. Teachers, both in this and prior research Han & Lu, 2021), have noted that their assessments go beyond strict rubric adherence to include subjective judgments, reflecting an understanding of individuals' progress and the learning contexts. This positions VidAAS as a supportive tool that augments, not replaces, teachers' observational assessments.…”

Section: Implications Of Studymentioning

confidence: 92%

A Study on the Curriculum of the Graduate School of Department of Education Consulting in South Korea

Lee¹

2022

Korea Assoc Edu Consulting Coaching

View full text Add to dashboard Cite

The purpose of this study was to suggest implications for the curriculum of the graduate school of department of education consulting and education consulting major in South Korea through the analysis of the current status and curriculum of the graduate school of department of education consulting and education consulting major in South Korea. In this study, in order to investigate the current status and curriculum of the graduate school of department of education consulting and education consulting major in South Korea, the keywords were limited to ‘education consulting’, and data were collected in the order of Daehakalrimi(https://www.academyinfo.go.kr), Naver and Google keyword search, and each university and graduate school’s website. As a result of the analysis of the collected data, it was confirmed that three master’s and doctoral programs in general graduate schools in South Korea, and nine master’s programs in graduate schools of education in South Korea were in operation, and the curriculum of the graduate school of department of education consulting and education consulting major in South Korea were organized based on the faculty members’s major and expertise according to new department and major or name changed department and major. This study is the first study to analysis the current status and curriculum of the graduate school of department of education consulting and education consulting major in South Korea and is meaningful as a basic study of the development of education consulting as disciplines.

show abstract

Section: Implications Of Studymentioning

confidence: 92%

A Study on the Curriculum of the Graduate School of Department of Education Consulting in South Korea

Lee¹

2022

Korea Assoc Edu Consulting Coaching

View full text Add to dashboard Cite

show abstract

“…An effective technique for assessing the caliber of translated materials and making sure they adhere to the necessary criteria for correctness and fluency is a translation judgment system. Nonetheless, it is crucial to choose a method that is suitable for the unique circumstances and objectives of the translation project [2]. The technique of automatically translating text from one language to another using computer software or algorithms is known as machine translation.…”

Section: Introductionmentioning

confidence: 99%

Analysis of Feature Extraction Model for Machine Korean Translation Judging System

Piao

2024

jes

View full text Add to dashboard Cite

Language translation is becoming increasingly widespread and diversified as internationalization and information technology advance significantly. Nonetheless, there are cultural variations across different nations, and there will unavoidably be some variations brought on by translation software. While the machine translation system has attained a high level of development, the issues with the older machine translation methods still remain and cannot be fully resolved. The efficiency of Korean-Chinese translation must thus be improved by creating a more effective model for converting translation information. This has significant implications for the development of international relationships, commercial interactions, cultural development, and commerce between China and South Korea. The translation is the rendering of words into other languages so that they may be understood by both individuals. Nevertheless, there are several flaws and inconsistencies in the present Korean-to-Chinese translational information processing method. Thus, this study suggests a Diverse Deep Embedding Data Accumulation (DDEDA) algorithm for the translation framework. We utilized the Korean-Chinese corpus dataset for the research. Utilizing translation accuracy, precision, recall, error rate, and translation time, the performance of the suggested approach was examined and compared with previously employed methodologies. The findings demonstrate that the proposed method has taken 43s for translation.

show abstract

Automatic assessment of spoken-language interpreting based on machine-translation evaluation metrics

Han

2022

INTP

View full text Add to dashboard Cite

Automated metrics for machine translation (MT) such as BLEU are customarily used because they are quick to compute and sufficiently valid to be useful in MT assessment. Whereas the instantaneity and reliability of such metrics are made possible by automatic computation based on predetermined algorithms, their validity is primarily dependent on a strong correlation with human assessments. Despite the popularity of such metrics in MT, little research has been conducted to explore their usefulness in the automatic assessment of human translation or interpreting. In the present study, we therefore seek to provide an initial insight into the way MT metrics would function in assessing spoken-language interpreting by human interpreters. Specifically, we selected five representative metrics – BLEU, NIST, METEOR, TER and BERT – to evaluate 56 bidirectional consecutive English–Chinese interpretations produced by 28 student interpreters of varying abilities. We correlated the automated metric scores with the scores assigned by different types of raters using different scoring methods (i.e., multiple assessment scenarios). The major finding is that BLEU, NIST, and METEOR had moderate-to-strong correlations with the human-assigned scores across the assessment scenarios, especially for the English-to-Chinese direction. Finally, we discuss the possibility and caveats of using MT metrics in assessing human interpreting.

show abstract

Interpreting quality assessment re-imagined: The synergy between human and machine scoring

Cited by 9 publications

References 56 publications

A Study on the Curriculum of the Graduate School of Department of Education Consulting in South Korea

A Study on the Curriculum of the Graduate School of Department of Education Consulting in South Korea

Analysis of Feature Extraction Model for Machine Korean Translation Judging System

Automatic assessment of spoken-language interpreting based on machine-translation evaluation metrics

Contact Info

Product

Resources

About