Deep learning and multimodal target recognition of complex and ambiguous words in automated English learning system

Diao, Lijing; Hu, Ping

doi:10.3233/jifs-189543

Cited by 20 publications

(15 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There are no specific experimental data for his research. Diao and Hu [ 8 ] analyzed the complexity of deep learning and the application of multimodal object recognition in English education systems. He proposed that the large-scale application of multimedia technology in college English classrooms is conducive to the construction of a real language environment.…”

Section: Introductionmentioning

confidence: 99%

College English Multimodal Teaching Based on Digital Information Technology

Wu¹

2022

Computational Intelligence and Neuroscience

View full text Add to dashboard Cite

In the era of in-depth application of knowledge technology in the field of education, the teaching mode combining school English teaching and network data technology is widely used in school English education. Teaching resources have become electronic resources under the influence of digital information technology. However, English teaching often ignores all aspects of English ability, so there are still shortcomings in English teaching. The role of information technology makes a single English teaching text model unable to meet the needs of scholars. In recent years, multimodal events have enriched the expression of language input and output content, which is in line with the learning needs of current students. Therefore, under the premise of digital information technology, this paper constructs a multimodal English teaching model from the aspects of multimodal English teaching resources, multimodal English teaching activities, and multimodal English teaching analysis. It aims to mobilize the enthusiasm of scholars to learn English from various aspects and build a multimodal teaching mode of English for teachers supported by digital data technology. Therefore, the experiment shows that the multimodal teaching mode of college English based on digital information technology proposed in this paper will mobilize the enthusiasm of students to learn in a comprehensive way. It greatly improves students’ English performance, promotes the development of students’ autonomous learning ability and comprehensive language ability, and improves the quality of English teaching by 20%.

show abstract

Section: Introductionmentioning

confidence: 99%

College English Multimodal Teaching Based on Digital Information Technology

Wu¹

2022

Computational Intelligence and Neuroscience

View full text Add to dashboard Cite

show abstract

“…The model takes the advantages of both the entropy method and the AGA-BP algorithm to make up for the shortcomings of the other way, which is mainly reflected in the benefit that the AGA-BP algorithm model can perform nonlinear mapping within arbitrary accuracy, which can make up for the disadvantage that the entropy method lacks the horizontal comparison of indicators [ 27 ]. The basic idea of the entropy value method, which is an objective assignment method, is to determine the indicator weights by calculating the degree of fluctuation of each indicator value; the process can reduce the deviation brought by human factors and provide a specific basis for the design of the neural network; the initial evaluation results determined by the method are used as a priori guiding samples for the AGA-BP algorithm model.…”

Section: Digital Teaching Quality Data Evaluation Model Designmentioning

confidence: 99%

Research on the Multimodal Digital Teaching Quality Data Evaluation Model Based on Fuzzy BP Neural Network

Feng

2022

Computational Intelligence and Neuroscience

View full text Add to dashboard Cite

We propose in this paper a fuzzy BP neural network model and DDAE-SVR deep neural network model to analyze multimodal digital teaching, establish a multimodal digital teaching quality data evaluation model based on a fuzzy BP neural network, and optimize the initial weights and thresholds of BP neural network by using adaptive variation genetic algorithm. Since the BP neural network is highly dependent on the initial weights and points, the improved genetic algorithm is used to optimize the initial weights and thresholds of the BP neural network, reduce the time for the BP neural network to find the importance and points that satisfy the training termination conditions, and improve the prediction accuracy and convergence speed of the neural network on the teaching quality evaluation results. The entropy value method, a data-based objectivity evaluation method, is introduced as the guidance mechanism of the BP neural network. The a priori guidance sample is obtained by the entropy method. Then, the adaptive variational genetic algorithm is used to optimize the BP neural network model to learn the a priori sample knowledge and establish the evaluation model, which reduces the subjectivity of the BP neural network learning sample. To better reflect and compare the effects of the two neural network evaluation models, BP and GA-BP, the sample data were continued to be input into the original GA and BSA to obtain the evaluation results and errors; then, the evaluation results of the two evaluation models, BP and GA-BP, were compared with the evaluation results of the two algorithms, GA and BSA. It was found that the GA-BP neural network evaluation model has higher accuracy and can be used for multimodal digital teaching quality evaluation, providing a more feasible solution.

show abstract

“…Previous studies on multimodal input in vocabulary learning have mainly focused on college students ( Wang and Chen (2018) ; Diao and Hu (2021) , adult learners ( Boers et al, 2017 ), and primary school students ( Tragant et al, 2016 ). Only few studies have worked with junior high school students ( Lin and Yu, 2017 ).…”

Section: Literature Reviewmentioning

confidence: 99%

“…Only few studies have worked with junior high school students ( Lin and Yu, 2017 ). Furthermore, majority of studies on multimodal input in vocabulary instruction available so far are focused on incidental vocabulary acquisition, in which the recalling of vocabulary meaning is a by-product of reading or listening, with only two exceptions ( Lin and Yu, 2017 ; Diao and Hu, 2021 ). It is, therefore, important to verify the effectiveness of multimodal input in explicit vocabulary instruction in class.…”

Section: Literature Reviewmentioning

confidence: 99%

Dual Coding or Cognitive Load? Exploring the Effect of Multimodal Input on English as a Foreign Language Learners’ Vocabulary Learning

Zhang

et al. 2022

Front. Psychol.

View full text Add to dashboard Cite

In the era of eLearning 4.0, many researchers have suggested that multimodal input helps to enhance second language (L2) vocabulary learning. However, previous studies on the effects of multimodal teaching have failed to yield definitive conclusions. Furthermore, only few studies on the multimodal input of vocabulary learning have aimed at junior high school students and have focused on explicit vocabulary instruction in class. To explore the effects of multimodal input on English as a foreign language (EFL) learners’ vocabulary learning and summarize effective methods, this study adopts a mixed-method approach. Based on dual coding theory and cognitive load theory, the teaching materials in this study were designed using the resources provided by the multimodal corpus iWeb and other websites. A total of 60 junior high school students who learned EFL and had a similar English proficiency level were divided into an experimental group (EG) and a control group (CG). Target words were selected through questionnaire I. During the experiment, the CG learned from monomodal materials while the EG received multimodal input, and an immediate post-test was delivered to the two groups. Questionnaire II was distributed in the EG, and five students of the EG were randomly selected for an interview. One week later, a delayed post-test was conducted on the EG and CG. The results showed that the EG performed better in the post-test but did worse than the CG in the delayed post-test. The results of the questionnaire and the interview suggest that students held both positive and negative attitudes toward the multimodal input approach in vocabulary learning. The study concludes with some implications for choosing a multimodal input approach in vocabulary learning, along with a number of suggestions on how to optimize its positive influence and minimize its negative effects.

show abstract

Deep learning and multimodal target recognition of complex and ambiguous words in automated English learning system

Cited by 20 publications

References 28 publications

College English Multimodal Teaching Based on Digital Information Technology

College English Multimodal Teaching Based on Digital Information Technology

Research on the Multimodal Digital Teaching Quality Data Evaluation Model Based on Fuzzy BP Neural Network

Dual Coding or Cognitive Load? Exploring the Effect of Multimodal Input on English as a Foreign Language Learners’ Vocabulary Learning

Contact Info

Product

Resources

About