Transformer Based Bengali Chatbot Using General Knowledge Dataset

Masum, Abu Kaisar Mohammad; Abujar, Sheikh; Akter, Sharmin; Ria, Nushrat Jahan; Hossain, Syed Akhter

doi:10.1109/icmla52953.2021.00200

Cited by 5 publications

(2 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Transformer [5] have emerged as the dominant architecture in natural language processing (NLP) tasks such as text generation and machine translation, outperforming convolutional models and recurrent neural networks (RNN) models [6]. The research conducted by Masum et al [7] found that a Bengali language chatbot using the Transformer model achieved a BLEU score of 85.00, surpassing the Seq2Seq and Bidirectional-RNN models, which achieved BLEU scores of 23.50 and 17.23, respectively. Generative pre-trained transformer (GPT) [8]- [10] is a transformer-based model that has emerged as the state of the art in language modeling tasks such as text generation and question-answering.…”

mentioning

confidence: 99%

Indonesian generative chatbot model for student services using GPT

Priccilia,

Girsang

2024

IJ-ICT

View full text Add to dashboard Cite

The accessibility of academic information greatly impacts the satisfaction and loyalty of university students. However, limited university resources often hinder students from conveniently accessing information services. To address this challenge, this research proposes the digitization of the question-answering process between students and student service staff through the implementation of generative chatbot. A generative chatbot can provide students with human-like responses to academic inquiries at their convenience. This research developed generative chatbot using pre-trained GPT-2 architecture in three different sizes, specifically designed for addressing practicum-related questions in a private university in Indonesia. The experiment utilized 1288 question-answer pairs in Indonesian and demonstrated the best performance with a BLEU score of 0.753, signifying good performance accuracy in generating text despite dataset limitations.

show abstract

mentioning

confidence: 99%

Indonesian generative chatbot model for student services using GPT

Priccilia,

Girsang

2024

IJ-ICT

View full text Add to dashboard Cite

show abstract

“…When integrated into other generative models, they introduce essential mechanisms and techniques such as attention, self-1 https://ai.google/static/documents/google-about-bard.pdf , accessed Jan 3rd,2024 attention, multi-head attention, and positional encoding [101]. This integration has unlocked practical applications of transformers in various domains, including text generation for creative writing [102], chatbots [103], code generation [104], and programming assistance [105]. Notably, incorporating transformers into other GAI has led to significant advancements in image synthesis.…”

Section: B Typical Gai Modelsmentioning

confidence: 99%

A Study Of Civil Engineering Education At Singapore Nanyang Technology University And At The University Of Florida

Liu¹,

Najafi²

2002 Annual Conference Proceedings

View full text Add to dashboard Cite

offer civil engineering courses to undergraduate and graduate students. This paper discusses and compares Civil Engineering curriculum in both Universities. The Civil Engineering courses at the University of Florida are divided into two phases of general education and upper division/civil engineering core education. At Nanyang Technology University, the Civil Engineering offers courses of a prescribed core of essential subjects and both institutions offer excellent program of study. The Civil Engineering program at Nanyang Technology University offers courses closely related to industry and government needs. Similarly, at the University of Florida, Civil Engineering program also offers excellent education program in line with government and industries needs. At both institutions, efforts should be focused on revising curriculum that is more responsible to existing and future rapid technological changes.

show abstract