Tuning Language Processing Approaches for Pashto Texts Classification

Abstract

Nowadays, text classification for different purposes becomes a basic task for concerned people. Hence, much research has been done to develop automatic text classification for the majority of national and international languages. However, the need for an automated text classification system for local languages is felt. The main purpose of this study is to establish a novel automatic classification system of Pashto text. In order to follow this up, we established a collection of Pashto documents and constructed the dataset. In addition, this study includes several models containing statistical techniques and neural network neural machine learning including DistilBERT-base-multilingual-cased, Multilayer Perceptron, Support Vector Machine, K Nearest Neighbor, decision tree, Gaussian naïve Bayes, multinomial naïve Bayes, random forest, and logistic regression to discover the most effective approach. Moreover, this investigation evaluates two different feature extraction methods including bag of words, and Term Frequency Inverse Document Frequency. Subsequently, this research obtained an average testing accuracy rate of 94% using the MLP classification algorithm and TFIDF feature extraction method in single label multi-class classification. Similarly, MLP+TFIDF with F1-measure of 0.81 showed the best result. Experiments on the use of pre-trained language representation models (such as DistilBERT) for classifying Pashto texts show that we need a specific tokenizer for a particular language to obtain reasonable results.

Artificial intelligence model GPT4 narrowly fails simulated radiological protection exam

“…GPT-4 exhibited superior performance across all knowledge domains and even surpassed the passing threshold in the Operations and Procedures sub-section. This discrepancy may be due to the advancements incorporated into GPT-4, which includes a substantially larger training dataset than GPT 3.5 and a ten-fold increase in the number of neural network parameters [8,9]. Furthermore, with GPT-4's image processing capabilities, it can be inferred that if the exam questions were to include figures and tables, as seen in many current certification exams, the performance gap between the two models would likely be more pronounced.…”

“…The third iteration of the Generative Pre-Trained Transformer (GPT-3.5) comprises 175 billion parameters, while GPT-4 boasts an impressive 1.76 trillion parameters [8,9]. Parameters can be defined as the components of a LLM that shape its proficiency in tasks such as text generation.…”

GPT's Performance in Identifying Outcome Changes on ClinicalTrials.gov

“…GPT-4, developed by OpenAI, is the fourth-generation LLM in the GPT series and is regarded as the most advanced and capable generative large language model. 33 Researchers are exploring the capabilities of GPT-4 in various scholarly tasks, 34 including reviewing scientific papers, [35][36][37] implementing edits based on reviewer comments, 38 and systematic review tasks, such as article screening, data extraction, 39,40 and assessing the risk of bias in included studies. 41 While GPT-4 has shown satisfactory performance in some of these tasks, the results in others have been less than optimal.…”

GPT-3.5 vs. GPT-4, Unveiling OpenAI’s Latest Breakthrough in Language Models

“…GPT-4, the latest iteration of OpenAI's language model, has introduced several remarkable improvements, setting it apart from its predecessor, GPT-3.5. Let's explore the key differences between the two models [1], [6][7][8][9][10][11]:…”