Language as a Social Instrument

Usman, Abdurrahman Hi.; Mahmud, Adi F.; Daud, Abdulhalim; Dahlan, Suratman

doi:10.33387/j.edu.v18i2.2101

Cited by 3 publications

(2 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Second, it is "information" view -perspective of information theory where the structure of a language could be considered as driven my objective of entropy minimization across all possible messages being transmitted in this language [5]. Third, it is "concordance" view -social and contractual perspective of the language where is is thought as a medium of enabling efficient communication between different groups minimizing discrepancy of social contexts across these social groups [6,7].…”

Section: Metrics For Tuning Of Hyper-parametersmentioning

confidence: 99%

Self-tuning hyper-parameters for unsupervised cross-lingual tokenization

Kolonin¹

2023

Preprint

View full text Add to dashboard Cite

We explore the possibility of meta-learning for the languageindependent unsupervised tokenization problem for English, Russian, and Chinese. We implement the meta-learning approach for automatic determination of hyper-parameters of the unsupervised tokenization model proposed in earlier works, relying on various human-independent fitness functions such as normalized anti-entropy, compression factor and crosssplit F 1 score, as well as additive and multiplicative composite combinations of the three metrics, testing them against the conventional F 1 tokenization score. We find a fairly good correlation between the latter and the additive combination of the former three metrics for English and Russian. In the case of Chinese, we find a significant correlation between the F 1 score and the compression factor. Our results suggest the possibility of robust unsupervised tokenization of low-resource and dead languages and allow us to think about human languages in terms of the evolution of efficient symbolic communication codes with different structural optimization schemes that have evolved in different human cultures.

show abstract

Section: Metrics For Tuning Of Hyper-parametersmentioning

confidence: 99%

Self-tuning hyper-parameters for unsupervised cross-lingual tokenization

Kolonin¹

2023

Preprint

View full text Add to dashboard Cite

show abstract

“…Language is an effective tool that is used by humans to communicate with each other. The importance of language cannot be separated from humans because language makes it easier for them to interact with one another (Usman et al, 2020). Nowadays, the function of language develops as a means of human thinking in studying various sciences and technologies (Richards, 2015).…”

Section: Introductionmentioning

confidence: 99%

Realisation of Language Variation Through Code Mixing in Satu Persen-Indonesian Life School on YOUTUBE.COM

Martisa,

Nasruddin,

Putra

et al. 2023

MJPM

View full text Add to dashboard Cite

The study is aimed to describe the types and the functions of code mixing in Satu Persen-Indonesian Life School Youtube channel. Thelander’s theory used to describe the types of code mixing and Marasigan’s theory used to analyze the functions of code mixing. There are two data sources in the research; the first data are three videos from Satu Persen on Youtube as primary data and a video script for each video as secondary data. The study used the descriptive qualitative method. The data were collected by watching, downloading, transcribing, identifying, coding, and classifying the data. The data analysis was done by presenting, describing, interpreting and concluding the data. The finding shows that there are fifteen data about code mixing in Satu Persen’s videos. It reveals that there are six types of code-mixing found in the videos namely word insertion, phrase insertion, hybrid insertion, repetition insertion, idiom insertion and clause insertion. Meanwhile, the functions of code mixing used are to quote somebody else, interjection, addressee specification, repetition, message qualification, personalization and objectification and facility expression.

show abstract

Self-tuning Hyper-parameters for Unsupervised Cross-lingual Tokenization

Kolonin

2023

2023 IEEE XVI International Scientific and Technical Conference Actual Problems of Electronic Instrument Engineering (APEIE)

View full text Add to dashboard Cite

Language as a Social Instrument

Cited by 3 publications

References 0 publications

Self-tuning hyper-parameters for unsupervised cross-lingual tokenization

Self-tuning hyper-parameters for unsupervised cross-lingual tokenization

Realisation of Language Variation Through Code Mixing in Satu Persen-Indonesian Life School on YOUTUBE.COM

Self-tuning Hyper-parameters for Unsupervised Cross-lingual Tokenization

Contact Info

Product

Resources

About