A Semantic Grammar for Augmentative and Alternative Communication Systems

Pereira, Jayr; Franco, Natália; Fidalgo, Robson

doi:10.1007/978-3-030-58323-1_28

Cited by 4 publications

(8 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…They divided the corpus into a five-fold split and computed the model performance in each fold. [Pereira et al 2020] assessed the quality of the predictions made by their semantic grammar by using it to reconstruct subject+verb+object sentences extracted from the CHILDES database [MacWhinney 2014]. All the experiments performed by [Pereira et al 2022] were in an automatic setting.…”

Section: Evaluation Methodmentioning

confidence: 99%

“…[Pereira et al 2022] used a metric called Perplexity, which indicates how surprised a language model is when exposed to a new distribution of text. [Pereira et al 2020] evaluated their proposal's precision for reconstructing the sentences from a corpus. And finally, [Garcia et al 2016] assessed the system's quality on saving keystrokes.…”

Section: Evaluation Methodmentioning

confidence: 99%

“…No study was labeled as negative or neutral. We marked those studies that did not compare their proposal to any other as having no baseline [Martínez-Santiago et al 2015, Dudy and Bedrick 2018, Pereira et al 2020]. [García et al 2015] performed no experiment, and there is no what to compare.…”

Section: Evaluation Methodmentioning

confidence: 99%

“…The authors used these vectors as input to their recurrent neural network. Other studies followed an approach similar to [Schwab et al 2020], which consider that a pictogram is better represented by a concept from a dictionary (e.g., person: a human being) [Martínez-Santiago et al 2015, Pereira et al 2020, Pereira et al 2022. This approach assumes that the concept is a link between the pictogram label and its figure.…”

Section: Prediction Unitmentioning

confidence: 99%

“…This approach assumes that the concept is a link between the pictogram label and its figure. [Martínez-Santiago et al 2015] used concepts from the FrameNet database, [Pereira et al 2020] used WordNet synsets (a set of synonyms with a glossary definition, e.g., a person is a human being), and [Pereira et al 2022] used WordNet word-senses (a link between a word and a synset). For more details about the differences between a synset and a word sense, refer to WordNet documentation 3 .…”

Section: Prediction Unitmentioning

confidence: 99%

See 4 more Smart Citations

Pictogram Prediction in Alternative Communication Boards: a Mapping Study

Pereira

Medeiros

Zanchettin

et al. 2022

Anais Do XXXIII Simpósio Brasileiro De Informática Na Educação (SBIE 2022)

View full text Add to dashboard Cite

Alternative communication boards (ACB) are tools that try to compensate for the difficulties faced by people with complex communication needs. Generally, these tools consist of a mobile application in which the user can construct sentences by arranging pictograms (picture+label pair representing a concept) in sequence. This study systematically maps the literature on pictogram prediction in ACBs. We analyzed eight studies to investigate how computational methods are used for pictogram prediction, how these proposals are evaluated, and the studies' outcomes regarding user communication improvement. The main findings indicate the usage of different methods for pictogram prediction and a mixture of automatic and expert evaluation, which lead to inconclusive outcomes regarding user communication improvement.

show abstract

Section: Evaluation Methodmentioning

confidence: 99%

Section: Evaluation Methodmentioning

confidence: 99%

Section: Evaluation Methodmentioning

confidence: 99%

Section: Prediction Unitmentioning

confidence: 99%

Section: Prediction Unitmentioning

confidence: 99%

See 3 more Smart Citations

Pictogram Prediction in Alternative Communication Boards: a Mapping Study

Pereira

Medeiros

Zanchettin

et al. 2022

Anais Do XXXIII Simpósio Brasileiro De Informática Na Educação (SBIE 2022)

View full text Add to dashboard Cite

show abstract

A Natural Language Generation Algorithm for Greek by Using Hole Semantics and a Systemic Grammatical Formalism

Giachos,

Batzaki,

Papakitsos

et al. 2023

j. of Comput. sci. res.

View full text Add to dashboard Cite

This work is about the progress of previous related work based on an experiment to improve the intelligence of robotic systems, with the aim of achieving more linguistic communication capabilities between humans and robots. In this paper, the authors attempt an algorithmic approach to natural language generation through hole semantics and by applying the OMAS-III computational model as a grammatical formalism. In the original work, a technical language is used, while in the later works, this has been replaced by a limited Greek natural language dictionary. This particular effort was made to give the evolving system the ability to ask questions as well as the authors developed an initial dialogue system using these techniques. The results show that the use of these techniques the authors apply can give us a more sophisticated dialogue system in the future.

show abstract

Requesting Help Module Interface Design on Key Partial Video with Action and Augmented Reality for Children with Autism Spectrum Disorder

2022

View full text Add to dashboard Cite

Children with autism spectrum disorder (ASD) have marked difficulty with vocabulary, lack of language, or shortcomings with their ability to organize their oral expression; thus, they cannot effectively communicate with others. In particular, people with moderate or severe disabilities cannot systematically narrate an incident and cannot follow pragmatic rules provided by others. Their attempts at standard everyday conversation lead to cognitive problems. When children with ASD are faced with difficult circumstances, they are usually unable to seek help from others, which in turn can result in their being unable to communicate effectively. This research focused on three child participants with ASD and language disorders. The goal was to strengthen the effectiveness of their requesting help and to organize their oral expression, to use requesting help modules, to remove static key images, and to use augmented reality (AR) combined with the dynamic video clips in key partial video with action (KPV). This study developed request-assistance training in conjunction with an auto organizational menu (AOM), multiple case studies and withdrawal designs, training-response methods, and a comparison of outcomes. The proposed AR sentence intervention effectively increased the children’s desire to communicate with others and the accuracy rate of their help requests, and increased their level of communication. We conclude that the interface of our requesting help modules is efficacious enough to assist children with ASD at different levels. The proposed AR sentence intervention helps them build scenarios by themselves, helps them organize communication with their peers, and assists them to request help.

show abstract

A Semantic Grammar for Augmentative and Alternative Communication Systems

Cited by 4 publications

References 11 publications

Pictogram Prediction in Alternative Communication Boards: a Mapping Study

Pictogram Prediction in Alternative Communication Boards: a Mapping Study

A Natural Language Generation Algorithm for Greek by Using Hole Semantics and a Systemic Grammatical Formalism

Requesting Help Module Interface Design on Key Partial Video with Action and Augmented Reality for Children with Autism Spectrum Disorder

Contact Info

Product

Resources

About