2023
DOI: 10.1016/j.simpat.2023.102754
|View full text |Cite
|
Sign up to set email alerts
|

Artificial intelligence foundation and pre-trained models: Fundamentals, applications, opportunities, and social impacts

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
3
1
1

Citation Types

0
3
0

Year Published

2023
2023
2024
2024

Publication Types

Select...
5
3

Relationship

0
8

Authors

Journals

citations
Cited by 30 publications
(8 citation statements)
references
References 60 publications
0
3
0
Order By: Relevance
“…Ethical and legal challenges related to AI-generated content are also a recurrent topic ( Lee, 2023b ; Salvagno, Taccone & Gerli, 2023 ; Ray, 2023 ; Karaali, 2023 ; Dwivedi et al, 2023 ), especially in the context of academic research and education, where concerns about authenticity and academic integrity arise. Moreover, many studies explore ChatGPT’s potential benefits and capabilities ( Victor et al, 2023 ; Farrokhnia et al, 2023 ; Halaweh, 2023 ; Kooli, 2023 ; Cox & Tzoc, 2023 ; Carvalho & Ivanov, 2023 ; Jungwirth & Haluza, 2023 ; Cascella et al, 2023 ; Kolides et al, 2023 ; Dwivedi et al, 2023 ), and potential to address societal megatrends ( Haluza & Jungwirth, 2023 ), with a focus on its role in writing, research, and pedagogy, suggesting a shift in educational paradigms.…”
Section: Study Background and Related Workmentioning
confidence: 99%
See 1 more Smart Citation
“…Ethical and legal challenges related to AI-generated content are also a recurrent topic ( Lee, 2023b ; Salvagno, Taccone & Gerli, 2023 ; Ray, 2023 ; Karaali, 2023 ; Dwivedi et al, 2023 ), especially in the context of academic research and education, where concerns about authenticity and academic integrity arise. Moreover, many studies explore ChatGPT’s potential benefits and capabilities ( Victor et al, 2023 ; Farrokhnia et al, 2023 ; Halaweh, 2023 ; Kooli, 2023 ; Cox & Tzoc, 2023 ; Carvalho & Ivanov, 2023 ; Jungwirth & Haluza, 2023 ; Cascella et al, 2023 ; Kolides et al, 2023 ; Dwivedi et al, 2023 ), and potential to address societal megatrends ( Haluza & Jungwirth, 2023 ), with a focus on its role in writing, research, and pedagogy, suggesting a shift in educational paradigms.…”
Section: Study Background and Related Workmentioning
confidence: 99%
“…Furthermore, the majority of the studies encompass exploratory approaches ( Haluza & Jungwirth, 2023 ; Yeadon et al, 2023 ; Victor et al, 2023 ; Dwivedi et al, 2023 ; Rozado, 2023 ; Cascella et al, 2023 ; Ariyaratne et al, 2023 ; Yan, 2023 ; Grünebaum et al, 2023 ; Kooli, 2023 ; Jungwirth & Haluza, 2023 ; Geerling et al, 2023 ; Gilson et al, 2023 ; Cooper, 2023 ; Short & Short, 2023 ). Similarly, several studies take the form of reviews, such as Ray (2023) , Lee (2023b) , Thurzo et al (2023) , Carvalho & Ivanov (2023) and Kolides et al (2023) . Moreover, text analysis is employed in studies conducted by Taecharungroj (2023) and Tlili et al (2023) .…”
Section: Study Background and Related Workmentioning
confidence: 99%
“…Deep neural networks offer considerable potential for identifying brain illnesses and providing prognosis predictions based on neuroimaging data, but significant, labeled training datasets are often needed for excellent predictive accuracy [15,18]. The authors of [19] explored a variety of pretraining and transfer learning (TL) [20] techniques to construct usable MRI representations for downstream tasks that lack significant quantities of training data, such as AD classification [21], in the absence of vast amounts of training data. The scientists studied 4098 3D T1-weighted brain MRI images from the Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort and 600 scans from the Open Access Series of Imaging Studies (OASIS3) [22] cohort to assess the suggested pretraining methodologies for identifying AD.…”
Section: Related Workmentioning
confidence: 99%
“…The general steps performed by ChatGPT are described as follows [24,25]: (a) the system enables the user to create a prompt message, which may contain specific commands, types of questions, etc., (b) the system tokenizes the above message by separating it into words or sequences of words that are going to be analyzed, (c) the tokenized output from the previous step is fed into the transformer-based neural network, and (d) the transformer elaborates on the resulting input and, using specialized inference mechanisms, provides a text-based answer to the user.…”
Section: Chatgpt 211 Capabilities and Functionality Of Chatgptmentioning
confidence: 99%
“…As a result, it appears to possess a more effective performance in various downstream endeavors related to classifying texts, answering questions, sentiment analysis, etc. The model also uses a transformer-based neural network with 48 transformer blocks, 1600 dimensions, and 1.5 billion parameters, while the context window uses 1024 tokens [13,24,25].…”
Section: Gpt Versions and Technologies Involvedmentioning
confidence: 99%