Let's Ask AI About Their Programs: Exploring ChatGPT's Answers To Program Comprehension Questions

Lehtinen, Teemu; Koutcheme, Charles; Hellas, Arto

doi:10.1145/3639474.3640058

Proceedings of the 46th International Conference on Software Engineering: Software Engineering Education and Training 2024

DOI: 10.1145/3639474.3640058

|View full text |Cite

Let's Ask AI About Their Programs: Exploring ChatGPT's Answers To Program Comprehension Questions

Teemu Lehtinen,

Charles Koutcheme,

Arto Hellas

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article1

Relationship

Self Cite0

Independent1

Authors

Journals

Cited by 1 publication

References 47 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Risk management strategy for generative AI in computing education: how to handle the strengths, weaknesses, opportunities, and threats?

Humble

2024

Int J Educ Technol High Educ

View full text Add to dashboard Cite

The idea of Artificial intelligence (AI) has a long history in both research and fiction and has been applied in educational settings since the 1970s. However, the topic of AI underwent a huge increase of interest with the release of ChatGPT in late 2022, and more people were talking about generative AI (GenAI or GAI). According to some estimates, the number of publications on generative AI increased with 2269.49% between 2022 and 2023, and the increase was even higher when related to computing education. The aim of this study is to investigate the potential strengths, weaknesses, opportunities, and threats of generative AI in computing education, as highlighted by research published after the release of ChatGPT. The study applied a scoping literature review approach with a three-step process for identifying and including a total of 129 relevant research papers, published in 2023 and 2024, through the Web of Science and Scopus databases. Included papers were then analyzed with a theoretical thematic analysis, supported by the SWOT analysis framework, to identify themes of strengths, weaknesses, opportunities, and threats with generative AI for computing education. A total of 19 themes were identified through the analysis. Findings of the study have both theoretical and practical implications for computing education specifically, and higher education in general. Findings highlights several challenges posed by generative AI, such as potential biases, overreliance, and loss of skills; but also several possibilities, such as increasing motivation, educational transformation, and supporting teaching and learning. The study expands the traditional SWOT analysis, by providing a risk management strategy for handling the strengths, weaknesses, opportunities, and threats of generative AI.

show abstract

Risk management strategy for generative AI in computing education: how to handle the strengths, weaknesses, opportunities, and threats?

Humble

2024

Int J Educ Technol High Educ

View full text Add to dashboard Cite

show abstract

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Let's Ask AI About Their Programs: Exploring ChatGPT's Answers To Program Comprehension Questions

Cited by 1 publication

References 47 publications

Risk management strategy for generative AI in computing education: how to handle the strengths, weaknesses, opportunities, and threats?

Risk management strategy for generative AI in computing education: how to handle the strengths, weaknesses, opportunities, and threats?

Contact Info

Product

Resources

About