Verbal behavior and the future of social science.

Boyd, Ryan L.; Markowitz, David M.

doi:10.1037/amp0001319

American Psychologist

2024

DOI: 10.1037/amp0001319

|View full text |Cite

Verbal behavior and the future of social science.

Ryan L. Boyd,

David M. Markowitz

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Article4

Relationship

Self Cite0

Independent4

Authors

Journals

Cited by 4 publications

References 177 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Evaluating large language models in theory of mind tasks

Kosinski

2024

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

Eleven large language models (LLMs) were assessed using 40 bespoke false-belief tasks, considered a gold standard in testing theory of mind (ToM) in humans. Each task included a false-belief scenario, three closely matched true-belief control scenarios, and the reversed versions of all four. An LLM had to solve all eight scenarios to solve a single task. Older models solved no tasks; Generative Pre-trained Transformer (GPT)-3-davinci-003 (from November 2022) and ChatGPT-3.5-turbo (from March 2023) solved 20% of the tasks; ChatGPT-4 (from June 2023) solved 75% of the tasks, matching the performance of 6-y-old children observed in past studies. We explore the potential interpretation of these results, including the intriguing possibility that ToM-like ability, previously considered unique to humans, may have emerged as an unintended by-product of LLMs’ improving language skills. Regardless of how we interpret these outcomes, they signify the advent of more powerful and socially skilled AI—with profound positive and negative implications.

show abstract

Evaluating large language models in theory of mind tasks

Kosinski

2024

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

show abstract

Opportunities and Challenges to Conversations with Generative AI: Integrating Theoretical Perspectives from Clark and Pennebaker

Markowitz

2024

KSJCS_ONLINE

View full text Add to dashboard Cite

How ready is speech-to-text for psychological language research? Evaluating the validity of AI-generated English transcripts for analyzing free-spoken responses in younger and older adults

Pfeifer,

Chilton,

Grilli

et al. 2024

Behav Res

View full text Add to dashboard Cite

scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.

Contact Info

customersupport@researchsolutions.com

10624 S. Eastern Ave., Ste. A-614

Henderson, NV 89052, USA

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Blog Terms and Conditions API Terms Privacy Policy Contact Cookie Preferences Do Not Sell or Share My Personal Information

Made with 💙 for researchers

Part of the Research Solutions Family.

Verbal behavior and the future of social science.

Cited by 4 publications

References 177 publications

Evaluating large language models in theory of mind tasks

Evaluating large language models in theory of mind tasks

Opportunities and Challenges to Conversations with Generative AI: Integrating Theoretical Perspectives from Clark and Pennebaker

How ready is speech-to-text for psychological language research? Evaluating the validity of AI-generated English transcripts for analyzing free-spoken responses in younger and older adults

Contact Info

Product

Resources

About