The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientation

Hartmann, Jochen; Schwenzow, Jasper; Witte, Maximilian

doi:10.48550/arxiv.2301.01768

Cited by 29 publications

(33 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…These biases may arise from the fact that ChatGPT models have been trained on human-generated text and reinforcement learning from human feedback to better align with human values [74,75]. In particular, ChatGPT outputs could potentially contain biases toward political leanings [76][77][78][79]. These possible biases are unlikely to have affected the results of Study 1, because ChatGPT was tasked to provide numeric scores and not to generate new ideas.…”

Section: Discussionmentioning

confidence: 99%

Using ChatGPT for human–computer interaction research: a primer

Tabone,

de Winter

2023

R. Soc. open sci.

View full text Add to dashboard Cite

ChatGPT could serve as a tool for text analysis within the field of Human–Computer Interaction, though its validity requires investigation. This study applied ChatGPT to: (1) textbox questionnaire responses on nine augmented-reality interfaces, (2) interview data from participants who experienced these interfaces in a virtual simulator, and (3) transcribed think-aloud data of participants who viewed a real painting and its replica. Using a hierarchical approach, ChatGPT produced scores or summaries of text batches, which were then aggregated. Results showed that (1) ChatGPT generated sentiment scores of the interfaces that correlated extremely strongly ( r > 0.99) with human rating scale outcomes and with a rule-based sentiment analysis method (criterion validity). Additionally, (2) by inputting automatically transcribed interviews to ChatGPT, it provided meaningful meta-summaries of the qualities of the interfaces (face validity). One meta-summary analysed in depth was found to have substantial but imperfect overlap with a content analysis conducted by an independent researcher (criterion validity). Finally, (3) ChatGPT's summary of the think-aloud data highlighted subtle differences between the real painting and the replica (face validity), a distinction corresponding with a keyword analysis (criterion validity). In conclusion, our research indicates that, with appropriate precautions, ChatGPT can be used as a valid tool for analysing text data.

show abstract

Section: Discussionmentioning

confidence: 99%

Using ChatGPT for human–computer interaction research: a primer

Tabone,

de Winter

2023

R. Soc. open sci.

View full text Add to dashboard Cite

show abstract

“…There have been concerns raised about the political leanings of ChatGPT. After being tested with 630 political statements, a study by Hartmann et al [25] suggested that ChatGPT has a left-libertarian ideology that is pro-environment. Another analysis 13 showed that ChatGPT's responses demonstrated a preference for left-leaning perspectives in 14 out of 15 political orientation tests 14 .…”

Section: Ethics and Moralitymentioning

confidence: 99%

A Categorical Archive of ChatGPT Failures

Borji¹

2023

Preprint

156

View full text Add to dashboard Cite

Large language models have been demonstrated to be valuable in different fields. ChatGPT, developed by OpenAI, has been trained using massive amounts of data and simulates human conversation by comprehending context and generating appropriate responses. It has garnered significant attention due to its ability to effectively answer a broad range of human inquiries, with fluent and comprehensive answers surpassing prior public chatbots in both security and usefulness. However, a comprehensive analysis of ChatGPT’s failures is lacking, which is the focus of this study. Eleven categories of failures, including reasoning, factual errors, math, coding, and bias, are presented and discussed. The risks, limitations, and societal implications of ChatGPT are also highlighted. The goal of this study is to assist researchers and developers in enhancing future language models and chatbots. Please refer to here for the list of questions.

show abstract

“…ChatGPT explains that it cannot think for itself. He also has filters that prevent him from creating texts about illegal or immoral activities (Hartmann, Schwenzow, & Witte, 2023). For example, the bot will not answer how to break into someone else's apartment.…”

Section: How the Model Differs From Other Text Neural Network?mentioning

confidence: 99%

“…Journalist Ben Tossel compiled some impressive responses from ChatGPT in one Twitter thread. One can only assess them and highlight the most interesting ones (Hartmann, Schwenzow, & Witte, 2023).…”

Section: What Can This Model Respond With?mentioning

confidence: 99%

“…A Google researcher rated an essay on the difference in approaches to nationalism by political scientists Benedict Anderson and Ernest Gellner a five-plus. ChatGPT wrote it in ten seconds (Hartmann, Schwenzow, & Witte, 2023). A University of Toronto professor rated several AI-generated essays with B's and A's, adding that it no longer makes sense to give homework to students.…”

Section: What Can This Model Respond With?mentioning

confidence: 99%

See 1 more Smart Citation

Voice Assistant Integrated with Chat GPT

Shafeeg¹,

Shazhaev²,

Mihaylov

et al. 2023

ijcs

View full text Add to dashboard Cite

AI has become deeply ingrained in the everyday life. The matter in question does not only touch upon the mobile phones that almost everyone carries within easy reach. Today, voice assistants and smart speakers are mainly used to turn on music, turn off the lights or forecast the weather. AI chatbots are getting smarter. The use of new technologies and the general development of neural networks makes it possible to chat or answer questions, write a script, a scientific work, or program code. One of the key differences from previous GPTs is that the new version is trained to continue the text and answer questions. The answers that the bot gives surprise users around the world. Yes, there are still questions about these answers and their validity, and everyone is sure that technology needs to be improved. For a technology to become revolutionary, it must find a better, new, breakthrough application. Although no, such an application has already been invented. Farcana decided to combine the functionality of the GPT chatbot and a voice assistant. By offering players a new approach to familiarizing themselves with game mechanics and general account management, Farcana promotes its advantages over others and rapidly contributes to AI's overall development in the digital society.

show abstract

The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientation

Cited by 29 publications

References 0 publications

Using ChatGPT for human–computer interaction research: a primer

Using ChatGPT for human–computer interaction research: a primer

A Categorical Archive of ChatGPT Failures

Voice Assistant Integrated with Chat GPT

Contact Info

Product

Resources

About