ChatGPT, a language-learning model chatbot, has garnered considerable attention for its ability to respond to users’ questions. Using data from 14 countries and 186 institutions, we compare ChatGPT and student performance for 28,085 questions from accounting assessments and textbook test banks. As of January 2023, ChatGPT provides correct answers for 56.5 percent of questions and partially correct answers for an additional 9.4 percent of questions. When considering point values for questions, students significantly outperform ChatGPT with a 76.7 percent average on assessments compared to 47.5 percent for ChatGPT if no partial credit is awarded and 56.5 percent if partial credit is awarded. Still, ChatGPT performs better than the student average for 15.8 percent of assessments when we include partial credit. We provide evidence of how ChatGPT performs on different question types, accounting topics, class levels, open/closed assessments, and test bank questions. We also discuss implications for accounting education and research.
This study examines the effect of the reviewer role on tax professionals' advocacy bias. Prior research establishes the prevalence of advocacy bias and focuses on whether reviewers can detect preparers' advocacy bias; however, this study examines whether the reviewer role influences tax professionals' judgment and decision-making processes. In an experiment randomly assigning 75 tax professionals to the reviewer and preparer roles, I find professionals who occupy the reviewer role report similar advocacy attitudes to preparers but are significantly less likely to exhibit advocacy bias than preparers. Reviewers also employ a more consistent decision process than those in a preparer role. Results highlight the reviewer role as a moderator of advocacy bias, demonstrating the importance of the reviewer role for firms and clients. Understanding the effects of review responsibilities on professionals at all levels is increasingly important as firms leverage emerging technology to complete tasks traditionally assigned to less experienced professionals.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.