ChatGPT, a language-learning model chatbot, has garnered considerable attention for its ability to respond to users’ questions. Using data from 14 countries and 186 institutions, we compare ChatGPT and student performance for 28,085 questions from accounting assessments and textbook test banks. As of January 2023, ChatGPT provides correct answers for 56.5 percent of questions and partially correct answers for an additional 9.4 percent of questions. When considering point values for questions, students significantly outperform ChatGPT with a 76.7 percent average on assessments compared to 47.5 percent for ChatGPT if no partial credit is awarded and 56.5 percent if partial credit is awarded. Still, ChatGPT performs better than the student average for 15.8 percent of assessments when we include partial credit. We provide evidence of how ChatGPT performs on different question types, accounting topics, class levels, open/closed assessments, and test bank questions. We also discuss implications for accounting education and research.
Financial statement audits are mandated in most countries, thus making it difficult to distinguish between auditing driven by private incentives versus that driven by regulation. Who would ask for an audit, and how would its quality be assessed in the absence of regulation? Many private companies in Canada get their financial statements audited even though the law does not require it. In this field study, we conduct interviews to discover reasons for demanding an audit, and criteria used to assess their quality. Our study reveals that both internal stakeholders (management, boards, and employees) as well as external stakeholders (customers, banks, and private equity firms) request audits. Users evaluate audit quality based on a variety of criteria such as the auditor's accounting expertise, the absence of errors, the fees involved, risk assessments offered, allocation of effort, internal control, and general business advice. Implications for audit regulations are discussed.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.