AI Assistance in Legal Analysis: An Empirical Study

Artificial Intelligence Quotient (AIQ)

“…First, the correlations among the human+AI performance scores on the four tasks are all positive and significant (Ps < 0.05; Table S3). 3 Second, a factor analysis (principal component analysis) of the human+AI performance scores on the four tasks yields one factor with an eigenvalue of 1.51 (factors with an eigenvalue larger than 1 are worth retaining because such factors explain more variance than does any single task in the analysis) (62). This factor accounts for a large proportion of the variance (37.9%).…”

“…Artificial intelligence (AI), or "machine(s) performing human-like cognitive functions (e.g., learning, understanding, reasoning, or interacting)" (2), is increasingly used across diverse domains (e.g., science, business, medicine, and law) (3)(4)(5)(6)(7). Thus, the ability to use AI is becoming essential for individuals, organizations, and society at large.…”

“…Specifically, for each of the four tasks, we used the other three tasks to compute a "restricted" AIQ 4 (using the formula above); this score was then used to predict performance on the fourth (left-out) task. 3 Researchers "recommend that the average interitem correlation fall in the range of .15-.50 (see Briggs & Cheek, 1986). This rather wide range is suggested because the optimal value necessarily will vary with the generality versus specificity of the target construct.…”

Artificial intelligence and wage inequality

“…Data are from 2012, with the exception of Hungary (2017) and Lithuania (2014). 21 The prevalence of creative and social tasks is derived from PIAAC data. PIAAC data include the frequency with which a number of tasks are performed at the individual level.…”

Challenges in Adapting LLMs for Transparency: Complying with Art. 14 EU AI Act

“…In the legal domain, [4] showcased the requirements and challenges of directly using GenAI systems in legal decision-making via the GPTJudge system. The use of AI assistance in legal analysis was presented in [5]. A repurposable fictional dataset and basic XAI system was presented in [6].…”