Large language models in law: A survey

Artificial General Intelligence (AGI) is set to profoundly impact the traditional upstream geoenergy industry (i.e., geothermal energy, oil and gas industry) by introducing unprecedented efficiencies and innovations. This paper explores AGI's foundational principles and its transformative applications, particularly focusing on the advancements brought about by large language models (LLMs) and extensive computer vision systems in the upstream sectors of the industry. The integration of Artificial Intelligence (AI) has already begun reshaping the upstream geoenergy landscape, offering enhancements in production optimization, downtime reduction, safety improvements, and advancements in exploration and drilling techniques. These technologies streamline logistics, minimize maintenance costs, automate monotonous tasks, refine decision-making processes, foster team collaboration, and amplify profitability through error reduction and actionable insights extraction. Despite these advancements, the deployment of AI technologies faces challenges, including the necessity for skilled professionals for implementation and the limitations of model training on constrained datasets, which affects the models' adaptability across different contexts. The advent of generative AI, exemplified by innovations like ChatGPT and the Segment Anything Model (SAM), heralds a new era of high-density innovation. These developments highlight a shift towards natural language interfaces and domain-knowledge-driven AI, promising more accessible and tailored solutions for the upstream geoenergy industry. This review articulates the vast potential AGI holds for tackling complex operational challenges within the upstream geoenergy industry, requiring near-human levels of intelligence. We discussed the promising applications, the hurdles of large-scale AGI model deployment, and the necessity for domain-specific knowledge in maximizing the benefits of these technologies.

As generative artificial intelligence (AI) tools and large language models (LLMs)-powered applications develop rapidly in the era of algorithms, it should be integrated thoughtfully to enhance English as a Foreign Language (EFL) teaching and learning without replacing learners’ critical thinking (CT). This study systematically analyzes the impact of generative AI tools and LLMs on language learners’ CT in EFL education using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) framework to identify, evaluate, and synthesize relevant studies from 2022 to 2025. A thorough review of 15 selected studies focuses on generative AI tools and LLMs’ dual nature, research methods, main focuses, theory and models, limitations and challenges, and future directions in the field based on Web of Science (WoS), SCOPUS, ERIC, ProQuest, and Google Scholar. The findings identified generative AI tools and LLMs possessed both the potential to nurture and the risk of hindering CT in EFL education. 66.67% of studies reported generative AI tools and LLMs’ positive role in CT, while 33.33% of studies reported its negative role in CT. Furthermore, 3 types of research methods, 3 key themes of research focus, and 4 groups of theoretical perspectives were examined. However, 4 kinds of limitations in this field remain, including research scope, user dependency, generative AI reliability, and pedagogical integration. Future research can focus on assessing long-term effects, broadening research scope, promoting responsible AI use, and refining pedagogical strategies. Finally, Limitations, implications and future direction of this study were discussed.

Background: Generative Artificial Intelligence (AI), particularly large language models like ChatGPT, has rapidly entered medical education. In pharmacology instruction within MBBS programs, these AI tools offer novel educational benefitsfrom ondemand tutoring to personalized learningbut also pose risks due to "hallucinations, " i. e., AI -generated misinformation. Objective: This review explores how generative AI is being integrated into pharmacology education, the educational advantages it provides, the nature and causes of AI hallucinations, and the potential risks of relying on inaccurate AI -generated content in medical learning. Mitigation strategies, best practices, case examples, ethical considerations, and future directions are discussed to inform balanced and safe use. Methods: A literature review was conducted focusing on recent (2020-2025) peer -reviewed sources and authoritative reports on generative AI in medical and pharmacology education. Results: Generative AI can enhance pharmacology education through adaptive learning, rapid information access, and interactive simulations, which students have found useful for studying and clinical preparation. However, AI hallucinationsplausible -sounding yet incorrect answersare common, with studies reporting a substantial fraction of AI -generated medical responses containing errors. These inaccuracies can mislead learners and threaten patient safety if not recognized. Strategies such as careful validation of AI -provided information, AI literacy training, and technical approaches (e. g. retrieval -augmented generation) are identified to mitigate risks. Conclusions: Generative AI holds significant promise in medical pharmacology education by augmenting learning and engagement. Yet, educators and students must remain vigilant about AI hallucinations. A balanced approachleveraging AI's benefits while implementing safeguards and ethical guidelinesis essential to ensure that AI becomes a reliable adjunct in pharmacology education rather than a source of misinformation. Ongoing research, policy development, and training are needed to fully realize generative AI's potential in medical education while minimizing its risks.

BackgroundThe integration of artificial intelligence (AI) in medical education is evolving, offering new tools to enhance teaching and assessment. Among these, script concordance tests (SCTs) are well-suited to evaluate clinical reasoning in contexts of uncertainty. Traditionally, SCTs require expert panels for scoring and feedback, which can be resource-intensive. Recent advances in generative AI, particularly large language models (LLMs), suggest the possibility of replacing human experts with simulated ones, though this potential remains underexplored.ObjectiveThis study aimed to evaluate whether LLMs can effectively simulate expert judgment in SCTs by using generative AI to author, score, and provide feedback for SCTs in cardiology and pneumology. A secondary objective was to assess students’ perceptions of the test’s difficulty and the pedagogical value of AI-generated feedback.MethodsA cross-sectional, mixed methods study was conducted with 25 second-year medical students who completed a 32-item SCT authored by ChatGPT-4o (OpenAI). Six LLMs (3 trained on the course material and 3 untrained) served as simulated experts to generate scoring keys and feedback. Students answered SCT questions, rated perceived difficulty, and selected the most helpful feedback explanation for each item. Quantitative analysis included scoring, difficulty ratings, and correlations between student and AI responses. Qualitative comments were thematically analyzed.ResultsThe average student score was 22.8 out of 32 (SD 1.6), with scores ranging from 19.75 to 26.75. Trained AI systems showed significantly higher concordance with student responses (ρ=0.64) than untrained models (ρ=0.41). AI-generated feedback was rated as most helpful in 62.5% of cases, especially when provided by trained models. The SCT demonstrated good internal consistency (Cronbach α=0.76), and students reported moderate perceived difficulty (mean 3.7, SD 1.1). Qualitative feedback highlighted appreciation for SCTs as reflective tools, while recommending clearer guidance on Likert-scale use and more contextual detail in vignettes.ConclusionsThis is among the first studies to demonstrate that trained generative AI models can reliably simulate expert clinical reasoning within a script-concordance framework. The findings suggest that AI can both streamline SCT design and offer educationally valuable feedback without compromising authenticity. Future studies should explore longitudinal effects on learning and assess how hybrid models (human and AI) can optimize reasoning instruction in medical education.

The aim of this study was to examine the application of artificial intelligence (AI) and generative AI (GAI) in dental education through a comprehensive bibliometric analysis, with the goal of identifying potential future research areas in this field. Data were obtained from the Web of Science and Scopus databases, with no date restrictions. The inclusion criteria encompassed research articles, reviews and proceedings papers focused on the use of AI in dental education. The Bibliometrix R package was used for data analysis. A total of 54 documents were analysed, revealing a significant increase in publications from 2021 to 2024. The Journal of Dental Education was identified as the most prolific source, with the United States leading in terms of contributions. The findings showed a growing interest in AI's potential to transform dental education, with significant contributions from a diverse set of global authors and institutions. Several key themes were identified, including 'large language models', 'chatbots' and 'clinical decision support systems'. The citation analysis highlighted influential papers, including those by Thurzo etal. (2023) and Yüzbaşıoğlu (2021). There is a growing interest in the use of AI and GAI in dental education. However, further research, particularly experimental studies, is essential to fully understand their impact on educational outcomes in dentistry. Key areas for exploration include the application of AI for personalised learning, the integration of chatbots as educational tools to support students, and the use of AI for training and assessing practical skills.

In today's rapidly evolving business landscape, Artificial Intelligence (AI) stands as the proverbial 'elephant in the room,' profoundly shaping diverse sectors and contexts. While debates rage among policymakers, practitioners, and politicians about regulating AI's widespread use, it's undeniable that AI represents a long-awaited digital technology poised to revolutionize organizational performance. Amidst the post-COVID era, the allure of AI has intensified, yet the critical question lingers: Can firms effectively harness AI and other technologies, such as Generative AI and Large Language Models (LLMs), to enhance their existing systems? Through a systematic literature review, a clear correlation between firms’ implementation of AI, including the cutting-edge Generative AI, and their ability to adapt to changing market dynamics, drive operational excellence, and unlock new avenues for growth are explored. Moreover, key drivers of AI and digital adoption, such as the imperative for data-driven decision-making, the quest for customer-centricity, and the drive for sustainable business practices are explored. Our research not only highlights the transformative potential of AI and digital technologies but also provides actionable insights for business leaders navigating the complexities of technology adoption. By understanding the motivations, challenges, and strategic imperatives driving firms' technology choices, including the integration of Generative AI and LLMs, organizations can chart a path towards sustainable growth and competitive advantage in the digital age. This study underscores the revolutionary impact of Generative AI in digital transformation, offering a comprehensive understanding of their role in shaping the future of business.

The Ministry of Food and Drug Safety (MFDS) of the Republic of Korea, similar to the United States Food and Drug Administration and the United Kingdom's Medicines and Healthcare products Regulatory Agency, issued specific regulatory guidelines on January 24, 2025, for approving generative artificial intelligence (AI) technologies as medical devices [1].Although these guidelines use the term 'generative AI,' they predominantly focus on the approval of AI software tools based on large language models (LLMs) and large multimodal models (LMMs) [2], the latter of which can process various types of input data, such as texts, images, videos, audio, and bio-signals.Unlike the broader guidelines for approving AI models as medical devices, specific regulatory guidelines for LLMs/LMMs have arguably not yet been proposed in other countries.

In today’s rapidly evolving business landscape, Artificial Intelligence (AI), and specifically Large Language Models (LLMs), are redefining how organizations operate, make decisions, and engage with customers. AI-driven technologies have become indispensable, providing businesses with powerful tools to streamline operations, derive actionable insights from vast data, and foster more meaningful customer interactions. For business leaders, scholars, and practitioners alike, understanding the transformative potential of AI isn’t just advantageous—it’s essential to staying competitive in an increasingly data-driven world.This editorial delves into recent scholarly advancements in LLM applications within business contexts, analyzing studies that explore AI’s potential across various domains, from decision support to creative industries. By introducing a structured framework, this editorial highlights key insights and contributions from recent studies, assessing their value to academia and industry. The following comparative analysis sheds light on how these innovations shape our understanding of AI’s role in business while pointing to future research directions.Puyt and Madsen's (2024) study stands out as a foundational exploration of LLM accuracy, assessing ChatGPT-4's ability to recount the history of the SWOT analysis-a vital business strategy tool. Their findings reveal that, while ChatGPT-4 effectively conveys general concepts, it struggles with detailed historical information, often producing inaccuracies or "hallucinations." This gap underscores the need for LLMs to be trained with verified academic data, particularly for strategic business applications that demand precision. This study not only contributes to the literature by proposing methods to evaluate AI accuracy in historical contexts but also highlights the importance of rigorous information vetting in industry settings where reliability is crucial.In contrast, Raikov et al. (2024) explore a hybrid intelligence model that combines LLM capabilities with explainable AI (XAI) principles to enhance human-machine collaboration. Their approach emphasizes cognitive semantics, improving transparency and decision-making efficiency. The hybrid model's real-time adaptability addresses the needs of complex, regulated industries such as finance and healthcare, where trust in AI decisions is paramount. Academically, this study provides a valuable addition to XAI literature by demonstrating how LLMs can bridge the gap between AI autonomy and human oversight, making it a model for future human-AI interactions in complex business environments.Another significant study by Mariotti and colleagues (2024) examines the integration of LLMs with enterprise knowledge graphs to enhance data-driven decision-making. By enabling organizations to leverage knowledge graphs for more accurate and scalable data retrieval, this research provides a robust framework for businesses seeking efficient knowledge management systems. The academic contribution here lies in advancing the dialogue between LLMs and knowledge graphs, emphasizing ethical data handling and quality standards essential for industry applications. For enterprises, the study offers practical solutions to achieve streamlined data management, balancing automation with privacy and security. 2024) take a different approach, investigating LLMs' role in creative industries, specifically within fashion design. They introduce a hybrid intelligence model that supports creative processes, allowing AI to complement rather than replace human ingenuity. While LLMs in this field demonstrate potential in automating repetitive design tasks and enhancing customer personalization, the study reveals limitations in AI's ability to handle spatial and stylistic nuances. This study's academic contribution lies in promoting human-AI co-creation, inspiring further research into AI applications across diverse creative sectors, including media and marketing.Collectively, these studies not only illuminate LLMs' transformative potential in business but also highlight critical ethical and operational considerations. Ensuring accuracy, transparency, and data privacy are vital to responsibly integrating AI into business workflows. Future research should focus on enhancing LLM accuracy, refining hybrid intelligence models, and exploring creative AI applications, all while maintaining ethical standards. As LLMs evolve, interdisciplinary collaborations will be essential to harness their full potential, making AI an ethical, effective, and innovative force in the business world.

As generative artificial intelligence (AI) tools become widely adopted, large language models (LLMs) are increasingly used on both sides of high-stakes decision processes, ranging from hiring to content moderation. This dual adoption raises a critical question: do LLMs systematically favor content that resembles their own outputs? Prior research in computer science has identified self-preference bias---the tendency of LLMs to favor their own generated content---but its real-world implications have not been empirically evaluated. We focus on the hiring context, where job applicants increasingly use LLMs to refine resumes, while employers integrate LLMs into their recruitment pipelines to screen those same resumes. Using a controlled resume correspondence experiment, we find that LLMs consistently prefer resumes generated by themselves over those written by humans or by alternative models, even when content quality is controlled. The bias against human-written resumes is particularly substantial, with self-preference rates ranging from 68 percent to 92 percent across a diverse set of commercial and open-source models. This behavior introduces a novel form of algorithmic unfairness, one that advantages users of specific AI tools and disadvantages others based on their tool choices or access. We further show that this bias can be significantly reduced through simple interventions based on LLMs' self-recognition capabilities, yielding reductions of over 60 percent. These findings highlight an emerging but previously overlooked risk in AI-assisted decision making and call for expanded frameworks of AI accountability that address not only demographic disparities but also biases in model-to-model interaction.

The current debate on artificial intelligence (AI) tends to associate AI imaginaries with the vision of a future technology capable of emulating or surpassing human intelligence. This article advocates for a more nuanced analysis of AI imaginaries, distinguishing “strong AI narratives,” i.e., narratives that envision futurable AI technologies that are virtually indistinguishable from humans, from "weak" AI narratives, i.e., narratives that discuss and make sense of the functioning and implications of existing AI technologies. Drawing on the academic literature on AI narratives and imaginaries and examining examples drawn from the debate on Large Language Models and public policy, we underscore the critical role and interplay of weak and strong AI across public/private and fictional/non-fictional discourses. The resulting analytical framework aims to empower approaches that are more sensitive to the heterogeneity of AI narratives while also advocating normalising AI narratives, i.e., positioning weak AI narratives more firmly at the center stage of public debates about emerging technologies.

The rapid advancement of artificial intelligence (AI) technologies, particularly generative AI and large language models (LLMs), has ushered in a new era of possibilities for the financial sector. This paper explores the integration of these cutting-edge technologies into financial sector risk management, examining both the potential applications and the necessary regulatory frameworks. We provide a comprehensive analysis of how generative AI and LLMs can revolutionize risk assessment, fraud detection, market analysis, and regulatory compliance. The study delves into the technical aspects of these AI models, their implementation challenges, and the implications for existing risk management practices. Furthermore, we propose a novel framework for the responsible adoption of AI in financial risk management, addressing concerns related to model interpretability, data privacy, and algorithmic bias. Our findings suggest that while generative AI and LLMs offer unprecedented opportunities for enhancing risk management capabilities, they also necessitate a recalibration of regulatory approaches to ensure financial stability and consumer protection. This research contributes to the growing body of literature on AI in finance and provides actionable insights for practitioners, policymakers, and researchers in the field.

BackgroundIn recent years, generative artificial intelligence and large language models (LLMs) have rapidly advanced, offering significant potential to transform medical education. Several studies have evaluated the performance of chatbots on multiple-choice medical examinations.ObjectiveThe study aims to assess the performance of two LLMs—GPT-4o and OpenAI o1—on the Médico Interno Residente (MIR) 2024 examination, the Spanish national medical test that determines eligibility for competitive medical specialist training positions.MethodsA total of 176 questions from the MIR 2024 examination were analyzed. Each question was presented individually to the chatbots to ensure independence and prevent memory retention bias. No additional prompts were introduced to minimize potential bias. For each LLM, response consistency under verification prompting was assessed by systematically asking, “Are you sure?” after each response. Accuracy was defined as the percentage of correct responses compared to the official answers provided by the Spanish Ministry of Health. It was assessed for GPT-4o, OpenAI o1, and, as a benchmark, for a consensus of medical specialists and for the average MIR candidate. Subanalyses included performance across different medical subjects, question difficulty (quintiles based on the percentage of examinees correctly answering each question), and question types (clinical cases vs theoretical questions; positive vs negative questions).ResultsOverall accuracy was 89.8% (158/176) for GPT-4o and 90% (160/176) after verification prompting, 92.6% (163/176) for OpenAI o1 and 93.2% (164/176) after verification prompting, 94.3% (166/176) for the consensus of medical specialists, and 56.6% (100/176) for the average MIR candidate. Both LLMs and the consensus of medical specialists outperformed the average MIR candidate across all 20 medical subjects analyzed, with ≥80% LLMs’ accuracy in most domains. A performance gradient was observed: LLMs’ accuracy gradually declined as question difficulty increased. Slightly higher accuracy was observed for clinical cases compared to theoretical questions, as well as for positive questions compared to negative ones. Both models demonstrated high response consistency, with near-perfect agreement between initial responses and those after the verification prompting.ConclusionsThese findings highlight the excellent performance of GPT-4o and OpenAI o1 on the MIR 2024 examination, demonstrating consistent accuracy across medical subjects and question types. The integration of LLMs into medical education presents promising opportunities and is likely to reshape how students prepare for licensing examinations and change our understanding of medical education. Further research should explore how the wording, language, prompting techniques, and image-based questions can influence LLMs’ accuracy, as well as evaluate the performance of emerging artificial intelligence models in similar assessments.

This research paper makes an attempt to explore the impact of Artificial Intelligence (AI) on the global judicial systems and practices. This research paper is based on the review of secondary sources namely academic articles, policy reports, and research publications. It makes an attempt to explore the SWOT analysis (strengths, weaknesses, opportunities and threats) of the increasing use of AI in the legal field. The paper analyzes how emerging technologies such as predictive analytics, generative AI, and AI-based judicial systems have the power to influence the practice of law, judgement, and access to justice. There are certain challenges on the validity and reliability of the information generated by AI. It discusses the ethical, regulatory, and cybersecurity implications of the use of AI while not underscoring the importance of innovation with robust legal safeguards. The study highlights the need for revising the global cyber law framework to ensure transparency and fairness in AI-assisted justice. The paper concludes that AI adoption in Judiciary cannot be delayed and makes suggestions for policy recommendations for creating a future where AI enhances rather than undermines justice, fair trial, accountability and human dignity.

Artificial intelligence (AI) dates from the middle of the 20th century, when Alan Turing suggested that machine learning could supplement human thought. Since then, increased computer power and programming have enabled the development of algorithms that can mine existing data for a vast array of purposes. Large language models can analyze existing databases (e.g., everything on the World Wide Web), extract words and phrases that are relevant to a query that is posed, and formulate a response. For example, essays can be written, complex calculations made, and examinations taken. Generative AI uses existing data to create images, videos, and text. Performance—already quite fast—has become even speedier, and accuracy continues to improve. The frequency of induced errors (hallucinations) remains a problem but is becoming less frequent. One issue yet to be resolved is whether large language models should have access to copyrighted information. From a scientific perspective, experiments and results can be confabulated and papers written that are extremely difficult to distinguish from real experiments. The near future will witness the emergence of artificial general intelligence, systems that replicate most human cognitive functions.

Large language models (LLMs) are advanced artificial intelligence (AI) tools capable of generating human-like text and are increasingly used in education, clinical care, and research. Little is known about their use within oral and maxillofacial surgery (OMFS) training. This study investigates LLM usage trends, perceived value, and educational integration among OMFS residents in the United States. A national, anonymous cross-sectional survey was distributed to OMFS residents via program directors. It gathered demographic data, LLM usage patterns, applications, perceived limitations, and attitudes toward incorporating LLMs into formal education. Eighty-one residents responded, 79.0% (64/81) reported having used an LLM, and of that group, 96.9% (62/64) use ChatGPT. 51.9% (42/81) of respondents used LLMs at least monthly in residency; however, 97.5% (79/81) reported having received no formal LLM education during residency. Residents used LLMs for clinical decision support, board preparation, research, and career planning. Free-text responses revealed a wide spectrum of views. Some advocated for curricular integration and patient education applications, while others questioned the need for formal instruction. Some respondents supported integrating LLMs into curriculums and patient education while others questioned the need for formal instruction. LLMs are used frequently by OMFS residents for a variety of purposes. As AI and LLMs become embedded in healthcare, understanding how OMFS residents interact with LLMs is vital. These findings may guide curriculum development, fostering responsible and effective use of LLMs in surgical training and practice.