Copertina

Evaluating the Capabilities of LLMs for Supporting Anticipatory Impact Assessment

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Allaham, Mowafak, Diakopoulos, Nicholas
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence Computers and Society
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Towards Leveraging News Media to Support Impact Assessment of AI Technologies
di: Allaham, Mowafak, et al.
Pubblicazione: (2024)

Synthetic Sources?: Auditing Generative Search Engine Citations for Evidence of AI-Generated Sources
di: Allaham, Mowafak, et al.
Pubblicazione: (2026)

Informing AI Risk Assessment with News Media: Analyzing National and Political Variation in the Coverage of AI Risks
di: Allaham, Mowafak, et al.
Pubblicazione: (2025)

Global Perspectives of AI Risks and Harms: Analyzing the Negative Impacts of AI Technologies as Prioritized by News Media
di: Allaham, Mowafak, et al.
Pubblicazione: (2025)

Simulating Policy Impacts: Developing a Generative Scenario Writing Method to Evaluate the Perceived Effects of Regulation
di: Barnett, Julia, et al.
Pubblicazione: (2024)

Multilingual != Multicultural: Evaluating Gaps Between Multilingual Capabilities and Cultural Alignment in LLMs
di: Rystrøm, Jonathan, et al.
Pubblicazione: (2025)

Informing AI Policy Assessment using Large-Scale Simulation of Interventions
di: Barnett, Julia, et al.
Pubblicazione: (2026)

Assessing the Performance of Human-Capable LLMs -- Are LLMs Coming for Your Job?
di: Mavi, John, et al.
Pubblicazione: (2024)

Enhancing LLMs for Governance with Human Oversight: Evaluating and Aligning LLMs on Expert Classification of Climate Misinformation for Detecting False or Misleading Claims about Climate Change
di: Allaham, Mowafak, et al.
Pubblicazione: (2025)

Envisioning Stakeholder-Action Pairs to Mitigate Negative Impacts of AI: A Participatory Approach to Inform Policy Making
di: Barnett, Julia, et al.
Pubblicazione: (2025)

Automated Assessment of Students' Code Comprehension using LLMs
di: Oli, Priti, et al.
Pubblicazione: (2023)

Frontier Lag: A Bibliometric Audit of Capability Misrepresentation in Academic AI Evaluation
di: Gringras, David, et al.
Pubblicazione: (2026)

Dr.Academy: A Benchmark for Evaluating Questioning Capability in Education for Large Language Models
di: Chen, Yuyan, et al.
Pubblicazione: (2024)

On the Credibility of Evaluating LLMs using Survey Questions
di: Libovický, Jindřich
Pubblicazione: (2026)

MEDEQUALQA: Evaluating Biases in LLMs with Counterfactual Reasoning
di: Ghosh, Rajarshi, et al.
Pubblicazione: (2025)

Using Generative Agents to Create Tip Sheets for Investigative Data Reporting
di: Veerbeek, Joris, et al.
Pubblicazione: (2024)

Evaluating Cultural Awareness of LLMs for Yoruba, Malayalam, and English
di: Dawson, Fiifi, et al.
Pubblicazione: (2024)

Not Wrong, But Untrue: LLM Overconfidence in Document-Based Queries
di: Hagar, Nick, et al.
Pubblicazione: (2025)

H-Neurons: On the Existence, Impact, and Origin of Hallucination-Associated Neurons in LLMs
di: Gao, Cheng, et al.
Pubblicazione: (2025)

Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs
di: Kabir, Mohsinul, et al.
Pubblicazione: (2025)

Are LLMs Court-Ready? Evaluating Frontier Models on Indian Legal Reasoning
di: Juvekar, Kush, et al.
Pubblicazione: (2025)

XCR-Bench: A Multi-Task Benchmark for Evaluating Cultural Reasoning in LLMs
di: Kabir, Mohsinul, et al.
Pubblicazione: (2026)

WHBench: Evaluating Frontier LLMs with Expert-in-the-Loop Validation on Women's Health Topics
di: Maurya, Sneha, et al.
Pubblicazione: (2026)

ClinBench-HPB: A Clinical Benchmark for Evaluating LLMs in Hepato-Pancreato-Biliary Diseases
di: Li, Yuchong, et al.
Pubblicazione: (2025)

RoleConflictBench: A Benchmark of Role Conflict Scenarios for Evaluating LLMs' Contextual Sensitivity
di: Shin, Jisu, et al.
Pubblicazione: (2025)

PLawBench: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice
di: Shi, Yuzhen, et al.
Pubblicazione: (2026)

EducationQ: Evaluating LLMs' Teaching Capabilities Through Multi-Agent Dialogue Framework
di: Shi, Yao, et al.
Pubblicazione: (2025)

Evaluating LLMs' Assessment of Mixed-Context Hallucination Through the Lens of Summarization
di: Qi, Siya, et al.
Pubblicazione: (2025)

The Political Preferences of LLMs
di: Rozado, David
Pubblicazione: (2024)

The simulation of judgment in LLMs
di: Loru, Edoardo, et al.
Pubblicazione: (2025)

Measuring Teaching with LLMs
di: Hardy, Michael
Pubblicazione: (2025)

Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge
di: Koutcheme, Charles, et al.
Pubblicazione: (2024)

Anticipatory Evaluation of Language Models
di: Park, Jungsoo, et al.
Pubblicazione: (2025)

Why are all LLMs Obsessed with Japanese Culture? On the Hidden Cultural and Regional Biases of LLMs
di: de Landa, Joseba Fernandez, et al.
Pubblicazione: (2026)

Moral Mazes in the Era of LLMs
di: Nguyen, Dang, et al.
Pubblicazione: (2026)

Are LLMs (Really) Ideological? An IRT-based Analysis and Alignment Tool for Perceived Socio-Economic Bias in LLMs
di: Wachter, Jasmin, et al.
Pubblicazione: (2025)

Interpretability Framework for LLMs in Undergraduate Calculus
di: Dakshit, Sagnik, et al.
Pubblicazione: (2025)

LocalValueBench: A Collaboratively Built and Extensible Benchmark for Evaluating Localized Value Alignment and Ethical Safety in Large Language Models
di: Meadows, Gwenyth Isobel, et al.
Pubblicazione: (2024)

From "Help" to Helpful: A Hierarchical Assessment of LLMs in Mental e-Health Applications
di: Steigerwald, Philipp, et al.
Pubblicazione: (2026)

Verbalizing LLMs' assumptions to explain and control sycophancy
di: Cheng, Myra, et al.
Pubblicazione: (2026)