Imagen de Portada

Inverse Constitutional AI: Compressing Preferences into Principles

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Findeis, Arduin, Kaufmann, Timo, Hüllermeier, Eyke, Albanie, Samuel, Mullins, Robert
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Feedback Forensics: A Toolkit to Measure AI Personality
por: Findeis, Arduin, et al.
Publicado: (2025)

Can External Validation Tools Improve Annotation Quality for LLM-as-a-Judge?
por: Findeis, Arduin, et al.
Publicado: (2025)

Problem Solving Through Human-AI Preference-Based Cooperation
por: Dutta, Subhabrata, et al.
Publicado: (2024)

Calibrated Preference Learning: The Case of Label Ranking
por: Thies, Santo M. A. R., et al.
Publicado: (2026)

C3AI: Crafting and Evaluating Constitutions for Constitutional AI
por: Kyrychenko, Yara, et al.
Publicado: (2025)

ConstitutionalExperts: Training a Mixture of Principle-based Prompts
por: Petridis, Savvas, et al.
Publicado: (2024)

OCALM: Object-Centric Assessment with Language Models
por: Kaufmann, Timo, et al.
Publicado: (2024)

Antithetic Sampling for Top-k Shapley Identification
por: Kolpaczki, Patrick, et al.
Publicado: (2025)

On-the-fly Preference Alignment via Principle-Guided Decoding
por: Zhu, Mingye, et al.
Publicado: (2025)

Evaluating the role of `Constitutions' for learning from AI feedback
por: Redgate, Saskia, et al.
Publicado: (2024)

The Quantum LLM: Modeling Semantic Spaces with Quantum Principles
por: Laine, Timo Aukusti
Publicado: (2025)

Controllable and explainable personality sliders for LLMs at inference time
por: Hoppe, Florian, et al.
Publicado: (2026)

Improving Labeling Consistency with Detailed Constitutional Definitions and AI-Driven Evaluation
por: Berlin, Konstantin, et al.
Publicado: (2026)

TokenRatio: Principled Token-Level Preference Optimization via Ratio Matching
por: Nguyen, Truong, et al.
Publicado: (2026)

Uncertainty Quantification as a Principled Foundation for Explainable Artificial Intelligence: A Case Study of Counterfactual Explanations
por: Sokol, Kacper, et al.
Publicado: (2025)

Clean First, Align Later: Benchmarking Preference Data Cleaning for Reliable LLM Alignment
por: Yeh, Samuel, et al.
Publicado: (2025)

Open Character Training: Shaping the Persona of AI Assistants through Constitutional AI
por: Maiya, Sharan, et al.
Publicado: (2025)

ResponseRank: Data-Efficient Reward Modeling through Preference Strength Learning
por: Kaufmann, Timo, et al.
Publicado: (2025)

Reverse Constitutional AI: A Framework for Controllable Toxic Data Generation via Probability-Clamped RLAIF
por: Fang, Yuan, et al.
Publicado: (2026)

Large language models struggle with ethnographic text annotation
por: Goodall, Leonardo S., et al.
Publicado: (2026)

Charting New Territories: Exploring the Geographic and Geospatial Capabilities of Multimodal LLMs
por: Roberts, Jonathan, et al.
Publicado: (2023)

Quantization Dominates Rank Reduction for KV-Cache Compression
por: Salfati, Samuel
Publicado: (2026)

Measuring Political Preferences in AI Systems: An Integrative Approach
por: Rozado, David
Publicado: (2025)

Humor in AI: Massive Scale Crowd-Sourced Preferences and Benchmarks for Cartoon Captioning
por: Zhang, Jifan, et al.
Publicado: (2024)

Pairwise Difference Learning for Classification
por: Belaid, Mohamed Karim, et al.
Publicado: (2024)

Is Human-Like Text Liked by Humans? Multilingual Human Detection and Preference Against AI
por: Wang, Yuxia, et al.
Publicado: (2025)

Does Claude's Constitution Have a Culture?
por: Pourdavood, Parham
Publicado: (2026)

Epistemic Constitutionalism Or: how to avoid coherence bias
por: Loi, Michele
Publicado: (2026)

Aligning Large Language Models from Self-Reference AI Feedback with one General Principle
por: Bao, Rong, et al.
Publicado: (2024)

Principled Fine-tuning of LLMs from User-Edits: A Medley of Preference, Supervision, and Reward
por: Misra, Dipendra, et al.
Publicado: (2026)

LRHP: Learning Representations for Human Preferences via Preference Pairs
por: Wang, Chenglong, et al.
Publicado: (2024)

Preference Packing: Efficient Preference Optimization for Large Language Models
por: Cho, Jaekyung
Publicado: (2026)

Preference Curriculum: LLMs Should Always Be Pretrained on Their Preferred Data
por: Zhang, Xuemiao, et al.
Publicado: (2025)

CAPO: Confidence Aware Preference Optimization Learning for Multilingual Preferences
por: Pokharel, Rhitabrat, et al.
Publicado: (2025)

Balancing Safety and Helpfulness in Healthcare AI Assistants through Iterative Preference Alignment
por: Nghiem, Huy, et al.
Publicado: (2025)

Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment
por: Zhang, Jianfei, et al.
Publicado: (2024)

Capturing Nuanced Preferences: Preference-Aligned Distillation for Small Language Models
por: Gu, Yanggan, et al.
Publicado: (2025)

FocalPO: Enhancing Preference Optimizing by Focusing on Correct Preference Rankings
por: Liu, Tong, et al.
Publicado: (2025)

LuxVeri at GenAI Detection Task 1: Inverse Perplexity Weighted Ensemble for Robust Detection of AI-Generated Text across English and Multilingual Contexts
por: Mobin, Md Kamrujjaman, et al.
Publicado: (2025)

Whose Preferences? Differences in Fairness Preferences and Their Impact on the Fairness of AI Utilizing Human Feedback
por: Lerner, Emilia Agis, et al.
Publicado: (2024)