The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang

Documenti analoghi

• Achieving Gold-Medal-Level Olympiad Reasoning via Simple and Unified Scaling
  di: Li, Yafu, et al.
  Pubblicazione: (2026)
• Creating ConLangs to Probe the Metalinguistic Grammatical Knowledge of LLMs
  di: Taguchi, Chihiro, et al.
  Pubblicazione: (2025)
• A Benchmark for the Detection of Metalinguistic Disagreements between LLMs and Knowledge Graphs
  di: Allen, Bradley P., et al.
  Pubblicazione: (2025)
• Scaling Test-Time Compute to Achieve IOI Gold Medal with Open-Weight Models
  di: Samadi, Mehrzad, et al.
  Pubblicazione: (2025)
• Large Language Models Achieve Gold Medal Performance at the International Olympiad on Astronomy & Astrophysics (IOAA)
  di: Pinheiro, Lucas Carrit Delgado, et al.
  Pubblicazione: (2025)