$Imagen de Portada$

OpenAI-o1 AB Testing: Does the o1 model really do good reasoning in math problem solving?

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Li, Leo, Luo, Ye, Pan, Tingyou
Formato:	Preprint
Publicado:	2024
Materias:	Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

OpenAI o1 System Card
por: OpenAI, et al.
Publicado: (2024)

When a language model is optimized for reasoning, does it still show embers of autoregression? An analysis of OpenAI o1
por: McCoy, R. Thomas, et al.
Publicado: (2024)

On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability
por: Wang, Kevin, et al.
Publicado: (2024)

Can OpenAI o1 outperform humans in higher-order cognitive thinking?
por: Latif, Ehsan, et al.
Publicado: (2024)

A Systematic Assessment of OpenAI o1-Preview for Higher Order Thinking in Education
por: Latif, Ehsan, et al.
Publicado: (2024)

Understanding and Benchmarking Artificial Intelligence: OpenAI's o3 Is Not AGI
por: Pfister, Rolf, et al.
Publicado: (2025)

Testing GPT-4-o1-preview on math and science problems: A follow-up study
por: Davis, Ernest
Publicado: (2024)

Early External Safety Testing of OpenAI's o3-mini: Insights from the Pre-Deployment Evaluation
por: Arrieta, Aitor, et al.
Publicado: (2025)

System 2 thinking in OpenAI's o1-preview model: Near-perfect performance on a mathematics exam
por: de Winter, Joost, et al.
Publicado: (2024)

OpenAI GPT-5 System Card
por: Singh, Aaditya, et al.
Publicado: (2025)

Reinforcement learning fine-tuning of language model for instruction following and math reasoning
por: Han, Yifu, et al.
Publicado: (2025)

Privacy and Security Threat for OpenAI GPTs
por: Wenying, Wei, et al.
Publicado: (2025)

LLMs Still Can't Plan; Can LRMs? A Preliminary Evaluation of OpenAI's o1 on PlanBench
por: Valmeekam, Karthik, et al.
Publicado: (2024)

The Phenomenology of Machine: A Comprehensive Analysis of the Sentience of the OpenAI-o1 Model Integrating Functionalism, Consciousness Theories, Active Inference, and AI Architectures
por: Hoyle, Victoria Violet
Publicado: (2024)

Can OpenAI o1 Reason Well in Ophthalmology? A 6,990-Question Head-to-Head Evaluation Study
por: Srinivasan, Sahana, et al.
Publicado: (2025)

How well do LLMs reason over tabular data, really?
por: Wolff, Cornelius, et al.
Publicado: (2025)

To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning
por: Sprague, Zayne, et al.
Publicado: (2024)

DeepSeek-R1 Outperforms Gemini 2.0 Pro, OpenAI o1, and o3-mini in Bilingual Complex Ophthalmology Reasoning
por: Xu, Pusheng, et al.
Publicado: (2025)

An Empirical Study of OpenAI API Discussions on Stack Overflow
por: Chen, Xiang, et al.
Publicado: (2025)

On stress-related behavior patterns in OpenAI's o3-mini model: analysis and mitigations
por: Levchenko, Anastasia, et al.
Publicado: (2025)

Give me a hint: Can LLMs take a hint to solve math problems?
por: Agrawal, Vansh, et al.
Publicado: (2024)

Comparative Analysis of OpenAI GPT-4o and DeepSeek R1 for Scientific Text Categorization Using Prompt Engineering
por: Maiti, Aniruddha, et al.
Publicado: (2025)

OpenAI's Approach to External Red Teaming for AI Models and Systems
por: Ahmad, Lama, et al.
Publicado: (2025)

Benchmarking Floworks against OpenAI & Anthropic: A Novel Framework for Enhanced LLM Function Calling
por: Bhan, Nirav, et al.
Publicado: (2024)

A Case Study of Web App Coding with OpenAI Reasoning Models
por: Cui, Yi
Publicado: (2024)

Testing GPT-4 with Wolfram Alpha and Code Interpreter plug-ins on math and science problems
por: Davis, Ernest, et al.
Publicado: (2023)

Evaluating Text Summaries Generated by Large Language Models Using OpenAI's GPT
por: Shakil, Hassan, et al.
Publicado: (2024)

FinAI Data Assistant: LLM-based Financial Database Query Processing with the OpenAI Function Calling API
por: Kim, Juhyeong, et al.
Publicado: (2025)

MTUncertainty: Assessing the Need for Post-editing of Machine Translation Outputs by Fine-tuning OpenAI LLMs
por: Gladkoff, Serge, et al.
Publicado: (2023)

Fast Analysis of the OpenAI O1-Preview Model in Solving Random K-SAT Problem: Does the LLM Solve the Problem Itself or Call an External SAT Solver?
por: Marino, Raffaele
Publicado: (2024)

Speech Emotion Recognition Leveraging OpenAI's Whisper Representations and Attentive Pooling Methods
por: Shendabadi, Ali, et al.
Publicado: (2026)

In AI Sweet Harmony: Sociopragmatic Guardrail Bypasses and Evaluation-Awareness in OpenAI gpt-oss-20b
por: Durner, Nils
Publicado: (2025)

OpenAI's GPT-OSS-20B Model and Safety Alignment Issues in a Low-Resource Language
por: Inuwa-Dutse, Isa
Publicado: (2025)

A Large-Scale Empirical Analysis of Custom GPTs' Vulnerabilities in the OpenAI Ecosystem
por: Ogundoyin, Sunday Oyinlola, et al.
Publicado: (2025)

Proof-of-TBI -- Fine-Tuned Vision Language Model Consortium and OpenAI-o3 Reasoning LLM-Based Medical Diagnosis Support System for Mild Traumatic Brain Injury (TBI) Prediction
por: Gore, Ross, et al.
Publicado: (2025)

HDDLGym: A Tool for Studying Multi-Agent Hierarchical Problems Defined in HDDL with OpenAI Gym
por: La, Ngoc, et al.
Publicado: (2025)

Scaling Down to Scale Up: A Cost-Benefit Analysis of Replacing OpenAI's LLM with Open Source SLMs in Production
por: Irugalbandara, Chandra, et al.
Publicado: (2023)

Standardization of Psychiatric Diagnoses -- Role of Fine-tuned LLM Consortium and OpenAI-gpt-oss Reasoning LLM Enabled Decision Support System
por: Bandara, Eranga, et al.
Publicado: (2025)

The 2025 OpenAI Preparedness Framework does not guarantee any AI risk mitigation practices: a proof-of-concept for affordance analyses of AI safety policies
por: Coggins, Sam, et al.
Publicado: (2025)

Exploring Memorization and Copyright Violation in Frontier LLMs: A Study of the New York Times v. OpenAI 2023 Lawsuit
por: Freeman, Joshua, et al.
Publicado: (2024)