QuArch: A Benchmark for Evaluating LLM Reasoning in Computer Architecture
Fuente:
arXiv
Saved in:
| Main Authors: | Prakash, Shvetank, Cheng, Andrew, Tschand, Arya, Mazumder, Mark, Gohil, Varun, Ma, Jeffrey, Yik, Jason, Wan, Zishen, Quaye, Jessica, Alvanaki, Elisavet Lydia, Kumar, Avinash, Mazumdar, Chandrashis, Khare, Tuhin, Ingare, Alexander, Uchendu, Ikechukwu, Ghosal, Radhika, Tyagi, Abhishek, Wang, Chenyu, Garavagno, Andrea Mattia, Gu, Sarah, Guo, Alice, Hur, Grace, Carloni, Luca, Krishna, Tushar, Nayak, Ankita, Yazdanbakhsh, Amir, Reddi, Vijay Janapa |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
QuArch: A Question-Answering Dataset for AI Agents in Computer Architecture
by: Prakash, Shvetank, et al.
Published: (2025)
by: Prakash, Shvetank, et al.
Published: (2025)
SLDB: An End-To-End Heterogeneous System-on-Chip Benchmark Suite for LLM-Aided Design
by: Alvanaki, Elisavet Lydia, et al.
Published: (2025)
by: Alvanaki, Elisavet Lydia, et al.
Published: (2025)
TinyTorch: Building Machine Learning Systems from First Principles
by: Reddi, Vijay Janapa
Published: (2026)
by: Reddi, Vijay Janapa
Published: (2026)
See it to Place it: Evolving Macro Placements with Vision-Language Models
by: Uchendu, Ikechukwu, et al.
Published: (2026)
by: Uchendu, Ikechukwu, et al.
Published: (2026)
Generative AI Agents in Autonomous Machines: A Safety Perspective
by: Jabbour, Jason, et al.
Published: (2024)
by: Jabbour, Jason, et al.
Published: (2024)
Wake Vision: A Tailored Dataset and Benchmark Suite for TinyML Computer Vision Applications
by: Banbury, Colby, et al.
Published: (2024)
by: Banbury, Colby, et al.
Published: (2024)
SwizzlePerf: Hardware-Aware LLMs for GPU Kernel Performance Optimization
by: Tschand, Arya, et al.
Published: (2025)
by: Tschand, Arya, et al.
Published: (2025)
From Seed to Harvest: Augmenting Human Creativity with AI for Red-teaming Text-to-Image Models
by: Quaye, Jessica, et al.
Published: (2025)
by: Quaye, Jessica, et al.
Published: (2025)
Decoupled Access-Execute enabled DVFS for tinyML deployments on STM32 microcontrollers
by: Alvanaki, Elisavet Lydia, et al.
Published: (2024)
by: Alvanaki, Elisavet Lydia, et al.
Published: (2024)
Lifetime-Aware Design for Item-Level Intelligence at the Extreme Edge
by: Prakash, Shvetank, et al.
Published: (2025)
by: Prakash, Shvetank, et al.
Published: (2025)
Slm-mux: Orchestrating small language models for reasoning
by: Wang, Chenyu, et al.
Published: (2025)
by: Wang, Chenyu, et al.
Published: (2025)
The Magnificent Seven Challenges and Opportunities in Domain-Specific Accelerator Design for Autonomous Systems
by: Neuman, Sabrina M., et al.
Published: (2024)
by: Neuman, Sabrina M., et al.
Published: (2024)
SWE-fficiency: Can Language Models Optimize Real-World Repositories on Real Workloads?
by: Ma, Jeffrey Jian, et al.
Published: (2025)
by: Ma, Jeffrey Jian, et al.
Published: (2025)
¿HISTORIAS DE GUERRA O GUERRAS POR LA HISTORIA?
by: Consuelo Figueroa Garavagno
Published: (2009)
by: Consuelo Figueroa Garavagno
Published: (2009)
FedStaleWeight: Buffered Asynchronous Federated Learning with Fair Aggregation via Staleness Reweighting
by: Ma, Jeffrey, et al.
Published: (2024)
by: Ma, Jeffrey, et al.
Published: (2024)
COSMIC: Enabling Full-Stack Co-Design and Optimization of Distributed Machine Learning Systems
by: Raju, Aditi, et al.
Published: (2025)
by: Raju, Aditi, et al.
Published: (2025)
Generative AI in Embodied Systems: System-Level Analysis of Performance, Efficiency and Scalability
by: Wan, Zishen, et al.
Published: (2025)
by: Wan, Zishen, et al.
Published: (2025)
GenAI for Systems: Recurring Challenges and Design Principles from Software to Silicon
by: Tschand, Arya, et al.
Published: (2026)
by: Tschand, Arya, et al.
Published: (2026)
SocratiQ: A Generative AI-Powered Learning Companion for Personalized Education and Broader Accessibility
by: Jabbour, Jason, et al.
Published: (2025)
by: Jabbour, Jason, et al.
Published: (2025)
Don't Run with Scissors: Pruning Breaks VLA Models but They Can Be Recovered
by: Jabbour, Jason, et al.
Published: (2025)
by: Jabbour, Jason, et al.
Published: (2025)
Tabula: Efficiently Computing Nonlinear Activation Functions for Secure Neural Network Inference
by: Lam, Maximilian, et al.
Published: (2022)
by: Lam, Maximilian, et al.
Published: (2022)
DIA-HARM: Dialectal Disparities in Harmful Content Detection Across 50 English Dialects
by: Lucas, Jason, et al.
Published: (2026)
by: Lucas, Jason, et al.
Published: (2026)
Mutual Interactions Between a Thin Flexible Panel and Supersonic Flows
by: Ganti, Himakar, et al.
Published: (2025)
by: Ganti, Himakar, et al.
Published: (2025)
A2Perf: Real-World Autonomous Agents Benchmark
by: Uchendu, Ikechukwu, et al.
Published: (2025)
by: Uchendu, Ikechukwu, et al.
Published: (2025)
TinyML Security: Exploring Vulnerabilities in Resource-Constrained Machine Learning Systems
by: Huckelberry, Jacob, et al.
Published: (2024)
by: Huckelberry, Jacob, et al.
Published: (2024)
Beyond Moore's Law: Harnessing the Redshift of Generative AI with Effective Hardware-Software Co-Design
by: Yazdanbakhsh, Amir
Published: (2025)
by: Yazdanbakhsh, Amir
Published: (2025)
Topological Data Analysis Applications in Natural Language Processing: A Survey
by: Uchendu, Adaku, et al.
Published: (2024)
by: Uchendu, Adaku, et al.
Published: (2024)
Multi-Agent Reinforcement Learning for Sample-Efficient Deep Neural Network Mapping
by: Krishnan, Srivatsan, et al.
Published: (2025)
by: Krishnan, Srivatsan, et al.
Published: (2025)
Adaptive Surrogate Gradients for Sequential Reinforcement Learning in Spiking Neural Networks
by: Berghe, Korneel Van den, et al.
Published: (2025)
by: Berghe, Korneel Van den, et al.
Published: (2025)
Materiality and Risk in the Age of Pervasive AI Sensors
by: Sloane, Mona, et al.
Published: (2024)
by: Sloane, Mona, et al.
Published: (2024)
Datasheets for Machine Learning Sensors
by: Stewart, Matthew, et al.
Published: (2023)
by: Stewart, Matthew, et al.
Published: (2023)
Significance of Size-Dependent Hygroscopicity Parameterization for Aerosol-Cloud Interactions
by: Gohil, Kanishk
Published: (2025)
by: Gohil, Kanishk
Published: (2025)
Analytical Proofs of Selected Theorems in 3D Tetrahedral Geometry
by: Gohil, Harshkumar
Published: (2025)
by: Gohil, Harshkumar
Published: (2025)
Effective and Efficient Jailbreaks of Black-Box LLMs with Cross-Behavior Attacks
by: Gohil, Vasudev
Published: (2025)
by: Gohil, Vasudev
Published: (2025)
Deep Learning Agents Trained For Avoidance Behave Like Hawks And Doves
by: Reddi, Aryaman
Published: (2025)
by: Reddi, Aryaman
Published: (2025)
Modeling and Optimizing Performance Bottlenecks for Neuromorphic Accelerators
by: Yik, Jason, et al.
Published: (2025)
by: Yik, Jason, et al.
Published: (2025)
How Far Can Disaggregation Go? A Design-Space Exploration of Attention-FFN Disaggregation for Efficient MoE LLM Serving
by: Wu, Hanjiang, et al.
Published: (2026)
by: Wu, Hanjiang, et al.
Published: (2026)
Searching Neural Architectures for Sensor Nodes on IoT Gateways
by: Garavagno, Andrea Mattia, et al.
Published: (2025)
by: Garavagno, Andrea Mattia, et al.
Published: (2025)
The weight of African native-centric ecology in eco-desacralization
by: Ikechukwu Monday Osebor
Published: (2024)
by: Ikechukwu Monday Osebor
Published: (2024)
Characterizing FaaS Workflows on Public Clouds: The Good, the Bad and the Ugly
by: Kulkarni, Varad, et al.
Published: (2025)
by: Kulkarni, Varad, et al.
Published: (2025)
Similar Items
-
QuArch: A Question-Answering Dataset for AI Agents in Computer Architecture
by: Prakash, Shvetank, et al.
Published: (2025) -
SLDB: An End-To-End Heterogeneous System-on-Chip Benchmark Suite for LLM-Aided Design
by: Alvanaki, Elisavet Lydia, et al.
Published: (2025) -
TinyTorch: Building Machine Learning Systems from First Principles
by: Reddi, Vijay Janapa
Published: (2026) -
See it to Place it: Evolving Macro Placements with Vision-Language Models
by: Uchendu, Ikechukwu, et al.
Published: (2026) -
Generative AI Agents in Autonomous Machines: A Safety Perspective
by: Jabbour, Jason, et al.
Published: (2024)