Cover Image

CompactifAI: Extreme Compression of Large Language Models using Quantum-Inspired Tensor Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tomut, Andrei, Jahromi, Saeed S., Sarkar, Abhijoy, Kurt, Uygar, Singh, Sukhbinder, Ishtiaq, Faysal, Muñoz, Cesar, Bajaj, Prabdeep Singh, Elborady, Ali, del Bimbo, Gianni, Alizadeh, Mehrazin, Montero, David, Martin-Ramiro, Pablo, Ibrahim, Muhammad, Alaoui, Oussama Tahiri, Malcolm, John, Mugel, Samuel, Orus, Roman
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Machine Learning Quantum Physics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Tensor network compressibility of convolutional models
by: Singh, Sukhbinder, et al.
Published: (2024)

Quantum Advantage: a Tensor Network Perspective
by: Kshetrimayum, Augustine, et al.
Published: (2026)

Efficient tensor network simulation of IBM's largest quantum processors
by: Patra, Siddhartha, et al.
Published: (2023)

Quantum Large Language Models via Tensor Network Disentanglers
by: Aizpurua, Borja, et al.
Published: (2024)

Boosting Defect Detection in Manufacturing using Tensor Convolutional Neural Networks
by: Martin-Ramiro, Pablo, et al.
Published: (2023)

Quantum-enhanced Large Language Models on Quantum Hardware via Cayley Unitary Adapters
by: Aizpurua, Borja, et al.
Published: (2026)

Tensorization is a powerful but underexplored tool for compression and interpretability of neural networks
by: Hamreras, Safa, et al.
Published: (2025)

Fast Tensorization of Neural Networks via Slice-wise Feature Distillation
by: Hamreras, Safa, et al.
Published: (2026)

Only relative ranks matter in weight-clustered large language models
by: Aizpurua, Borja, et al.
Published: (2026)

Projected Entangled Pair States with flexible geometry
by: Patra, Siddhartha, et al.
Published: (2024)

Classical Neural Networks on Quantum Devices via Tensor Network Disentanglers: A Case Study in Image Classification
by: Aizpurua, Borja, et al.
Published: (2025)

Globally optimized SVD compression of LLMs via Fermi-function-based rank selection and gauge fixing
by: Rausch, Roman, et al.
Published: (2025)

Accuracy and Consumption analysis from a compressed model by CompactifAI from Multiverse Computing
by: Fovet, Damien, et al.
Published: (2025)

Which Quantization Should I Use? A Unified Evaluation of llama.cpp Quantization on Llama-3.1-8B-Instruct
by: Kurt, Uygar
Published: (2026)

Variational Tensor Neural Networks for Deep Learning
by: Jahromi, Saeed S., et al.
Published: (2022)

Quantum artificial vision for defect detection in manufacturing
by: Guijo, Daniel, et al.
Published: (2022)

Multi-disk clutch optimization using quantum annealing
by: Malcolm, John D., et al.
Published: (2022)

Molecular Absorption-Aware User Assignment, Spectrum, and Power Allocation in Dense THz Networks with Multi-Connectivity
by: Saeidi, Mohammad Amin, et al.
Published: (2024)

Reinforcement Learning Framework for Quantitative Trading
by: Yasin, Alhassan S., et al.
Published: (2024)

Financial Risk Management on a Neutral Atom Quantum Processor
by: Leclerc, Lucas, et al.
Published: (2022)

Categorical Quantum Volume Operator
by: Hahn, Alexander, et al.
Published: (2024)

REAMS: Reasoning Enhanced Algorithm for Maths Solving
by: Singh, Eishkaran, et al.
Published: (2025)

Position: Safety and Fairness in Agentic AI Depend on Interaction Topology, Not on Model Scale or Alignment
by: Bajaj, Tanav Singh, et al.
Published: (2026)

Ascent and Descent of Weighted Composition Operators on Lorentz spaces
by: Datt, Gopal, et al.
Published: (2024)

Lost in Translation: Narrative Perspective Silenced by the Voice of the Translator
by: Lindita Tahiri
Published: (2020)

Quantum-Inspired Solver for Simulating Material Deformations
by: Ali, Mazen, et al.
Published: (2025)

The four misses of agricultural water husbandry in the Maghreb
by: Adel Zeggaf Tahiri
Published: (2024)

Ultralight Signal Classification Model for Automatic Modulation Recognition
by: Oquendo, Alessandro Daniele Genuardi, et al.
Published: (2024)

Lightweight Cloud Masking Models for On-Board Inference in Hyperspectral Imaging
by: Ali, Mazen, et al.
Published: (2025)

Accelerating Photonic Integrated Circuit Design: Traditional, ML and Quantum Methods
by: Oquendo, Alessandro Daniele Genuardi, et al.
Published: (2025)

Copper‐Catalyzed 2 H ‐Azirine Ring Expansion: An Efficient Route to N ‐Substituted Pyrazoles
by: Vishal Sharma, et al.
Published: (2025)

Scaling Laws for Energy Efficiency of Local LLMs
by: Alvarez, Ander, et al.
Published: (2025)

Encoding of Probability Distributions for Quantum Monte Carlo Using Tensor Networks
by: Pereira, Antonio, et al.
Published: (2024)

A novel Diamond-Mean predictor for reversible watermarking of images
by: Muhammad Ishtiaq
Published: (2017)

Capturing long-range memory structures with tree-geometry process tensors
by: Dowling, Neil, et al.
Published: (2023)

Fixed Point Property in G-Complete Fuzzy Metric Space
by: Tahiri, Ismail, et al.
Published: (2024)

An Accelerated Newton-GMRES Method for Multilinear PageRank
by: Boubekraoui, Maryam, et al.
Published: (2025)

Polynomial-time completion of phylogenetic tree sets
by: Koshkarov, Aleksandr, et al.
Published: (2026)

An Accelerated Newton‐GMRES Method for Multilinear PageRank
by: Maryam Boubekraoui, et al.
Published: (2026)

Segregación de las mujeres en rubros tecnológicos
by: Katihuska Tahiri Mota Suárez
Published: (2019)