Cover Image

Jamba: A Hybrid Transformer-Mamba Language Model

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lieber, Opher, Lenz, Barak, Bata, Hofit, Cohen, Gal, Osin, Jhonathan, Dalmedigos, Itay, Safahi, Erez, Meirom, Shaked, Belinkov, Yonatan, Shalev-Shwartz, Shai, Abend, Omri, Alon, Raz, Asida, Tomer, Bergman, Amir, Glozman, Roman, Gokhman, Michael, Manevich, Avashalom, Ratner, Nir, Rozen, Noam, Shwartz, Erez, Zusman, Mor, Shoham, Yoav
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Jamba-1.5: Hybrid Transformer-Mamba Models at Scale
by: Jamba Team, et al.
Published: (2024)

From Reasoning to Super-Intelligence: A Search-Theoretic Perspective
by: Shalev-Shwartz, Shai, et al.
Published: (2025)

Research Program: Theory of Learning in Dynamical Systems
by: Hazan, Elad, et al.
Published: (2025)

Contextual Plackett-Luce: An Efficient Neural Model for Probabilistic Sequence Selection under Ambiguity
by: Mizrachi, Noam, et al.
Published: (2026)

Untangling Lariats: Subgradient Following of Variationally Penalized Objectives
by: Mo, Kai-Chia, et al.
Published: (2024)

A New Strategy for Omnidirectional Broadband Absorption of the Solar Radiation for Thin‐Film Solar Cells
by: Nipun Vashistha, et al.
Published: (2025)

Jàmbá
Published: (2013)

Matchings of theta lifts associated to Non-trivial Automorphic Characters of Odd Orthogonal Groups
by: Erez, Ron
Published: (2024)

Analytic Solutions of Control Mechanism in Single-Qubit Systems
by: Abrams, Erez
Published: (2024)

Handwritten Text Recognition of Historical Manuscripts Using Transformer-Based Models
by: Meoded, Erez
Published: (2025)

Non-Monotone Response Modules and Cascades from the EML Operator for Reduced Models of Biological Dynamics
by: Erez, Amir
Published: (2026)

Unique Winning Opening Move in Three-Row Chomp
by: Sheiner, Erez
Published: (2026)

Party identification as a mediating variable in the perception of governmental legitimacy in Israel during the coronavirus epidemic
by: Erez Cohen
Published: (2024)

Generating Benchmarks for Factuality Evaluation of Language Models
by: Muhlgay, Dor, et al.
Published: (2023)

Survey based assessment of sustainable agricultural practices: Evidence from Indian plots
by: Beata Itin‐Shwartz
Published: (2024)

Career Don’t Stop Believing: Career Empowerment as a Mediator between Hope and Organizational Outcomes
by: Daphna Shwartz-Asher
Published: (2023)

Particle Detectors, Second Edition
by: Grupen, Claus, et al.
Published: (2023)

The Dual Nature of Body-Axis Formation in Hydra Regeneration: Polarity-Morphology Concurrency
by: Agam, Oded, et al.
Published: (2025)

DifuzCam: Replacing Camera Lens with a Mask and a Diffusion Model
by: Yosef, Erez, et al.
Published: (2024)

Controlled Loop Expansion for the Topological Heavy Fermion Model
by: Vituri, Yaar, et al.
Published: (2026)

Force Geometry and Irreversibility in Nonequilibrium Dynamics
by: Aghion, Erez, et al.
Published: (2026)

Real-space blocking of qubit variables on parallel lattice gauge theory links for quantum simulation
by: Shir, Judy, et al.
Published: (2023)

A Simple Receive Diversity Technique for Distributed Beamforming
by: Domanovitz, Elad, et al.
Published: (2019)

On the convergence of zeta functions of prehomogeneous vector spaces
by: Finis, Tobias, et al.
Published: (2024)

Rupture-Repair Cycles in Regenerating Hydra Tissues
by: Agam, Oded, et al.
Published: (2026)

Charge and pair density waves in a spin and valley-polarized system at a Van-Hove singularity
by: Gil, Avigail, et al.
Published: (2025)

From Contextual Combinatorial Semi-Bandits to Bandit List Classification: Improved Sample Complexity with Sparse Rewards
by: Erez, Liad, et al.
Published: (2025)

Quantifying Coupled Dynamics in Phase-Space from State Distribution Snapshots
by: Aghion, Erez, et al.
Published: (2025)

Evaluation of the extracts of purple basil (Ocimum basilicum L.) as natural pH‐indicator dyes anticipated to be utilised in intelligent food packaging—an optimisation study
by: Elif Erez, et al.
Published: (2024)

How Circular Economy Innovation Can Backfire on the Environment: Quantifying the Rebound Effect of the Textiles and Clothing Sector
by: Erez Yerushalmi, et al.
Published: (2025)

T-duality and bosonization as examples of continuum gauging and disentangling
by: Roose, Gertian, et al.
Published: (2025)

Simple Bounds for the Symmetric Capacity of the Rayleigh Fading Multiple Access Channel
by: Domanovitz, Elad, et al.
Published: (2019)

Gauging a superposition of fermionic Gaussian projected entangled pair states to get lattice gauge theory eigenstates
by: Roose, Gertian, et al.
Published: (2024)

Every real number is a sum of two real numbers with diverging partial quotients
by: Gayfulin, Dmitry, et al.
Published: (2025)

Gaussian continuous tensor network states: short-distance properties and imaginary-time evolution
by: Rigobello, Marco, et al.
Published: (2026)

Increasing the distance of topological codes with time vortex defects
by: Kishony, Gilad, et al.
Published: (2025)

Tell Me What You See: Text-Guided Real-World Image Denoising
by: Yosef, Erez, et al.
Published: (2023)

Concurrent aggregate queries
by: Sela, Gal, et al.
Published: (2024)

Continuum limit of gauged tensor network states
by: Roose, Gertian, et al.
Published: (2025)

Fluctuation-Driven Morphological Patterning: A Novel Approach to Morphogenesis
by: Agam, Oded, et al.
Published: (2024)