Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2601.08584 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914251835179008 |
|---|---|
| author | Liu, Alexander H. Khandelwal, Kartik Subramanian, Sandeep Jouault, Victor Rastogi, Abhinav Sadé, Adrien Jeffares, Alan Jiang, Albert Cahill, Alexandre Gavaudan, Alexandre Sablayrolles, Alexandre Héliou, Amélie You, Amos Ehrenberg, Andy Lo, Andy Eliseev, Anton Calvi, Antonia Sooriyarachchi, Avinash Bout, Baptiste Rozière, Baptiste De Monicault, Baudouin Lanfranchi, Clémence Barreau, Corentin Courtot, Cyprien Grattarola, Daniele Dabert, Darius Casas, Diego de las Chane-Sane, Elliot Ahmed, Faruk Berrada, Gabrielle Ecrepont, Gaëtan Guinet, Gauthier Novikov, Georgii Kunsch, Guillaume Lample, Guillaume Martin, Guillaume Gupta, Gunshi Ludziejewski, Jan Rute, Jason Studnia, Joachim Amar, Jonas Delas, Joséphine Roberts, Josselin Somerville Yadav, Karmesh Chandu, Khyathi Jain, Kush Aitchison, Laurence Fainsin, Laurent Blier, Léonard Zhao, Lingxiao Martin, Louis Saulnier, Lucile Gao, Luyu Buyl, Maarten Jennings, Margaret Pellat, Marie Prins, Mark Poirée, Mathieu Guillaumin, Mathilde Dinot, Matthieu Futeral, Matthieu Darrin, Maxime Augustin, Maximilian Chiquier, Mia Schimpf, Michel Grinsztajn, Nathan Gupta, Neha Raghuraman, Nikhil Bousquet, Olivier Duchenne, Olivier Wang, Patricia von Platen, Patrick Jacob, Paul Wambergue, Paul Kurylowicz, Paula Muddireddy, Pavankumar Reddy Chagniot, Philomène Stock, Pierre Agrawal, Pravesh Torroba, Quentin Sauvestre, Romain Soletskyi, Roman Menneer, Rupert Vaze, Sagar Barry, Samuel Gandhi, Sanchit Waghjale, Siddhant Gandhi, Siddharth Ghosh, Soham Mishra, Srijan Aithal, Sumukh Antoniak, Szymon Scao, Teven Le Cachet, Théo Sorg, Theo Simon Lavril, Thibaut Saada, Thiziri Nait Chabal, Thomas Foubert, Thomas Robert, Thomas Wang, Thomas Lawson, Tim Bewley, Tom Bewley, Tom Edwards, Tom Jamil, Umar Tomasini, Umberto Nemychnikova, Valeriia Phung, Van Maladière, Vincent Richard, Virgile Bouaziz, Wassim Li, Wen-Ding Marshall, William Li, Xinghui Yang, Xinyu Ouahidi, Yassine El Wang, Yihan Tang, Yunhao Ramzi, Zaccharie |
| author_facet | Liu, Alexander H. Khandelwal, Kartik Subramanian, Sandeep Jouault, Victor Rastogi, Abhinav Sadé, Adrien Jeffares, Alan Jiang, Albert Cahill, Alexandre Gavaudan, Alexandre Sablayrolles, Alexandre Héliou, Amélie You, Amos Ehrenberg, Andy Lo, Andy Eliseev, Anton Calvi, Antonia Sooriyarachchi, Avinash Bout, Baptiste Rozière, Baptiste De Monicault, Baudouin Lanfranchi, Clémence Barreau, Corentin Courtot, Cyprien Grattarola, Daniele Dabert, Darius Casas, Diego de las Chane-Sane, Elliot Ahmed, Faruk Berrada, Gabrielle Ecrepont, Gaëtan Guinet, Gauthier Novikov, Georgii Kunsch, Guillaume Lample, Guillaume Martin, Guillaume Gupta, Gunshi Ludziejewski, Jan Rute, Jason Studnia, Joachim Amar, Jonas Delas, Joséphine Roberts, Josselin Somerville Yadav, Karmesh Chandu, Khyathi Jain, Kush Aitchison, Laurence Fainsin, Laurent Blier, Léonard Zhao, Lingxiao Martin, Louis Saulnier, Lucile Gao, Luyu Buyl, Maarten Jennings, Margaret Pellat, Marie Prins, Mark Poirée, Mathieu Guillaumin, Mathilde Dinot, Matthieu Futeral, Matthieu Darrin, Maxime Augustin, Maximilian Chiquier, Mia Schimpf, Michel Grinsztajn, Nathan Gupta, Neha Raghuraman, Nikhil Bousquet, Olivier Duchenne, Olivier Wang, Patricia von Platen, Patrick Jacob, Paul Wambergue, Paul Kurylowicz, Paula Muddireddy, Pavankumar Reddy Chagniot, Philomène Stock, Pierre Agrawal, Pravesh Torroba, Quentin Sauvestre, Romain Soletskyi, Roman Menneer, Rupert Vaze, Sagar Barry, Samuel Gandhi, Sanchit Waghjale, Siddhant Gandhi, Siddharth Ghosh, Soham Mishra, Srijan Aithal, Sumukh Antoniak, Szymon Scao, Teven Le Cachet, Théo Sorg, Theo Simon Lavril, Thibaut Saada, Thiziri Nait Chabal, Thomas Foubert, Thomas Robert, Thomas Wang, Thomas Lawson, Tim Bewley, Tom Bewley, Tom Edwards, Tom Jamil, Umar Tomasini, Umberto Nemychnikova, Valeriia Phung, Van Maladière, Vincent Richard, Virgile Bouaziz, Wassim Li, Wen-Ding Marshall, William Li, Xinghui Yang, Xinyu Ouahidi, Yassine El Wang, Yihan Tang, Yunhao Ramzi, Zaccharie |
| contents | We introduce the Ministral 3 series, a family of parameter-efficient dense language models designed for compute and memory constrained applications, available in three model sizes: 3B, 8B, and 14B parameters. For each model size, we release three variants: a pretrained base model for general-purpose use, an instruction finetuned, and a reasoning model for complex problem-solving. In addition, we present our recipe to derive the Ministral 3 models through Cascade Distillation, an iterative pruning and continued training with distillation technique. Each model comes with image understanding capabilities, all under the Apache 2.0 license. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_08584 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Ministral 3 Liu, Alexander H. Khandelwal, Kartik Subramanian, Sandeep Jouault, Victor Rastogi, Abhinav Sadé, Adrien Jeffares, Alan Jiang, Albert Cahill, Alexandre Gavaudan, Alexandre Sablayrolles, Alexandre Héliou, Amélie You, Amos Ehrenberg, Andy Lo, Andy Eliseev, Anton Calvi, Antonia Sooriyarachchi, Avinash Bout, Baptiste Rozière, Baptiste De Monicault, Baudouin Lanfranchi, Clémence Barreau, Corentin Courtot, Cyprien Grattarola, Daniele Dabert, Darius Casas, Diego de las Chane-Sane, Elliot Ahmed, Faruk Berrada, Gabrielle Ecrepont, Gaëtan Guinet, Gauthier Novikov, Georgii Kunsch, Guillaume Lample, Guillaume Martin, Guillaume Gupta, Gunshi Ludziejewski, Jan Rute, Jason Studnia, Joachim Amar, Jonas Delas, Joséphine Roberts, Josselin Somerville Yadav, Karmesh Chandu, Khyathi Jain, Kush Aitchison, Laurence Fainsin, Laurent Blier, Léonard Zhao, Lingxiao Martin, Louis Saulnier, Lucile Gao, Luyu Buyl, Maarten Jennings, Margaret Pellat, Marie Prins, Mark Poirée, Mathieu Guillaumin, Mathilde Dinot, Matthieu Futeral, Matthieu Darrin, Maxime Augustin, Maximilian Chiquier, Mia Schimpf, Michel Grinsztajn, Nathan Gupta, Neha Raghuraman, Nikhil Bousquet, Olivier Duchenne, Olivier Wang, Patricia von Platen, Patrick Jacob, Paul Wambergue, Paul Kurylowicz, Paula Muddireddy, Pavankumar Reddy Chagniot, Philomène Stock, Pierre Agrawal, Pravesh Torroba, Quentin Sauvestre, Romain Soletskyi, Roman Menneer, Rupert Vaze, Sagar Barry, Samuel Gandhi, Sanchit Waghjale, Siddhant Gandhi, Siddharth Ghosh, Soham Mishra, Srijan Aithal, Sumukh Antoniak, Szymon Scao, Teven Le Cachet, Théo Sorg, Theo Simon Lavril, Thibaut Saada, Thiziri Nait Chabal, Thomas Foubert, Thomas Robert, Thomas Wang, Thomas Lawson, Tim Bewley, Tom Bewley, Tom Edwards, Tom Jamil, Umar Tomasini, Umberto Nemychnikova, Valeriia Phung, Van Maladière, Vincent Richard, Virgile Bouaziz, Wassim Li, Wen-Ding Marshall, William Li, Xinghui Yang, Xinyu Ouahidi, Yassine El Wang, Yihan Tang, Yunhao Ramzi, Zaccharie Computation and Language We introduce the Ministral 3 series, a family of parameter-efficient dense language models designed for compute and memory constrained applications, available in three model sizes: 3B, 8B, and 14B parameters. For each model size, we release three variants: a pretrained base model for general-purpose use, an instruction finetuned, and a reasoning model for complex problem-solving. In addition, we present our recipe to derive the Ministral 3 models through Cascade Distillation, an iterative pruning and continued training with distillation technique. Each model comes with image understanding capabilities, all under the Apache 2.0 license. |
| title | Ministral 3 |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2601.08584 |