Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	NVIDIA, :, Blakeman, Aaron, Basant, Aarti, Khattar, Abhinav, Renduchintala, Adithya, Bercovich, Akhiad, Ficek, Aleksander, Bjorlin, Alexis, Taghibakhshi, Ali, Deshmukh, Amala Sanjay, Mahabaleshwarkar, Ameya Sunil, Tao, Andrew, Shors, Anna, Aithal, Ashwath, Poojary, Ashwin, Dattagupta, Ayush, Buddharaju, Balaram, Chen, Bobby, Ginsburg, Boris, Wang, Boxin, Norick, Brandon, Butterfield, Brian, Catanzaro, Bryan, del Mundo, Carlo, Dong, Chengyu, Harvey, Christine, Parisien, Christopher, Su, Dan, Korzekwa, Daniel, Yin, Danny, Gitman, Daria, Mosallanezhad, David, Narayanan, Deepak, Fridman, Denys, Rekesh, Dima, Ma, Ding, Pykhtar, Dmytro, Ahn, Dong, Riach, Duncan, Stosic, Dusan, Long, Eileen, Segal, Elad, Evans, Ellie, Chung, Eric, Galinkin, Erick, Bakhturina, Evelina, Dobrowolska, Ewa, Jia, Fei, Liu, Fuxiao, Prasad, Gargi, Shen, Gerald, Liu, Guilin, Chen, Guo, Qian, Haifeng, Ngo, Helen, Liu, Hongbin, Li, Hui, Gitman, Igor, Karmanov, Ilia, Moshkov, Ivan, Golan, Izik, Kautz, Jan, Scowcroft, Jane Polak, Casper, Jared, Seppanen, Jarno, Lu, Jason, Sewall, Jason, Zeng, Jiaqi, You, Jiaxuan, Zhang, Jimmy, Zhang, Jing, Huang, Jining, Xue, Jinze, Huang, Jocelyn, Conway, Joey, Kamalu, John, Barker, Jon, Cohen, Jonathan, Jennings, Joseph, Parmar, Jupinder, Sapra, Karan, Briski, Kari, Chumachenko, Kateryna, Luna, Katherine, Santhanam, Keshav, Kong, Kezhi, Sivamani, Kirthi, Pawelec, Krzysztof, Anik, Kumar, Li, Kunlun, McAfee, Lawrence, Derczynski, Leon, Pavao, Lindsey, Vega, Luis, Voegtle, Lukas, Bala, Maciej, de Melo, Maer Rodrigues, Sreedhar, Makesh Narsimhan, Chochowski, Marcin, Kliegl, Markus, Stepniewska-Dziubinska, Marta, Le, Matthieu, Novikov, Matvei, Samadi, Mehrzad, Andersch, Michael, Evans, Michael, Martinez, Miguel, Chrzanowski, Mike, Ranzinger, Mike, Blaz, Mikolaj, Smelyanskiy, Misha, Fawzy, Mohamed, Shoeybi, Mohammad, Patwary, Mostofa, Lee, Nayeon, Tajbakhsh, Nima, Xu, Ning, Rybakov, Oleg, Kuchaiev, Oleksii, Delalleau, Olivier, Nitski, Osvald, Chadha, Parth, Shamis, Pasha, Micikevicius, Paulius, Molchanov, Pavlo, Dykas, Peter, Fischer, Philipp, Aquilanti, Pierre-Yves, Bialecki, Piotr, Varshney, Prasoon, Gundecha, Pritam, Tredak, Przemek, Karimi, Rabeeh, Kandu, Rahul, El-Yaniv, Ran, Joshi, Raviraj, Waleffe, Roger, Zhang, Ruoxi, Kavanaugh, Sabrina, Jain, Sahil, Kriman, Samuel, Lym, Sangkug, Satheesh, Sanjeev, Muralidharan, Saurav, Narenthiran, Sean, Anandaraj, Selvaraj, Bak, Seonmyeong, Kashirsky, Sergey, Han, Seungju, Acharya, Shantanu, Ghosh, Shaona, Sreenivas, Sharath Turuvekere, Clay, Sharon, Thomas, Shelby, Prabhumoye, Shrimai, Pachori, Shubham, Toshniwal, Shubham, Prayaga, Shyamala, Jain, Siddhartha, Das, Sirshak, Kierat, Slawek, Majumdar, Somshubra, Han, Song, Singhal, Soumye, Niverty, Sriharsha, Alborghetti, Stefania, Panguluri, Suseella, Bhendigeri, Swetha, Akter, Syeda Nahida, Migacz, Szymon, Shiri, Tal, Kong, Terry, Roman, Timo, Ronen, Tomer, Saar, Trisha, Konuk, Tugrul, Rintamaki, Tuomas, Poon, Tyler, De, Ushnish, Noroozi, Vahid, Singh, Varun, Korthikanti, Vijay, Kurin, Vitaly, Ahmad, Wasi Uddin, Du, Wei, Ping, Wei, Dai, Wenliang, Byeon, Wonmin, Ren, Xiaowei, Xu, Yao, Choi, Yejin, Zhang, Yian, Lin, Ying, Suhara, Yoshi, Yu, Zhiding, Li, Zhiqi, Li, Zhiyu, Zhu, Zhongbo, Yang, Zhuolin, Chen, Zijia
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!