Staff View: :: Library Catalog

Saved in:

Bibliographic Details
Main Authors:	NVIDIA, :, Blakeman, Aaron, Grattafiori, Aaron, Basant, Aarti, Gupta, Abhibha, Khattar, Abhinav, Renduchintala, Adi, Vavre, Aditya, Shukla, Akanksha, Bercovich, Akhiad, Ficek, Aleksander, Shaposhnikov, Aleksandr, Kondratenko, Alex, Bukharin, Alexander, Milesi, Alexandre, Taghibakhshi, Ali, Liu, Alisa, Barton, Amelia, Mahabaleshwarkar, Ameya Sunil, Klein, Amir, Zuker, Amit, Geifman, Amnon, Shen, Amy, Bhiwandiwalla, Anahita, Tao, Andrew, Agrusa, Anjulie, Verma, Ankur, Guan, Ann, Mandarwal, Anubhav, Mehta, Arham, Aithal, Ashwath, Poojary, Ashwin, Ahamed, Asif, Mishra, Asit, Thekkumpate, Asma Kuriparambil, Dattagupta, Ayush, Zhu, Banghua, Sadeghi, Bardiya, Simkin, Barnaby, Lanir, Ben, Schifferer, Benedikt, Nushi, Besmira, Kartal, Bilal, Rouhani, Bita Darvish, Ginsburg, Boris, Norick, Brandon, Soubasis, Brandon, Kisacanin, Branislav, Yu, Brian, Catanzaro, Bryan, del Mundo, Carlo, Hwang, Chantal, Wang, Charles, Hsieh, Cheng-Ping, Zhang, Chenghao, Yu, Chenhan, Mungekar, Chetan, Patel, Chintan, Alexiuk, Chris, Parisien, Christopher, Neale, Collin, Meurillon, Cyril, Mosk-Aoyama, Damon, Su, Dan, Corneil, Dane, Afrimi, Daniel, Lo, Daniel, Rohrer, Daniel, Serebrenik, Daniel, Gitman, Daria, Levy, Daria, Stosic, Darko, Mosallanezhad, David, Narayanan, Deepak, Nathawani, Dhruv, Rekesh, Dima, Yared, Dina, Kakwani, Divyanshu, Ahn, Dong, Riach, Duncan, Stosic, Dusan, Minasyan, Edgar, Lin, Edward, Long, Eileen, Long, Eileen Peters, Segal, Elad, Lantz, Elena, Evans, Ellie, Ning, Elliott, Chung, Eric, Harper, Eric, Tramel, Eric, Galinkin, Erick, Pounds, Erik, Briones, Evan, Bakhturina, Evelina, Tsykunov, Evgeny, Ladhak, Faisal, Wang, Fay, Jia, Fei, Soares, Felipe, Chen, Feng, Galko, Ferenc, Sun, Frank, Siino, Frankie, Agam, Gal Hubara, Ajjanagadde, Ganesh, Bhatt, Gantavya, Prasad, Gargi, Armstrong, George, Shen, Gerald, Batmaz, Gorkem, Nalbandyan, Grigor, Qian, Haifeng, Sharma, Harsh, Ross, Hayley, Ngo, Helen, Hum, Herbert, Sahota, Herman, Wang, Hexin, Soni, Himanshu, Upadhyay, Hiren, Mao, Huizi, Nguyen, Huy C, Nguyen, Huy Q, Cunningham, Iain, Galil, Ido, Shahaf, Ido, Gitman, Igor, Loshchilov, Ilya, Schen, Itamar, Levy, Itay, Moshkov, Ivan, Golan, Izik, Putterman, Izzy, Kautz, Jan, Scowcroft, Jane Polak, Casper, Jared, Mitra, Jatin, Glick, Jeffrey, Chen, Jenny, Oliver, Jesse, Zhang, Jian, Zeng, Jiaqi, Lou, Jie, Zhang, Jimmy, Choi, Jinhang, Huang, Jining, Conway, Joey, Guman, Joey, Kamalu, John, Greco, Johnny, Cohen, Jonathan, Jennings, Joseph, Daw, Joyjit, Vialard, Julien Veron, Yi, Junkeun, Parmar, Jupinder, Xu, Kai, Zhu, Kan, Briski, Kari, Cheung, Katherine, Luna, Katherine, Wyss, Keith, Santhanam, Keshav, Shih, Kevin, Kong, Kezhi, Bhardwaj, Khushi, Shankar, Kirthi, Puvvada, Krishna C., Pawelec, Krzysztof, Anik, Kumar, McAfee, Lawrence, Sleiman, Laya, Derczynski, Leon, Ding, Li, Wei, Lizzie, Liebenwein, Lucas, Vega, Luis, Grover, Maanu, Van Segbroeck, Maarten, de Melo, Maer Rodrigues, Nazemi, Mahdi, Sreedhar, Makesh Narsimhan, Kilaru, Manoj, Ashkenazi, Maor, Romeijn, Marc, Chochowski, Marcin, Cai, Mark, Kliegl, Markus, Moosaei, Maryam, Kulka, Matt, Novikov, Matvei, Samadi, Mehrzad, Corpuz, Melissa, Wang, Mengru, Price, Meredith, Andersch, Michael, Boone, Michael, Evans, Michael, Martinez, Miguel, Khona, Mikail, Chrzanowski, Mike, Lee, Minseok, Dabbah, Mohammad, Shoeybi, Mohammad, Patwary, Mostofa, Mulepati, Nabin, Nabwani, Najeeb, Hereth, Natalie, Assaf, Nave, Habibi, Negar, Zmora, Neta, Haber, Netanel, Sessions, Nicola, Bhatia, Nidhi, Jukar, Nikhil, Pope, Nikki, Ludwig, Nikolai, Tajbakhsh, Nima, Ailon, Nir, Juluru, Nirmal, Sharma, Nishant, Hrinchuk, Oleksii, Kuchaiev, Oleksii, Delalleau, Olivier, Olabiyi, Oluwatobi, Argov, Omer Ullman, Puny, Omri, Tropp, Oren, Xie, Ouye, Chadha, Parth, Shamis, Pasha, Gibbons, Paul, Molchanov, Pavlo, Morkisz, Pawel, Dykas, Peter, Jin, Peter, Xu, Pinky, Januszewski, Piotr, Thombre, Pranav Prashant, Varshney, Prasoon, Gundecha, Pritam, Tredak, Przemek, Miao, Qing, Wan, Qiyu, Mahabadi, Rabeeh Karimi, Garg, Rachit, El-Yaniv, Ran, Zilberstein, Ran, Shafipour, Rasoul, Harang, Rich, Izzo, Rick, Shahbazyan, Rima, Garg, Rishabh, Borkar, Ritika, Gala, Ritu, Islam, Riyad, Hesse, Robert, Waleffe, Roger, Watve, Rohit, Koren, Roi, Zhang, Ruoxi, Hewett, Russell, Hewett, Russell J., Prenger, Ryan, Timbrook, Ryan, Mahdavi, Sadegh, Modi, Sahil, Kriman, Samuel, Lim, Sangkug, Kariyappa, Sanjay, Satheesh, Sanjeev, Kaji, Saori, Pasumarthi, Satish, Muralidharan, Saurav, Narentharen, Sean, Narenthiran, Sean, Bak, Seonmyeong, Kashirsky, Sergey, Poulos, Seth, Mor, Shahar, Ramasamy, Shanmugam, Acharya, Shantanu, Ghosh, Shaona, Sreenivas, Sharath Turuvekere, Thomas, Shelby, Fan, Shiqing, Gopal, Shreya, Prabhumoye, Shrimai, Pachori, Shubham, Toshniwal, Shubham, Ding, Shuoyang, Singh, Siddharth, Sun, Simeng, Ithape, Smita, Majumdar, Somshubra, Singhal, Soumye, Sergienko, Stas, Alborghetti, Stefania, Ge, Stephen, Devare, Sugam Dipak, Barua, Sumeet Kumar, Panguluri, Suseella, Gupta, Suyog, Priyadarshi, Sweta, Akter, Syeda Nahida, Bui, Tan, Ene, Teodor-Dumitru, Kong, Terry, Do, Thanh, Blankevoort, Tijmen, Moon, Tim, Balough, Tom, Asida, Tomer, Natan, Tomer Bar, Ronen, Tomer, Konuk, Tugrul, Vashishth, Twinkle, Karpas, Udi, De, Ushnish, Noorozi, Vahid, Noroozi, Vahid, Srinivasan, Venkat, Elango, Venmugil, Cui, Victor, Korthikanti, Vijay, Rao, Vinay, Kurin, Vitaly, Lavrukhin, Vitaly, Anisimov, Vladimir, Jiang, Wanli, Ahmad, Wasi Uddin, Du, Wei, Ping, Wei, Zhou, Wenfei, Jennings, Will, Zhang, William, Prazuch, Wojciech, Ren, Xiaowei, Karnati, Yashaswi, Choi, Yejin, Meyer, Yev, Wu, Yi-Fu, Zhang, Yian, Qin, Yigong, Lin, Ying, Geifman, Yonatan, Fu, Yonggan, Subara, Yoshi, Suhara, Yoshi, Gao, Yubo, Moshe, Zach, Dong, Zhen, Zhu, Zhongbo, Liu, Zihan, Chen, Zijia, Yan, Zijie
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence Machine Learning
Online Access:	https://arxiv.org/abs/2512.20856
Tags:	Add Tag No Tags, Be the first to tag this record!

_version_	1866912786743820288
author	NVIDIA : Blakeman, Aaron Grattafiori, Aaron Basant, Aarti Gupta, Abhibha Khattar, Abhinav Renduchintala, Adi Vavre, Aditya Shukla, Akanksha Bercovich, Akhiad Ficek, Aleksander Shaposhnikov, Aleksandr Kondratenko, Alex Bukharin, Alexander Milesi, Alexandre Taghibakhshi, Ali Liu, Alisa Barton, Amelia Mahabaleshwarkar, Ameya Sunil Klein, Amir Zuker, Amit Geifman, Amnon Shen, Amy Bhiwandiwalla, Anahita Tao, Andrew Agrusa, Anjulie Verma, Ankur Guan, Ann Mandarwal, Anubhav Mehta, Arham Aithal, Ashwath Poojary, Ashwin Ahamed, Asif Mishra, Asit Thekkumpate, Asma Kuriparambil Dattagupta, Ayush Zhu, Banghua Sadeghi, Bardiya Simkin, Barnaby Lanir, Ben Schifferer, Benedikt Nushi, Besmira Kartal, Bilal Rouhani, Bita Darvish Ginsburg, Boris Norick, Brandon Soubasis, Brandon Kisacanin, Branislav Yu, Brian Catanzaro, Bryan del Mundo, Carlo Hwang, Chantal Wang, Charles Hsieh, Cheng-Ping Zhang, Chenghao Yu, Chenhan Mungekar, Chetan Patel, Chintan Alexiuk, Chris Parisien, Christopher Neale, Collin Meurillon, Cyril Mosk-Aoyama, Damon Su, Dan Corneil, Dane Afrimi, Daniel Lo, Daniel Rohrer, Daniel Serebrenik, Daniel Gitman, Daria Levy, Daria Stosic, Darko Mosallanezhad, David Narayanan, Deepak Nathawani, Dhruv Rekesh, Dima Yared, Dina Kakwani, Divyanshu Ahn, Dong Riach, Duncan Stosic, Dusan Minasyan, Edgar Lin, Edward Long, Eileen Long, Eileen Peters Segal, Elad Lantz, Elena Evans, Ellie Ning, Elliott Chung, Eric Harper, Eric Tramel, Eric Galinkin, Erick Pounds, Erik Briones, Evan Bakhturina, Evelina Tsykunov, Evgeny Ladhak, Faisal Wang, Fay Jia, Fei Soares, Felipe Chen, Feng Galko, Ferenc Sun, Frank Siino, Frankie Agam, Gal Hubara Ajjanagadde, Ganesh Bhatt, Gantavya Prasad, Gargi Armstrong, George Shen, Gerald Batmaz, Gorkem Nalbandyan, Grigor Qian, Haifeng Sharma, Harsh Ross, Hayley Ngo, Helen Hum, Herbert Sahota, Herman Wang, Hexin Soni, Himanshu Upadhyay, Hiren Mao, Huizi Nguyen, Huy C Nguyen, Huy Q Cunningham, Iain Galil, Ido Shahaf, Ido Gitman, Igor Loshchilov, Ilya Schen, Itamar Levy, Itay Moshkov, Ivan Golan, Izik Putterman, Izzy Kautz, Jan Scowcroft, Jane Polak Casper, Jared Mitra, Jatin Glick, Jeffrey Chen, Jenny Oliver, Jesse Zhang, Jian Zeng, Jiaqi Lou, Jie Zhang, Jimmy Choi, Jinhang Huang, Jining Conway, Joey Guman, Joey Kamalu, John Greco, Johnny Cohen, Jonathan Jennings, Joseph Daw, Joyjit Vialard, Julien Veron Yi, Junkeun Parmar, Jupinder Xu, Kai Zhu, Kan Briski, Kari Cheung, Katherine Luna, Katherine Wyss, Keith Santhanam, Keshav Shih, Kevin Kong, Kezhi Bhardwaj, Khushi Shankar, Kirthi Puvvada, Krishna C. Pawelec, Krzysztof Anik, Kumar McAfee, Lawrence Sleiman, Laya Derczynski, Leon Ding, Li Wei, Lizzie Liebenwein, Lucas Vega, Luis Grover, Maanu Van Segbroeck, Maarten de Melo, Maer Rodrigues Nazemi, Mahdi Sreedhar, Makesh Narsimhan Kilaru, Manoj Ashkenazi, Maor Romeijn, Marc Chochowski, Marcin Cai, Mark Kliegl, Markus Moosaei, Maryam Kulka, Matt Novikov, Matvei Samadi, Mehrzad Corpuz, Melissa Wang, Mengru Price, Meredith Andersch, Michael Boone, Michael Evans, Michael Martinez, Miguel Khona, Mikail Chrzanowski, Mike Lee, Minseok Dabbah, Mohammad Shoeybi, Mohammad Patwary, Mostofa Mulepati, Nabin Nabwani, Najeeb Hereth, Natalie Assaf, Nave Habibi, Negar Zmora, Neta Haber, Netanel Sessions, Nicola Bhatia, Nidhi Jukar, Nikhil Pope, Nikki Ludwig, Nikolai Tajbakhsh, Nima Ailon, Nir Juluru, Nirmal Sharma, Nishant Hrinchuk, Oleksii Kuchaiev, Oleksii Delalleau, Olivier Olabiyi, Oluwatobi Argov, Omer Ullman Puny, Omri Tropp, Oren Xie, Ouye Chadha, Parth Shamis, Pasha Gibbons, Paul Molchanov, Pavlo Morkisz, Pawel Dykas, Peter Jin, Peter Xu, Pinky Januszewski, Piotr Thombre, Pranav Prashant Varshney, Prasoon Gundecha, Pritam Tredak, Przemek Miao, Qing Wan, Qiyu Mahabadi, Rabeeh Karimi Garg, Rachit El-Yaniv, Ran Zilberstein, Ran Shafipour, Rasoul Harang, Rich Izzo, Rick Shahbazyan, Rima Garg, Rishabh Borkar, Ritika Gala, Ritu Islam, Riyad Hesse, Robert Waleffe, Roger Watve, Rohit Koren, Roi Zhang, Ruoxi Hewett, Russell Hewett, Russell J. Prenger, Ryan Timbrook, Ryan Mahdavi, Sadegh Modi, Sahil Kriman, Samuel Lim, Sangkug Kariyappa, Sanjay Satheesh, Sanjeev Kaji, Saori Pasumarthi, Satish Muralidharan, Saurav Narentharen, Sean Narenthiran, Sean Bak, Seonmyeong Kashirsky, Sergey Poulos, Seth Mor, Shahar Ramasamy, Shanmugam Acharya, Shantanu Ghosh, Shaona Sreenivas, Sharath Turuvekere Thomas, Shelby Fan, Shiqing Gopal, Shreya Prabhumoye, Shrimai Pachori, Shubham Toshniwal, Shubham Ding, Shuoyang Singh, Siddharth Sun, Simeng Ithape, Smita Majumdar, Somshubra Singhal, Soumye Sergienko, Stas Alborghetti, Stefania Ge, Stephen Devare, Sugam Dipak Barua, Sumeet Kumar Panguluri, Suseella Gupta, Suyog Priyadarshi, Sweta Akter, Syeda Nahida Bui, Tan Ene, Teodor-Dumitru Kong, Terry Do, Thanh Blankevoort, Tijmen Moon, Tim Balough, Tom Asida, Tomer Natan, Tomer Bar Ronen, Tomer Konuk, Tugrul Vashishth, Twinkle Karpas, Udi De, Ushnish Noorozi, Vahid Noroozi, Vahid Srinivasan, Venkat Elango, Venmugil Cui, Victor Korthikanti, Vijay Rao, Vinay Kurin, Vitaly Lavrukhin, Vitaly Anisimov, Vladimir Jiang, Wanli Ahmad, Wasi Uddin Du, Wei Ping, Wei Zhou, Wenfei Jennings, Will Zhang, William Prazuch, Wojciech Ren, Xiaowei Karnati, Yashaswi Choi, Yejin Meyer, Yev Wu, Yi-Fu Zhang, Yian Qin, Yigong Lin, Ying Geifman, Yonatan Fu, Yonggan Subara, Yoshi Suhara, Yoshi Gao, Yubo Moshe, Zach Dong, Zhen Zhu, Zhongbo Liu, Zihan Chen, Zijia Yan, Zijie
author_facet	NVIDIA : Blakeman, Aaron Grattafiori, Aaron Basant, Aarti Gupta, Abhibha Khattar, Abhinav Renduchintala, Adi Vavre, Aditya Shukla, Akanksha Bercovich, Akhiad Ficek, Aleksander Shaposhnikov, Aleksandr Kondratenko, Alex Bukharin, Alexander Milesi, Alexandre Taghibakhshi, Ali Liu, Alisa Barton, Amelia Mahabaleshwarkar, Ameya Sunil Klein, Amir Zuker, Amit Geifman, Amnon Shen, Amy Bhiwandiwalla, Anahita Tao, Andrew Agrusa, Anjulie Verma, Ankur Guan, Ann Mandarwal, Anubhav Mehta, Arham Aithal, Ashwath Poojary, Ashwin Ahamed, Asif Mishra, Asit Thekkumpate, Asma Kuriparambil Dattagupta, Ayush Zhu, Banghua Sadeghi, Bardiya Simkin, Barnaby Lanir, Ben Schifferer, Benedikt Nushi, Besmira Kartal, Bilal Rouhani, Bita Darvish Ginsburg, Boris Norick, Brandon Soubasis, Brandon Kisacanin, Branislav Yu, Brian Catanzaro, Bryan del Mundo, Carlo Hwang, Chantal Wang, Charles Hsieh, Cheng-Ping Zhang, Chenghao Yu, Chenhan Mungekar, Chetan Patel, Chintan Alexiuk, Chris Parisien, Christopher Neale, Collin Meurillon, Cyril Mosk-Aoyama, Damon Su, Dan Corneil, Dane Afrimi, Daniel Lo, Daniel Rohrer, Daniel Serebrenik, Daniel Gitman, Daria Levy, Daria Stosic, Darko Mosallanezhad, David Narayanan, Deepak Nathawani, Dhruv Rekesh, Dima Yared, Dina Kakwani, Divyanshu Ahn, Dong Riach, Duncan Stosic, Dusan Minasyan, Edgar Lin, Edward Long, Eileen Long, Eileen Peters Segal, Elad Lantz, Elena Evans, Ellie Ning, Elliott Chung, Eric Harper, Eric Tramel, Eric Galinkin, Erick Pounds, Erik Briones, Evan Bakhturina, Evelina Tsykunov, Evgeny Ladhak, Faisal Wang, Fay Jia, Fei Soares, Felipe Chen, Feng Galko, Ferenc Sun, Frank Siino, Frankie Agam, Gal Hubara Ajjanagadde, Ganesh Bhatt, Gantavya Prasad, Gargi Armstrong, George Shen, Gerald Batmaz, Gorkem Nalbandyan, Grigor Qian, Haifeng Sharma, Harsh Ross, Hayley Ngo, Helen Hum, Herbert Sahota, Herman Wang, Hexin Soni, Himanshu Upadhyay, Hiren Mao, Huizi Nguyen, Huy C Nguyen, Huy Q Cunningham, Iain Galil, Ido Shahaf, Ido Gitman, Igor Loshchilov, Ilya Schen, Itamar Levy, Itay Moshkov, Ivan Golan, Izik Putterman, Izzy Kautz, Jan Scowcroft, Jane Polak Casper, Jared Mitra, Jatin Glick, Jeffrey Chen, Jenny Oliver, Jesse Zhang, Jian Zeng, Jiaqi Lou, Jie Zhang, Jimmy Choi, Jinhang Huang, Jining Conway, Joey Guman, Joey Kamalu, John Greco, Johnny Cohen, Jonathan Jennings, Joseph Daw, Joyjit Vialard, Julien Veron Yi, Junkeun Parmar, Jupinder Xu, Kai Zhu, Kan Briski, Kari Cheung, Katherine Luna, Katherine Wyss, Keith Santhanam, Keshav Shih, Kevin Kong, Kezhi Bhardwaj, Khushi Shankar, Kirthi Puvvada, Krishna C. Pawelec, Krzysztof Anik, Kumar McAfee, Lawrence Sleiman, Laya Derczynski, Leon Ding, Li Wei, Lizzie Liebenwein, Lucas Vega, Luis Grover, Maanu Van Segbroeck, Maarten de Melo, Maer Rodrigues Nazemi, Mahdi Sreedhar, Makesh Narsimhan Kilaru, Manoj Ashkenazi, Maor Romeijn, Marc Chochowski, Marcin Cai, Mark Kliegl, Markus Moosaei, Maryam Kulka, Matt Novikov, Matvei Samadi, Mehrzad Corpuz, Melissa Wang, Mengru Price, Meredith Andersch, Michael Boone, Michael Evans, Michael Martinez, Miguel Khona, Mikail Chrzanowski, Mike Lee, Minseok Dabbah, Mohammad Shoeybi, Mohammad Patwary, Mostofa Mulepati, Nabin Nabwani, Najeeb Hereth, Natalie Assaf, Nave Habibi, Negar Zmora, Neta Haber, Netanel Sessions, Nicola Bhatia, Nidhi Jukar, Nikhil Pope, Nikki Ludwig, Nikolai Tajbakhsh, Nima Ailon, Nir Juluru, Nirmal Sharma, Nishant Hrinchuk, Oleksii Kuchaiev, Oleksii Delalleau, Olivier Olabiyi, Oluwatobi Argov, Omer Ullman Puny, Omri Tropp, Oren Xie, Ouye Chadha, Parth Shamis, Pasha Gibbons, Paul Molchanov, Pavlo Morkisz, Pawel Dykas, Peter Jin, Peter Xu, Pinky Januszewski, Piotr Thombre, Pranav Prashant Varshney, Prasoon Gundecha, Pritam Tredak, Przemek Miao, Qing Wan, Qiyu Mahabadi, Rabeeh Karimi Garg, Rachit El-Yaniv, Ran Zilberstein, Ran Shafipour, Rasoul Harang, Rich Izzo, Rick Shahbazyan, Rima Garg, Rishabh Borkar, Ritika Gala, Ritu Islam, Riyad Hesse, Robert Waleffe, Roger Watve, Rohit Koren, Roi Zhang, Ruoxi Hewett, Russell Hewett, Russell J. Prenger, Ryan Timbrook, Ryan Mahdavi, Sadegh Modi, Sahil Kriman, Samuel Lim, Sangkug Kariyappa, Sanjay Satheesh, Sanjeev Kaji, Saori Pasumarthi, Satish Muralidharan, Saurav Narentharen, Sean Narenthiran, Sean Bak, Seonmyeong Kashirsky, Sergey Poulos, Seth Mor, Shahar Ramasamy, Shanmugam Acharya, Shantanu Ghosh, Shaona Sreenivas, Sharath Turuvekere Thomas, Shelby Fan, Shiqing Gopal, Shreya Prabhumoye, Shrimai Pachori, Shubham Toshniwal, Shubham Ding, Shuoyang Singh, Siddharth Sun, Simeng Ithape, Smita Majumdar, Somshubra Singhal, Soumye Sergienko, Stas Alborghetti, Stefania Ge, Stephen Devare, Sugam Dipak Barua, Sumeet Kumar Panguluri, Suseella Gupta, Suyog Priyadarshi, Sweta Akter, Syeda Nahida Bui, Tan Ene, Teodor-Dumitru Kong, Terry Do, Thanh Blankevoort, Tijmen Moon, Tim Balough, Tom Asida, Tomer Natan, Tomer Bar Ronen, Tomer Konuk, Tugrul Vashishth, Twinkle Karpas, Udi De, Ushnish Noorozi, Vahid Noroozi, Vahid Srinivasan, Venkat Elango, Venmugil Cui, Victor Korthikanti, Vijay Rao, Vinay Kurin, Vitaly Lavrukhin, Vitaly Anisimov, Vladimir Jiang, Wanli Ahmad, Wasi Uddin Du, Wei Ping, Wei Zhou, Wenfei Jennings, Will Zhang, William Prazuch, Wojciech Ren, Xiaowei Karnati, Yashaswi Choi, Yejin Meyer, Yev Wu, Yi-Fu Zhang, Yian Qin, Yigong Lin, Ying Geifman, Yonatan Fu, Yonggan Subara, Yoshi Suhara, Yoshi Gao, Yubo Moshe, Zach Dong, Zhen Zhu, Zhongbo Liu, Zihan Chen, Zijia Yan, Zijie
contents	We introduce the Nemotron 3 family of models - Nano, Super, and Ultra. These models deliver strong agentic, reasoning, and conversational capabilities. The Nemotron 3 family uses a Mixture-of-Experts hybrid Mamba-Transformer architecture to provide best-in-class throughput and context lengths of up to 1M tokens. Super and Ultra models are trained with NVFP4 and incorporate LatentMoE, a novel approach that improves model quality. The two larger models also include MTP layers for faster text generation. All Nemotron 3 models are post-trained using multi-environment reinforcement learning enabling reasoning, multi-step tool use, and support granular reasoning budget control. Nano, the smallest model, outperforms comparable models in accuracy while remaining extremely cost-efficient for inference. Super is optimized for collaborative agents and high-volume workloads such as IT ticket automation. Ultra, the largest model, provides state-of-the-art accuracy and reasoning performance. Nano is released together with its technical report and this white paper, while Super and Ultra will follow in the coming months. We will openly release the model weights, pre- and post-training software, recipes, and all data for which we hold redistribution rights.
format	Preprint
id	arxiv_https___arxiv_org_abs_2512_20856
institution	arXiv
publishDate	2025
record_format	arxiv
spellingShingle	NVIDIA Nemotron 3: Efficient and Open Intelligence NVIDIA : Blakeman, Aaron Grattafiori, Aaron Basant, Aarti Gupta, Abhibha Khattar, Abhinav Renduchintala, Adi Vavre, Aditya Shukla, Akanksha Bercovich, Akhiad Ficek, Aleksander Shaposhnikov, Aleksandr Kondratenko, Alex Bukharin, Alexander Milesi, Alexandre Taghibakhshi, Ali Liu, Alisa Barton, Amelia Mahabaleshwarkar, Ameya Sunil Klein, Amir Zuker, Amit Geifman, Amnon Shen, Amy Bhiwandiwalla, Anahita Tao, Andrew Agrusa, Anjulie Verma, Ankur Guan, Ann Mandarwal, Anubhav Mehta, Arham Aithal, Ashwath Poojary, Ashwin Ahamed, Asif Mishra, Asit Thekkumpate, Asma Kuriparambil Dattagupta, Ayush Zhu, Banghua Sadeghi, Bardiya Simkin, Barnaby Lanir, Ben Schifferer, Benedikt Nushi, Besmira Kartal, Bilal Rouhani, Bita Darvish Ginsburg, Boris Norick, Brandon Soubasis, Brandon Kisacanin, Branislav Yu, Brian Catanzaro, Bryan del Mundo, Carlo Hwang, Chantal Wang, Charles Hsieh, Cheng-Ping Zhang, Chenghao Yu, Chenhan Mungekar, Chetan Patel, Chintan Alexiuk, Chris Parisien, Christopher Neale, Collin Meurillon, Cyril Mosk-Aoyama, Damon Su, Dan Corneil, Dane Afrimi, Daniel Lo, Daniel Rohrer, Daniel Serebrenik, Daniel Gitman, Daria Levy, Daria Stosic, Darko Mosallanezhad, David Narayanan, Deepak Nathawani, Dhruv Rekesh, Dima Yared, Dina Kakwani, Divyanshu Ahn, Dong Riach, Duncan Stosic, Dusan Minasyan, Edgar Lin, Edward Long, Eileen Long, Eileen Peters Segal, Elad Lantz, Elena Evans, Ellie Ning, Elliott Chung, Eric Harper, Eric Tramel, Eric Galinkin, Erick Pounds, Erik Briones, Evan Bakhturina, Evelina Tsykunov, Evgeny Ladhak, Faisal Wang, Fay Jia, Fei Soares, Felipe Chen, Feng Galko, Ferenc Sun, Frank Siino, Frankie Agam, Gal Hubara Ajjanagadde, Ganesh Bhatt, Gantavya Prasad, Gargi Armstrong, George Shen, Gerald Batmaz, Gorkem Nalbandyan, Grigor Qian, Haifeng Sharma, Harsh Ross, Hayley Ngo, Helen Hum, Herbert Sahota, Herman Wang, Hexin Soni, Himanshu Upadhyay, Hiren Mao, Huizi Nguyen, Huy C Nguyen, Huy Q Cunningham, Iain Galil, Ido Shahaf, Ido Gitman, Igor Loshchilov, Ilya Schen, Itamar Levy, Itay Moshkov, Ivan Golan, Izik Putterman, Izzy Kautz, Jan Scowcroft, Jane Polak Casper, Jared Mitra, Jatin Glick, Jeffrey Chen, Jenny Oliver, Jesse Zhang, Jian Zeng, Jiaqi Lou, Jie Zhang, Jimmy Choi, Jinhang Huang, Jining Conway, Joey Guman, Joey Kamalu, John Greco, Johnny Cohen, Jonathan Jennings, Joseph Daw, Joyjit Vialard, Julien Veron Yi, Junkeun Parmar, Jupinder Xu, Kai Zhu, Kan Briski, Kari Cheung, Katherine Luna, Katherine Wyss, Keith Santhanam, Keshav Shih, Kevin Kong, Kezhi Bhardwaj, Khushi Shankar, Kirthi Puvvada, Krishna C. Pawelec, Krzysztof Anik, Kumar McAfee, Lawrence Sleiman, Laya Derczynski, Leon Ding, Li Wei, Lizzie Liebenwein, Lucas Vega, Luis Grover, Maanu Van Segbroeck, Maarten de Melo, Maer Rodrigues Nazemi, Mahdi Sreedhar, Makesh Narsimhan Kilaru, Manoj Ashkenazi, Maor Romeijn, Marc Chochowski, Marcin Cai, Mark Kliegl, Markus Moosaei, Maryam Kulka, Matt Novikov, Matvei Samadi, Mehrzad Corpuz, Melissa Wang, Mengru Price, Meredith Andersch, Michael Boone, Michael Evans, Michael Martinez, Miguel Khona, Mikail Chrzanowski, Mike Lee, Minseok Dabbah, Mohammad Shoeybi, Mohammad Patwary, Mostofa Mulepati, Nabin Nabwani, Najeeb Hereth, Natalie Assaf, Nave Habibi, Negar Zmora, Neta Haber, Netanel Sessions, Nicola Bhatia, Nidhi Jukar, Nikhil Pope, Nikki Ludwig, Nikolai Tajbakhsh, Nima Ailon, Nir Juluru, Nirmal Sharma, Nishant Hrinchuk, Oleksii Kuchaiev, Oleksii Delalleau, Olivier Olabiyi, Oluwatobi Argov, Omer Ullman Puny, Omri Tropp, Oren Xie, Ouye Chadha, Parth Shamis, Pasha Gibbons, Paul Molchanov, Pavlo Morkisz, Pawel Dykas, Peter Jin, Peter Xu, Pinky Januszewski, Piotr Thombre, Pranav Prashant Varshney, Prasoon Gundecha, Pritam Tredak, Przemek Miao, Qing Wan, Qiyu Mahabadi, Rabeeh Karimi Garg, Rachit El-Yaniv, Ran Zilberstein, Ran Shafipour, Rasoul Harang, Rich Izzo, Rick Shahbazyan, Rima Garg, Rishabh Borkar, Ritika Gala, Ritu Islam, Riyad Hesse, Robert Waleffe, Roger Watve, Rohit Koren, Roi Zhang, Ruoxi Hewett, Russell Hewett, Russell J. Prenger, Ryan Timbrook, Ryan Mahdavi, Sadegh Modi, Sahil Kriman, Samuel Lim, Sangkug Kariyappa, Sanjay Satheesh, Sanjeev Kaji, Saori Pasumarthi, Satish Muralidharan, Saurav Narentharen, Sean Narenthiran, Sean Bak, Seonmyeong Kashirsky, Sergey Poulos, Seth Mor, Shahar Ramasamy, Shanmugam Acharya, Shantanu Ghosh, Shaona Sreenivas, Sharath Turuvekere Thomas, Shelby Fan, Shiqing Gopal, Shreya Prabhumoye, Shrimai Pachori, Shubham Toshniwal, Shubham Ding, Shuoyang Singh, Siddharth Sun, Simeng Ithape, Smita Majumdar, Somshubra Singhal, Soumye Sergienko, Stas Alborghetti, Stefania Ge, Stephen Devare, Sugam Dipak Barua, Sumeet Kumar Panguluri, Suseella Gupta, Suyog Priyadarshi, Sweta Akter, Syeda Nahida Bui, Tan Ene, Teodor-Dumitru Kong, Terry Do, Thanh Blankevoort, Tijmen Moon, Tim Balough, Tom Asida, Tomer Natan, Tomer Bar Ronen, Tomer Konuk, Tugrul Vashishth, Twinkle Karpas, Udi De, Ushnish Noorozi, Vahid Noroozi, Vahid Srinivasan, Venkat Elango, Venmugil Cui, Victor Korthikanti, Vijay Rao, Vinay Kurin, Vitaly Lavrukhin, Vitaly Anisimov, Vladimir Jiang, Wanli Ahmad, Wasi Uddin Du, Wei Ping, Wei Zhou, Wenfei Jennings, Will Zhang, William Prazuch, Wojciech Ren, Xiaowei Karnati, Yashaswi Choi, Yejin Meyer, Yev Wu, Yi-Fu Zhang, Yian Qin, Yigong Lin, Ying Geifman, Yonatan Fu, Yonggan Subara, Yoshi Suhara, Yoshi Gao, Yubo Moshe, Zach Dong, Zhen Zhu, Zhongbo Liu, Zihan Chen, Zijia Yan, Zijie Computation and Language Artificial Intelligence Machine Learning We introduce the Nemotron 3 family of models - Nano, Super, and Ultra. These models deliver strong agentic, reasoning, and conversational capabilities. The Nemotron 3 family uses a Mixture-of-Experts hybrid Mamba-Transformer architecture to provide best-in-class throughput and context lengths of up to 1M tokens. Super and Ultra models are trained with NVFP4 and incorporate LatentMoE, a novel approach that improves model quality. The two larger models also include MTP layers for faster text generation. All Nemotron 3 models are post-trained using multi-environment reinforcement learning enabling reasoning, multi-step tool use, and support granular reasoning budget control. Nano, the smallest model, outperforms comparable models in accuracy while remaining extremely cost-efficient for inference. Super is optimized for collaborative agents and high-volume workloads such as IT ticket automation. Ultra, the largest model, provides state-of-the-art accuracy and reasoning performance. Nano is released together with its technical report and this white paper, while Super and Ultra will follow in the coming months. We will openly release the model weights, pre- and post-training software, recipes, and all data for which we hold redistribution rights.
title	NVIDIA Nemotron 3: Efficient and Open Intelligence
topic	Computation and Language Artificial Intelligence Machine Learning
url	https://arxiv.org/abs/2512.20856

Similar Items