Pretraining Large Language Models with NVFP4

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: NVIDIA, Abecassis, Felix, Agrusa, Anjulie, Ahn, Dong, Alben, Jonah, Alborghetti, Stefania, Andersch, Michael, Arayandi, Sivakumar, Bjorlin, Alexis, Blakeman, Aaron, Briones, Evan, Buck, Ian, Catanzaro, Bryan, Chang, Muya, Choi, Jinhang, Chrzanowski, Mike, Chung, Eric, Cui, Victor, Dai, Steve, Rouhani, Bita Darvish, del Mundo, Carlo, Donia, Deena, Eryilmaz, Burc, Estela, Henry, Goel, Abhinav, Goncharov, Oleg, Guvvala, Yugi, Hesse, Robert, Hewett, Russell, Hum, Herbert, Kapasi, Ujval, Khailany, Brucek, Khona, Mikail, Knight, Nick, Kondratenko, Alex, Krashinsky, Ronny, Lanir, Ben, Layton, Simon, Lightstone, Michael, Lo, Daniel, Micikevicius, Paulius, Mishra, Asit, Moon, Tim, Narayanan, Deepak, Ni, Chao, Paithankar, Abhijit, Pasumarthi, Satish, Patel, Ankit, Patwary, Mostofa, Poojary, Ashwin, Prasad, Gargi, Priyadarshi, Sweta, Qin, Yigong, Ren, Xiaowei, Rybakov, Oleg, Sakr, Charbel, Satheesh, Sanjeev, Sergienko, Stas, Shamis, Pasha, Shankar, Kirthi, Sharma, Nishant, Shoeybi, Mohammad, Siu, Michael, Smelyanskiy, Misha, Stosic, Darko, Stosic, Dusan, Su, Bor-Yiing, Sun, Frank, Tajbakhsh, Nima, Thomas, Shelby, Tredak, Przemek, Tsykunov, Evgeny, Vaithilingam, Gandhi, Vavre, Aditya, Venkatesan, Rangharajan, Waleffe, Roger, Wan, Qiyu, Wang, Hexin, Wang, Mengdi, Wei, Lizzie, Wu, Hao, Wu, Evan, Wyss, Keith, Xu, Ning, Xue, Jinze, Yang, Charlene, Zhai, Yujia, Zhang, Ruoxi, Zhu, Jingyang, Zhu, Zhongbo
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!