Saved in:
| Main Authors: | Javis AI Team, Singh, Amrendra, Shah, Maulik, Sampath, Dharshan |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2507.08865 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Chinese ModernBERT with Whole-Word Masking
by: Zhao, Zeyu, et al.
Published: (2025)
by: Zhao, Zeyu, et al.
Published: (2025)
Patent Language Model Pretraining with ModernBERT
by: Yousefiramandi, Amirhossein, et al.
Published: (2025)
by: Yousefiramandi, Amirhossein, et al.
Published: (2025)
TabiBERT: A Large-Scale ModernBERT Foundation Model and A Unified Benchmark for Turkish
by: Türker, Melikşah, et al.
Published: (2025)
by: Türker, Melikşah, et al.
Published: (2025)
ModernBERT + ColBERT: Enhancing biomedical RAG through an advanced re-ranking retriever
by: Rivera, Eduardo Martínez, et al.
Published: (2025)
by: Rivera, Eduardo Martínez, et al.
Published: (2025)
Clinical ModernBERT: An efficient and long context encoder for biomedical text
by: Lee, Simon A., et al.
Published: (2025)
by: Lee, Simon A., et al.
Published: (2025)
ModernBERT is More Efficient than Conventional BERT for Chest CT Findings Classification in Japanese Radiology Reports
by: Yamagishi, Yosuke, et al.
Published: (2025)
by: Yamagishi, Yosuke, et al.
Published: (2025)
ModernBERT or DeBERTaV3? Examining Architecture and Data Influence on Transformer Encoder Models Performance
by: Antoun, Wissam, et al.
Published: (2025)
by: Antoun, Wissam, et al.
Published: (2025)
Pretraining Finnish ModernBERTs
by: Reunamo, Akseli, et al.
Published: (2025)
by: Reunamo, Akseli, et al.
Published: (2025)
A Diversity Diet for a Healthier Model: A Case Study of French ModernBERT
by: Estève, Louis, et al.
Published: (2026)
by: Estève, Louis, et al.
Published: (2026)
llm-jp-modernbert: A ModernBERT Model Trained on a Large-Scale Japanese Corpus with Long Context Length
by: Sugiura, Issa, et al.
Published: (2025)
by: Sugiura, Issa, et al.
Published: (2025)
NorBERTo: A ModernBERT Model Trained for Portuguese with 331 Billion Tokens Corpus
by: Silva, Enzo S. N., et al.
Published: (2026)
by: Silva, Enzo S. N., et al.
Published: (2026)
BioClinical ModernBERT: A State-of-the-Art Long-Context Encoder for Biomedical and Clinical NLP
by: Sounack, Thomas, et al.
Published: (2025)
by: Sounack, Thomas, et al.
Published: (2025)
TocBERT: Medical Document Structure Extraction Using Bidirectional Transformers
by: Saleh, Majd, et al.
Published: (2024)
by: Saleh, Majd, et al.
Published: (2024)
Lightweight Spatial Modeling for Combinatorial Information Extraction From Documents
by: Dong, Yanfei, et al.
Published: (2024)
by: Dong, Yanfei, et al.
Published: (2024)
Fin-ExBERT: User Intent based Text Extraction in Financial Context using Graph-Augmented BERT and trainable Plugin
by: Sarker, Soumick, et al.
Published: (2025)
by: Sarker, Soumick, et al.
Published: (2025)
Leveraging Semantic Triples for Private Document Generation with Local Differential Privacy Guarantees
by: Meisenbacher, Stephen, et al.
Published: (2025)
by: Meisenbacher, Stephen, et al.
Published: (2025)
KIEval: Evaluation Metric for Document Key Information Extraction
by: Khang, Minsoo, et al.
Published: (2025)
by: Khang, Minsoo, et al.
Published: (2025)
ViBERTgrid BiLSTM-CRF: Multimodal Key Information Extraction from Unstructured Financial Documents
by: Pala, Furkan, et al.
Published: (2024)
by: Pala, Furkan, et al.
Published: (2024)
Artificial Intelligence and the Spatial Documentation of Languages
by: Ghanim, Hakam
Published: (2024)
by: Ghanim, Hakam
Published: (2024)
Multi-Document Financial Question Answering using LLMs
by: Shah, Shalin, et al.
Published: (2024)
by: Shah, Shalin, et al.
Published: (2024)
Event-Arguments Extraction Corpus and Modeling using BERT for Arabic
by: Aljabari, Alaa, et al.
Published: (2024)
by: Aljabari, Alaa, et al.
Published: (2024)
Transformer-Based Extraction of Statutory Definitions from the U.S. Code
by: Hosabettu, Arpana, et al.
Published: (2025)
by: Hosabettu, Arpana, et al.
Published: (2025)
SUIT: Knowledge Editing with Subspace-Aware Key-Value Mappings
by: Park, Haewon, et al.
Published: (2025)
by: Park, Haewon, et al.
Published: (2025)
Improve Academic Query Resolution through BERT-based Question Extraction from Images
by: Kamal, Nidhi, et al.
Published: (2024)
by: Kamal, Nidhi, et al.
Published: (2024)
End-to-End Navigation with Vision Language Models: Transforming Spatial Reasoning into Question-Answering
by: Goetting, Dylan, et al.
Published: (2024)
by: Goetting, Dylan, et al.
Published: (2024)
m3BERT: A Modern, Multi-lingual, Matryoshka Bidirectional Encoder
by: Wang, Yaoxiang, et al.
Published: (2026)
by: Wang, Yaoxiang, et al.
Published: (2026)
Indexing and Visualization of Climate Change Narratives Using BERT and Causal Extraction
by: Sakaji, Hiroki, et al.
Published: (2024)
by: Sakaji, Hiroki, et al.
Published: (2024)
LongKey: Keyphrase Extraction for Long Documents
by: Alves, Jeovane Honorio, et al.
Published: (2024)
by: Alves, Jeovane Honorio, et al.
Published: (2024)
Enhancing TinyBERT for Financial Sentiment Analysis Using GPT-Augmented FinBERT Distillation
by: Thomas, Graison Jos
Published: (2024)
by: Thomas, Graison Jos
Published: (2024)
Enhancing Grammatical Error Detection using BERT with Cleaned Lang-8 Dataset
by: Nihalani, Rahul, et al.
Published: (2024)
by: Nihalani, Rahul, et al.
Published: (2024)
SLIDE: Sliding Localized Information for Document Extraction
by: Singh, Divyansh, et al.
Published: (2025)
by: Singh, Divyansh, et al.
Published: (2025)
FinAI-BERT: A Transformer-Based Model for Sentence-Level Detection of AI Disclosures in Financial Reports
by: Zafar, Muhammad Bilal
Published: (2025)
by: Zafar, Muhammad Bilal
Published: (2025)
It is Time to Develop an Auditing Framework to Promote Value Aware Chatbots
by: Wang, Yanchen, et al.
Published: (2024)
by: Wang, Yanchen, et al.
Published: (2024)
HyperBox: A Supervised Approach for Hypernym Discovery using Box Embeddings
by: Parmar, Maulik, et al.
Published: (2022)
by: Parmar, Maulik, et al.
Published: (2022)
A Combination of BERT and Transformer for Vietnamese Spelling Correction
by: Trung, Hieu Ngo, et al.
Published: (2024)
by: Trung, Hieu Ngo, et al.
Published: (2024)
Empirical Study on Updating Key-Value Memories in Transformer Feed-forward Layers
by: Qiu, Zihan, et al.
Published: (2024)
by: Qiu, Zihan, et al.
Published: (2024)
AraModernBERT: Transtokenized Initialization and Long-Context Encoder Modeling for Arabic
by: Elshehy, Omar, et al.
Published: (2026)
by: Elshehy, Omar, et al.
Published: (2026)
A Pluggable Multi-Task Learning Framework for Sentiment-Aware Financial Relation Extraction
by: Luo, Jinming, et al.
Published: (2025)
by: Luo, Jinming, et al.
Published: (2025)
On the Spatial Structure of Mixture-of-Experts in Transformers
by: Bershatsky, Daniel, et al.
Published: (2025)
by: Bershatsky, Daniel, et al.
Published: (2025)
Transformers need glasses! Information over-squashing in language tasks
by: Barbero, Federico, et al.
Published: (2024)
by: Barbero, Federico, et al.
Published: (2024)
Similar Items
-
Chinese ModernBERT with Whole-Word Masking
by: Zhao, Zeyu, et al.
Published: (2025) -
Patent Language Model Pretraining with ModernBERT
by: Yousefiramandi, Amirhossein, et al.
Published: (2025) -
TabiBERT: A Large-Scale ModernBERT Foundation Model and A Unified Benchmark for Turkish
by: Türker, Melikşah, et al.
Published: (2025) -
ModernBERT + ColBERT: Enhancing biomedical RAG through an advanced re-ranking retriever
by: Rivera, Eduardo Martínez, et al.
Published: (2025) -
Clinical ModernBERT: An efficient and long context encoder for biomedical text
by: Lee, Simon A., et al.
Published: (2025)