LSHBloom: Memory-efficient, Extreme-scale Document Deduplication
Fuente:
arXiv
Saved in:
| Main Authors: | Khan, Arham, Underwood, Robert, Siebenschuh, Carlo, Babuji, Yadu, Ajith, Aswathy, Hippe, Kyle, Gokdemir, Ozan, Brace, Alexander, Chard, Kyle, Foster, Ian |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
AdaParse: An Adaptive Parallel PDF Parsing and Resource Scaling Engine
by: Siebenschuh, Carlo, et al.
Published: (2025)
by: Siebenschuh, Carlo, et al.
Published: (2025)
UniFaaS: Programming across Distributed Cyberinfrastructure with Federated Function Serving
by: Li, Yifei, et al.
Published: (2024)
by: Li, Yifei, et al.
Published: (2024)
Memory Injections: Correcting Multi-Hop Reasoning Failures during Inference in Transformer-Based Language Models
by: Sakarvadia, Mansi, et al.
Published: (2023)
by: Sakarvadia, Mansi, et al.
Published: (2023)
Employing Artificial Intelligence to Steer Exascale Workflows with Colmena
by: Ward, Logan, et al.
Published: (2024)
by: Ward, Logan, et al.
Published: (2024)
Scalable Agentic Reasoning for Designing Biologics Targeting Intrinsically Disordered Proteins
by: Sinclair, Matthew, et al.
Published: (2025)
by: Sinclair, Matthew, et al.
Published: (2025)
Parsl+CWL: Towards Combining the Python and CWL Ecosystems
by: Karle, Nishchay, et al.
Published: (2024)
by: Karle, Nishchay, et al.
Published: (2024)
Empowering Scientific Workflows with Federated Agents
by: Kamatar, Alok, et al.
Published: (2025)
by: Kamatar, Alok, et al.
Published: (2025)
Deep Model Merging: The Sister of Neural Network Interpretability -- A Survey
by: Khan, Arham, et al.
Published: (2024)
by: Khan, Arham, et al.
Published: (2024)
Flight: A FaaS-Based Framework for Complex and Hierarchical Federated Learning
by: Hudson, Nathaniel, et al.
Published: (2024)
by: Hudson, Nathaniel, et al.
Published: (2024)
Mitigating Memorization In Language Models
by: Sakarvadia, Mansi, et al.
Published: (2024)
by: Sakarvadia, Mansi, et al.
Published: (2024)
Connecting Large Language Model Agent to High Performance Computing Resource
by: Ma, Heng, et al.
Published: (2025)
by: Ma, Heng, et al.
Published: (2025)
GreenFaaS: Maximizing Energy Efficiency of HPC Workloads with FaaS
by: Kamatar, Alok, et al.
Published: (2024)
by: Kamatar, Alok, et al.
Published: (2024)
Combining Language and Graph Models for Semi-structured Information Extraction on the Web
by: Hong, Zhi, et al.
Published: (2024)
by: Hong, Zhi, et al.
Published: (2024)
HiPerRAG: High-Performance Retrieval Augmented Generation for Scientific Insights
by: Gokdemir, Ozan, et al.
Published: (2025)
by: Gokdemir, Ozan, et al.
Published: (2025)
Agentic Discovery: Closing the Loop with Cooperative Agents
by: Pauloski, J. Gregory, et al.
Published: (2025)
by: Pauloski, J. Gregory, et al.
Published: (2025)
Object Proxy Patterns for Accelerating Distributed Applications
by: Pauloski, J. Gregory, et al.
Published: (2024)
by: Pauloski, J. Gregory, et al.
Published: (2024)
BioAlchemy: Distilling Biological Literature into Reasoning-Ready Reinforcement Learning Training Data
by: Hsu, Brian, et al.
Published: (2026)
by: Hsu, Brian, et al.
Published: (2026)
AERO: An autonomous platform for continuous research
by: Hayot-Sasson, Valérie, et al.
Published: (2025)
by: Hayot-Sasson, Valérie, et al.
Published: (2025)
Topology-Aware Knowledge Propagation in Decentralized Learning
by: Sakarvadia, Mansi, et al.
Published: (2025)
by: Sakarvadia, Mansi, et al.
Published: (2025)
Automated MCQA Benchmarking at Scale: Evaluating Reasoning Traces as Retrieval Sources for Domain Adaptation of Small Language Models
by: Gokdemir, Ozan, et al.
Published: (2025)
by: Gokdemir, Ozan, et al.
Published: (2025)
Accelerating Python Applications with Dask and ProxyStore
by: Pauloski, J. Gregory, et al.
Published: (2024)
by: Pauloski, J. Gregory, et al.
Published: (2024)
Addressing Reproducibility Challenges in HPC with Continuous Integration
by: Hayot-Sasson, Valérie, et al.
Published: (2025)
by: Hayot-Sasson, Valérie, et al.
Published: (2025)
Steering a Fleet: Adaptation for Large-Scale, Workflow-Based Experiments
by: Pruyne, Jim, et al.
Published: (2024)
by: Pruyne, Jim, et al.
Published: (2024)
Diseño de cuestionarios : cómo planear, estructurar y redactar material de encuesta para una investigación de mercados eficaz / Ian Brace ; traducción Gloria E. Padilla Sierra
by: Brace, Ian
by: Brace, Ian
Experiences with Model Context Protocol Servers for Science and High Performance Computing
by: Pan, Haochen, et al.
Published: (2025)
by: Pan, Haochen, et al.
Published: (2025)
Scalable Cross-Facility Federated Learning for Scientific Foundation Models on Multiple Supercomputers
by: Li, Yijiang, et al.
Published: (2026)
by: Li, Yijiang, et al.
Published: (2026)
Optimizing Fine-Grained Parallelism Through Dynamic Load Balancing on Multi-Socket Many-Core Systems
by: Wang, Wenyi, et al.
Published: (2025)
by: Wang, Wenyi, et al.
Published: (2025)
The Changing World of Government Documents.
by: Brace, William
Published: (1996)
by: Brace, William
Published: (1996)
WRATH: Workload Resilience Across Task Hierarchies in Task-based Parallel Programming Frameworks
by: Zhou, Sicheng, et al.
Published: (2025)
by: Zhou, Sicheng, et al.
Published: (2025)
The False Promise of Zero-Shot Super-Resolution in Machine-Learned Operators
by: Sakarvadia, Mansi, et al.
Published: (2025)
by: Sakarvadia, Mansi, et al.
Published: (2025)
Octopus: Experiences with a Hybrid Event-Driven Architecture for Distributed Scientific Computing
by: Pan, Haochen, et al.
Published: (2024)
by: Pan, Haochen, et al.
Published: (2024)
Comprehensive Exploration of Synthetic Data Generation: A Survey
by: Bauer, André, et al.
Published: (2024)
by: Bauer, André, et al.
Published: (2024)
Icicle: Scalable Metadata Indexing and Real-Time Monitoring for HPC File Systems
by: Pan, Haochen, et al.
Published: (2026)
by: Pan, Haochen, et al.
Published: (2026)
FastqZip: An Improved Reference-Based Genome Sequence Lossy Compression Framework
by: Liu, Yuanjian, et al.
Published: (2024)
by: Liu, Yuanjian, et al.
Published: (2024)
TaPS: A Performance Evaluation Suite for Task-based Execution Frameworks
by: Pauloski, J. Gregory, et al.
Published: (2024)
by: Pauloski, J. Gregory, et al.
Published: (2024)
Exploring Distributed Vector Databases Performance on HPC Platforms: A Study with Qdrant
by: Ockerman, Seth, et al.
Published: (2025)
by: Ockerman, Seth, et al.
Published: (2025)
XaaS Containers: Performance-Portable Representation With Source and IR Containers
by: Copik, Marcin, et al.
Published: (2025)
by: Copik, Marcin, et al.
Published: (2025)
Assessing the radiation hazard due to cosmic radiation on flights near the poles
by: Yadu Krishnan
Published: (2025)
by: Yadu Krishnan
Published: (2025)
Quantum Integrated High-Performance Computing: Foundations, Architectural Elements and Future Directions
by: Raj, Suman, et al.
Published: (2026)
by: Raj, Suman, et al.
Published: (2026)
SciQAG: A Framework for Auto-Generated Science Question Answering Dataset with Fine-grained Evaluation
by: Wan, Yuwei, et al.
Published: (2024)
by: Wan, Yuwei, et al.
Published: (2024)
Similar Items
-
AdaParse: An Adaptive Parallel PDF Parsing and Resource Scaling Engine
by: Siebenschuh, Carlo, et al.
Published: (2025) -
UniFaaS: Programming across Distributed Cyberinfrastructure with Federated Function Serving
by: Li, Yifei, et al.
Published: (2024) -
Memory Injections: Correcting Multi-Hop Reasoning Failures during Inference in Transformer-Based Language Models
by: Sakarvadia, Mansi, et al.
Published: (2023) -
Employing Artificial Intelligence to Steer Exascale Workflows with Colmena
by: Ward, Logan, et al.
Published: (2024) -
Scalable Agentic Reasoning for Designing Biologics Targeting Intrinsically Disordered Proteins
by: Sinclair, Matthew, et al.
Published: (2025)