Cover Image

How to Choose a Threshold for an Evaluation Metric for Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sarmah, Bhaskarjit, Li, Mingshu, Lyu, Jingrao, Frank, Sebastian, Castellanos, Nathalia, Pasquali, Stefano, Mehta, Dhagash
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computation and Language Statistical Finance Applications
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extraction
by: Sarmah, Bhaskarjit, et al.
Published: (2024)

Can an unsupervised clustering algorithm reproduce a categorization system?
by: Castellanos, Nathalia, et al.
Published: (2024)

A Comparative Study of DSPy Teleprompter Algorithms for Aligning Large Language Models Evaluation Metrics to Human Evaluation
by: Sarmah, Bhaskarjit, et al.
Published: (2024)

AlphaAgents: Large Language Model based Multi-Agents for Equity Portfolio Constructions
by: Zhao, Tianjiao, et al.
Published: (2025)

Machine Learning-based Relative Valuation of Municipal Bonds
by: Saha, Preetha, et al.
Published: (2024)

Enhanced Local Explainability and Trust Scores with Random Forest Proximities
by: Rosaler, Joshua, et al.
Published: (2023)

Case-based Explainability for Random Forest: Prototypes, Critics, Counter-factuals and Semi-factuals
by: Yampolsky, Gregory, et al.
Published: (2024)

Quantile Regression using Random Forest Proximities
by: Li, Mingshu, et al.
Published: (2024)

FinReflectKG -- HalluBench: GraphRAG Hallucination Benchmark for Financial Question Answering Systems
by: Kumar, Mahesh, et al.
Published: (2026)

Uncovering Representation Bias for Investment Decisions in Open-Source Large Language Models
by: Dimino, Fabrizio, et al.
Published: (2025)

STRAPSim: A Portfolio Similarity Metric for ETF Alignment and Portfolio Trades
by: Li, Mingshu, et al.
Published: (2025)

Risk-Adjusted Harm Scoring for Automated Red Teaming for LLMs in Financial Services
by: Dimino, Fabrizio, et al.
Published: (2026)

FinReflectKG -- EvalBench: Benchmarking Financial KG with Multi-Dimensional Evaluation
by: Dimino, Fabrizio, et al.
Published: (2025)

FINCH: Financial Intelligence using Natural language for Contextualized SQL Handling
by: Singh, Avinash Kumar, et al.
Published: (2025)

Dynamic Skewness in Stochastic Volatility Models: A Penalized Prior Approach
by: Holtz, Bruno E., et al.
Published: (2025)

An Accurate Discretized Approach to Parameter Estimation in the CKLS Model via the CIR Framework
by: Barick, Sourojyoti
Published: (2025)

FinCARE: Financial Causal Analysis with Reasoning and Evidence
by: Michel, Alejandro, et al.
Published: (2025)

Tracing Positional Bias in Financial Decision-Making: Mechanistic Insights from Qwen2.5
by: Dimino, Fabrizio, et al.
Published: (2025)

High-frequency lead-lag relationships in the Chinese stock index futures market: tick-by-tick dynamics of calendar spreads
by: Li, Guanlin, et al.
Published: (2025)

Copula estimation for nonsynchronous financial data
by: Chakrabarti, Arnab, et al.
Published: (2019)

Forecasting the Evolving Composition of Inbound Tourism Demand: A Bayesian Compositional Time Series Approach Using Platform Booking Data
by: Katz, Harrison
Published: (2026)

Structured factor copulas for modeling the systemic risk of European and United States banks
by: Nguyen, Hoang, et al.
Published: (2024)

Credit scoring using neural networks and SURE posterior probability calibration
by: Garcin, Matthieu, et al.
Published: (2021)

The Impact of Oil and Gold Prices Shock on Tehran Stock Exchange: A Copula Approach
by: Najafabadi, Amir T. Payandeh, et al.
Published: (2020)

Scaling and shape of financial returns distributions modeled as conditionally independent random variables
by: Larralde, Hernán, et al.
Published: (2025)

Distributional Reference Class Forecasting of Corporate Sales Growth With Multiple Reference Variables
by: Theising, Etienne
Published: (2024)

Predicting Value at Risk for Cryptocurrencies With Generalized Random Forests
by: Buse, Rebekka, et al.
Published: (2022)

The $κ$-generalised Distribution for Stock Returns
by: Forbes, Samuel
Published: (2024)

Coupled Supply and Demand Forecasting in Platform Accommodation Markets
by: Katz, Harrison
Published: (2026)

Polyspectral Mean based Time Series Clustering of Indian Stock Market
by: Ghosh, Dhrubajyoti
Published: (2025)

Distributional Fitting and Tail Analysis of Lead-Time Compositions: Nights vs. Revenue on Airbnb
by: Katz, Harrison E., et al.
Published: (2026)

Lead Times in Flux: Analyzing Airbnb Booking Dynamics During Global Upheavals (2018-2022)
by: Katz, Harrison, et al.
Published: (2025)

Regularization for electricity price forecasting
by: Uniejewski, Bartosz
Published: (2024)

Pairs Trading Using a Novel Graphical Matching Approach
by: Qureshi, Khizar, et al.
Published: (2024)

Time Series Analysis in American Stock Market Recovering in Post COVID-19 Pandemic Period
by: Fu, Weilin, et al.
Published: (2022)

Multivariate Simulation-based Forecasting for Intraday Power Markets: Modelling Cross-Product Price Effects
by: Hirsch, Simon, et al.
Published: (2023)

Analysing Models for Volatility Clustering with Subordinated Processes: VGSA and Beyond
by: Barick, Sourojyoti, et al.
Published: (2025)

How to verify that a given process is a Lévy-Driven Ornstein-Uhlenbeck Process
by: Abdelrazeq, Ibrahim, et al.
Published: (2025)

Directional-Shift Dirichlet ARMA Models for Compositional Time Series with Structural Break Intervention
by: Katz, Harrison
Published: (2026)

FinReflectKG -- MultiHop: Financial QA Benchmark for Reasoning with Knowledge Graph Evidence
by: Arun, Abhinav, et al.
Published: (2025)