Cover Image

Evaluating the Evaluator: Problems with SemEval-2020 Task 1 for Lexical Semantic Change Detection

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Phan-Tat, Bach, Heylen, Kris, Geeraerts, Dirk, De Pascale, Stefano, Speelmana, Dirk
Format:	Preprint
Published:	2026
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ReFRAME or Remain: Unsupervised Lexical Semantic Change Detection with Frame Semantics
by: Phan-Tat, Bach, et al.
Published: (2026)

Transparent Semantic Change Detection with Dependency-Based Profiles
by: Phan-Tat, Bach, et al.
Published: (2026)

Lexical Variation and Change
by: Geeraerts, Dirk, et al.
Published: (2023)

SemEval-2024 Task 1: Semantic Textual Relatedness for African and Asian Languages
by: Ousidhoum, Nedjma, et al.
Published: (2024)

SemEval-2025 Task 9: The Food Hazard Detection Challenge
by: Randl, Korbinian, et al.
Published: (2025)

MasonTigers at SemEval-2024 Task 1: An Ensemble Approach for Semantic Textual Relatedness
by: Goswami, Dhiman, et al.
Published: (2024)

Tübingen-CL at SemEval-2024 Task 1:Ensemble Learning for Semantic Relatedness Estimation
by: Zhang, Leixin, et al.
Published: (2024)

AILS-NTUA at SemEval-2026 Task 8: Evaluating Multi-Turn RAG Conversations
by: Athanasiou, Dimosthenis, et al.
Published: (2026)

SemEval-2025 Task 11: Bridging the Gap in Text-Based Emotion Detection
by: Muhammad, Shamsuddeen Hassan, et al.
Published: (2025)

AAdaM at SemEval-2024 Task 1: Augmentation and Adaptation for Multilingual Semantic Textual Relatedness
by: Zhang, Miaoran, et al.
Published: (2024)

Zero-Shot Commonsense Validation and Reasoning with Large Language Models: An Evaluation on SemEval-2020 Task 4 Dataset
by: Alfugaha, Rawand, et al.
Published: (2025)

HausaNLP at SemEval-2025 Task 11: Hausa Text Emotion Detection
by: Sani, Sani Abdullahi, et al.
Published: (2025)

SemEval-2026 Task 9: Detecting Multilingual, Multicultural and Multievent Online Polarization
by: Naseem, Usman, et al.
Published: (2026)

CRCL at SemEval-2024 Task 2: Simple prompt optimizations
by: Brutti-Mairesse, Clément, et al.
Published: (2024)

D-NLP at SemEval-2024 Task 2: Evaluating Clinical Inference Capabilities of Large Language Models
by: Altinok, Duygu
Published: (2024)

ATLANTIS at SemEval-2025 Task 3: Detecting Hallucinated Text Spans in Question Answering
by: Kobus, Catherine, et al.
Published: (2025)

SemEval-2024 Task 8: Multidomain, Multimodel and Multilingual Machine-Generated Text Detection
by: Wang, Yuxia, et al.
Published: (2024)

AIpom at SemEval-2024 Task 8: Detecting AI-produced Outputs in M4
by: Shirnin, Alexander, et al.
Published: (2024)

mdok-style at SemEval-2026 Task 10: Finetuning LLMs for Conspiracy Detection
by: Macko, Dominik
Published: (2026)

SemEval-2017 Task 4: Sentiment Analysis in Twitter using BERT
by: Das, Rupak Kumar, et al.
Published: (2024)

SemEval-2026 Task 6: CLARITY -- Unmasking Political Question Evasions
by: Thomas, Konstantinos, et al.
Published: (2026)

UoB-NLP at SemEval-2025 Task 11: Leveraging Adapters for Multilingual and Cross-Lingual Emotion Detection
by: De Leon, Frances Laureano, et al.
Published: (2025)

USTCCTSU at SemEval-2024 Task 1: Reducing Anisotropy for Cross-lingual Semantic Textual Relatedness Task
by: Li, Jianjian, et al.
Published: (2024)

University of Indonesia at SemEval-2025 Task 11: Evaluating State-of-the-Art Encoders for Multi-Label Emotion Detection
by: Hanif, Ikhlasul Akmal, et al.
Published: (2025)

KCLarity at SemEval-2026 Task 6: Encoder and Zero-Shot Approaches to Political Evasion Detection
by: Sage, Archie, et al.
Published: (2026)

eagerlearners at SemEval2024 Task 5: The Legal Argument Reasoning Task in Civil Procedure
by: Sabzevari, Hoorieh, et al.
Published: (2024)

mdok-style at SemEval-2026 Task 9: Finetuning LLMs for Multilingual Polarization Detection
by: Macko, Dominik, et al.
Published: (2026)

MALTO at SemEval-2024 Task 6: Leveraging Synthetic Data for LLM Hallucination Detection
by: Borra, Federico, et al.
Published: (2024)

SmurfCat at SemEval-2024 Task 6: Leveraging Synthetic Data for Hallucination Detection
by: Rykov, Elisei, et al.
Published: (2024)

CLaC at SemEval-2026 Task 6: Response Clarity Detection in Political Discourse
by: Turk, Nawar, et al.
Published: (2026)

NLU-STR at SemEval-2024 Task 1: Generative-based Augmentation and Encoder-based Scoring for Semantic Textual Relatedness
by: Malaysha, Sanad, et al.
Published: (2024)

SemEval-2026 Task 4: Narrative Story Similarity and Narrative Representation Learning
by: Hatzel, Hans Ole, et al.
Published: (2026)

SemEval-2026 Task 7: Everyday Knowledge Across Diverse Languages and Cultures
by: Ousidhoum, Nedjma, et al.
Published: (2026)

LTG at SemEval-2025 Task 10: Optimizing Context for Classification of Narrative Roles
by: Rønningstad, Egil, et al.
Published: (2025)

Archimedes-AUEB at SemEval-2024 Task 5: LLM explains Civil Procedure
by: Chlapanis, Odysseas S., et al.
Published: (2024)

IITK at SemEval-2024 Task 1: Contrastive Learning and Autoencoders for Semantic Textual Relatedness in Multilingual Texts
by: Basak, Udvas, et al.
Published: (2024)

WOLI at SemEval-2020 Task 12: Arabic Offensive Language Identification on Different Twitter Datasets
by: Otiefy, Yasser, et al.
Published: (2020)

Team A at SemEval-2025 Task 11: Breaking Language Barriers in Emotion Detection with Multilingual Models
by: Sahil, P Sam, et al.
Published: (2025)

BAMO at SemEval-2024 Task 9: BRAINTEASER: A Novel Task Defying Common Sense
by: Ansari, Baktash, et al.
Published: (2024)

UMBCLU at SemEval-2024 Task 1A and 1C: Semantic Textual Relatedness with and without machine translation
by: Dipta, Shubhashis Roy, et al.
Published: (2024)