resurchify Conferences Journals Workshops Seminars
      
SYMPOSIUMS MEETINGS CONFERENCE RANKING JOURNAL RANKING IMPACT FACTOR BLOGS



EvalNLGEval 2020 : 1st Workshop on Evaluating NLG Evaluation

Dublin, Ireland (online conference)
Event Date: Dec 18, 2020 - Dec 18, 2020
Submission Deadline: Sep 20, 2020
Notification of Acceptance: Oct 20, 2020
Camera Ready Version Due : Nov 20, 2020

About

This workshop is intended as a discussion platform on the status and the future of the evaluation of Natural Language Generation systems. Among other topics, we will discuss current evaluation quality, human versus automated metrics, and the development of shared tasks for NLG evaluation. The workshop also involves an ‘unshared task’, where participants are invited to experiment with evaluation data from earlier shared tasks.

Call For Paper

We invite papers on any topic related to the evaluation of NLG systems, including (but not limited to):

  • Qualitative studies, definitions of evaluation metrics (e.g., readability, fluency, semantic correctness)
  • Crowdsourcing Strategies, qualitative tests for crowdsourcing (How to elucidate evaluation metrics?)
  • Looking at individual differences and cognitive biases in human evaluation (expert vs. non-expert, L1 vs L2 speakers)
  • Best practices for system evaluations (How does your lab choose models?)
  • Qualitative study/error analysis approaches
  • Demo: Systems that make the evaluation easier
  • Comparison of metrics across different NLG tasks (captioning, data2text, story generation, summarization…) or different languages (with a focus on low-resource languages)
  • Evaluation surveys
  • Opinion pieces and commentary on trends in evaluation

Hotel Deals

Booking.com

Check Other Conferences, Workshops, and Seminars

OTHER NATURAL LANGUAGE GENERATION EVENTS

AIWolfDial 2019 : The 1st Workshop of AI Werewolf and Dialog System
Tokyo
Oct 29, 2019
MSR 2019 : Second Workshop on Multilingual Surface Realization (+ Shared task)
Hong Kong
Nov 3, 2019
INLG 2019 : 12th International Conference on Natural Language Generation Conference Series
Tokyo, Japan
Oct 29, 2019

OTHER NATURAL LANGUAGE PROCESSING EVENTS

DDIF 2020 : ICDM 2020 Workshop on Deep Data Intelligence for Finance
Sorrento, Italy
Nov 17, 2020
SLTC 2020 : 8th Swedish Language Technology Conference
Gothenburg, Sweden
Nov 25, 2020
iSAI-NLP 2020 and AIoT 2020 : The 15th International Joint Symposium on Artificial Intelligence and Natural Language Processing and The International Conference on Artificial Intelligence and Internet of Things
Bangkok, Thailand
Nov 18, 2020
MLNLP 2020 : 3rd International Conference on Machine Learning and Natural Language Processing
Sanya, China
Dec 24, 2020
SENTIRE 2020 : ICDM Workshop Series on Sentiment Analysis
Sorrento
Nov 17, 2020