Paper Reading and Discussion #3
  • If you can, please make sure to register to Edit this document!

Date: May 16, 2020, May 9 2020

Title: TLDR: Extreme Summarization of Scientific Documents

Authors: Isabel Cachola, Kyle Lo, Arman Cohan, Daniel S. Weld

Abstract: We introduce TLDR generation for scientific papers, a new automatic summarization task with high source compression, requiring expert background knowledge and complex language understanding. To facilitate research on this task, we introduce SciTLDR, a dataset of 3.9K TLDRs. Furthermore, we introduce a novel annotation protocol for scalably curating additional gold summaries by rewriting peer review comments. We use this protocol to augment our test set, yielding multiple gold TLDRs for evaluation, which is unlike most recent summarization datasets that assume only one valid gold summary. We present a training strategy for adapting pretrained language models that exploits similarities between TLDR generation and the related task of title generation, which outperforms strong extractive and abstractive summarization baselines.


Slack channel: paper_reading_tldr


Website: https://dair.ai/
Newsletter: https://dair.ai/newsletter/

Why Paper Reading/Discussion?
  • Enable a fun and open place to discuss about the latest research in NLP and ML
  • Keeping up with the fast pace of ML and NLP research
  • Create a community where you can feel free to bounce off ideas/start conversations and always know that you are welcome to do so 
  • Connect and engage with academics and industry practitioners

Agenda/Housekeeping

  • Introductions in chat
  • Where you from?
  • One thing you would love to get from today’s session?
  • Format of the paper reading sessions
  • Silent reading (~90 minutes)?
  • Open Discussion (30 minutes)
  • Introduction (5 minutes)
  • Method/Results (15 minutes)
  • Practicality (5 minutes)
  • Questions (5 minutes)
  • Note taking, especially during discussions (Volunteers! 🙏 )
  • GitHub repo to upload notes and track discussions

Discussion 🤓 

Introduction  
Discuss the motivation and objectives of this paper at a high level. As we read through the paper we can all take notes on the points we found important to emphasize and have further discussion about.