Okazaki Lab
日本語

Paper reading (2024)

Copied from: Public/Paper Reading 2023

このセミナーについて (About this seminar)

担当者が見つけた面白い研究を紹介するセミナーです。以下の内容で構成されます。 In this seminar, presenters share interesting studies that they found. The seminar consists of the following elements.

  1. 論文紹介 (Paper presentation): 面白いと思う論文(基本的にLong Paper)を選んで,その内容を著者の代わりになったつもりで発表する。 A presenter reads a paper (long paper is strongly preffered) that he or she finds interesting, and explains the content as if he or she was an author of the paper.
  2. 著者プレゼンの上映と解説 (Watching talk videos): 担当者は面白いと思う研究の発表動画を選び,その論文の内容を把握する。担当者の補足説明を聞きながら,参加者みんなで発表動画を鑑賞する。 Finding an interesting video presentation, a presenter reads and understands the content of the paper. Attendees watch the presentation video of the author of the paper. The presenter is expected to explain supplementary information about the research.

前者 (1) はプレゼンテーションの練習を兼ねています。後者 (2) は「よい」プレゼンテーションを鑑賞しながら,英語でのプレゼンテーションやディスカッションに慣れることを狙っています。 The former (1) aims at practicing presentations. The latter (2) aims at improving listening and discussion skills in English as we enjoy good presentations.

発表者は一人目は (1) を,二人目は (1) か (2) のどちらかを担当します。 The 1st presentator take (1). The 2nd one can select (1) or (2).

座長(chair)は、セミナーの司会進行をおこないます。 chair person host the seminar. 座長の仕事を参考にして,円滑に議論が進むように心がけてください。 Please contribute to active discussion refering to Chair's Job.

発表時間 (Presentation Time)

  • Presentation: 15 ~ 20 minnutes
  • QA: 5 ~ 10 minutes

日時 (Date and time)

  • 3Q: 13:30~ (Tues.)
  • 4Q: 15:25~ (Mon.)

参加者 (Attendee)

  • 全員

:exclamation: 発表を登録するときは,著者名,発表年,タイトル,会議名/ジャーナル名,(巻,号,ページ番号など)を必ず記入してください。preprintの論文は発表しないでください。 :exclamation: Please include author names, publication year, title, conference/journal name, (volume and page numbers) when you add an entry for presentation. Do not introduce papers of preprints.

論文へのリンク集 (Links to the papers)

  • ACL Anthlogy: TACL, ACL, NAACL, EMNLP, EACL, COLING, CoNLL, IJCNLP
  • AAAI
  • IJCAI
  • NeurIPS
  • ICML
  • ICLR

著者プレゼンテーションのリンク集 (Links to authors' presentations)

  • ACL 2022
  • EMNLP 2021
  • ICLR 2022 (Oral, Spotlight)
  • ICLR 2021
  • ICML 2021
  • ICML 2022
  • NeurIPS 2019~

Tips

  • リモートミーティングでビデオプレゼンテーションを行う場合は,画面およびオーディオを共有してください。
    • Zoomの場合:特別な操作は不要です
    • Microsoft Teamsの場合:システムオーディオの共有(Share the system audio)機能を利用してください。
  • When you stream the video presentation via remote meeting, please share the both screen and system audio.
    • For Zoom: You don't have to do nothing special. Just share your screen.
    • For Microsoft Teams: Please activate Share the system audio feature.

今後の予定 (Planned Seminars)

2024-12/16 (Mon) 15:25-17:05

  • seminar

    • shimada

      • Paper
      • Slide
    • shiotani

      • Can LLMs Recognize Toxicity? A Structured Investigation Framework and Toxicity Metric paper | slide
  • chair

    • takahashi

2024-12/23 (Mon) 15:25-17:05

  • seminar

    • maeda: ReCEval: Evaluating Reasoning Chains via Correctness and Informativeness (EMNLP2023) paper | slides(pdf) | slides(html)

    • koyama: Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps (EMNLP 2024) paper | slides

  • chair

    • hattori

### 2025-1/6 (Mon) 15:25-17:05 言語処理学会直前の為

### 2025-1/13 (Mon) 15:25-17:05 成人式の為

2025-1/20 (Mon) 15:25-17:05

  • seminar
    • david
    • hida
  • chair
    • panatchakorn

2024-01/27 (Mon) 15:25-17:05

  • seminar
    • yang
  • chair
    • maruyama

Past Seminars

2024-04/09(Tue) 17:15-18:55

  • seminar - wang - Mamba: Linear-Time Sequence Modeling with Selective State Spaces paper slide

     - hida
         - Exploring Cross-Cultural Differences in English Hate Speech Annotations: From Dataset Construction to Analysis(NAACL2024) [paper](https://arxiv.org/abs/2308.16705)   [slide](https://dl.esa.io/uploads/production/attachments/7452/2024/04/09/147552/aca8be9f-b0c7-4319-96d2-65c810868c09.pdf)
    

    ) - Nayeon Lee, Chani Jung, Junho Myung, Jiho Jin, Jose Camacho-Collados, Juho Kim, Alice Oh

  • chair

    • endo maruyama

2024-04/16(Tue) 17:15-18:55

  • seminar

    • koike
      • DNA-GPT: DIVERGENT N-GRAM ANALYSIS FOR TRAINING-FREE DETECTION OF GPT-GENERATED TEXT
        • Xianjun Yang, Wei Cheng, Yue Wu, Linda Ruth Petzold, William Yang Wang, Haifeng Chen; ICLR2024
        • Paper | Slide
    • maeda
      • LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation
        • Yujie Lu et al., NeurIPS 2023 Main Conf.
        • Paper | Slide
  • chair

    • hattori

2024-04/23(Tue) 17:15-18:55

  • seminar

    • vijay

      • Semantic Sensitivities and Inconsistent Predictions Measuring the Fragility of NLI Models
        • Paper
        • Slides
    • ma

      • Prompting is not a substitute for probability measurements in large language models (EMNLP 2023)
      • Jennifer Hu, Roger Levy
      • video, paper, author slides
  • chair

    • mizuki-kentaro

2024-04/30(Tue) 17:15-18:55

ゴールデンウィーク中日

2024-05/07(Tue) 17:15-18:55

  • potential research topic
  • chair
    • david

2024-05/14(Tue) 17:15-18:55

  • seminar

    • panatchakorn

      • We’re Afraid Language Models Aren’t Modeling Ambiguity (EMNLP 2023)
      • Alisa Liu, Zhaofeng Wu, Julian Michael, Alane Suhr, Peter West, Alexander Koller, Swabha Swayamdipta, Noah Smith, Yejin Choi
      • paper, slide
    • maruyama

      • Tree of Thoughts: Deliberate Problem Solving with Large Language Models (NeurIPS 2023)
      • Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, Karthik R Narasimhan
      • paper, video
  • chair

    • shimada shiotani

2024-05/21(Tue) 17:15-18:55

  • seminar

    • sangwhan
      • Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language Models (arXiv preprint)
      • Sander Land, Max Bartolo
      • paper, slides
    • yang
      • Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine Translation (EMNLP 2023)
      • Wenyu Guo, Qingkai Fang, Dong Yu, Yang Feng
      • paper , Slides
  • chair

    • david

2024-05/28(Tue) 17:15-18:55

  • seminar

    • hattori

      • Rho-1: Not All Tokens Are What You Need (arXiv preprint)
      • Paper, Slides
    • endo

  • chair

    • takahashi

2024-06/04(Tue) 17:15-18:55

  • seminar
    • yoshikawa
      • On Large Language Models’ Hallucination with Regard to Known Facts (NAACL 2024)
      • paper, slides
    • erick
  • chair
    • endo

2024-06/11(Tue) 17:15-18:55

  • seminar - koyama - Exploring Human-Like Translation Strategy with Large Language Models (TACL 2024) - Zhiwei He, Tian Liang, Wenxiang Jiao, Zhuosheng Zhang, Yujiu Yang, Rui Wang, Zhaopeng Tu, Shuming Shi, Xing Wang - paper, slide

     - ~~cognetta~~
    
  • chair

    • panatchakorn

2024-06/18(Tue) 17:15-18:55

  • seminar
    • mizuki-kentaro
      • Salewski et al., In-Context Impersonation Reveals Large Language Models' Strengths and Biases, NeurIPS 2023
      • Slide (PDF)
    • shimada
      • Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injection (NAACL 2024)
      • Jun Yan, Vikas Yadav, Shiyang Li, Lichang Chen, Zheng Tang, Hai Wang, Vijay Srinivasan, Xiang Ren, Hongxia Jin
      • Paper, Slides
  • chair
    • shiotani

2024-06/25(Tue) 17:15-18:55

  • seminar

    • shiotani

      • Evaluating the Moral Beliefs Encoded in LLMs (NeurIPS 2023)
      • Nino Scherrer, Claudia Shi, Amir Feder, David Blei
      • Slides, Paper
    • david

      • Slides
      • Paper: Alleviating the Long-Tail Problem in Conversational Recommender Systems
  • chair

    • maruyama

2024-07/02(Tue) 17:15-18:55

  • seminar

    • saito

      • Red Teaming Language Model Detectors with Language Models (TACL 2024)
      • Zhouxing Shi, Yihan Wang, Fan Yin, Xiangning Chen, Kai-Wei Chang, Cho-Jui Hsieh
      • Paper, Slides
    • takahashi

      • Beyond Memorization: Violating Privacy via Inference with Large Language Models (ICLR 2024)
      • Robin Staab · Mark Vero · Mislav Balunovic · Martin Vechev
      • paper, video
  • chair

    • mizuki-kentaro

2024-07/09(Tue) 17:15-18:55

absence of presenters

2024-07/16(Tue) 17:15-18:55

Shifted to following week

2024-07/23(Tue) 17:15-18:55

  • seminar

    • endo
      • slides
      • MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Tasks
    • marco
      • DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines (link)
      • In-Context Learning for Extreme Multi-Label Classification (link)
      • slides
  • chair

    • shimada

2024-10/22 (Tue) 13:30-15:10

  • seminar

    • panatchakorn

      • Confidence Under the Hood: An Investigation into the Confidence-Probability Alignment in Large Language Models (ACL'24)
      • paper, slide
    • maruyama

      • Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization
      • paper, slide
  • chair

    • endo

2024-10/29 (Tue) 13:30-15:10

  • seminar
    • hattori
      • Generative Verifiers: Reward Modeling as Next-Token Prediction (arXiv)
      • Paper, Slides
    • takahashi
      • Do Membership Inference Attacks Work on Large Language Models? (COLM 2024)
      • Paper, Slides
  • chair
    • panatchakorn

### 2024-11/5 (Tue) 13:30-15:10 大学祭のため

2024-11/12 (Tue) 13:30-15:10

  • seminar

    • muraoka

      • Paper: "Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMs" (Tong et al., CVPR'24)
      • Slides: 241112_PR_muraoka.pdf (4.3 MB)
    • saito

      • Paper: "AI-generated text boundary detection with RoFT" (Kushnareva et al., COLM'24)
      • Slides: paper_reading_1112_v1.pdf (1.3 MB)
  • chair

    • yamada (arase lab)

2024-11/19 (Tue) 13:30-15:10

  • seminar

    • yamada (arase lab)

      • Paper: RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models (Niu et al., ACL 2024)
      • Slides: RAGTruth.pdf (804.1 kB)
    • WU (arase lab)

      • Paper: xcomet: Transparent Machine Translation Evaluation through Fine-grained Error Detection (Guerreiro et al., ACL 2024)
      • Slides: reading_group_xuanxin_20241119.pdf (866.1 kB)
  • chair

    • shimada

2024-11/26 (Tue) 13:30-15:10

  • seminar

    • LUO (arase lab)

      • Paper https://aclanthology.org/2024.acl-long.715.pdf
      • Slides paper_reading_luo_241126.pdf (1.1 MB)
    • endo

      • Paper https://aclanthology.org/2024.naacl-long.95.pdf
      • Slides Ghostbuster_ Detecting Text Ghostwritten by Large Language Models.pdf (580.0 kB)
  • chair - hattori ### 2024-12/3 (Tue) 13:30-15:10 absense of presenters

2024-12/9 (Mon) 15:25-17:05

  • seminar

    • sangwhan
      • Tokenization is More Than Compression - Schmidt et al., 2024 (EMNLP 2024)
      • Paper: anthology
      • Slides: master, pdf
    • marco
      • CUTE: Measuring LLMs’ Understanding of Their Tokens (Edman et al., EMNLP 2024)
      • Paper
      • Slides
  • chair

    • david