---
title: 【人工知能・深層学習】レビュー：モダリティギャップの研究紹介
tags:  #論文紹介 #deeplearning #深層学習 #人工知能 #マルチモーダル #モダリティギャップ  
author: [Taki lab.](https://www.docswell.com/user/8328889256)
site: [Docswell](https://www.docswell.com/)
thumbnail: https://bcdn.docswell.com/page/Y76QZXMZ7V.jpg?width=480
description: 【学生の情報】：D2 安木駿介、https://snskysk.github.io/、https://www.docswell.com/user/snskysk  【論文の学術分野】：Computer Vision and Pattern Recognition; Machine Learning; Computation and Language 【レビュー対象論文】： Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning (NeurIPS 2022) UNDERSTANDING THE MODALITY GAP IN CLIP (ICLR 2023 workshop) It’s Not a Modality Gap: Characterizing and Addressing the Contrastive Gap (2024/06) Mitigate the Gap: Investigating Approaches for Improving Cross-Modal Alignment in CLIP (2024/06) Two Effects, One Trigger: On the Modality Gap, Object Bias, and Information Imbalance in Contrastive Vision-Language Models (2024/10) Explaining and Mitigating the Modality Gap in Contrastive Multimodal Learning (2024/12) Cross the Gap: Exposing the Intra-modal Misalignment in CLIP via Modality Inversion (ICLR2025 2025/02)  【概要】：マルチモーダルモデルの表現空間における「モダリティギャップ」という幾何学的現象に関して、最近のいくつかの研究論文を取り上げて研究動向をレビューします。論文によって、ギャップの発生原因やギャップを閉じることの効果に関する見解が異なるなどの研究状況が読み取れます。  【注意書き】：研究室内で発表に利用したものです。自分用のメモも兼ねていますので、情報が混みあっています。解釈に誤りがある可能性がありますので、ご参考いただく際はご注意ください。**資料の転用は禁止しております。**
published: April 18, 25
canonical: https://www.docswell.com/s/8328889256/5EXMXD-2025-04-18-131029
---
# Page. 1

![Page Image](https://bcdn.docswell.com/page/Y76QZXMZ7V.jpg)

モダリティギャップの研究紹介
2025/02
立教大学人工知能科学研究科
瀧雅人研究室D2 安木 駿介


# Page. 2

![Page Image](https://bcdn.docswell.com/page/G75RWXZ9E4.jpg)



# Page. 3

![Page Image](https://bcdn.docswell.com/page/9J2DQXR5JR.jpg)



# Page. 4

![Page Image](https://bcdn.docswell.com/page/DEY2W8D6EM.jpg)



# Page. 5

![Page Image](https://bcdn.docswell.com/page/VJN89QN178.jpg)



# Page. 6

![Page Image](https://bcdn.docswell.com/page/YE9K2DRYE3.jpg)



# Page. 7

![Page Image](https://bcdn.docswell.com/page/GE8R53WKJD.jpg)



# Page. 8

![Page Image](https://bcdn.docswell.com/page/LELKYVNPJR.jpg)



# Page. 9

![Page Image](https://bcdn.docswell.com/page/4JM2NGX2JW.jpg)



# Page. 10

![Page Image](https://bcdn.docswell.com/page/PJRMDZN5E9.jpg)



# Page. 11

![Page Image](https://bcdn.docswell.com/page/PEXV19NX7X.jpg)



# Page. 12

![Page Image](https://bcdn.docswell.com/page/3EKQ2PN9ED.jpg)



# Page. 13

![Page Image](https://bcdn.docswell.com/page/L73P4XV9E5.jpg)



# Page. 14

![Page Image](https://bcdn.docswell.com/page/87DLQ288EG.jpg)



# Page. 15

![Page Image](https://bcdn.docswell.com/page/VJP2L18WJ8.jpg)



# Page. 16

![Page Image](https://bcdn.docswell.com/page/2EVDQYN9EQ.jpg)



# Page. 17

![Page Image](https://bcdn.docswell.com/page/57GYW9K47L.jpg)



# Page. 18

![Page Image](https://bcdn.docswell.com/page/4EQM3WNRJP.jpg)



# Page. 19

![Page Image](https://bcdn.docswell.com/page/KJ4V1KGQE1.jpg)



# Page. 20

![Page Image](https://bcdn.docswell.com/page/LE13GXDLJG.jpg)



# Page. 21

![Page Image](https://bcdn.docswell.com/page/GEWPKNYQJ2.jpg)



# Page. 22

![Page Image](https://bcdn.docswell.com/page/47ZKZ3X373.jpg)



# Page. 23

![Page Image](https://bcdn.docswell.com/page/YJ6QZX4ZJV.jpg)



# Page. 24

![Page Image](https://bcdn.docswell.com/page/GJ5RWXQ974.jpg)



# Page. 25

![Page Image](https://bcdn.docswell.com/page/9E2DQXP5ER.jpg)



# Page. 26

![Page Image](https://bcdn.docswell.com/page/D7Y2W8567M.jpg)



# Page. 27

![Page Image](https://bcdn.docswell.com/page/VEN89Q41J8.jpg)



# Page. 28

![Page Image](https://bcdn.docswell.com/page/Y79K2DQY73.jpg)



# Page. 29

![Page Image](https://bcdn.docswell.com/page/G78R53GKED.jpg)



# Page. 30

![Page Image](https://bcdn.docswell.com/page/L7LKYVGPER.jpg)



# Page. 31

![Page Image](https://bcdn.docswell.com/page/4EM2NGQ2EW.jpg)



# Page. 32

![Page Image](https://bcdn.docswell.com/page/PERMDZ8579.jpg)



# Page. 33

![Page Image](https://bcdn.docswell.com/page/P7XV198XJX.jpg)



# Page. 34

![Page Image](https://bcdn.docswell.com/page/37KQ2PK97D.jpg)



# Page. 35

![Page Image](https://bcdn.docswell.com/page/LJ3P4XZ975.jpg)



# Page. 36

![Page Image](https://bcdn.docswell.com/page/8JDLQ2R87G.jpg)



# Page. 37

![Page Image](https://bcdn.docswell.com/page/VEP2L1WWE8.jpg)



# Page. 38

![Page Image](https://bcdn.docswell.com/page/27VDQY897Q.jpg)



# Page. 39

![Page Image](https://bcdn.docswell.com/page/5JGYW954JL.jpg)



# Page. 40

![Page Image](https://bcdn.docswell.com/page/47QM3WZREP.jpg)



# Page. 41

![Page Image](https://bcdn.docswell.com/page/KE4V1K3Q71.jpg)



# Page. 42

![Page Image](https://bcdn.docswell.com/page/L713GX1LEG.jpg)



# Page. 43

![Page Image](https://bcdn.docswell.com/page/G7WPKN8QE2.jpg)



# Page. 44

![Page Image](https://bcdn.docswell.com/page/4JZKZ383J3.jpg)



# Page. 45

![Page Image](https://bcdn.docswell.com/page/YE6QZXPZEV.jpg)



# Page. 46

![Page Image](https://bcdn.docswell.com/page/GE5RWXK9J4.jpg)



# Page. 47

![Page Image](https://bcdn.docswell.com/page/972DQXW57R.jpg)



# Page. 48

![Page Image](https://bcdn.docswell.com/page/DJY2W8L6JM.jpg)



# Page. 49

![Page Image](https://bcdn.docswell.com/page/V7N89QL1E8.jpg)



# Page. 50

![Page Image](https://bcdn.docswell.com/page/YJ9K2D4YJ3.jpg)



# Page. 51

![Page Image](https://bcdn.docswell.com/page/GJ8R53QK7D.jpg)



# Page. 52

![Page Image](https://bcdn.docswell.com/page/LJLKYVXP7R.jpg)



# Page. 53

![Page Image](https://bcdn.docswell.com/page/47M2NGL27W.jpg)



# Page. 54

![Page Image](https://bcdn.docswell.com/page/P7RMDZK5J9.jpg)



# Page. 55

![Page Image](https://bcdn.docswell.com/page/PJXV19LXEX.jpg)



# Page. 56

![Page Image](https://bcdn.docswell.com/page/3JKQ2PL9JD.jpg)



# Page. 57

![Page Image](https://bcdn.docswell.com/page/LE3P4X39J5.jpg)



# Page. 58

![Page Image](https://bcdn.docswell.com/page/8EDLQ248JG.jpg)



# Page. 59

![Page Image](https://bcdn.docswell.com/page/V7P2L1MW78.jpg)



# Page. 60

![Page Image](https://bcdn.docswell.com/page/2JVDQY99JQ.jpg)



# Page. 61

![Page Image](https://bcdn.docswell.com/page/5EGYW9Z4EL.jpg)



# Page. 62

![Page Image](https://bcdn.docswell.com/page/4JQM3WLR7P.jpg)



# Page. 63

![Page Image](https://bcdn.docswell.com/page/K74V1KDQJ1.jpg)



# Page. 64

![Page Image](https://bcdn.docswell.com/page/LJ13GXZL7G.jpg)



# Page. 65

![Page Image](https://bcdn.docswell.com/page/GJWPKN9Q72.jpg)



# Page. 66

![Page Image](https://bcdn.docswell.com/page/4EZKZ393E3.jpg)



# Page. 67

![Page Image](https://bcdn.docswell.com/page/Y76QZXKZ7V.jpg)



# Page. 68

![Page Image](https://bcdn.docswell.com/page/G75RWXP9E4.jpg)



# Page. 69

![Page Image](https://bcdn.docswell.com/page/9J2DQX65JR.jpg)



# Page. 70

![Page Image](https://bcdn.docswell.com/page/DEY2W896EM.jpg)



# Page. 71

![Page Image](https://bcdn.docswell.com/page/VJN89QD178.jpg)



