---
title: 【論文サーベイ】Score-Based Generative Model
tags: 
author: [tf63](https://www.docswell.com/user/8590143908)
site: [Docswell](https://www.docswell.com/)
thumbnail: https://bcdn.docswell.com/page/47ZVRP8GE3.jpg?width=480
description: 【論文サーベイ】Score-Based Generative Model by tf63
published: October 25, 23
canonical: https://www.docswell.com/s/8590143908/K7V64V-2023-10-25-145425
---
# Page. 1

![Page Image](https://bcdn.docswell.com/page/47ZVRP8GE3.jpg)

Score-Based Generative Model
キーワード
●
●
●
●
Langevin Monte Carlo Sampling
Score Matching
Denoising Score Matching
Classifier Guidance


# Page. 2

![Page Image](https://bcdn.docswell.com/page/YJ65RMPQ7V.jpg)

Score-Based Generative Model
Generative Modeling by Estimating Gradients of the Data Distribution,
Y. Song, S. Ermon [NeurIPS’19]
Diffusion Models Beat GANs on Image Synthesis,
P. Dhariwal, A. Nichol [NeurIPS’21]


# Page. 3

![Page Image](https://bcdn.docswell.com/page/GJ5Y8ZK2J4.jpg)

Score-Based Generative Model
NCSN,
Y. Song, S. Ermon [NeurIPS’19]
Classifier Guidance,
P. Dhariwal, A. Nichol [NeurIPS’21]


# Page. 4

![Page Image](https://bcdn.docswell.com/page/9E2GKRW1ER.jpg)

Score-Based Generative Modelと連続時間
Diffusion Model
Generative Modeling by Estimating Gradients of the Data Distribution,
Y. Song, S. Ermon [NeurIPS’19]
Score-Based Generative Modeling through Stochastic Differential
Equations, Y. Song, J. Sohl-Dickstein, D. P. Kingma, A. Kumar, S. Ermon, B. Poole [ICLR’21 oral]
Diffusion Models Beat GANs on Image Synthesis,
P. Dhariwal, A. Nichol [NeurIPS’21]
SDEdit: Guided Image Synthesis and Editing with Stochastic Differential
Equations, C. Meng, Y. He, Y. Song, J. Song, J. Wu, J. Zhu, S. Ermon [ICLR’22]


# Page. 5

![Page Image](https://bcdn.docswell.com/page/D7YVNDL47M.jpg)

Score-Based Generative Modelと連続時間
Diffusion Model
NCSN,
Y. Song, S. Ermon [NeurIPS’19]
Score SDE,
Y. Song, J. Sohl-Dickstein, D. P. Kingma, A. Kumar, S. Ermon, B. Poole [ICLR’21 oral]
Classifier Guidance,
P. Dhariwal, A. Nichol [NeurIPS’21]
SDEdit,
C. Meng, Y. He, Y. Song, J. Song, J. Wu, J. Zhu, S. Ermon [ICLR’22]


# Page. 6

![Page Image](https://bcdn.docswell.com/page/VENMX646J8.jpg)



# Page. 7

![Page Image](https://bcdn.docswell.com/page/Y79N8LQR73.jpg)

概要
Diffusion Model
- エネルギーベース (スコアベース)の生成モデル
- 元々はDPM，DDPMを指していた
Score-Based generative Model (SBM)
- スコアベースの生成モデル
- DDPMと統一的な枠組みで扱えることが示され，DDPMとSBMを
合わせてDiffusion Modelと呼ぶようになった


# Page. 8

![Page Image](https://bcdn.docswell.com/page/G78K8XGGJD.jpg)

Background (1/8) エネルギーベースモデル


# Page. 9

![Page Image](https://bcdn.docswell.com/page/L7LZR8GXER.jpg)

Background (2/8) MCMCサンプリング


# Page. 10

![Page Image](https://bcdn.docswell.com/page/4EMVR6Q3EW.jpg)

Background (3/8) スコア


# Page. 11

![Page Image](https://bcdn.docswell.com/page/PER2RP8R79.jpg)

Background (4/8) Langevin Monte Carlo サンプリング


# Page. 12

![Page Image](https://bcdn.docswell.com/page/P7XDR38YJX.jpg)

Background (5/8) Score Matching


# Page. 13

![Page Image](https://bcdn.docswell.com/page/37KXRYK4JD.jpg)

Background (6/8) Denoising Score Matching (1)


# Page. 14

![Page Image](https://bcdn.docswell.com/page/LJ3589ZD75.jpg)

Background (7/8) Denoising Score Matching (2)


# Page. 15

![Page Image](https://bcdn.docswell.com/page/8JDDMGR2JG.jpg)

Background (8/8) Score Based Model (SBM)


# Page. 16

![Page Image](https://bcdn.docswell.com/page/VEPXR3WLJ8.jpg)

Generative Modeling by Estimating Gradients of the Data Distribution,
Y. Song, S. Ermon [NeurIPS’19]


# Page. 17

![Page Image](https://bcdn.docswell.com/page/27VLR486EQ.jpg)

Generative Modeling by Estimating Gradients of the Data Distribution,
Y. Song, S. Ermon [NeurIPS’19]


# Page. 18

![Page Image](https://bcdn.docswell.com/page/5JGXM1527L.jpg)

Diffusion Models Beat GANs on Image Synthesis, (一部)
P. Dhariwal, A. Nichol [NeurIPS’21]


# Page. 19

![Page Image](https://bcdn.docswell.com/page/47Q8RDZ9EP.jpg)

Diffusion Models Beat GANs on Image Synthesis, (一部)
P. Dhariwal, A. Nichol [NeurIPS’21]
[J. Ho 2022]


# Page. 20

![Page Image](https://bcdn.docswell.com/page/KE428ZDR71.jpg)

Summary


