|
15 | 15 |
|
16 | 16 |
|
17 | 17 | <meta name="twitter:title" content="The Diffusion Duality"> |
18 | | - <meta name="twitter:description" content="TWITTER BANNER DESCRIPTION META TAG"> |
| 18 | + <meta name="twitter:description" content="Unlocking Few-Step Generation in Discrete Diffusion Language Models"> |
19 | 19 | <!-- Path to banner image, should be in the path listed below. Optimal dimenssions are 1200X600--> |
20 | 20 | <meta name="twitter:image" content="static/images/duo_schematic.png"> |
21 | 21 | <meta name="twitter:card" content="summary_large_image"> |
22 | 22 | <!-- Keywords for your paper to be indexed by--> |
23 | | - <meta name="keywords" content="The Diffusion Duality DUO"> |
| 23 | + <meta name="keywords" content="The Diffusion Duality DUO Diffusion Language Models"> |
24 | 24 | <meta name="viewport" content="width=device-width, initial-scale=1"> |
25 | 25 |
|
26 | 26 |
|
@@ -90,7 +90,7 @@ <h1 class="title is-1 publication-title">The Diffusion Duality</h1> |
90 | 90 |
|
91 | 91 | <!-- ArXiv abstract Link --> |
92 | 92 | <span class="link-block"> |
93 | | - <a href="https://openreview.net/forum?id=CB0Ub2yXjC" target="_blank" |
| 93 | + <a href="https://arxiv.org/abs/2506.10892v1" target="_blank" |
94 | 94 | class="external-link button is-normal is-rounded is-dark"> |
95 | 95 | <span class="icon"> |
96 | 96 | <i class="ai ai-arxiv"></i> |
@@ -163,21 +163,15 @@ <h1 class="title is-1 publication-title">The Diffusion Duality</h1> |
163 | 163 | <div class="container is-max-desktop"> |
164 | 164 | <div class="hero-body"> |
165 | 165 | <div style="text-align: center;"> |
166 | | - <img src="static/images/duo_schematic.png" alt="MY ALT TEXT" style="width: 65%; height: auto;"/> |
| 166 | + <img src="static/images/duo_schematic_graphical.png" alt="MY ALT TEXT" style="width: 65%; height: auto;"/> |
167 | 167 | </div> |
168 | 168 | <h4 class="subtitle has-text-centered"> |
169 | 169 | An illustration of uniform state discrete diffusion (top) and |
170 | 170 | the underlying Gaussian diffusion (bottom). While both are separate Markov processes, |
171 | 171 | applying \(\texttt{arg max}\) maps Gaussian latents \(\mathbf{w}_t \in \mathbb{R}^n\) to discrete latents |
172 | 172 | \(\mathbf{z}_t \in \mathcal{V}\), transforming their marginals from |
173 | | - \(\tilde{q}_t(.|\mathbf{x}; \tilde{\alpha}_t)\) |
174 | | - <!-- ~\Eqn{eqn:gaussian_marginal} --> |
175 | | - to \(q_t(.|\mathbf{x}; \mathcal{T}(\tilde{\alpha}_t))\) |
176 | | - <!-- ~\Eqn{eqn:discrete_marginal} --> |
177 | | - and adjusting diffusion parameters from \(\tilde{\alpha}_t\) |
178 | | - to \(\alpha_t = \mathcal{T}(\tilde{\alpha}_t)\) |
179 | | - <!-- ~\Eqn{eqn:coefficient_relation} --> |
180 | | - . |
| 173 | + \(K\)-dimensional Gaussian distribution to \(K\)-dimensional categorical distribution and adjusting diffusion parameters from \(\tilde{\alpha}_t\) |
| 174 | + to \(\alpha_t = \mathcal{T}(\tilde{\alpha}_t)\). |
181 | 175 | <!-- The ELBOs of both processes are related by \Eqn{eqn:elbo_inequality}. --> |
182 | 176 | </h4> |
183 | 177 | <!-- <img src="static/images/output.gif" width="100%" alt="A descriptive text for the GIF" > --> |
@@ -323,10 +317,14 @@ <h2 class="title">BibTeX</h2> |
323 | 317 | <button onclick="copyBibTeX()" style="position: absolute; top: 10px; right: 10px; z-index: 1;"> |
324 | 318 | Copy |
325 | 319 | </button> |
326 | | - <pre><code id="bibtex-code">@inproceedings{sahoo2025diffusion, |
327 | | - title={The Diffusion Duality}, |
328 | | - author={Sahoo, Subham Sekhar and Deschenaux, Justin and Gokaslan, Aaron and Wang, Guanghan and Chiu, Justin T and Kuleshov, Volodymyr}, |
329 | | - booktitle={ICLR 2025 Workshop on Deep Generative Model in Machine Learning: Theory, Principle and Efficacy} |
| 320 | + <pre><code id="bibtex-code">@misc{sahoo2025diffusionduality, |
| 321 | + title={The Diffusion Duality}, |
| 322 | + author={Subham Sekhar Sahoo and Justin Deschenaux and Aaron Gokaslan and Guanghan Wang and Justin Chiu and Volodymyr Kuleshov}, |
| 323 | + year={2025}, |
| 324 | + eprint={2506.10892}, |
| 325 | + archivePrefix={arXiv}, |
| 326 | + primaryClass={cs.LG}, |
| 327 | + url={https://arxiv.org/abs/2506.10892}, |
330 | 328 | }</code></pre> |
331 | 329 | </div> |
332 | 330 | </div> |
|
0 commit comments