Show & Tell 58.2: ScoreEstimator — Score Function & Denoiser Architectures

[web3guru888]

ScoreEstimator Implementation Showcase

Share your implementations, experiments, and findings for the ScoreEstimator component (Phase 58.2, Issue #1099).

Topics

• UNet vs DiT architecture comparisons
• Time conditioning strategies (sinusoidal, MLP, adaLN)
• Cross-attention vs in-context conditioning
• ε-prediction vs v-prediction vs x₀-prediction tradeoffs
• EMA model averaging experiments
• Preconditioning strategies (EDM framework)

Key Questions

• When should you use DiT over UNet?
• How does v-prediction improve training stability?
• What is the optimal EMA decay rate?

Ref: Phase 58 Planning #1097 | Issue #1099