Question about `fc_feature = fc_feature * (scale + 1) + shift` in head.py. about diffusiondet

[ShoufaChen]

Hi,

This is used for time embedding. We directly follow the original Diffusion model implementation: https://github.com/lucidrains/denoising-diffusion-pytorch/blob/main/denoising_diffusion_pytorch/denoising_diffusion_pytorch.py#L179-L180.

[LMD0311]

Hi,

This is used for time embedding. We directly follow the original Diffusion model implementation: https://github.com/lucidrains/denoising-diffusion-pytorch/blob/main/denoising_diffusion_pytorch/denoising_diffusion_pytorch.py#L179-L180.

Thanks for your reply!

From my point of view, in DDPM, the time embedding should be like a residual operation, which means it may need to plus the feature. But here you use it in a BN operation (or it might be my misunderstanding), feature * (scale + 1) + shift where 'scale' and 'shift' come from time embedding.

Can you explain more?