Generated Video Background Is Not Static about eat_code

[yuangan]

Thank you for your attention.

In my opinion, this is one limitation of EAT. When using RePos-Net to generate talking heads and backgrounds, controlling only the head with latent key-points proves challenging. Here are some potential solutions to address this issue:

1. Use a segmentation network, like ModNet, to isolate the talking head and then integrate it with the background.
2. Fine-tune the OSFV network to ensure that the latent keypoints influence only the head. This may seem difficult but has been shown in Nvidia's demo.
3. Create the talking head without the background and combine them afterward.
4. Incorporate emotional expressions into other projects, such as Real3DPortrait and so on. They generate the head and background separately.

[hrWong]

Thank you for your attention.

In my opinion, this is one limitation of EAT. When using RePos-Net to generate talking heads and backgrounds, controlling only the head with latent key-points proves challenging. Here are some potential solutions to address this issue:

1. Use a segmentation network, like ModNet, to isolate the talking head and then integrate it with the background.
2. Fine-tune the OSFV network to ensure that the latent keypoints influence only the head. This may seem difficult but has been shown in Nvidia's demo.
3. Create the talking head without the background and combine them afterward.
4. Incorporate emotional expressions into other projects, such as Real3DPortrait and so on. They generate the head and background separately.

Thank you for your prompt response. I will try out the suggestions you provided.

[yuangan]

Good Luck~