Training time

#31 · open · 2 comments

View on GitHub ↗

emlcpfx

How long did it take to train the model. What GPU(s) did you use?

Comments

filby89

Hey, we trained the model on an RTX 3090. Approximately 2 - 3 days for both pretraining and training should be enough.

weihaosky

> Hey, we trained the model on an RTX 3090. Approximately 2 - 3 days for both pretraining and training should be enough. In the `config_pretrain.yaml`, it writes `num_epochs: 300`, which would take a much longer time than 2-3 days. So how many epochs does the pertraining need? Similarly, how many epochs does the core training need?