Self host Models weights using Torrent about from-hf-to-torrent

[casperdcl]

surely we should have WebSeeds¹² too?

In pseudocode:

wget https://example.com/model.hf
torrent create -o model.torrent model.hf
torrent modify --add-url https://example.com/model.hf model.torrent  # proposed
torrent serve model.torrent

Footnotes

1. https://torf.readthedocs.io/en/stable/#torf.Torrent.webseeds ↩

2. http://bittorrent.org/beps/bep_0019.html ↩

[filopedraz]

Sure, good for me. Let me know when you need access to the machine :)

[biswaroop1547]

hi need access :")

[biswaroop1547]

For having a separate webseed url, we should be using a new instance which will just serve the files over http. Are we okay with using another machine for this? or expose files over http on the same machine?

we cannot directly serve the files from hf link (using git lfs) e.g -https://huggingface.co/premai-io/CodeLlama-34b-Instruct-hf as a webseed url. And if using the same server for seeding torrent + hosting webseed url, it'll cause much higher load on the machine.

Ideally for webseed url we should have a mirror link (e.g https://mirror.premai.io/models/) which will point to a new instance hosting models.

I think we can start with serving webseed url from the same machine and later move if required.