premai-io / from-hf-to-torrent

Script to download an HF Model and Upload it to Torrent

from-hf-to-torrent

Download a Huggingface Model and share as Torrent.

All torrent files can be accessed under torrents directory and we are already hosting and seeding the following models:

• premai-io/CodeLlama-34b-Instruct-hf

  Magnet URI:

  magnet:?xt=urn:btih:d16bc0903cc98cd06e4c7247a515445a6607c521&dn=CodeLlama-34b-Instruct-hf&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=http%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=https%3A%2F%2Ftracker1.520.jp%3A443%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.demonii.com%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.openbittorrent.com%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker.openbittorrent.com%3A80%2Fannounce&tr=udp%3A%2F%2Fopen.stealth.si%3A80%2Fannounce&tr=udp%3A%2F%2Fexodus.desync.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.torrent.eu.org%3A451%2Fannounce&tr=udp%3A%2F%2Ftracker1.bt.moack.co.kr%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.moeking.me%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker-udp.gbitt.info%3A80%2Fannounce&tr=udp%3A%2F%2Fp4p.arenabg.com%3A1337%2Fannounce&tr=udp%3A%2F%2Fmovies.zsw.ca%3A6969%2Fannounce&tr=udp%3A%2F%2Fexplodie.org%3A6969%2Fannounce&tr=https%3A%2F%2Ftracker.tamersunion.org%3A443%2Fannounce&tr=https%3A%2F%2Ftracker.gbitt.info%3A443%2Fannounce&tr=http%3A%2F%2Ftracker.gbitt.info%3A80%2Fannounce&tr=udp%3A%2F%2Fuploads.gamecoast.net%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=http%3A%2F%2Ftracker2.dler.org%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.dump.cl%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.bittor.pw%3A1337%2Fannounce&tr=udp%3A%2F%2Fsanincode.com%3A6969%2Fannounce&tr=udp%3A%2F%2Fretracker01-msk-virt.corbina.net%3A80%2Fannounce&tr=udp%3A%2F%2Fprivate.anonseed.com%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.free-tracker.ga%3A6969%2Fannounce&tr=udp%3A%2F%2Fopen.dstud.io%3A6969%2Fannounce&tr=udp%3A%2F%2Fmoonburrow.club%3A6969%2Fannounce&tr=udp%3A%2F%2Fisk.richardsw.club%3A6969%2Fannounce&tr=udp%3A%2F%2Fepider.me%3A6969%2Fannounce&tr=udp%3A%2F%2Fbt.ktrackers.com%3A6666%2Fannounce&tr=udp%3A%2F%2Facxx.de%3A6969%2Fannounce&tr=udp%3A%2F%2Faarsen.me%3A6969%2Fannounce&tr=https%3A%2F%2Ftr.burnabyhighstar.com%3A443%2Fannounce&tr=http%3A%2F%2Fopen.acgnxtracker.com%3A80%2Fannounce&tr=udp%3A%2F%2Fyahor.of.by%3A6969%2Fannounce&tr=udp%3A%2F%2Fwepzone.net%3A6969%2Fannounce&tr=http%3A%2F%2Fwepzone.net%3A6969%2Fannounce&tr=udp%3A%2F%2Fv2.iperson.xyz%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker1.myporn.club%3A9337%2Fannounce&tr=udp%3A%2F%2Ftracker.therarbg.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.theoks.net%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.qu.ax%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker.qu.ax%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.publictracker.xyz%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.filemail.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.farted.net%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.cubonegro.lol%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.ccp.ovh%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.4.babico.name.tr%3A3131%2Fannounce&tr=udp%3A%2F%2Ftracker.0x7c0.com%3A6969%2Fannounce&tr=udp%3A%2F%2Fthouvenin.cloud%3A6969%2Fannounce&tr=udp%3A%2F%2Ftamas3.ynh.fr%3A6969%2Fannounce&tr=udp%3A%2F%2Fryjer.com%3A6969%2Fannounce&tr=udp%3A%2F%2Frun-2.publictracker.xyz%3A6969%2Fannounce&tr=udp%3A%2F%2Fpublic.tracker.vraphim.com%3A6969%2Fannounce&tr=udp%3A%2F%2Fopentracker.io%3A6969%2Fannounce&tr=udp%3A%2F%2Foh.fuuuuuck.com%3A6969%2Fannounce&tr=udp%3A%2F%2Fnew-line.net%3A6969%2Fannounce&tr=udp%3A%2F%2Fmail.segso.net%3A6969%2Fannounce&tr=udp%3A%2F%2Fhtz3.noho.st%3A6969%2Fannounce&tr=udp%3A%2F%2Ffree.publictracker.xyz%3A6969%2Fannounce&tr=udp%3A%2F%2Fcarr.codes%3A6969%2Fannounce&tr=udp%3A%2F%2Fbt2.archive.org%3A6969%2Fannounce&tr=udp%3A%2F%2Fbt1.archive.org%3A6969%2Fannounce&tr=udp%3A%2F%2F6ahddutb1ucc3cp.ru%3A6969%2Fannounce&tr=udp%3A%2F%2F6.pocketnet.app%3A6969%2Fannounce&tr=udp%3A%2F%2F1c.premierzal.ru%3A6969%2Fannounce&tr=https%3A%2F%2Ftracker.renfei.net%3A443%2Fannounce&tr=http%3A%2F%2Ftracker.renfei.net%3A8080%2Fannounce&tr=https%3A%2F%2Ftracker.loligirl.cn%3A443%2Fannounce&tr=https%3A%2F%2Ftracker.lilithraws.org%3A443%2Fannounce&tr=https%3A%2F%2Ftracker.imgoingto.icu%3A443%2Fannounce&tr=https%3A%2F%2Ftracker.cloudit.top%3A443%2Fannounce&tr=https%3A%2F%2Ft1.hloli.org%3A443%2Fannounce&tr=https%3A%2F%2F1337.abcvg.info%3A443%2Fannounce&tr=http%3A%2F%2Ftracker.skyts.net%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker.mywaifu.best%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker.ipv6tracker.org%3A80%2Fannounce&tr=http%3A%2F%2Ftracker.files.fm%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker.bt4g.com%3A2095%2Fannounce&tr=http%3A%2F%2Fopen.tracker.ink%3A6969%2Fannounce&tr=http%3A%2F%2Fincine.ru%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.t-rb.org%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.srv00.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.netmap.top%3A6969%2Fannounce&tr=https%3A%2F%2Ftracker.netmap.top%3A8443%2Fannounce&tr=http%3A%2F%2Ftracker.netmap.top%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.leech.ie%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.artixlinux.org%3A6969%2Fannounce&tr=udp%3A%2F%2Ftorrents.artixlinux.org%3A6969%2Fannounce&tr=udp%3A%2F%2Fmail.artixlinux.org%3A6969%2Fannounce&tr=udp%3A%2F%2Flloria.fr%3A6969%2Fannounce&tr=udp%3A%2F%2Ffh2.cmp-gaming.com%3A6969%2Fannounce&tr=udp%3A%2F%2Fconcen.org%3A6969%2Fannounce&tr=udp%3A%2F%2Fboysbitte.be%3A6969%2Fannounce&tr=udp%3A%2F%2Faegir.sexy%3A6969%2Fannounce&tr=https%3A%2F%2Fwww.peckservers.com%3A9443%2Fannounce&tr=http%3A%2F%2Fwww.peckservers.com%3A9000%2Fannounce&tr=https%3A%2F%2Ftracker.ipfsscan.io%3A443%2Fannounce&tr=http%3A%2F%2Ftracker1.itzmx.com%3A8080%2Fannounce&tr=http%3A%2F%2Ft.acg.rip%3A6699%2Fannounce&ws=http%3A%2F%2F128.140.126.131%3A8989%2F
  

• petals-team/StableBeluga2

  Magnet URI:

  magnet:?xt=urn:btih:7ab2e0578db22874ccb60ed434142e6ea0aab0fe&dn=StableBeluga2&tr=udp://tracker.opentrackr.org:1337/announce&tr=http://tracker.opentrackr.org:1337/announce&tr=https://tracker1.520.jp:443/announce&tr=udp://opentracker.i2p.rocks:6969/announce&tr=udp://open.demonii.com:1337/announce&tr=udp://tracker.openbittorrent.com:6969/announce&tr=http://tracker.openbittorrent.com:80/announce&tr=udp://open.stealth.si:80/announce&tr=udp://exodus.desync.com:6969/announce&tr=udp://tracker.torrent.eu.org:451/announce&tr=udp://tracker1.bt.moack.co.kr:80/announce&tr=udp://tracker.tiny-vps.com:6969/announce&tr=udp://tracker.moeking.me:6969/announce&tr=udp://tracker-udp.gbitt.info:80/announce&tr=udp://p4p.arenabg.com:1337/announce&tr=udp://movies.zsw.ca:6969/announce&tr=udp://explodie.org:6969/announce&tr=https://tracker.tamersunion.org:443/announce&tr=https://tracker.gbitt.info:443/announce&tr=http://tracker.gbitt.info:80/announce&tr=udp://uploads.gamecoast.net:6969/announce&tr=udp://tracker2.dler.org:80/announce&tr=http://tracker2.dler.org:80/announce&tr=udp://tracker.dump.cl:6969/announce&tr=udp://tracker.bittor.pw:1337/announce&tr=udp://sanincode.com:6969/announce&tr=udp://retracker01-msk-virt.corbina.net:80/announce&tr=udp://private.anonseed.com:6969/announce&tr=udp://open.free-tracker.ga:6969/announce&tr=udp://open.dstud.io:6969/announce&tr=udp://moonburrow.club:6969/announce&tr=udp://isk.richardsw.club:6969/announce&tr=udp://epider.me:6969/announce&tr=udp://bt.ktrackers.com:6666/announce&tr=udp://acxx.de:6969/announce&tr=udp://aarsen.me:6969/announce&tr=https://tr.burnabyhighstar.com:443/announce&tr=http://open.acgnxtracker.com:80/announce&tr=udp://yahor.of.by:6969/announce&tr=udp://wepzone.net:6969/announce&tr=http://wepzone.net:6969/announce&tr=udp://v2.iperson.xyz:6969/announce&tr=udp://tracker1.myporn.club:9337/announce&tr=udp://tracker.therarbg.com:6969/announce&tr=udp://tracker.theoks.net:6969/announce&tr=udp://tracker.qu.ax:6969/announce&tr=http://tracker.qu.ax:6969/announce&tr=udp://tracker.publictracker.xyz:6969/announce&tr=udp://tracker.filemail.com:6969/announce&tr=udp://tracker.farted.net:6969/announce&tr=udp://tracker.dler.org:6969/announce&tr=http://tracker.dler.org:6969/announce&tr=udp://tracker.cubonegro.lol:6969/announce&tr=udp://tracker.ccp.ovh:6969/announce&tr=udp://tracker.4.babico.name.tr:3131/announce&tr=udp://tracker.0x7c0.com:6969/announce&tr=udp://thouvenin.cloud:6969/announce&tr=udp://tamas3.ynh.fr:6969/announce&tr=udp://ryjer.com:6969/announce&tr=udp://run-2.publictracker.xyz:6969/announce&tr=udp://public.tracker.vraphim.com:6969/announce&tr=udp://opentracker.io:6969/announce&tr=udp://oh.fuuuuuck.com:6969/announce&tr=udp://new-line.net:6969/announce&tr=udp://mail.segso.net:6969/announce&tr=udp://htz3.noho.st:6969/announce&tr=udp://free.publictracker.xyz:6969/announce&tr=udp://carr.codes:6969/announce&tr=udp://bt2.archive.org:6969/announce&tr=udp://bt1.archive.org:6969/announce&tr=udp://6ahddutb1ucc3cp.ru:6969/announce&tr=udp://6.pocketnet.app:6969/announce&tr=udp://1c.premierzal.ru:6969/announce&tr=https://tracker.renfei.net:443/announce&tr=http://tracker.renfei.net:8080/announce&tr=https://tracker.loligirl.cn:443/announce&tr=https://tracker.lilithraws.org:443/announce&tr=https://tracker.imgoingto.icu:443/announce&tr=https://tracker.cloudit.top:443/announce&tr=https://t1.hloli.org:443/announce&tr=https://1337.abcvg.info:443/announce&tr=http://tracker.skyts.net:6969/announce&tr=http://tracker.mywaifu.best:6969/announce&tr=http://tracker.ipv6tracker.org:80/announce&tr=http://tracker.files.fm:6969/announce&tr=http://tracker.bt4g.com:2095/announce&tr=http://open.tracker.ink:6969/announce&tr=http://incine.ru:6969/announce&tr=udp://tracker.t-rb.org:6969/announce&tr=udp://tracker.srv00.com:6969/announce&tr=udp://tracker.netmap.top:6969/announce&tr=https://tracker.netmap.top:8443/announce&tr=http://tracker.netmap.top:6969/announce&tr=udp://tracker.leech.ie:1337/announce&tr=udp://tracker.artixlinux.org:6969/announce&tr=udp://torrents.artixlinux.org:6969/announce&tr=udp://mail.artixlinux.org:6969/announce&tr=udp://lloria.fr:6969/announce&tr=udp://fh2.cmp-gaming.com:6969/announce&tr=udp://concen.org:6969/announce&tr=udp://boysbitte.be:6969/announce&tr=udp://aegir.sexy:6969/announce&tr=https://www.peckservers.com:9443/announce&tr=http://www.peckservers.com:9000/announce&tr=https://tracker.ipfsscan.io:443/announce&tr=http://tracker1.itzmx.com:8080/announce&tr=http://t.acg.rip:6699/announce&ws=http://128.140.126.131:8989/
  

Seeding

1. Requirements and Clone models

pip install -r requirements.txt

mkdir data
cd ./data
git lfs install
huggingface-cli lfs-enable-largefiles .
git clone https://huggingface.co/gpt2

or modify and use download.sh.

2. Change Parameters

Under main.py change the following parameters as required:

models = ["CodeLlama-34b-Instruct-hf", "StableBeluga2"]  # list of names of the cloned model folders you want to use
data_path = "./data/" # relative path where the models are stored
torrents_dir = "./torrents/" # relative path where the torrents will be stored

3. Set Environment Variables

For basic auth create a .client_password file containing just the password in it, at the root of this repository.

export TRANSMISSION_USER=prem # change this to your username
export TRANSMISSION_PASS=$(cat .client_password) # change this to your password

4. Start Transmission Client in the background

Modify absolute paths on docker-compose.yml file based on your machine.

docker compose up -d

WebUI should be accessible at http://<localhost/public-ip>:9091

Note: Open Firewall if you are on a Mac - https://github.com/transmission/transmission/blob/main/docs/Port-Forwarding-Guide.md#open-your-local-firewall

5. Create the torrent and seed it

python main.py

---

Related Project Links

• https://aria2.github.io/
• https://github.com/Elyah2035/llama-dl#how-do-i-know-this-is-safe
• https://reddit.com/r/LocalLLaMA/s/et7M4h5uw7
• https://pypi.org/project/transmission-rpc/
• https://pypi.org/project/torrentool/
• https://github.com/idlesign/torrentool
• https://github.com/rndusr/torf

from-hf-to-torrent's Issues

Self host Models weights using Torrent

Description

We need to self-host the weights using Torrent on a Hetzener machine. The steps are the following:

1. Run the transmission daemon using docker-compose
2. Download the weights from HF
3. Create a .torrent file for each folder containing the weights.
4. Seed the torrents using the folder used for dumping the weights.

We want to seed the following models:

• premai-io/CodeLlama-34b-Instruct-hf
• petals-team/StableBeluga2
• tiiuae/falcon-180B-chat

Missing

Most of the logic and the scripts are in the repo. The entire flow must be tested and fixed accordingly.