aigenprotocol / aigenml

Aigen's artificial intelligence library to extract model weights and create shards based on the number of ainfts specified

AigenML

Aigen's artificial intelligence library to extract model weights and create shards based on the number of ainfts specified

create environment variables

create a .env file and put these variables

PROJECTS_DIR=/Users/apple/aigen

commands

extract model weights and create shards in a single command

python main.py --action "create_shards" -n "test" -m "<path-to-model.h5>" -no 20

provide project name, model path and no of ainfts to create

• For the time being, we only support Keras models

code

extract and save model weights

from aigenml import save_model
save_model(project_name=project_name, project_dir=os.environ.get("PROJECTS_DIR"), model_path=model_path)

provide model name and local model path to start extracting weights

create shards of model weights

from aigenml import create_shards
create_shards(project_name=project_name, project_dir=os.environ.get("PROJECTS_DIR"), no_of_ainfts=no_of_ainfts)

provide project name and no of ainfts to create. This function will automatically create shards of model weights

merge model shards

python main.py --action "merge_shards" --name test

this will merge shards back to recover the original weight files

load model (keras)

python main.py --action "load_model" --name test

this will load model from merged shards

License

This project is licensed under the MIT License - see the LICENSE file for details