not able to load the gptlm example given in readme about lightseq

[Taka152]

@rkoystart You can try docker run -e MODEL_ZOO="/models" to add environment variable in the container. This variable is used to find .pb file when starting the custom engine.

[Taka152]

plz set environment variable MODEL_ZOO !

It seems that you forgot to set this environment variable required by the server.

i want the config.pbtxt and weight file for the transformer model that is supported by you if possible

You can check the proto/transformer.proto file to generate your transformer model(.pb file) and the config.pbtxt file only differs in names of inputs and outputs. Also, we'll consider adding a transformer example after the National Day holiday.

[rkoystart]

@Taka152 even after initializing the environment variable i am getting the same error

(allennlp)nlp@nlp:/hdd1/ravi/ravi/lightseq$ export MODEL_ZOO="/hdd1/ravi/ravi/lightseq/modelzoo"
(allennlp)nlp@nlp:/hdd1/ravi/ravi/lightseq$ sudo docker run --gpus=1 --rm -p8000:8000 -p8001:8001 -p8002:8002 -v/hdd1/ravi/ravi/lightseq/modelzoo:/models
nvcr.io/nvidia/tensorrtserver:19.05-py3 trtserver --model-store=/models