DS-MII License query about deepspeed-mii

[mrwyattii]

Hi @mayank31398 MII has an MIT license, which indicates you can reuse code for your own purposes (provided the copyright text is also included, I believe). However, I'm no expert on licensing... so @jeffra if this is wrong, please correct me :)

[mayank31398]

Wellm I am just re-using code in these 2 files:
https://github.com/huggingface/transformers-bloom-inference/blob/4fee9755090fe744ad1aebe1a860dc32064126a4/inference_server/model_handler/deployment.py
https://github.com/huggingface/transformers-bloom-inference/blob/4fee9755090fe744ad1aebe1a860dc32064126a4/inference_server/model_handler/grpc_utils/generation_server.py
The first one is just extending the class MIIServerClient.
and the second file is quite generic. Nothing special in it.

[jeffra]

Hi @mayank31398, Mike is right here we’re MIT license which allows this type of usage. Please do retain copyright at the top of the file and also if you could acknowledge DeepSpeed-MII in some way that would be greatly appreciated :)

Closing the issue for now but feel free to reopen if you would like.