AML deployment error due to missing az cli arguments about deepspeed-mii

[mrwyattii]

@aponte411 currently we expect the user to set resource group and subscription from the Azure-CLI like so:
az account set --subscription "xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx"

I agree that exposing more options and expanding the AML deployment capabilities would be nice. Let me know if you have some time to help test/debug/expand these capabilities!

[buswrecker]

Hi, i resolved this - i had an issue with torch (had to pip uninstall nvidia_cublas_cu11) and also i wasn't on a GPU VM. Managed to build the folder with deploy.sh and deploying to a managed endpoint now

@aponte411 - did you make any progress? i'm getting the same error in Jupyter notebook.

deepspeed==0.8.2
deepspeed-mii==0.05+unknown
python==3.8.0
Ubuntu==20.04.1

[TahaBinhuraib]

@buswrecker I can run deepspeed mii from the gpu vm but I still can't deploy, I get the same error:
subprocess.CalledProcessError: Command '['az', 'ml', 'workspace', 'show', '--query', 'container_registry']' returned non-zero exit status 2.

[jakemanger]

I also could not get this working after following instructions in the readme. The only way I could use aml is after I overrode the get_acr_name() function to return my acr name instead of calling the az cli command. Is there a way to set a default --name argument for this command so this can be fixed and it returns the correct acr name?

The command I'm talking about is:

["az",
  "ml",
  "workspace",
   "show",
   "--query",
   "container_registry"],

Note, I also tried putting --name myworkspacename in as an argument and it just returned ------

[ShuntaIto]

I'm facing same problem, on GPU VM.

Maybe, adding "shell=True" will resolve this problem?

acr_name = subprocess.check_output(
            ["az",
             "ml",
             "workspace",
             "show",
             "--query",
             "container_registry"],
            text=True, shell=True)