I can't run deploy_transformer_model_from_hf_hub.ipynb on AWS Sagemaker notebook instance about notebooks

[farshadsm]

Hi,
Just an update. Interestingly, I was able to run the following code from my local machine. So, it seems that there's a problem with Sagemaker Notebook Instance.

`
from sagemaker.huggingface import HuggingFaceModel
import boto3

iam_client = boto3.client('iam')
role = iam_client.get_role(RoleName='{IAM_ROLE_WITH_SAGEMAKER_PERMISSIONS}')['Role']['Arn']

hub = {
'HF_MODEL_ID':'distilbert-base-uncased-distilled-squad',
'HF_TASK':'question-answering' # NLP task you want to use for predictions
}

huggingface_model = HuggingFaceModel(
transformers_version='4.6.1',
pytorch_version='1.7.1',
py_version='py36',
env=hub,
role=role,
)

predictor = huggingface_model.deploy(
initial_instance_count=1, # number of instances
instance_type='ml.m5.xlarge' # ec2 instance type
)

input_data = {
"inputs": {
"question": "What is used for inference?",
"context": "My Name is Philipp and I live in Nuremberg. This model is used with sagemaker for inference."
}
}

predictor.predict(input_data)
`

Best,
Farshad

[philschmid]

Hi @farshadsm,

you might need to run pip install sagemaker --upgrade on the SageMaker Notebook instance to work. I am not sure how regularly AWS is updating the kernels.

But I am happy you managed to solve it!