Why can't I see the instance metrics for my Amazon SageMaker endpoint though I can see the invocation metrics?

1 minute read
0

I can see invocation metrics for my Amazon SageMaker endpoint in Amazon CloudWatch. However, instance metrics such as CPUUtilization, MemoryUtilization, and DiskUtilization are missing.

Resolution

This happens when the execution role for Amazon SageMaker doesn't have the PutMetricData permission for CloudWatch. To resolve the issue, add "cloudwatch:PutMetricData" to the AWS Identity and Access Management (IAM) policy that's attached to the execution role.

To send instance metrics to CloudWatch, instances must assume the execution role. That's why the PutMetricData permission is required for instance metrics.


Related information

Monitor Amazon SageMaker with Amazon CloudWatch

SageMaker roles

AWS OFFICIAL
AWS OFFICIALUpdated 2 years ago