aws sagemaker-runtime invoke-endpoint-async

After you deploy a model into production using Amazon SageMaker AI hosting services, your client applications use this API to get inferences from the model hosted at the specified endpoint in an asynchronous manner. AWS CLI reference

11 options Its page in the AWS CLI reference

Options

11 in the AWS CLI reference

--acceptThe desired MIME type of the inference response from the model container.

--bodyProvides inline input data for the inference request, in the format specified in the ContentType request header.

--content-typeThe MIME type of the input data in the request body.

--custom-attributesProvides additional information about a request for an inference submitted to a model hosted at an Amazon SageMaker AI endpoint.

--endpoint-nameThe name of the endpoint that you specified when you created the endpoint using the CreateEndpoint API.

--filenameThe filename for the inference response payload stored in Amazon S3.

--inference-idThe identifier for the inference request.

--input-locationThe Amazon S3 URI where the inference request payload is stored.

--invocation-timeout-secondsMaximum amount of time in seconds a request can be processed before it is marked as expired.

--request-ttl-secondsMaximum age in seconds a request can be in the queue before it is marked as expired.

--s3-output-path-extensionThe path extension that is appended to the Amazon S3 output path where the inference response payload is stored.