EndpointConfig

Source: src/AWS/SageMaker/EndpointConfig.ts

An Amazon SageMaker EndpointConfig — the deployment recipe that maps one or more Models to hosting resources (provisioned instances or serverless capacity). Pure configuration: it costs nothing until an Endpoint references it.

Endpoint configurations are immutable — any change other than tags replaces the configuration. To roll a live endpoint onto new settings, point the Endpoint at the replacement config (alchemy creates the new config first, updates the endpoint, then deletes the old config).

Creating Endpoint Configurations

Serverless Variant

import * as AWS from "alchemy/AWS";

const config = yield* AWS.SageMaker.EndpointConfig("MyConfig", {
  productionVariants: [{
    VariantName: "AllTraffic",
    ModelName: model.modelName,
    ServerlessConfig: { MemorySizeInMB: 2048, MaxConcurrency: 5 },
  }],
});

Provisioned Instances

const config = yield* AWS.SageMaker.EndpointConfig("MyConfig", {
  productionVariants: [{
    VariantName: "AllTraffic",
    ModelName: model.modelName,
    InstanceType: "ml.m5.large",
    InitialInstanceCount: 1,
  }],
});