Enterprises can benefit from SageMaker in various ways. Mehrotra explained, “SageMaker can help enterprises do both. At one end enterprises can use features inside the service to control how a model responds and at the other end SageMaker has integrations with LangChain for RAG.”
Initially a general AI platform, SageMaker has evolved with AWS adding more capabilities focused on implementing generative AI. In November, two new offerings were introduced: SageMaker HyperPod and SageMaker Inference, aimed at helping enterprises train and deploy LLMs efficiently.
HyperPod, in contrast to the manual LLM training process, eliminates the heavy lifting involved in building and optimizing machine learning infrastructure for training models. This results in a reduction of training time by up to 40%, according to the company.
