| Amazon Updates Bedrock With Custom Model Support |
| Written by Kay Ewbank |
| Tuesday, 07 May 2024 |
|
Amazon has updated Bedrock, its tool for building with generative AI on AWS. The update adds support for importing custom models and evaluating models, as well as support for using Meta Llama 3 models and extra models from Mistral and Anthropic. Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs). Generative AI apps are applications that can generate text, images, audio, and synthetic data in response to prompts.
The way developers use Amazon Bedrock is to experiment with a variety of FMs, customize them privately with the developer's own data using techniques such as fine-tuning and retrieval-augmented generation (RAG), and create managed agents that perform complex business tasks. The tool is designed to be used without writing any code. The first improvement to the updated version is the ability to import custom FMs. Some of the models supported by Bedrock provide publicly available weights that can be fine-tuned and customized, and Bedrock now lets developers import custom weights for such models, and serve the custom model using On-Demand mode. The preview feature means developers can use Amazon Bedrock with existing customized models such as Code Llama, a code-specialized version of Llama 2 that was created by further training Llama 2 on code-specific datasets, or use your data to fine-tune models and import the resulting model in Amazon Bedrock. A second improvement adds support for model evaluation, giving users the means to evaluate, compare, and select the best FMs for a particular use, based on either automatic or human evaluation. Automatic evaluation is based on predefined metrics such as accuracy, robustness, and toxicity. Subjective or custom metrics, such as friendliness, style, and alignment to brand voice, can be assessed via human evaluation workflows. Another addition, Guardrails for Amazon Bedrock, provides a way to implement safeguards when developing generative AI applications. Bedrock now lets you set up rules to ensure applications conform to your organization's responsible AI policies. The updated release also comes with support for extra models from Mistral AI, including Mistral Large, and for Meta Llama 3 models. Amazon Bedrock is available now.
More InformationRelated ArticlesAmazon Releases Bedrock AI Tool Amazon's DeepRacer - Careful What You Wish For Amazon's Giant Push Into Machine Learning Amazon Redshift ML Now Generally Available To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin. 
Comments
or email your comment to: comments@i-programmer.info |
