IBM has released the first models in its watsonx Granite model series. Watsonx is an AI and data platform that includes an AI development studio with access to IBM-curated and trained foundation models and open-source models, access to a data store, and a toolkit for AI governance.

IBM Watson is a platform that uses natural language processing and machine learning to discover insights in large sets of unstructured data. It is a question-answering system that can answer questions phrased using natural language.

The initial release of watsonx.ai included the Slate family of encoder-only models targeting enterprise Natural Language Processing (NLP) use. This latest release is aimed at uses such as summarization, content generation and extracting insights.

The Granite series is a collection of generative AI models that apply generative AI to the modalities of language and code. IBM says the Granite models are being developed in different sizes and are built on a decoder-only architecture. The models are trained on business-relevant domains, including financial, legal, IT, coding, and academic domains. The model type lends itself to retrieval augmented generation for searching knowledge bases to generate tailored responses to customer inquiries, or to condense content into short descriptions.

The training data was filtered for objectionable content and benchmarked against internal and external models to address issues including governance, risk assessment, privacy concerns and bias mitigation. The Watson team says that as part of this process, IBM is using its end-to-end AI and data model lifecycle governance process and capabilities to manage and help mitigate client risk with the watsonx AI and data platform. This includes the planned release of watsonx.governance, an AI governance toolkit to enable trusted AI workflows that will be generally available later this year.

The initial Granite collection includes two variants of a 13 billion parameter model: granite-13b-chat and granite-13b-instruct. According to the Watson team, at 13 billion parameters, these variants have the potential to be more efficient than larger models since they can fit onto a single A100-80 GB GPU which can also help lower the total cost of ownership.

IBM says its standard intellectual property protections will apply to the AI models.

The Watsonx Granite data sets are available now.

More Information

Watsonx Website

Related Articles

IBM Announces WatsonX AI Platform

IBM Announces COBOL Modernizing Solution

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Comments

Make a Comment or View Existing Comments Using Disqus

or email your comment to: comments@i-programmer.info