{"@context":"https://schema.org","@type":"NewsArticle","contentId":"0000018b-3525-d976-a9bb-b53f69440001","url":"https://www.aboutamazon.com/news/aws/what-you-need-to-know-about-the-aws-ai-chips-powering-amazons-partnership-with-anthropic","headline":"What you need to know about the AWS AI chips powering Amazon's partnership with Anthropic","description":"Anthropic will use our powerful, purpose-built AI chips to accelerate generative AI for our customers.","datePublished":"2023-10-16T23:17:08.821Z","dateModified":"2023-10-16T23:17:08.821Z","author":[{"@type":"Person","name":"Amazon Staff","image":{"@type":"ImageObject","url":"https://assets.aboutamazon.com/dims4/default/08549ff/2147483647/strip/true/crop/1125x1125+438+0/resize/84x84!/quality/90/?url=https%3A%2F%2Fassets.aboutamazon.com%2F47%2F6d%2F7fe296e642859c7ba2a629eda3ba%2Famazon-logo-hero-images-2024.jpg","width":"84","height":"84"}}],"image":{"@type":"ImageObject","url":"https://assets.aboutamazon.com/dims4/default/890055a/2147483647/strip/true/crop/1688x1125+156+0/resize/300x200!/quality/90/?url=https%3A%2F%2Fassets.aboutamazon.com%2F24%2Fd5%2F7417fa5e4d04938d47021e9d76db%2Fhero-newcolors-1.jpg","width":"300","height":"200"},"articleBody":"![A photo of the AWS Tranium chip.](https://assets.aboutamazon.com/dims4/default/890055a/2147483647/strip/true/crop/1688x1125+156+0/resize/300x200!/quality/90/?url=https%3A%2F%2Fassets.aboutamazon.com%2F24%2Fd5%2F7417fa5e4d04938d47021e9d76db%2Fhero-newcolors-1.jpg)\n\n# What you need to know about the AWS AI chips powering Amazon's partnership with Anthropic\n\n*Anthropic will use our powerful, purpose-built AI chips to accelerate generative AI for our customers.*\n\nAmazon’s [expanded partnership with Anthropic](https://www.aboutamazon.com/news/company-news/amazon-aws-anthropic-ai) is a pivotal development in our commitment to help organizations of all sizes unlock the power of generative artificial intelligence (generative AI) and provide them with options.\n\n![Side-by-side logos for Amazon and Anthropic.](https://assets.aboutamazon.com/dims4/default/384d5e4/2147483647/strip/true/crop/2624x1749+0+437/resize/300x200!/quality/90/?url=https%3A%2F%2Fassets.aboutamazon.com%2F08%2F32%2F14b251fb4b6cac3397807a7f7720%2Famazon-anthropic.png)\n\n- [Amazon and Anthropic announce strategic collaboration to advance generative AI ](https://www.aboutamazon.com/news/company-news/amazon-aws-anthropic-ai)\n\n“Our customers need us to have great generative AI capabilities,” AWS CEO Adam Selipsky said on [Bloomberg Technology](https://www.bloomberg.com/news/videos/2023-09-25/aws-generative-ai-will-be-explosive-source-of-growth-video). “We have a strategy for providing customers the choices for whatever’s best for the job at hand, so Anthropic is going to provide an amazing set of models to meet many customer use cases.”\n\nSo, what comes from this expanded collaboration with Anthropic? Here’s a quick summary, with a focus on our powerful, purpose-built AI chips—[AWS Trainium](https://aws.amazon.com/machine-learning/trainium/) and [AWS Inferentia](https://aws.amazon.com/machine-learning/inferentia/)—and how they are at the center of our work with Anthropic.\n\n Anthropic, a leading foundation model (FM) provider and advocate for the responsible deployment of generative AI, has been an AWS customer since 2021. Anthropic’s FM, named “Claude,” excels at thoughtful dialogue, content creation, complex reasoning, creativity, and coding, and it’s available to AWS customers through [Amazon Bedrock](https://www.aboutamazon.com/news/aws/aws-amazon-bedrock-general-availability-generative-ai-innovations). Foundation models, like Claude, are large machine learning models pre-trained on vast amounts of data that can be used to power generative AI applications.\n\n## What’s different with this expanded collaboration?\n\nThrough our expanded partnership, Anthropic made a long-term commitment to AWS customers around the world, with access to future generations of its foundation models with Amazon Bedrock. AWS customers will also get early access to unique features for model customizations and fine-tuning.\n\n## What does this have to do with AWS AI chips?\n\nWith AWS now Anthropic’s primary cloud provider—another key element of our expanded collaboration—Anthropic will train and deploy their future FMs on the AWS Cloud using our Trainium and Inferentia chips. The AWS chips will be the engines behind the FMs. In addition, Anthropic will collaborate with us in the development of future Trainium and Inferentia technology.\n\n## Why did Amazon develop Inferentia and Trainium?\n\nMachine learning requires enormous amounts of computing power. With the increasing adoption of machine learning, AI, and now generative AI by so many customers, Amazon saw the need for chips that were both powerful and cost-efficient while using less energy. Trainium is a purpose-built chip for training deep learning models, with up to a 50% cost-to-train savings over comparable [Amazon Elastic Compute Cloud (Amazon EC2)](https://aws.amazon.com/pm/ec2/) instances. The Inferentia chip enables models to generate inferences more quickly and at lower cost, with up to 40% better price performance.\n\n![Two engineers examining computer components on workbench](https://assets.aboutamazon.com/dims4/default/f6d75ce/2147483647/strip/true/crop/1350x900+72+0/resize/300x200!/quality/90/?url=https%3A%2F%2Fassets.aboutamazon.com%2F1c%2F5f%2F3bf9503b4a2b833166e490b24772%2Fbau-0699b.png)\n\n- [Follow us into the lab where AWS designs custom chips ](https://www.aboutamazon.com/news/aws/take-a-look-inside-the-lab-where-aws-makes-custom-chips)\n\n## How do our chips benefit customers and partners, like Anthropic?\n\nRather than building generative AI from scratch, data scientists start with FMs. These very large models, like Claude, can make the development of new generative AI applications cheaper and more efficient. Trainium, which AWS launched last year, is a high-performance machine learning chip specifically designed to reduce the time and cost of training generative AI models. It can cut training time for some models from months to hours. This also means that building new models requires less money and power, potentially saving up to 50% of costs and reducing energy consumption up to 29%, versus comparable instances. Our Inferentia2 machine learning inference chip provides up to 50% more performance per watt and can reduce costs by up to 50% against comparable instances.\n\nThis is good news for our customers and the environment. The faster we can handle training, the less power is consumed. We offer different types of chips, and we share with customers the power profile and performance so they can choose the right chip for the right workload, and optimize for the lowest possible power consumption at the lowest cost.\n\n## What tasks are Trainium and Inferentia already helping Amazon and its customers accomplish?\n\nAWS customers have been using Trainium and Inferentia, and here are a few examples. [Finch Computing](https://aws.amazon.com/solutions/case-studies/finchcomputing-case-study/), an AWS customer, develops natural language processing technology to provide customers with the ability to uncover insights from huge volumes of text data. Using Inferentia for language translation allowed the company to reduce inference costs by 80%. [Dataminr](https://aws.amazon.com/solutions/case-studies/dataminr-case-study/), which detects high-impact events and emerging risks for corporate and government customers, achieved nine times better throughput per dollar for AI models optimized for Inferentia. Closer to home, Inferentia allows [Alexa](https://www.aboutamazon.com/news/devices/amazon-alexa-generative-ai) to run much more advanced machine learning algorithms at lower costs and with lower latency than a standard general-purpose chip. And we are using Trainium to improve the customer shopping experience, training large language models that include text, images, multiple languages, and locales, as well as different entities such as products, queries, brands, and reviews.\n\n![Person sitting and working on laptop. Screen says prompt to output](https://assets.aboutamazon.com/dims4/default/7cb61eb/2147483647/strip/true/crop/1688x1125+156+0/resize/300x200!/quality/90/?url=https%3A%2F%2Fassets.aboutamazon.com%2F0f%2Fc5%2Fb1a871604e8094c9caaa6f5c423f%2Fai-ml-certifications-hero-2000x1125-v2.jpg)\n\n- [AWS now offers 5 AI certifications to help you stand out in a competitive job market](https://www.aboutamazon.com/news/aws/aws-certifications-generative-ai-machine-learning-cloud-jobs)\n\n## What’s next for Trainium and Inferentia?\n\nAWS will continue to innovate on behalf of our customers and provide access to the most advanced technologies while improving performance cost-efficiency and sustainability. We will collaborate with partners like Anthropic on development of future generations of the Trainium and Inferentia technology.\n\nLearn more about [Trainium](https://aws.amazon.com/machine-learning/trainium/) and [Inferentia](https://aws.amazon.com/machine-learning/inferentia/).","publisher":{"@type":"Organization","name":"About Amazon","url":"https://www.aboutamazon.com","sameAs":["https://x.com/amazonnews","https://www.linkedin.com/company/amazon","https://www.instagram.com/amazonnews"],"logo":{"@type":"ImageObject","url":"https://assets.aboutamazon.com/bd/8f/88e7b0314cc2bd05b9de3155a0fe/amazon-news.svg"},"parentOrganization":{"@type":"Organization","name":"Amazon","url":"https://www.amazon.com","sameAs":["https://www.wikidata.org/wiki/Q3884","https://en.wikipedia.org/wiki/Amazon_(company)","https://x.com/Amazon"]}}}