Newsletter
Just about every major company is diving deep into AI technology, and Amazon is no exception. The e-commerce giant has been working on AI for years, but now it’s doubling down on its efforts with the announcement of new chips at its Re:Invent conference in Vegas. These chips promise to offer improvements with AI training.
One of the main things you need when you’re training AI models is a powerful set of chips. You’ll need them to process all of the data flowing in. This is why companies buy boatloads of powerful chips from chip manufacturers.
Amazon is working on new chips for AI training
First up, we have the Trainium2 chips. The second generation in the series, they offer some improvements over their predecessors. Amazon says that they’re twice as power efficient and 4x more powerful than the first generation. Those are notable improvements, for just one generational leap. When it comes to chip technologies, generational leaps usually bring 30%-50% jumps in performance, not 400%.
Along with Amazon, another company is going to be using these chips. Anthropic AI will also employ these chips to help train its models. This company is backed by Amazon, so that should come as no surprise.
Next up, the company is also working on the new Graviton4 chips. These aren’t quite as robust as the aforementioned ones, but they’re not meant to be. These new chips offer a 30% jump in performance over their predecessors. That’s not as notable as with the Trainium2 chips, but that’s still nothing to sneeze at. These chips are based on ARM architecture which leads to gains in power efficiency.
These new chips are another example of major companies gathering major silicon to boost their AI development. Not too long ago, Elon Musk secured thousands of GPUs from Nvidia to build the AI for X Corp.
Speaking of Nvidia, Amazon partnered with Nvidia to offer enterprise customers access to some of the company’s powerful cloud-based AI chips. They’ll have access to the H200 AU GPUs.
Amazon has a new bot
During the event, the company took the wraps off of Q; its new AI chatbot. We all knew that this was coming. Every company eventually comes out with a chatbot. However, you won’t be asking this one to help you cheat on your history essay. Rather, Q comes with a suit and a tie.
It’s a chatbot designed for internal; business use. We’re talking about speeding up work projects and customer service. This will be an all-in-one business solution that can connect to several different services like Dropbox, Salesforce, Microsoft 365, Zendesk, and many more. If you’re interested in using this bot, then it will cost you between $20 and $30/month. It’s available in preview form currently.