Dan’s Biz Bookshelf: ‘Elevate: Push Beyond Your Limits'
The Marketing Minute: The First Step to More Sales—Marketing
It’s Only Common Sense: Customer Service Is Sales in Disguise
TrendForce: New AI Accelerator Chips Boost HBM3 and HBM3e to Dominate 2024 Market
August 1, 2023 | TrendForceEstimated reading time: 2 minutes
TrendForce reports that the HBM (High Bandwidth Memory) market's dominant product for 2023 is HBM2e, employed by the NVIDIA A100/A800, AMD MI200, and most CSPs' (Cloud Service Providers) self-developed accelerator chips. As the demand for AI accelerator chips evolves, manufacturers plan to introduce new HBM3e products in 2024, with HBM3 and HBM3e expected to become mainstream in the market next year.
The distinctions between HBM generations primarily lie in their speed. The industry experienced a proliferation of confusing names when transitioning to the HBM3 generation. TrendForce clarifies that the so-called HBM3 in the current market should be subdivided into two categories based on speed. One category includes HBM3 running at speeds between 5.6 to 6.4 Gbps, while the other features the 8 Gbps HBM3e, which also goes by several names including HBM3P, HBM3A, HBM3+, and HBM3 Gen2.
The development status of HBM by the three major manufacturers, SK hynix, Samsung, and Micron, varies. SK hynix and Samsung began their efforts with HBM3, which is used in NVIDIA's H100/H800 and AMD's MI300 series products. These two manufacturers are also expected to sample HBM3e in Q1 2024. Meanwhile, Micron chose to skip HBM3 and directly develop HBM3e.
HBM3e will be stacked with 24Gb mono dies, and under the 8-layer (8Hi) foundation, the capacity of a single HBM3e will jump to 24GB. This is anticipated to feature in NVIDIA’s GB100, set to launch in 2025. Hence, major manufacturers are expected to release HBM3e samples in Q1 2024 and aim to mass-produce them by 2H 2024.
CSPs are developing their own AI chips in an effort to reduce dependency on NVIDIA and AMD
NVIDIA continues to command the highest market share when it comes to AI server accelerator chips. However, the high costs associated with NVIDIA’s H100/H800 GPUs, priced at between US$20,000 and $25,000 per unit, coupled with an AI server’s recommended eight-card configuration, have dramatically increased the total cost of ownership. Therefore, while CSPs will continue to source server GPUs from NVIDIA or AMD, they are concurrently planning to develop their own AI accelerator chips.
Tech giants Google and Amazon Web Services (AWS) have already made significant strides in this area with the establishment of the Google Tensor Processing Unit (TPU) and AWS’ Trainium and Inferentia chips. Furthermore, these two industry leaders are already hard at work on their next-generation AI accelerators, which are set to utilize HBM3 or HBM3e technology. Furthermore, other CSPs in North America and China are also conducting related verifications, signaling a potential surge in competition in the AI accelerator chip market in the coming years.
Share on:
Suggested Items
ViTrox’s HITS 5.0 Empowers Global Partners with Innovative Solutions and Stronger Bonds
07/16/2025 | ViTroxViTrox, strives to be the World’s Most Trusted Technology Company, proudly announces the successful conclusion of its fifth edition of High Impact Training for Sales (HITS 5.0), held from 23rd to 27th June 2025 at ViTrox Campus 2.0 and 3.0, located in Batu Kawan Industrial Park, Penang, Malaysia.
The Marketing Minute: The First Step to More Sales—Marketing
07/16/2025 | Brittany Martin -- Column: The Marketing MinuteIn today’s competitive B2B landscape, marketing is no longer just a support role; it’s the starting line. Before a PO is ever submitted, marketing has already laid the foundation for the sale. These days, buyers are more informed, selective, and self-guided than ever, and marketing is how they find, evaluate, and build trust in your company.
Infineon Advances on 300-millimeter GaN Manufacturing Roadmap as Leading Integrated Device Manufacturer (IDM)
07/10/2025 | InfineonAs the demand for gallium nitride (GaN) semiconductors continues to grow, Infineon Technologies AG is poised to capitalize on this trend and solidify its position as a leading Integrated Device Manufacturer (IDM) in the GaN market.
Webinar Review: A Global Trade and Economy in Flux
07/09/2025 | I-Connect007 Editorial TeamIn a July 8 webinar, Global Electronics Association Chief Economist Shawn DuBravac provided a comprehensive analysis of the evolving international trade environment, its implications for inflation, monetary policy, and labor dynamics, and a sober assessment of market valuations. In “Navigating a Shifting Landscape” DuBravac painted a picture of a global economy in flux, where shifting trade alliances and tariff structures are redrawing the supply chain map and influencing the broader economic landscape, while also conveying an overall bullish market outlook.
I-Connect007’s Editor’s Choice: Five Must-Reads for the Week
07/04/2025 | Marcy LaRont, I-Connect007For our industry, we have seen several bullish market announcements over the past few weeks, including one this week by IDC on the massive growth in the global server market. We’re also closely watching global trade and nearshoring. One good example of successful nearshoring is Rehm Thermal Systems, which celebrates its 10th anniversary in Mexico and the official opening of its new building in Guadalajara.