-
- News
- Books
Featured Books
- pcb007 Magazine
Latest Issues
Current IssueIn Pursuit of Perfection: Defect Reduction
For bare PCB board fabrication, defect reduction is a critical aspect of a company's bottom line profitability. In this issue, we examine how imaging, etching, and plating processes can provide information and insight into reducing defects and increasing yields.
Voices of the Industry
We take the pulse of the PCB industry by sharing insights from leading fabricators and suppliers in this month's issue. We've gathered their thoughts on the new U.S. administration, spending, the war in Ukraine, and their most pressing needs. It’s an eye-opening and enlightening look behind the curtain.
The Essential Guide to Surface Finishes
We go back to basics this month with a recount of a little history, and look forward to addressing the many challenges that high density, high frequency, adhesion, SI, and corrosion concerns for harsh environments bring to the fore. We compare and contrast surface finishes by type and application, take a hard look at the many iterations of gold plating, and address palladium as a surface finish.
- Articles
- Columns
Search Console
- Links
- Media kit
||| MENU - pcb007 Magazine
AI, HPC Demand Set to Boost HBM Volume by Almost 60% in 2023
July 3, 2023 | TrendForceEstimated reading time: 1 minute

High Bandwidth Memory (HBM) is emerging as the preferred solution for overcoming memory transfer speed restrictions due to the bandwidth limitations of DDR SDRAM in high-speed computation. HBM is recognized for its revolutionary transmission efficiency and plays a pivotal role in allowing core computational components to operate at their maximum capacity. Top-tier AI server GPUs have set a new industry standard by primarily using HBM. TrendForce forecasts that global demand for HBM will experience almost 60% growth annually in 2023, reaching 290 million GB, with a further 30% growth in 2024.
TrendForce's forecast for 2025, taking into account five large-scale AIGC products equivalent to ChatGPT, 25 mid-size AIGC products from Midjourney, and 80 small AIGC products, the minimum computing resources required globally could range from 145,600 to 233,700 Nvidia A100 GPUs. Emerging technologies such as supercomputers, 8K video streaming, and AR/VR, among others, are expected to simultaneously increase the workload on cloud computing systems due to escalating demands for high-speed computing.
HBM is unequivocally a superior solution for building high-speed computing platforms, thanks to its higher bandwidth and lower energy consumption compared to DDR SDRAM. This distinction is clear when comparing DDR4 SDRAM and DDR5 SDRAM, released in 2014 and 2020 respectively, whose bandwidths only differed by a factor of two. Regardless of whether DDR5 or the future DDR6 is used, the quest for higher transmission performance will inevitably lead to an increase in power consumption, which could potentially affect system performance adversely. Taking HBM3 and DDR5 as examples, the former's bandwidth is 15 times that of the latter and can be further enhanced by adding more stacked chips. Furthermore, HBM can replace a portion of GDDR SDRAM or DDR SDRAM, thus managing power consumption more effectively.
TrendForce concludes that the current driving force behind the increasing demand is AI servers equipped with Nvidia A100, H100, AMD MI300, and large CSPs such as Google and AWS, which are developing their own ASICs. It is estimated that the shipment volume of AI servers, including those equipped with GPUs, FPGAs, and ASICs, will reach nearly 1.2 million units in 2023, marking an annual growth rate of almost 38%. TrendForce also anticipates a concurrent surge in the shipment volume of AI chips, with growth potentially exceeding 50%.
Suggested Items
Technica Expands into Emerging Printed Electronics and Advanced Coatings Markets
06/04/2025 | Technica USATechnica is expanding its product portfolio with Agfa’s advanced line of Orgacon conductive coatings. The Orgacon products are a natural complement to Technica’s existing solutions and will allow the company to deliver greater value to customers in these markets.
Tariffs: Hope for the Best, Plan for the Worst
06/04/2025 | I-Connect007 Editorial TeamPaul Krugman received the Nobel Prize for Economics in 2008 for his work in economic geography and identifying international trade patterns. In April, he told the Goldman Sachs Exchanges podcast1, “The secret sauce of the Trump tariffs is that they are extremely uncertain. Nobody knows what they will be. Nobody knows what comes next. Now, if you’re a business trying to make plans, would you want to invest under those conditions?”
BAE Systems Unveils Comprehensive Line of M-Code GPS Receivers at Joint Navigation Conference
06/04/2025 | PRNewswireBAE Systems unveiled a diverse line of M-Code Global Positioning System (GPS) receiver solutions at the Joint Navigation Conference in Cincinnati this week, rounding out an extensive line of products that ensure U.S. warfighters have the most dependable GPS systems available across sea, land, and air.
Tesollo Selected for NVIDIA Inception Program
06/02/2025 | TesolloRobotics and solutions development company Tesollo Inc. announced that it has been officially selected as a member of NVIDIA’s Inception Program.
Qualcomm, Xiaomi Expand Collaboration with Multi-Year Agreement
05/23/2025 | Qualcomm Technologies, Inc.Qualcomm Technologies, Inc. and Xiaomi Corporation are celebrating 15 years of collaboration and have executed a multi-year agreement.