The Marketing Minute: Marketing With Layers
The Right Approach: Electro-Tek—A Williams Family Legacy, Part 1
It’s Only Common Sense: If You’re Not Differentiated, You’re Dead
TrendForce: New AI Accelerator Chips Boost HBM3 and HBM3e to Dominate 2024 Market
August 1, 2023 | TrendForceEstimated reading time: 2 minutes
TrendForce reports that the HBM (High Bandwidth Memory) market's dominant product for 2023 is HBM2e, employed by the NVIDIA A100/A800, AMD MI200, and most CSPs' (Cloud Service Providers) self-developed accelerator chips. As the demand for AI accelerator chips evolves, manufacturers plan to introduce new HBM3e products in 2024, with HBM3 and HBM3e expected to become mainstream in the market next year.
The distinctions between HBM generations primarily lie in their speed. The industry experienced a proliferation of confusing names when transitioning to the HBM3 generation. TrendForce clarifies that the so-called HBM3 in the current market should be subdivided into two categories based on speed. One category includes HBM3 running at speeds between 5.6 to 6.4 Gbps, while the other features the 8 Gbps HBM3e, which also goes by several names including HBM3P, HBM3A, HBM3+, and HBM3 Gen2.
The development status of HBM by the three major manufacturers, SK hynix, Samsung, and Micron, varies. SK hynix and Samsung began their efforts with HBM3, which is used in NVIDIA's H100/H800 and AMD's MI300 series products. These two manufacturers are also expected to sample HBM3e in Q1 2024. Meanwhile, Micron chose to skip HBM3 and directly develop HBM3e.
HBM3e will be stacked with 24Gb mono dies, and under the 8-layer (8Hi) foundation, the capacity of a single HBM3e will jump to 24GB. This is anticipated to feature in NVIDIA’s GB100, set to launch in 2025. Hence, major manufacturers are expected to release HBM3e samples in Q1 2024 and aim to mass-produce them by 2H 2024.
CSPs are developing their own AI chips in an effort to reduce dependency on NVIDIA and AMD
NVIDIA continues to command the highest market share when it comes to AI server accelerator chips. However, the high costs associated with NVIDIA’s H100/H800 GPUs, priced at between US$20,000 and $25,000 per unit, coupled with an AI server’s recommended eight-card configuration, have dramatically increased the total cost of ownership. Therefore, while CSPs will continue to source server GPUs from NVIDIA or AMD, they are concurrently planning to develop their own AI accelerator chips.
Tech giants Google and Amazon Web Services (AWS) have already made significant strides in this area with the establishment of the Google Tensor Processing Unit (TPU) and AWS’ Trainium and Inferentia chips. Furthermore, these two industry leaders are already hard at work on their next-generation AI accelerators, which are set to utilize HBM3 or HBM3e technology. Furthermore, other CSPs in North America and China are also conducting related verifications, signaling a potential surge in competition in the AI accelerator chip market in the coming years.
Share on:
Testimonial
"The I-Connect007 team is outstanding—kind, responsive, and a true marketing partner. Their design team created fresh, eye-catching ads, and their editorial support polished our content to let our brand shine. Thank you all! "
Sweeney Ng - CEE PCBSuggested Items
The Marketing Minute: Marketing With Layers
10/15/2025 | Brittany Martin -- Column: The Marketing MinuteMarketing to a technical audience is like crafting a multilayer board: Each layer serves a purpose, from the surface story to the buried detail that keeps everything connected. At I-Connect007, we’ve learned that the best marketing campaigns aren’t built linearly; they’re layered. A campaign might start with a highly technical resource, such as an in-depth article, a white paper, or a podcast featuring an engineer delving into the details of a process. That’s the foundation, the substance that earns credibility.
ICT Symposium Review: Sustainability and the Circular Economy
10/09/2025 | Pete Starkey, I-Connect007It was pleasant autumnal weather as we made our way once again to Meriden, the nominal centre of England, for the 2025 Annual Symposium of the Institute of Circuit Technology. Delegates were welcomed by technical director Emma Hudson who introduced and moderated a skilfully coordinated programme, focused on the highly relevant theme of sustainability.
Circular Packaging Market to Reach $98.0 Billion by 2035
10/08/2025 | Fact.MRThe market's journey from USD 45.8 billion in 2025 to USD 98.0 billion by 2035 represents substantial growth, the market will rise at a CAGR of 7.9% demonstrating the accelerating adoption of sustainable packaging systems and circular economy solutions across food & beverage, personal care, and e-commerce sectors.
It’s Only Common Sense: Stop Whining About the Market—Outwork It
10/06/2025 | Dan Beaulieu -- Column: It's Only Common SenseWhenever the market hiccups or the industry cycle dips, I hear the same tired chorus: “The market is down. Customers aren’t buying. What can we do? We just have to wait it out.” Nonsense. If you think that by showing up, opening your doors, and waiting for the economy to smile kindly upon you, that success will follow, you are in the wrong business. Worse yet, you’re living in the wrong mindset. Most people don’t want to hear the truth that winners find business in down cycles. Losers blame the economy.
Schweizer Ends Staff Restructuring Measures and Short-Time Working at the Schramberg Site
10/01/2025 | Schweizer Electronic AGSchweizer Electronic AG has implemented comprehensive measures to adjust its cost and personnel structure at its Schramberg site due to strong market fluctuations in the automotive and industrial electronics sector. Thanks to the successful restructuring, short-time working can now be ended with immediate effect. A stable order situation is expected for the fourth quarter, with signs of growth momentum returning in 2026.