Marcy’s Musings: The Legislative Outlook—Helping or Hurting?
It’s Only Common Sense: The Phone Is Still Mightier Than the Keyboard
The Marketing Minute: Marketing With Layers
Global AI Server Demand Surge Expected to Drive 2024 Market Value to US$187 Billion; Represents 65% of Server Market
July 17, 2024 | TrendForceEstimated reading time: 2 minutes
TrendForce’s latest industry report on AI servers reveals that high demand for advanced AI servers from major CSPs and brand clients is expected to continue in 2024. Meanwhile, TSMC, SK hynix, Samsung, and Micron’s gradual production expansion has significantly eased shortages in 2Q24. Consequently, the lead time for NVIDIA’s flagship H100 solution has decreased from the previous 40–50 weeks to less than 16 weeks.
TrendForce estimates that AI server shipments in the second quarter will increase by nearly 20% QoQ, and has revised the annual shipment forecast up to 1.67 million units—marking a 41.5% YoY growth.
TrendForce notes that this year, major CSPs continue to focus their budgets on procuring AI servers, which is crowding out the growth momentum of general servers. Compared to the high growth rate of AI servers, the annual growth rate of general server shipments is only 1.9%. The share of AI servers in total server shipments is expected to reach 12.2% for an increase of about 3.4 percentage points from 2023.
In terms of market value, AI servers are significantly contributing to revenue growth more than general servers. The market value of AI servers is projected to exceed $187 billion in 2024, with a growth rate of 69%, accounting for 65% of the total server market value.
North American CSPs (e.g., AWS, Meta) are continuously expanding their proprietary ASICs, and Chinese companies like Alibaba, Baidu, and Huawei are actively expanding their own ASIC AI solutions. This is expected to increase the share of ASIC servers in the total AI server market to 26% in 2024, while mainstream GPU-equipped AI servers will account for about 71%.
In terms of AI chip suppliers for AI servers, NVIDIA holds the highest market share—approaching 90% for GPU-equipped AI servers—while AMD’s market share is only about 8%. However, when including all AI chips used in AI servers (GPU, ASIC, FPGA), NVIDIA’s market share this year is around 64%.
TrendForce observes that demand for advanced AI servers is expected to remain strong through 2025, especially with NVIDIA’s next-generation Blackwell (including GB200, B100/B200) set to replace the Hopper platform as the market mainstream. This will also drive demand for CoWoS and HBM. For NVIDIA’s B100, the chip size will be double that of the H100, consuming more CoWoS. The production capacity of major supplier TSMC’s CoWoS is estimated to reach 550–600K units by the end of 2025, with a growth rate approaching 80%.
Mainstream H100 in 2024 will be equipped with 80 GB HMB3. By 2025, main chips like NVIDIA’s Blackwell Ultra or AMD’s MI350 are expected to be equipped with up to 288 GB of HBM3e, tripling the unit usage. The overall HBM supply is expected to double by 2025 with the strong ongoing demand in the AI server market.
Share on:
Testimonial
"The I-Connect007 team is outstanding—kind, responsive, and a true marketing partner. Their design team created fresh, eye-catching ads, and their editorial support polished our content to let our brand shine. Thank you all! "
Sweeney Ng - CEE PCBSuggested Items
Teledyne FLIR Defense to Deliver Portable Chemical Detectors to US Customs and Border Protection
10/21/2025 | BUSINESS WIRETeledyne FLIR Defense, part of Teledyne Technologies Incorporated, announced that it has received an order from U.S. Customs and Border Protection (CBP) for 15 of its Griffin™ G510x portable chemical detectors, specifically designed to analyze and identify explosives and narcotics, such as fentanyl and nitazenes, within five minutes.
Curtiss-Wright to Supply Turret Drive Stabilization Systems for U.S. Army XM30 Combat Vehicle Prototypes
10/16/2025 | BUSINESS WIRECurtiss-Wright Corporation announced that it has been selected by American Rheinmetall to provide its Turret Drive Stabilization System (TDSS) for the prototype phase of the U.S. Army’s XM30 Combat Vehicle (CV) program, which was recently approved to advance to Milestone B, the Engineering and Manufacturing Development (EMD) phase.
Episode 6 of Ultra HDI Podcast Series Explores Copper-filled Microvias in Advanced PCB Design and Fabrication
10/15/2025 | I-Connect007I-Connect007 has released Episode 6 of its acclaimed On the Line with... American Standard Circuits: Ultra High Density Interconnect (UHDI) podcast series. In this episode, “Copper Filling of Vias,” host Nolan Johnson once again welcomes John Johnson, Director of Quality and Advanced Technology at American Standard Circuits, for a deep dive into the pros and cons of copper plating microvias—from both the fabricator’s and designer’s perspectives.
American Standard Circuits Achieves Successful AS9100 Recertification
10/14/2025 | American Standard CircuitsAmerican Standard Circuits (ASC), a leading manufacturer of advanced printed circuit boards, proudly announces the successful completion of its AS9100 recertification audit. This milestone reaffirms ASC’s ongoing commitment to the highest levels of quality, reliability, and process control required to serve aerospace, defense, space, and other mission-critical industries.
Imec Launches 300mm GaN Program to Develop Advanced Power Devices and Reduce Manufacturing Costs
10/13/2025 | ImecImec, a world-leading research and innovation hub in nanoelectronics and digital technologies, welcomes AIXTRON, GlobalFoundries, KLA Corporation, Synopsys, and Veeco as first partners in its 300mm gallium-nitride (GaN) open innovation program track for low- and high-voltage power electronics applications.