-
-
News
News Highlights
- Books
Featured Books
- smt007 Magazine
Latest Issues
Current IssueWhat's Your Sweet Spot?
Are you in a niche that’s growing or shrinking? Is it time to reassess and refocus? We spotlight companies thriving by redefining or reinforcing their niche. What are their insights?
Moving Forward With Confidence
In this issue, we focus on sales and quoting, workforce training, new IPC leadership in the U.S. and Canada, the effects of tariffs, CFX standards, and much more—all designed to provide perspective as you move through the cloud bank of today's shifting economic market.
Intelligent Test and Inspection
Are you ready to explore the cutting-edge advancements shaping the electronics manufacturing industry? The May 2025 issue of SMT007 Magazine is packed with insights, innovations, and expert perspectives that you won’t want to miss.
- Articles
- Columns
- Links
- Media kit
||| MENU - smt007 Magazine
Global AI Server Demand Surge Expected to Drive 2024 Market Value to US$187 Billion; Represents 65% of Server Market
July 17, 2024 | TrendForceEstimated reading time: 2 minutes

TrendForce’s latest industry report on AI servers reveals that high demand for advanced AI servers from major CSPs and brand clients is expected to continue in 2024. Meanwhile, TSMC, SK hynix, Samsung, and Micron’s gradual production expansion has significantly eased shortages in 2Q24. Consequently, the lead time for NVIDIA’s flagship H100 solution has decreased from the previous 40–50 weeks to less than 16 weeks.
TrendForce estimates that AI server shipments in the second quarter will increase by nearly 20% QoQ, and has revised the annual shipment forecast up to 1.67 million units—marking a 41.5% YoY growth.
TrendForce notes that this year, major CSPs continue to focus their budgets on procuring AI servers, which is crowding out the growth momentum of general servers. Compared to the high growth rate of AI servers, the annual growth rate of general server shipments is only 1.9%. The share of AI servers in total server shipments is expected to reach 12.2% for an increase of about 3.4 percentage points from 2023.
In terms of market value, AI servers are significantly contributing to revenue growth more than general servers. The market value of AI servers is projected to exceed $187 billion in 2024, with a growth rate of 69%, accounting for 65% of the total server market value.
North American CSPs (e.g., AWS, Meta) are continuously expanding their proprietary ASICs, and Chinese companies like Alibaba, Baidu, and Huawei are actively expanding their own ASIC AI solutions. This is expected to increase the share of ASIC servers in the total AI server market to 26% in 2024, while mainstream GPU-equipped AI servers will account for about 71%.
In terms of AI chip suppliers for AI servers, NVIDIA holds the highest market share—approaching 90% for GPU-equipped AI servers—while AMD’s market share is only about 8%. However, when including all AI chips used in AI servers (GPU, ASIC, FPGA), NVIDIA’s market share this year is around 64%.
TrendForce observes that demand for advanced AI servers is expected to remain strong through 2025, especially with NVIDIA’s next-generation Blackwell (including GB200, B100/B200) set to replace the Hopper platform as the market mainstream. This will also drive demand for CoWoS and HBM. For NVIDIA’s B100, the chip size will be double that of the H100, consuming more CoWoS. The production capacity of major supplier TSMC’s CoWoS is estimated to reach 550–600K units by the end of 2025, with a growth rate approaching 80%.
Mainstream H100 in 2024 will be equipped with 80 GB HMB3. By 2025, main chips like NVIDIA’s Blackwell Ultra or AMD’s MI350 are expected to be equipped with up to 288 GB of HBM3e, tripling the unit usage. The overall HBM supply is expected to double by 2025 with the strong ongoing demand in the AI server market.
Suggested Items
PCBAA Wins Summit Silver Award from the American Society of Association Executives
07/18/2025 | PCBAAPCBAA was one of 38 associations that earned Silver Awards for outstanding contributions for an entry titled: Chips Don’t Float: More Printed Circuit Boards Must be Made in America.
INSPECTIS AB ‘Makes it a Meal’ with Series U50s Advanced Kit
07/18/2025 | INSPECTIS ABFamous chefs the world over maintain that an entrée doesn’t make a great meal without side dishes. At INSPECTIS, we call those ‘sides’ an Advanced Kit.
July 2025 PCB007 Magazine: Sales—From Pitch to PO
07/18/2025 |Though all parts of a company are essential for holistic success, it is a foundational truth that a company lives and dies by its sales. If there are no sales, the company eventually ceases to exist, or as Henry Ford says, “Nothing happens until someone sells something.” In the July issue of PCB007 Magazine, we break down the sales stack and provide a guide to up your sales game.
Silicon Mountain Contract Services Enhances SMT Capabilities with New HELLER Reflow Oven
07/17/2025 | Silicon Mountain Contract ServicesSilicon Mountain Contract Services, a leading provider of custom electronics manufacturing solutions, is proud to announce a significant upgrade to its SMT production capability with the addition of a HELLER 2043 MK5 10‑zone reflow oven to its Nampa facility.
KONIG Launches KP400: Advanced 3D Digital Conformal Coating System for High-Density Electronics
07/15/2025 | KONIGKONIG, a leader in electronic packaging protection solutions, is proud to announce the launch of the KP400 3D Digital Packaging Solution—a breakthrough conformal coating system that brings new levels of precision, speed, and material efficiency to electronics manufacturing.