-
- News
- Books
Featured Books
- smt007 Magazine
Latest Issues
Current IssueCounterfeit Concerns
The distribution of counterfeit parts has become much more sophisticated in the past decade, and there's no reason to believe that trend is going to be stopping any time soon. What might crop up in the near future?
Solder Printing
In this issue, we turn a discerning eye to solder paste printing. As apertures shrink, and the requirement for multiple thicknesses of paste on the same board becomes more commonplace, consistently and accurately applying paste becomes ever more challenging.
A Culture of Thriving
One cannot simply command thriving; it must be nurtured, developed, and encouraged. In this issue, we explore strategies to improve your working relationship model—both internally and externally. In this culture of thriving, your business will grow in the process.
- Articles
- Columns
Search Console
- Links
- Media kit
||| MENU - smt007 Magazine
Global AI Server Demand Surge Expected to Drive 2024 Market Value to US$187 Billion; Represents 65% of Server Market
July 17, 2024 | TrendForceEstimated reading time: 2 minutes
TrendForce’s latest industry report on AI servers reveals that high demand for advanced AI servers from major CSPs and brand clients is expected to continue in 2024. Meanwhile, TSMC, SK hynix, Samsung, and Micron’s gradual production expansion has significantly eased shortages in 2Q24. Consequently, the lead time for NVIDIA’s flagship H100 solution has decreased from the previous 40–50 weeks to less than 16 weeks.
TrendForce estimates that AI server shipments in the second quarter will increase by nearly 20% QoQ, and has revised the annual shipment forecast up to 1.67 million units—marking a 41.5% YoY growth.
TrendForce notes that this year, major CSPs continue to focus their budgets on procuring AI servers, which is crowding out the growth momentum of general servers. Compared to the high growth rate of AI servers, the annual growth rate of general server shipments is only 1.9%. The share of AI servers in total server shipments is expected to reach 12.2% for an increase of about 3.4 percentage points from 2023.
In terms of market value, AI servers are significantly contributing to revenue growth more than general servers. The market value of AI servers is projected to exceed $187 billion in 2024, with a growth rate of 69%, accounting for 65% of the total server market value.
North American CSPs (e.g., AWS, Meta) are continuously expanding their proprietary ASICs, and Chinese companies like Alibaba, Baidu, and Huawei are actively expanding their own ASIC AI solutions. This is expected to increase the share of ASIC servers in the total AI server market to 26% in 2024, while mainstream GPU-equipped AI servers will account for about 71%.
In terms of AI chip suppliers for AI servers, NVIDIA holds the highest market share—approaching 90% for GPU-equipped AI servers—while AMD’s market share is only about 8%. However, when including all AI chips used in AI servers (GPU, ASIC, FPGA), NVIDIA’s market share this year is around 64%.
TrendForce observes that demand for advanced AI servers is expected to remain strong through 2025, especially with NVIDIA’s next-generation Blackwell (including GB200, B100/B200) set to replace the Hopper platform as the market mainstream. This will also drive demand for CoWoS and HBM. For NVIDIA’s B100, the chip size will be double that of the H100, consuming more CoWoS. The production capacity of major supplier TSMC’s CoWoS is estimated to reach 550–600K units by the end of 2025, with a growth rate approaching 80%.
Mainstream H100 in 2024 will be equipped with 80 GB HMB3. By 2025, main chips like NVIDIA’s Blackwell Ultra or AMD’s MI350 are expected to be equipped with up to 288 GB of HBM3e, tripling the unit usage. The overall HBM supply is expected to double by 2025 with the strong ongoing demand in the AI server market.
Suggested Items
OLED Monitor Shipments to Reach 1.44 Million Units in 2024, Marking 181% YoY Growth
10/17/2024 | TrendForceTrendForce reports that the OLED monitor market is set to receive a boost with the introduction of new 31.5-inch OLED models. Panel makers are focusing on product differentiation and improved specifications, while several gaming brands are aggressively launching new models to capture market share. OLED monitor shipments are projected to reach 1.44 million units in 2024—representing YoY growth of 181%—with strong growth expected to continue in the coming years.
iNEMI End-of-Project Webinar: Investigation of AI Enhancement to AOI for PCBA
10/16/2024 | iNEMIAutomated optical inspection (AOI) systems are essential in electronic manufacturing for ensuring the quality of printed circuit board assemblies (PCBAs).
PCB007 Magazine October 2024: Alternate Metallization Processes
10/16/2024 | I-Connect007 Editorial TeamTraditional electroless copper and electroless copper immersion gold have been primary PCB plating methods for decades. But alternative plating metals and processes have been introduced over the past few years as miniaturization and advanced packaging continue to develop taking us into new directions. In this issue of PCB007 Magazine, we examine the impact of alternate metallization methods giving a glimpse into how and when we will arrive at 'destination metallization'.
Vitronics Soltec Unveils Advanced Heavy Board Options for Reflow Soldering System
10/15/2024 | Vitronics SoltecVitronics Soltec, a leader in reflow soldering technology, announces the launch of new Heavy Board options for its industry-leading Centurion 1240 reflow soldering system.
AV Unveils P550: Autonomous Group 2 eVTOL UAS
10/15/2024 | BUSINESS WIREAeroVironment (AV) has introduced the P550™ advanced autonomous Group 2 eVTOL uncrewed aircraft system (UAS) designed to set a new standard for battlefield adaptability and operational readiness. Leveraging a Modular Open Systems Approach (MOSA) and AI-driven autonomy, P550 is engineered to empower maneuver forces to quickly respond to evolving mission demands with rapid deployment, scalability, and superior situational awareness.