Knocking Down the Bone Pile: Best Practices for Electronic Component Salvaging
Global Citizenship: Together for a Perfect PCB Solution
Smart Automation: Odd-form Assembly—Dedicated Insertion Equipment Matters
Global AI Server Demand Surge Expected to Drive 2024 Market Value to US$187 Billion; Represents 65% of Server Market
July 17, 2024 | TrendForceEstimated reading time: 2 minutes
TrendForce’s latest industry report on AI servers reveals that high demand for advanced AI servers from major CSPs and brand clients is expected to continue in 2024. Meanwhile, TSMC, SK hynix, Samsung, and Micron’s gradual production expansion has significantly eased shortages in 2Q24. Consequently, the lead time for NVIDIA’s flagship H100 solution has decreased from the previous 40–50 weeks to less than 16 weeks.
TrendForce estimates that AI server shipments in the second quarter will increase by nearly 20% QoQ, and has revised the annual shipment forecast up to 1.67 million units—marking a 41.5% YoY growth.
TrendForce notes that this year, major CSPs continue to focus their budgets on procuring AI servers, which is crowding out the growth momentum of general servers. Compared to the high growth rate of AI servers, the annual growth rate of general server shipments is only 1.9%. The share of AI servers in total server shipments is expected to reach 12.2% for an increase of about 3.4 percentage points from 2023.
In terms of market value, AI servers are significantly contributing to revenue growth more than general servers. The market value of AI servers is projected to exceed $187 billion in 2024, with a growth rate of 69%, accounting for 65% of the total server market value.
North American CSPs (e.g., AWS, Meta) are continuously expanding their proprietary ASICs, and Chinese companies like Alibaba, Baidu, and Huawei are actively expanding their own ASIC AI solutions. This is expected to increase the share of ASIC servers in the total AI server market to 26% in 2024, while mainstream GPU-equipped AI servers will account for about 71%.
In terms of AI chip suppliers for AI servers, NVIDIA holds the highest market share—approaching 90% for GPU-equipped AI servers—while AMD’s market share is only about 8%. However, when including all AI chips used in AI servers (GPU, ASIC, FPGA), NVIDIA’s market share this year is around 64%.
TrendForce observes that demand for advanced AI servers is expected to remain strong through 2025, especially with NVIDIA’s next-generation Blackwell (including GB200, B100/B200) set to replace the Hopper platform as the market mainstream. This will also drive demand for CoWoS and HBM. For NVIDIA’s B100, the chip size will be double that of the H100, consuming more CoWoS. The production capacity of major supplier TSMC’s CoWoS is estimated to reach 550–600K units by the end of 2025, with a growth rate approaching 80%.
Mainstream H100 in 2024 will be equipped with 80 GB HMB3. By 2025, main chips like NVIDIA’s Blackwell Ultra or AMD’s MI350 are expected to be equipped with up to 288 GB of HBM3e, tripling the unit usage. The overall HBM supply is expected to double by 2025 with the strong ongoing demand in the AI server market.
Share on:
Testimonial
"Advertising in PCB007 Magazine has been a great way to showcase our bare board testers to the right audience. The I-Connect007 team makes the process smooth and professional. We’re proud to be featured in such a trusted publication."
Klaus Koziol - atgSuggested Items
Breakthrough in Non-Contact Solder Removal Earns Kurtz Ersa 2025 Mexico Technology Award at SMTA Guadalajara
09/18/2025 | Kurtz Ersa Inc.Kurtz Ersa Inc., a leading supplier of electronics production equipment, is proud to announce that it has been awarded a 2025 Mexico Technology Award in the category of Rework & Repair for its HR 600P Automatic Rework System.
Knocking Down the Bone Pile: Best Practices for Electronic Component Salvaging
09/17/2025 | Nash Bell -- Column: Knocking Down the Bone PileElectronic component salvaging is the practice of recovering high-value devices from PCBs taken from obsolete or superseded electronic products. These components can be reused in new assemblies, reducing dependence on newly purchased parts that may be costly or subject to long lead times.
On the Line With… Podcast: UHDI and RF Performance
09/17/2025 | I-Connect007I-Connect007 is excited to announce the release of a new episode in its latest On the Line with... podcast series, which shines a spotlight on one of the most important emerging innovations in electronics manufacturing: Ultra-High-Density Interconnect (UHDI).
The Marketing Minute: Cracking the Code of Technical Marketing
09/17/2025 | Brittany Martin -- Column: The Marketing MinuteMarketing is never a one-size-fits-all endeavor, but the challenges are magnified for highly technical industries like electronics. Products and processes are complex, audiences are diverse, and the stakes are high, especially when your customers are engineers, decision-makers, and global partners who depend on your expertise.
EV Group Achieves Breakthrough in Hybrid Bonding Overlay Control for Chiplet Integration
09/12/2025 | EV GroupEV Group (EVG), a leading provider of innovative process solutions and expertise serving leading-edge and future semiconductor designs and chip integration schemes, today unveiled the EVG®40 D2W—the first dedicated die-to-wafer overlay metrology platform to deliver 100 percent die overlay measurement on 300-mm wafers at high precision and speeds needed for production environments. With up to 15X higher throughput than EVG’s industry benchmark EVG®40 NT2 system designed for hybrid wafer bonding metrology, the new EVG40 D2W enables chipmakers to verify die placement accuracy and take rapid corrective action, improving process control and yield in high-volume manufacturing (HVM).