Inside the AI Hardware Boom: Servers, Substrates and Advanced Packaging
August 7, 2025 | Edy Yu, Printed Circuit Information, China, and Marcy LaRont, I-Connect007Estimated reading time: 4 minutes

AI is rewriting the hardware playbook, marrying complex software and algorithms to run and improve machine and equipment operations. Sorting through, managing, and utilizing massive amounts of data takes tremendous data storage and processing power. Enter the new generation of supercomputers and data servers. The data servers being built today are not your momma’s server, as they say.
As discussed in article one of this series, AI server shipments more than doubled, jumping from under 400,000 units to over 1 million in 2024. Each of these machines is far more complex and PCB-intensive than traditional servers, from massive 22-layer any-layer HDI motherboards to accelerator card carriers packed with GPUs and high-bandwidth memory (HBM), containing between $1,000–$2,000 worth of PCBs in a single unit.
The Market Explosion
The knock-on effect for the wider server and storage market has been dramatic. In 2023, the global server and storage market stood at $172 billion. By the end of 2024, that figure had ballooned to $254 billion, with projections of $431 billion by 2028. This growth is driven by hyperscale data centers and new deployments in defense, autonomous vehicles, robotics, and biomedical computing, all of which need AI-optimized hardware.
HDI Boards Lead the Charge
AI servers have triggered a boom in high density interconnect (HDI) boards. In 2024, HDI boards grew 17.8%, the fastest among PCB categories. With half of 2025 in the rearview mirror, it sometimes seems like HDI is all we discuss in PCB fabrication. HDI and UHDI technology can deliver tight interconnects, high signal integrity, and complex stack-ups in a relatively small footprint. Many AI mainboards use hybrid architectures–a combination of 20–30 traditional multilayer core layers for power distribution and two to eight HDI layers for ultra-dense signal routing.
Substrates: ABF Stumbles, BT Holds Strong
After 2024, not every segment was thriving. ABF substrates, the workhorse for advanced packaging, suffered a sharp correction in 2024 after years of rapid expansion. Overcapacity and price competition dragged down revenue for leading suppliers within Ibiden, with a decrease of 18%, and Nanya PCB, a decrease of over 20%.
In contrast, BT-type substrates combining BT resin with more traditional glass fiber reinforcement outperformed expectations, buoyed by their role in high-performance computing and automotive electronics.
Halfway through 2025, the research and development of advanced materials remains an area of intense interest and activity, though the solutions that will go the distance remain to be proven out. The term and concept of “advanced packaging” as an offshoot of electronics manufacturing and how that is affecting PCBs and the interconnect piece of more complex electronic product solutions has started to pick up steam in industry engineering and technical circles, something only expected to grow.
Packaging Gets Super-sized
If there’s one phrase that defines packaging in 2024, it is “bigger and more complex.” NVIDIA’s Blackwell GB200 package spans 81×75 mm, integrating two GPUs and eight HBM modules. By 2027, package sizes could reach 100x100 mm or larger, creating enormous engineering challenges.
To handle this, NVIDIA, along with AMD and Intel, relies on TSMC’s CoWoS (Chip-on-Wafer-on-Substrate) packaging technology. This approach combines ABF substrates with multi-chip fusion, enabling massive computational density. Intel’s EMIB (Embedded Multi-Die Interconnect Bridge) offers an alternative path to multi-chip integration, but the goal is the same: fuse more chips into larger, denser packages.
The Unseen Heroes: PCB Fabricators
Behind every AI chip and server is a PCB supplier rising to the challenge. Chinese companies like WUS, Gold Circuit (Taiwanese), Shengyi, and Victory Giant saw revenue growth exceeding 30% in 2024, driven by demand for high-layer-count boards in servers and networking equipment. These aren’t just bigger boards, they’re more technically demanding, requiring tight tolerances, sequential lamination, and advanced HDI processing.
Conclusion: Bigger, Faster, Smarter
AI servers are supercomputers in a rack, and their rise is transforming the PCB industry. From hybrid HDI multilayers to supersized CoWoS substrates, hardware design is evolving at breakneck speed. For PCB manufacturers, it’s a race to keep up, and those who can deliver the most advanced boards will claim the lion’s share of this new golden market.
Stay tuned for the final article in this series,“Materials & Manufacturing for the AI Era: The Next PCB Frontier.”
This article is based on insights shared by Dr. Shiuh-Kao Chiang of Prismark during his technical seminar at HKPCA 2024 with some editorial discourse based on this article being published in I-Connect007 in 2025. Any omissions are unintentional. For more details, visit www.prismark.com or contact the author at edy@e-cio.cn.
Testimonial
"In a year when every marketing dollar mattered, I chose to keep I-Connect007 in our 2025 plan. Their commitment to high-quality, insightful content aligns with Koh Young’s values and helps readers navigate a changing industry. "
Brent Fischthal - Koh YoungSuggested Items
Datest Unveils Viscom iX7059 XL 3D CT AXI System
08/25/2025 | DatestDatest, a trusted leader in advanced testing, engineering, inspection, and failure analysis services, and the go-to destination for when your boards misbehave and your AXI line goes on vacation, is thrilled to announce the arrival of its newest diagnostic weapon: the Viscom iX7059 XL 3D CT AXI Inspection System.
Polar Instruments Announces Additive Transmission Line Support for Si9000e
08/20/2025 | Polar InstrumentsTransmission lines embedded into the PCB surface are a feature of UHDI constructions. The 2025 fall release of Polar's Si9000e PCB impedance & insertion loss transmission line field solver incorporates eight new single ended, differential and coplanar transmission line structures.
Axxon-Mycronic Brings High-Performance Conformal Coating to productronica India 2025
08/20/2025 | Axxon-MycronicAxxon-Mycronic, a leading, global supplier of innovative and production-ready, dispensing and conformal coating systems, is pleased to announce its participation in productronica India 2025, taking place September 17–19 at the Bangalore International Exhibition Centre (BIEC).
The Marketing Minute: Staying Positive When the Market Isn’t
08/20/2025 | Brittany Martin -- Column: The Marketing MinuteIn today’s volatile electronics market, buffeted by tariffs, supply-chain shifts, and squeezed margins, it’s tempting to tighten belts and cut your marketing budget. But history shows us that the quietest brands get forgotten fastest. Staying visible is not a luxury; it’s a competitive advantage.
Eltek Ltd. Reports Strong Second-Quarter 2025 Results
08/14/2025 | PR NewswireEltek Ltd., a global manufacturer and supplier of technologically advanced solutions in the field of printed circuit boards (PCBs), today announced its financial results for the quarter ended June 30, 2025.