Chiplet Architecture for AI Will Create New Demands for Assembly
May 28, 2024 | Nolan Johnson, SMT007 MagazineEstimated reading time: 2 minutes
![](https://iconnect007.com/application/files/5517/1644/2377/Arvind_Kumar_300.jpg)
As we examine the entire AI ecosystem more closely, it becomes clear that AI algorithms are intensely hungry for compute power. This demand is accelerating beyond the customary rate predicted by Moore’s Law, just as traditional semiconductor fabrication methods are failing to maintain Moore’s Law. It’s a real dilemma.
Those watching AI say that advanced packaging techniques, which have been in R&D development for some time, see AI as their killer app. AI is needed to propel these cutting-edge packages into the mainstream.
At a 2022 symposium on advanced packaging in Washington, D.C., I met Dale McHerron, a researcher on AI compute hardware. As we discussed IBM’s work in this area, Dale introduced me to Arvind Kumar, a principal research scientist and manager in AI hardware and chiplet architectures.
I reached out to Arvind to discuss his keynote presentation at the recent IMAPS conference where he discussed the AI hardware ecosystem and role of advanced packaging. Those in the assembly services industry know that any new packages will require accurate and reliable placement on the EMS manufacturing floor. Arvind shares his perspective and some predictions based on his research. It is also clear there is still much coordination and communication needed to make this work.
Nolan Johnson: What is chiplet architecture and why does it matter? How is advanced packaging moving forward?
Arvind Kumar: Chiplet architectures, which allow the partitioning of complex designs into tightly co-packaged sub-elements, are influencing the way we think about packaging. We would like to put more chips into a single package and have them talk to each other with high bandwidth, low latency, and low-energy interconnects. That goal is driving emerging packaging technologies to higher interconnect densities, more routing layers, and larger body sizes.
Johnson: Ever since semiconductors were developed, we’ve used the thought pattern of making bigger monolithic chips. Why the change?
Kumar: For a long time, the fundamental idea was that we could get more performance out of larger dies at the most advanced technology node. Fabricating all parts of a chip at the most advanced node is getting very expensive and has major yield challenges, so this drives us toward smaller die sizes. Additionally, we can partition the chip such that some parts that don’t scale well can remain in an older technology node. That's a very natural fit for chiplet architecture.
To continue reading this interview that originally appeared in the May 2024 issue of SMT007 Magazine, click here.
Suggested Items
MKS’ Atotech and ESI Participate in Electronics Circuit Asia in Thailand
07/25/2024 | AtotechMKS Instruments announces its participation at the Electronics Circuit Asia 2024 in Thailand, July 24-26, highlighting its leading brands Atotech® and ESI® and related advances in advanced packaging, package substrate, and printed circuit board manufacturing.
iNEMI Packaging Tech Topic Series: Damage-Free Rapid Electron Beam Testing for Advanced Packaging
07/24/2024 | iNEMITesting issues are limiting chip makers’ ability to create larger SOCs (system-on-chip). The scan field dimensions of EUV (extreme ultraviolet light) and NA (numerical aperture) EUV, which are typically used for testing, are too small.
Keysight, University of Malaga’s MobileNet Join Forces to Accelerate Open RAN Development with RAN Intelligent Controller Testing
07/23/2024 | BUSINESS WIREKeysight Technologies, Inc. announces that the University of Malaga, specifically the MobileNet: Mobile & Aerospace Networks Lab within the Telecommunications Institute (TELMA), has selected its RAN Intelligent Controller Test Solutions (RICtest).
BAE Systems to Deliver Advanced Microelectronics to U.S. Defense Industrial Base
07/23/2024 | BUSINESS WIREThe contract will support the Strategic Transition of Microelectronics to Accelerate Modernization by Prototyping and Innovating in the Packaging Ecosystem (STEAM PIPE) project and will be managed by National Security Technology Accelerator (NSTXL).
Digital Twin Consortium Members Develop and Deploy Multi-Agent Gen AI Systems
07/23/2024 | GlobeNewswireDigital Twin Consortium® (DTC) announced that members are developing and deploying Multi-agent GenAI Systems (MAGS) that are redefining the boundaries of how product design, services, and processes can be realized, born of efficiency and optimizations.