Chiplet Architecture for AI Will Create New Demands for Assembly
May 28, 2024 | Nolan Johnson, SMT007 MagazineEstimated reading time: 2 minutes

As we examine the entire AI ecosystem more closely, it becomes clear that AI algorithms are intensely hungry for compute power. This demand is accelerating beyond the customary rate predicted by Moore’s Law, just as traditional semiconductor fabrication methods are failing to maintain Moore’s Law. It’s a real dilemma.
Those watching AI say that advanced packaging techniques, which have been in R&D development for some time, see AI as their killer app. AI is needed to propel these cutting-edge packages into the mainstream.
At a 2022 symposium on advanced packaging in Washington, D.C., I met Dale McHerron, a researcher on AI compute hardware. As we discussed IBM’s work in this area, Dale introduced me to Arvind Kumar, a principal research scientist and manager in AI hardware and chiplet architectures.
I reached out to Arvind to discuss his keynote presentation at the recent IMAPS conference where he discussed the AI hardware ecosystem and role of advanced packaging. Those in the assembly services industry know that any new packages will require accurate and reliable placement on the EMS manufacturing floor. Arvind shares his perspective and some predictions based on his research. It is also clear there is still much coordination and communication needed to make this work.
Nolan Johnson: What is chiplet architecture and why does it matter? How is advanced packaging moving forward?
Arvind Kumar: Chiplet architectures, which allow the partitioning of complex designs into tightly co-packaged sub-elements, are influencing the way we think about packaging. We would like to put more chips into a single package and have them talk to each other with high bandwidth, low latency, and low-energy interconnects. That goal is driving emerging packaging technologies to higher interconnect densities, more routing layers, and larger body sizes.
Johnson: Ever since semiconductors were developed, we’ve used the thought pattern of making bigger monolithic chips. Why the change?
Kumar: For a long time, the fundamental idea was that we could get more performance out of larger dies at the most advanced technology node. Fabricating all parts of a chip at the most advanced node is getting very expensive and has major yield challenges, so this drives us toward smaller die sizes. Additionally, we can partition the chip such that some parts that don’t scale well can remain in an older technology node. That's a very natural fit for chiplet architecture.
To continue reading this interview that originally appeared in the May 2024 issue of SMT007 Magazine, click here.
Testimonial
"Advertising in PCB007 Magazine has been a great way to showcase our bare board testers to the right audience. The I-Connect007 team makes the process smooth and professional. We’re proud to be featured in such a trusted publication."
Klaus Koziol - atgSuggested Items
U.S. CHIPS Act Funding Detailed on SIA Website
09/12/2025 | Nolan Johnson, I-Connect007The U.S. CHIPS Act has moved well into the implementation stage in 2025. But where has that money gone? The Semiconductor Industry Association has been tracking these projects and provides details on its website. It was updated May. Among the five key programs being managed under CHIPS, two stand out as influencing advanced electronic packaging: the National Advanced Packaging Manufacturing Program (NAPMP), and the CHIPS Manufacturing USA Institute (MFG USA).
Advanced Packaging: Preparation is Now
09/15/2025 | Nolan Johnson, I-Connect007In this interview, Matt Kelly, CTO for the Global Electronics Association, and Devan Iyer, chief strategist of advanced packaging, define advanced electronics packaging and the critical nature of getting it right in the electronics manufacturing field. They share details from their white paper, “Advanced Packaging to Board Level Integration—Needs and Challenges,” and provide insight into how next-generation packaging will change the design, fabrication, and assembly of printed circuit boards, including the implications for final system assembly.
Defense Speak Interpreted: If CHIPS Cuts Back, What Happens to Electronics Packaging Funds?
09/02/2025 | Dennis Fritz -- Column: Defense Speak InterpretedIn my May column, I examined the topic of the CHIPS Act and its current status as a U.S. government program. I found that CHIPS activities continue, but some corporations have delayed or canceled them because of budget cuts or corporation-specific problems. However, CHIPS integrated circuits—mostly administered by the Department of Commerce—don’t fully drive the electronics interconnection activity being funded by the government. Let’s cover the progress/status of other programs:
Amkor Announces New Site for U.S. Semiconductor Advanced Packaging and Test Facility
09/01/2025 | BUSINESS WIREAmkor Technology, Inc., a leading provider of semiconductor packaging and test services, announced revised plans for the location of the company’s new semiconductor advanced packaging and test facility in Arizona.
MacDermid Alpha Awarded for Innovation: Driving Process Optimization and Efficiency with Major Indian EMS Provider
08/28/2025 | MacDermid Alpha Electronics SolutionsMacDermid Alpha Electronics Solutions, a leading global supplier of integrated materials for the electronics industry, is recognized by one of India’s top EMS providers, Syrma SGS, with an award for innovation that advanced process optimization, enhanced operational efficiency, and yield gains.