Chiplet Architecture for AI Will Create New Demands for Assembly
May 28, 2024 | Nolan Johnson, SMT007 MagazineEstimated reading time: 2 minutes

As we examine the entire AI ecosystem more closely, it becomes clear that AI algorithms are intensely hungry for compute power. This demand is accelerating beyond the customary rate predicted by Moore’s Law, just as traditional semiconductor fabrication methods are failing to maintain Moore’s Law. It’s a real dilemma.
Those watching AI say that advanced packaging techniques, which have been in R&D development for some time, see AI as their killer app. AI is needed to propel these cutting-edge packages into the mainstream.
At a 2022 symposium on advanced packaging in Washington, D.C., I met Dale McHerron, a researcher on AI compute hardware. As we discussed IBM’s work in this area, Dale introduced me to Arvind Kumar, a principal research scientist and manager in AI hardware and chiplet architectures.
I reached out to Arvind to discuss his keynote presentation at the recent IMAPS conference where he discussed the AI hardware ecosystem and role of advanced packaging. Those in the assembly services industry know that any new packages will require accurate and reliable placement on the EMS manufacturing floor. Arvind shares his perspective and some predictions based on his research. It is also clear there is still much coordination and communication needed to make this work.
Nolan Johnson: What is chiplet architecture and why does it matter? How is advanced packaging moving forward?
Arvind Kumar: Chiplet architectures, which allow the partitioning of complex designs into tightly co-packaged sub-elements, are influencing the way we think about packaging. We would like to put more chips into a single package and have them talk to each other with high bandwidth, low latency, and low-energy interconnects. That goal is driving emerging packaging technologies to higher interconnect densities, more routing layers, and larger body sizes.
Johnson: Ever since semiconductors were developed, we’ve used the thought pattern of making bigger monolithic chips. Why the change?
Kumar: For a long time, the fundamental idea was that we could get more performance out of larger dies at the most advanced technology node. Fabricating all parts of a chip at the most advanced node is getting very expensive and has major yield challenges, so this drives us toward smaller die sizes. Additionally, we can partition the chip such that some parts that don’t scale well can remain in an older technology node. That's a very natural fit for chiplet architecture.
To continue reading this interview that originally appeared in the May 2024 issue of SMT007 Magazine, click here.
Testimonial
"The I-Connect007 team is outstanding—kind, responsive, and a true marketing partner. Their design team created fresh, eye-catching ads, and their editorial support polished our content to let our brand shine. Thank you all! "
Sweeney Ng - CEE PCBSuggested Items
Defense Speak Interpreted: If CHIPS Cuts Back, What Happens to Electronics Packaging Funds?
09/02/2025 | Dennis Fritz -- Column: Defense Speak InterpretedIn my May column, I examined the topic of the CHIPS Act and its current status as a U.S. government program. I found that CHIPS activities continue, but some corporations have delayed or canceled them because of budget cuts or corporation-specific problems. However, CHIPS integrated circuits—mostly administered by the Department of Commerce—don’t fully drive the electronics interconnection activity being funded by the government. Let’s cover the progress/status of other programs:
Amkor Announces New Site for U.S. Semiconductor Advanced Packaging and Test Facility
09/01/2025 | BUSINESS WIREAmkor Technology, Inc., a leading provider of semiconductor packaging and test services, announced revised plans for the location of the company’s new semiconductor advanced packaging and test facility in Arizona.
MacDermid Alpha Awarded for Innovation: Driving Process Optimization and Efficiency with Major Indian EMS Provider
08/28/2025 | MacDermid Alpha Electronics SolutionsMacDermid Alpha Electronics Solutions, a leading global supplier of integrated materials for the electronics industry, is recognized by one of India’s top EMS providers, Syrma SGS, with an award for innovation that advanced process optimization, enhanced operational efficiency, and yield gains.
Coming Soon: The Advanced Electronics Packaging Digest
08/27/2025 | Marcy LaRont, I-Connect007The upcoming Advanced Electronics Packaging Digest is a curated, condensed monthly publication designed to keep you informed and engaged with the fast-moving world of advanced electronics packaging (AEP). In our inaugural September issue, we will begin at the foundation with an in-depth interview featuring Matt Kelly, CTO of the Global Electronics Association. Kelly and his Technology Solutions Team approach advanced packaging from a holistic systems perspective.
Gardien Services Installs Customized G93 Flying Probe Tester – Largest Test Area in North America/Europe
08/24/2025 | Gardien GroupGardien Group is proud to announce the successful installation of a customized G93 Flying Probe Test Machine at a major manufacturer in North America. This cutting-edge system features the largest test area of any flying probe tester in North America and Europe, setting a new benchmark for PCB testing capabilities.