Samsung Develops Industry’s First High Bandwidth Memory with AI Processing Power
February 17, 2021 | Business WireEstimated reading time: 1 minute
Samsung Electronics Co., Ltd., the world leader in advanced memory technology, today announced that it has developed the industry's first High Bandwidth Memory (HBM) integrated with artificial intelligence (AI) processing power — the HBM-PIM. The new processing-in-memory (PIM) architecture brings powerful AI computing capabilities inside high-performance memory, to accelerate large-scale processing in data centers, high performance computing (HPC) systems and AI-enabled mobile applications.
Kwangil Park, senior vice president of Memory Product Planning at Samsung Electronics stated, "Our groundbreaking HBM-PIM is the industry's first programmable PIM solution tailored for diverse AI-driven workloads such as HPC, training and inference. We plan to build upon this breakthrough by further collaborating with AI solution providers for even more advanced PIM-powered applications."
Rick Stevens, Argonne’s Associate Laboratory Director for Computing, Environment and Life Sciences commented, “I’m delighted to see that Samsung is addressing the memory bandwidth/power challenges for HPC and AI computing. HBM-PIM design has demonstrated impressive performance and power gains on important classes of AI applications, so we look forward to working together to evaluate its performance on additional problems of interest to Argonne National Laboratory.”
Most of today's computing systems are based on the von Neumann architecture, which uses separate processor and memory units to carry out millions of intricate data processing tasks. This sequential processing approach requires data to constantly move back and forth, resulting in a system-slowing bottleneck especially when handling ever-increasing volumes of data.
Instead, the HBM-PIM brings processing power directly to where the data is stored by placing a DRAM-optimized AI engine inside each memory bank — a storage sub-unit — enabling parallel processing and minimizing data movement. When applied to Samsung's existing HBM2 Aquabolt solution, the new architecture is able to deliver over twice the system performance while reducing energy consumption by more than 70%. The HBM-PIM also does not require any hardware or software changes, allowing faster integration into existing systems.
Samsung’s paper on the HBM-PIM has been selected for presentation at the renowned International Solid-State Circuits Virtual Conference (ISSCC) held through Feb. 22. Samsung’s HBM-PIM is now being tested inside AI accelerators by leading AI solution partners, with all validations expected to be completed within the first half of this year.
Testimonial
"In a year when every marketing dollar mattered, I chose to keep I-Connect007 in our 2025 plan. Their commitment to high-quality, insightful content aligns with Koh Young’s values and helps readers navigate a changing industry. "
Brent Fischthal - Koh YoungSuggested Items
Macronix Introduces Cutting-Edge Secure-Boot NOR Flash Memory
08/08/2025 | PRNewswireMacronix International Co., Ltd., a leading integrated device manufacturer in the non-volatile memory (NVM) market, announced ArmorBoot MX76, a robust NOR flash memory combining in a single device, the essential performance and an array of security features that deliver rapid boot times and iron-clad data protection.
Inside the AI Hardware Boom: Servers, Substrates and Advanced Packaging
08/07/2025 | Edy Yu, Printed Circuit Information, China, and Marcy LaRont, I-Connect007AI is rewriting the hardware playbook, marrying complex software and algorithms to run and improve machine and equipment operations. Sorting through, managing, and utilizing massive amounts of data takes tremendous data storage and processing power. Enter the new generation of supercomputers and data servers. The data servers being built today are not your momma’s server, as they say.
AI Is the Golden Track Reviving Electronics and PCBs
08/06/2025 | Edy Yu, Chief Editor, ECIO, and the I-Connect007 Editorial TeamRemember 2021? Despite COVID, the electronics industry hit a high. Then came the slide. By 2023, the industry was deep in the red. With inflation, policy shifts, and exchange rate shocks, the problems were long, and the outlook was bleak. Recovery finally appeared in 2024, but it was fragile. Automotive electronics slumped, wireless demand stayed soft, and the ride up was anything but smooth. Yet, amid the uncertainty, one bright track emerged: artificial intelligence (AI).
Brent Laufenberg Appointed CIO of the Global Electronics Association, Advancing Technology and Member Services
07/31/2025 | Global Electronics AssociationThe Global Electronics Association (formerly IPC International Inc.) announces the appointment of Brent Laufenberg as its new Chief Information Officer (CIO).
SES AI Accelerates Timeline for Revenue Growth and Profitability with Acquisition of UZ Energy
07/31/2025 | BUSINESS WIRESES AI Corporation, a global leader in the development and manufacturing of AI-enhanced high-performance Li-Metal and Li-ion batteries, today announced it has executed a definitive agreement to acquire 100% of UZ Energy, an energy storage systems (“ESS”) provider, for a purchase price of approximately $25.5 million, subject to earnout adjustment based on the achievement of specified financial targets.