The Knowledge Base: The Impact of Harsh Environments on Residue Tolerance
Standard of Excellence: Hiring for Quality Positions in Manufacturing, Engineering, and Management
Global Citizenship: What I’ve Learned About the American PCB Business
Intel AI Platforms Accelerate Microsoft Phi-3 GenAI Models
May 27, 2024 | Intel CorporationEstimated reading time: 1 minute
Intel has validated and optimized its AI product portfolio across client, edge and data center for several of Microsoft’s Phi-3 family of open models. The Phi-3 family of small, open models can run on lower-compute hardware, be more easily fine-tuned to meet specific requirements and enable developers to build applications that run locally. Intel’s supported products include Intel® Gaudi® AI accelerators and Intel® Xeon® processors for data center applications and Intel® Core™ Ultra processors and Intel® Arc™ graphics for client.
“We provide customers and developers with powerful AI solutions that utilize the industry’s latest AI models and software. Our active collaboration with fellow leaders in the AI software ecosystem, like Microsoft, is key to bringing AI everywhere. We’re proud to work closely with Microsoft to ensure Intel hardware – spanning data center, edge and client – actively supports several new Phi-3 models,” said Pallavi Mahajan, Intel corporate vice president and general manager, Data Center and AI Software.
As part of its mission to bring AI everywhere, Intel continuously invests in the AI software ecosystem by collaborating with AI leaders and innovators.
Intel worked with Microsoft to enable Phi-3 model support for its central processing units (CPUs), graphics processing units (GPUs) and Intel Gaudi accelerators on launch day. Intel also co-designed the accelerator abstraction in DeepSpeed, which is an easy-to-use deep learning optimization software suite, and extended the automatic tensor parallelism support for Phi-3 and other models on Hugging Face.
The size of Phi-3 models is well-suited to be used for on-device inference and makes lightweight model development like fine-tuning or customization on AI PCs and edge devices possible. Intel client hardware is accelerated through comprehensive software frameworks and tools, including PyTorch and Intel® Extension for PyTorch used for local research and development and OpenVINO™ Toolkit for model deployment and inference.
Intel is committed to meet the generative AI needs of its enterprise customers and will continue to support and optimize software for Phi-3 and other leading state-of-the-art language models.
Share on:
Suggested Items
Biden-Harris Administration: CHIPS Incentives Award with Intel to Advance U.S. Leading-Edge Chip Capacity
11/27/2024 | U.S. Department of CommerceThe Biden-Harris Administration announced that the U.S. Department of Commerce awarded Intel Corporation up to $7.865 billion in direct funding under the CHIPS Incentives Program’s Funding Opportunity for Commercial Fabrication Facilities. The award follows the previously signed preliminary memorandum of terms, announced on March 20, 2024, and the completion of the Department’s due diligence.
New Ultrafast Memory Boosts Intel Data Center Chips
11/19/2024 | IntelWhile Intel’s primary product focus is on the processors, or brains, that make computers work, system memory (that’s DRAM) is a critical component for performance. This is especially true in servers, where the multiplication of processing cores has outpaced the rise in memory bandwidth (in other words, the memory bandwidth available per core has fallen).
Infineon, Stellantis to Advance Innovation in Power Conversion and Distribution for Vehicle Architectures
11/08/2024 | InfineonStellantis N.V. and Infineon Technologies AG announced they will work jointly on the power architecture for Stellantis’ electric vehicles to support Stellantis’ ambition of offering clean, safe and affordable mobility to all.
CACI Completes Acquisition of Azure Summit Technology
10/31/2024 | BUSINESS WIRECACI International Inc. announced that it has completed its acquisition of Azure Summit Technology, a provider of innovative, high-performance radio frequency (RF) technology and engineering, focused on electromagnetic spectrum, in an all-cash transaction for $1.275 billion.
onsemi East Fishkill Fab Accredited as Trusted Foundry by Department of Defense
10/29/2024 | BUSINESS WIREonsemi announced its wafer fab in East Fishkill (EFK), New York, has been accredited by the Defense Microelectronics Activity (DMEA) of the U.S. Department of Defense (DoD) as a Category 1A Trusted Supplier.