Intel Contributes AI Acceleration to PyTorch 2.0
March 17, 2023 | IntelEstimated reading time: 1 minute
?In the release of Python 2.0, contributions from Intel using Intel® Extension for PyTorch , oneAPI Deep Neural Network Library (oneDNN) and additional support for Intel® CPUs enable developers to optimize inference and training performance for artificial intelligence (AI).
As part of the PyTorch 2.0 compilation stack, the TorchInductor CPU backend optimization by Intel Extension for PyTorch and PyTorch ATen CPU achieved up to 1.7 times faster FP32 inference performance when benchmarked with TorchBench, HuggingFace and timm.1 This update brings notable performance improvements to graph compilation over the PyTorch eager mode.
Other optimizations include:
- Improved message-passing between adjacent neural network nodes to support graph neural network in PyTorch Geometric (PyG) for enhanced inference and performance training on Intel CPUs.
- New x86 quantization backend – a combination of FBGEMM (Facebook General Matrix-Matrix Multiplication) and oneDNN backends – replaces FBGEMM as the default quantization backend for x86 CPU platforms to enable better end-to-end int8 inference performance.
- Extended use of oneDNN with oneDNN Graph API to maximize efficient code generation on AI hardware by automatically identifying the graph partitions to be accelerated through fusion. BFloat16 and Float32 data types are supported and only inference workloads can be optimized; BF16 is only optimized on machines with AVX512_BF16 ISA support.
Suggested Items
Aismalibar to Showcase Thermal Management Solutions for EV Battery Systems at The Battery Show North America 2024
09/27/2024 | AismalibarAismalibar, a leader in innovative thermal management materials, will be presenting its newest solutions for electric vehicle (EV) battery systems at The Battery Show North America from October 7-11, 2024. Located at Huntington Place, Detroit, MI, Aismalibar will exhibit at booth 6231, unveiling a range of cutting-edge Thermal Interface Materials (TIMs) designed to improve the safety, performance, and longevity of EV batteries.
Intel Unveils Next-Generation AI Solutions with the Launch of Xeon 6 and Gaudi 3
09/25/2024 | IntelAs AI continues to revolutionize industries, enterprises are increasingly in need of infrastructure that is both cost-effective and available for rapid development and deployment.
Data-driven Industrial Digital Solutions Drive Quality and Reduce Costs
09/24/2024 | Mikalai Kuchuk, MKS’ AtotechData-driven digital solutions for decision support, process optimization, and operational efficiency have emerged as essential elements for the PCB manufacturing industry, leveraging technologies such as IIoT (Industrial Internet of Things), machine learning (ML), and artificial intelligence (AI) to provide real-time insights into equipment health and performance in the first place. In the following article, we will explore the importance and impact of data-driven solutions on industrial operations.
Renesas Leads ADAS Innovation with Power-Efficient 4th-Generation R-Car Automotive SoCs
09/24/2024 | RenesasRenesas Electronics Corporation (TSE:6723), a premier supplier of advanced semiconductor solutions, expanded its popular R-Car Family of system-on-chips (SoCs) for entry-level Advanced Driver Assistance Systems (ADAS).
Semtech Accelerates 5G-Advanced Infrastructure Buildouts
09/23/2024 | BUSINESS WIRESemtech Corporation, a high-performance semiconductor, IoT systems, and cloud connectivity service provider, today announced sampling of GN2255S, its next generation Tri-Edge 50 Gbps clock and data recovery (CDR) with integrated DML driver for SFP56 50G PAM4 bidirectional (BiDi) and CWDM6 optical modules.
Copyright © 2024 I-Connect007 | IPC Publishing Group Inc. All rights reserved.
Log in