From Athletes to GenAI Developers: Intel Tackles Real-World Challenges with AI Systems
July 19, 2024 | BUSINESS WIREEstimated reading time: 3 minutes
Intel shares exciting details on its collaboration with the International Olympic Committee (IOC) and on an industry-driven generative AI (GenAI) retrieval-augmented generation (RAG) solution. These announcements demonstrate how open AI systems and platforms using Intel® Gaudi® AI accelerators and Intel® Xeon® processors put the power in the hands of developers and enterprises to tackle challenges created by the AI boom.
How Athlete365 Works: Qualifying for the Olympic Games is only the beginning for athletes. To help about 11,000 athletes with varying languages and cultures navigate the venue and comply with rules and guidelines, the IOC collaborated with Intel to develop a chatbot, Athlete365. A RAG solution powered by Intel Gaudi accelerators and Xeon processors, Athlete365 is capable of handling athlete inquiries and interactions and will deliver on-demand information during athletes’ stay at the Olympic Village in Paris, enabling them to focus on training and competing.
Why It Matters: Deploying GenAI solutions poses challenges like cost, scale, accuracy, development requirements, privacy and security. RAG is a crucial GenAI workload because it allows companies to leverage proprietary data securely, enhancing the timeliness and reliability of AI outputs. This improves the quality and usefulness of AI applications, which is critical in today's data-driven world.
Intel’s collaborative approach utilizing AI platforms, open standards, and a robust software and systems ecosystem allows developers to build customized GenAI RAG solutions tailored to each enterprise’s needs. The momentum shared today underscores Intel's commitment to providing open, robust and composable multi-provider generative AI solutions.
How the GenAI RAG Solution Architecture Works: Intel works with industry partners to create an open source, interoperable solution for easy RAG deployment. The GenAI solution is an industry-driven, out-of-the-box, production-ready RAG solution built on the Open Platform for Enterprise AI (OPEA) foundation. While the GenAI turnkey solution offers a streamlined approach to deploying RAG solutions for enterprises in their data centers, it is designed to be highly flexible and customizable, integrating components from a catalog of offerings by multiple OEM systems and industry partners.
The GenAI turnkey solution integrates OPEA-based microservice components into a scalable RAG solution designed to deploy Xeon and Gaudi AI systems. It scales seamlessly with proven orchestration frameworks like Kubernetes and Red Hat OpenShift and provides standardized APIs with security and system telemetry.
- Breaking Down Proprietary Walls with an Open Software Stack: Nearly all large language model (LLM) development is based on the high abstraction framework PyTorch, which is supported by Intel Gaudi and Xeon technologies, making it easy to develop on Intel AI systems or platforms. Intel has worked with OPEA to develop an open software stack for RAG and LLM deployment optimized for the GenAI turnkey solution and built with PyTorch, Hugging Face serving libraries (TGI and TEI), LangChain and Redis Vector database.
- Meeting Developers Where They are: OPEA offers open source, standardized, modular and heterogeneous RAG pipelines for enterprises, focusing on open model development and support for various compilers and toolchains. This foundation accelerates containerized AI integration and delivery for unique vertical use cases. OPEA unlocks new AI possibilities by creating a detailed, composable framework that stands at the forefront of technology stacks.
With GenAI turnkey and the comprehensive enterprise AI stack, Intel delivers a complete solution addressing the challenges of deploying and scaling RAG and LLM applications within enterprises and data centers. Leveraging Intel-powered AI systems or platforms and optimized software in OPEA, businesses can harness the full potential of GenAI with greater efficiency and speed.
What’s Next: Increasing access to the latest AI compute technology is a challenge enterprises face in enabling critical business outcomes with GenAI. Through strategic collaborations with industry partners and customers, Intel is creating new opportunities for AI services driven by GenAI and RAG solutions.
Committed to the secure and responsible advancement of AI, Intel announced today its collaboration with Google, IBM and other industry partners in a new Coalition for Secure AI (CoSAI), created to enhance trust and security in AI development and deployment.
Intel will further demonstrate its unique approach to AI systems and continued customer and partner momentum at Intel Innovation on Sept. 24-25.
Suggested Items
CACI Awarded $290 Million Contract to Provide AI and Geospatial Expertise to NGA
12/06/2024 | CACI International Inc.CACI International Inc announced that it is an awardee of a five-year contract valued at up to $290 million to provide artificial intelligence (AI) and geospatial expertise to the National Geospatial-Intelligence Agency (NGA) under the Luno-A multi-award indefinite delivery, indefinite quantity vehicle.
Intel Announces Retirement of CEO Pat Gelsinger
12/02/2024 | BUSINESS WIREIntel Corporation announced that CEO Pat Gelsinger retired from the company after a distinguished 40-plus-year career and has stepped down from the board of directors, effective Dec. 1, 2024.
SIA Applauds Finalization of CHIPS Investments for Intel Manufacturing Projects
11/29/2024 | SIAThe Semiconductor Industry Association (SIA) today released the following statement from SIA President and CEO John Neuffer praising finalization of semiconductor manufacturing investments announced by the U.S. Department of Commerce and Intel Corporation.
Biden-Harris Administration: CHIPS Incentives Award with Intel to Advance U.S. Leading-Edge Chip Capacity
11/27/2024 | U.S. Department of CommerceThe Biden-Harris Administration announced that the U.S. Department of Commerce awarded Intel Corporation up to $7.865 billion in direct funding under the CHIPS Incentives Program’s Funding Opportunity for Commercial Fabrication Facilities. The award follows the previously signed preliminary memorandum of terms, announced on March 20, 2024, and the completion of the Department’s due diligence.
New Ultrafast Memory Boosts Intel Data Center Chips
11/19/2024 | IntelWhile Intel’s primary product focus is on the processors, or brains, that make computers work, system memory (that’s DRAM) is a critical component for performance. This is especially true in servers, where the multiplication of processing cores has outpaced the rise in memory bandwidth (in other words, the memory bandwidth available per core has fallen).