-
- News
- Books
Featured Books
- design007 Magazine
Latest Issues
Current IssueSilicon to Systems: From Soup to Nuts
This month, we asked our expert contributors to weigh in on silicon to systems—what it means to PCB designers and design engineers, EDA companies, and the rest of the PCB supply chain... from soup to nuts.
Cost Drivers
In this month’s issue of Design007 Magazine, our expert contributors explain the impact of cost drivers on PCB designs and the need to consider a design budget. They discuss the myriad design cycle cost adders—hidden and not so hidden—and ways to add value.
Mechatronics
Our expert contributors discuss the advent of mechatronics in PCB design, the challenges and opportunities this creates for circuit board designers, and the benefits—to the employee and the company—of becoming a mechatronics engineer.
- Articles
- Columns
Search Console
- Links
- Events
||| MENU - design007 Magazine
From Athletes to GenAI Developers: Intel Tackles Real-World Challenges with AI Systems
July 19, 2024 | BUSINESS WIREEstimated reading time: 3 minutes
Intel shares exciting details on its collaboration with the International Olympic Committee (IOC) and on an industry-driven generative AI (GenAI) retrieval-augmented generation (RAG) solution. These announcements demonstrate how open AI systems and platforms using Intel® Gaudi® AI accelerators and Intel® Xeon® processors put the power in the hands of developers and enterprises to tackle challenges created by the AI boom.
How Athlete365 Works: Qualifying for the Olympic Games is only the beginning for athletes. To help about 11,000 athletes with varying languages and cultures navigate the venue and comply with rules and guidelines, the IOC collaborated with Intel to develop a chatbot, Athlete365. A RAG solution powered by Intel Gaudi accelerators and Xeon processors, Athlete365 is capable of handling athlete inquiries and interactions and will deliver on-demand information during athletes’ stay at the Olympic Village in Paris, enabling them to focus on training and competing.
Why It Matters: Deploying GenAI solutions poses challenges like cost, scale, accuracy, development requirements, privacy and security. RAG is a crucial GenAI workload because it allows companies to leverage proprietary data securely, enhancing the timeliness and reliability of AI outputs. This improves the quality and usefulness of AI applications, which is critical in today's data-driven world.
Intel’s collaborative approach utilizing AI platforms, open standards, and a robust software and systems ecosystem allows developers to build customized GenAI RAG solutions tailored to each enterprise’s needs. The momentum shared today underscores Intel's commitment to providing open, robust and composable multi-provider generative AI solutions.
How the GenAI RAG Solution Architecture Works: Intel works with industry partners to create an open source, interoperable solution for easy RAG deployment. The GenAI solution is an industry-driven, out-of-the-box, production-ready RAG solution built on the Open Platform for Enterprise AI (OPEA) foundation. While the GenAI turnkey solution offers a streamlined approach to deploying RAG solutions for enterprises in their data centers, it is designed to be highly flexible and customizable, integrating components from a catalog of offerings by multiple OEM systems and industry partners.
The GenAI turnkey solution integrates OPEA-based microservice components into a scalable RAG solution designed to deploy Xeon and Gaudi AI systems. It scales seamlessly with proven orchestration frameworks like Kubernetes and Red Hat OpenShift and provides standardized APIs with security and system telemetry.
- Breaking Down Proprietary Walls with an Open Software Stack: Nearly all large language model (LLM) development is based on the high abstraction framework PyTorch, which is supported by Intel Gaudi and Xeon technologies, making it easy to develop on Intel AI systems or platforms. Intel has worked with OPEA to develop an open software stack for RAG and LLM deployment optimized for the GenAI turnkey solution and built with PyTorch, Hugging Face serving libraries (TGI and TEI), LangChain and Redis Vector database.
- Meeting Developers Where They are: OPEA offers open source, standardized, modular and heterogeneous RAG pipelines for enterprises, focusing on open model development and support for various compilers and toolchains. This foundation accelerates containerized AI integration and delivery for unique vertical use cases. OPEA unlocks new AI possibilities by creating a detailed, composable framework that stands at the forefront of technology stacks.
With GenAI turnkey and the comprehensive enterprise AI stack, Intel delivers a complete solution addressing the challenges of deploying and scaling RAG and LLM applications within enterprises and data centers. Leveraging Intel-powered AI systems or platforms and optimized software in OPEA, businesses can harness the full potential of GenAI with greater efficiency and speed.
What’s Next: Increasing access to the latest AI compute technology is a challenge enterprises face in enabling critical business outcomes with GenAI. Through strategic collaborations with industry partners and customers, Intel is creating new opportunities for AI services driven by GenAI and RAG solutions.
Committed to the secure and responsible advancement of AI, Intel announced today its collaboration with Google, IBM and other industry partners in a new Coalition for Secure AI (CoSAI), created to enhance trust and security in AI development and deployment.
Intel will further demonstrate its unique approach to AI systems and continued customer and partner momentum at Intel Innovation on Sept. 24-25.
Suggested Items
Intel, IBM Deliver Enterprise AI in the Cloud
09/03/2024 | IntelIBM and Intel announced a global collaboration to deploy Intel® Gaudi® 3 AI accelerators as a service on IBM Cloud. This offering, which is expected to be available in early 2025, aims to help more cost-effectively scale enterprise AI and drive innovation underpinned with security and resiliency.
Dr. Jennie Hwang to Deliver Course on AI Opportunities, Challenges, Possibilities at SMTAI
08/28/2024 | Dr. Jennie HwangDr. Jennie Hwang, Chair of AI Committee of National Academies/DoD AI study, Chair of Review Panel of National AI Institute of NSF, and Committee of Strategic Thinking for Engineering Research in the Era of Artificial Intelligence of NSF, brings broad-based information and insights through an integrated perspective to the AI course.
Maxar’s Third and Fourth WorldView Legion Satellites Performing Well After Launch
08/16/2024 | BUSINESS WIREMaxar Intelligence, a provider of secure, precise geospatial intelligence, confirmed that its third and fourth WorldView Legion satellites are performing well after being launched on a SpaceX Falcon 9 rocket earlier today from Cape Canaveral Space Force Station, Florida.
I-Connect007 Editor’s Choice: Five Must-Reads for the Week
08/16/2024 | Nolan Johnson, I-Connect007People are on the move, new books are being released, and a new PCB manufacturer is making waves. This week, I'm highlighting the latest ASC/Sunstone book on DFM essentials, our 40th book in the I-Connect007 library and a must-read whether you're a new or seasoned member of industry. I'm also including leadership news from NextFlex, a discussion on integrated passives from Joe Fjelstad, and a new processor chip from Intel meant specifically for automotive applications.
Karma Automotive Goes All-In with Intel for a Software-Defined Future
08/15/2024 | IntelIn a bold move signaling a major shift in automotive development, Karma Automotive, California’s first and only ultra-luxury automaker, announces a sweeping collaboration with Intel, integrating Intel Automotive solutions across its entire vehicle platform.