In this technology demonstration, we will showcase the deployment of an AI workload using Cisco Intersight automation on a single UCS X-Series blade, leveraging a neighboring X440p (X-Fabric) with an NVIDIA A40 GPU. This demo will highlight the powerful capabilities of both Cisco Intersight and the Cisco AI Toolkit, which includes tools for AI model deployment, system monitoring, and resource management. By utilizing Miniconda for environment management, CUDA for GPU acceleration, and various large language models like Vicuna and Meta OPT, we will feed data into a retrieval-augmented generation (RAG) model.

A cloud managed, high performance, easy to deploy and operate, consolidated network - integrated with your Al stack.

Designed to be managed exclusively from the cloud.

As AI hype continues, the task of implementing and scaling AI initiatives is becoming increasingly complex and daunting. In this executive-led conversation between WWT's Neil Anderson and Cisco Senior Vice President of Compute, Jeremy Foster, learn about how Cisco's AI-ready infrastructure can help you accelerate the introduction of AI into all aspects of your organization. Jeremy and Neil talk about the growing partnership between Cisco, NVIDIA and WWT; new innovations coming out of Cisco like Cisco Nexus HyperFabric; and how you can make sense of the fast-moving AI landscape to make informed decisions that will drive outcomes for your business.