In this technology demonstration, we will showcase the deployment of an AI workload using Cisco Intersight automation on a single UCS X-Series blade, leveraging a neighboring X440p (X-Fabric) with an NVIDIA A40 GPU. This demo will highlight the powerful capabilities of both Cisco Intersight and the Cisco AI Toolkit, which includes tools for AI model deployment, system monitoring, and resource management. By utilizing Miniconda for environment management, CUDA for GPU acceleration, and various large language models like Vicuna and Meta OPT, we will feed data into a retrieval-augmented generation (RAG) model.

A cloud managed, high performance, easy to deploy and operate, consolidated network - integrated with your Al stack.