Advanced Configuration Lab · On-demand
F5 AI Gateway
Details
Goals & objectives
Hardware & software
Solution overview
The F5 AI Gateway solution matures your AI infrastructure in multiple ways. Below are a few benefits of running the F5 AI Gateway, from security to resiliency to performance. This is how the F5 AI Gateway can assist:
- Inspecting and filtering client requests and responses across multiple models
- Preventing malicious inputs from reaching an LLM back-end
- Ensuring that responses are safe to send to clients, providing guardrails no matter the LLM
- Ability to begin collecting data to retrain or fine-tune models to be more relevant to the consumers
- Identifies a user through profiles or information, providing a level of trust that data will not be uploaded or exposed to the wrong audience
- Can route traffic to different LLMs, including the benefit of upgrading or replacing LLMs without downtime.
- Ability to leverage GPUs or pure software for performance gains - this particular lab runs on NVIDIA GPUs
This launchable lab will provide access to an OpenShift cluster running the F5 AI Gateway solution. We have two different paths for you to interact with in this lab. Path one allows you to interact with a custom AI Proving Ground chatbot protected by the F5 AI Gateway solution. In contrast, the other path will enable you to see more of the backend and directly make API/curl calls to the models in use.