Why we constructed the Safe AI Manufacturing facility
One yr in the past at NVIDIA GTC, Cisco and NVIDIA launched the Cisco Safe AI Manufacturing facility with NVIDIA. On the time, the problem for enterprises was clear: AI was shifting from science mission to strategic precedence, however the infrastructure and software program had been fragmented. Prospects had been fighting the complexity of standing up huge compute clusters for coaching, optimization, and inferencing, whereas making certain their information remained safe and personal.
To unravel this, the Safe AI Manufacturing facility was constructed upon the muse of Cisco AI PODs, our modular reference structure primarily based on Cisco Validated Designs and NVIDIA Enterprise Reference Structure–compliant deployments. By integrating Cisco networking, compute, and associate storage with NVIDIA’s accelerated infrastructure, the full-stack AI POD permits enterprises to seamlessly deploy AI purposes with enterprise-grade safety fused into the material. Embedded into every layer of the reference structure and wrapped round it’s the Cisco portfolio of safety and observability capabilities options. It supplies companies with a dependable, safe, hardened path to coaching, optimization, and inferencing throughout the core information heart.
The rise of multi-agents in every single place
Within the final twelve months, the panorama of enterprise AI has shifted. We have now moved past easy generative AI chatbots and have now transitioned into the period of autonomous brokers that drive business-critical features. The key driver right now is the necessity to run these multi-agent techniques in every single place: within the core, within the cloud, and more and more, on the edge.
Nonetheless, this shift has revealed a large hurdle: Safety is at the moment the one greatest barrier to the enterprise adoption of AI brokers.
In contrast to a typical chatbot, an agent is autonomous; it has the facility to invoke APIs, entry information lakes, and make choices, thus enabling groups to lower time to worth. These brokers depend on giant language fashions (LLMs) and small language fashions (SLMs) to supply reasoning context. If the mannequin offering that context is attacked or goes down, the impression is catastrophic:
- Compromised operational resolution making: If an agent managing warehouse logistics is hijacked via immediate injection, it might be manipulated to authorize incorrect transport priorities or “ghost” stock, resulting in important margin erosion and unfulfilled buyer orders.
- Vital workflow stagnation: In a high-velocity setting, if an edge mannequin goes down or its reasoning is corrupted, the automated course of stops. For a warehouse, this implies vans aren’t loaded and the availability chain grinds to a halt, immediately impacting the quarterly backside line.
- Regulatory and compliance publicity: Brokers working on the edge typically deal with delicate information. A safety breach that results in the exfiltration of personally identifiable data (PII) or proprietary predictive fashions can lead to huge regulatory fines and a everlasting lack of buyer belief.
Extending Safe AI Manufacturing facility throughout the core to the sting
To fulfill these challenges, Cisco is asserting that it’s increasing Cisco Safe AI Manufacturing facility from the info heart to the sting, making certain safety follows the agent throughout the whole multi-agent spectrum.
With Cisco AI Protection, we offer a constant safety posture no matter location. Whether or not an agent is working a trillion-parameter LLM within the information heart or a specialised SLM in a distant warehouse, Cisco ensures the mannequin is validated and the prompts are sanitized in actual time.
A brand new reference structure: Predicting stockouts for retail or manufacturing warehouses with Cisco Safe AI Manufacturing facility with NVIDIA and its ISV ecosystem
Whereas the Cisco AI POD supplies a high-performance engine within the information heart, a brand new problem for some organizations lies on the warehouse ground. At GTC, we’re showcasing how a warehousing workforce can leverage Cisco and associate structure to seek out worth via visibility: understanding the precise second a stockout happens or a security hazard arises earlier than it impacts the morning shift. For IT, the problem is bridging the IT/OT hole by deploying and securing AI throughout a whole lot of distant websites with out making a administration nightmare. Extending visibility and operations from the core information heart to the sting is about extra than simply {hardware}; it’s about getting the proper intelligence to the proper individual, securely and at scale.
At GTC, we’re demonstrating this growth via a real-world resolution extending the NVIDIA Multi-Agent Clever Warehouse blueprint. This demo showcases how specialised brokers can bridge the hole between IT and OT layers.
How the answer parts coordinate
The workflow begins on the edge, the place Vaidio acts because the “eyes” of the warehouse, monitoring video feeds for occasions like pallet stockouts. When a stockout or low inventory occasion is detected, Vaidio triggers a REST API name to an Aible agent working domestically on Cisco Unified Edge. This agent makes use of an SLM to supply rapid reasoning context—deciding if a stockout is essential sufficient to disrupt a pending cargo. If motion is required, the sting agent pings a core agent within the Cisco AI POD hosted within the information heart, which queries the enterprise information lake and LLM to calculate the income impression.
For the warehouse supervisor, this closes the IT/OT hole totally. As an alternative of manually cross-referencing spreadsheets or discovering empty cabinets too late, the supervisor has a 24/7 digital assistant that identifies issues, calculates the enterprise price, and triggers an expedited order mechanically, eliminating “ghost stock” and holding the availability chain shifting.
The answer structure
- Vaidio (the eyes): Operating on Cisco Unified Edge nodes (3-4 nodes per web site), Vaidio laptop imaginative and prescient containers make the most of NVIDIA L4 GPUs to observe the ground for stockouts or security hazards.
- Aible (the mind): An agentic platform orchestrating the workflow throughout the sting and core. When Vaidio detects a problem via a RESTful API, an Aible agent on the edge makes use of an area SLM (akin to Nemotron-3 Nano or Llama 3.3) to supply rapid reasoning context.
- Cisco AI POD (the core): For heavy-duty predictive modeling, edge brokers talk again to the core AI POD (powered by NVIDIA GPUs). This core long-running agent powered by Aible understands the way to stability the impression of stockouts towards the price of expedited transport, queries the warehouse information lake to take the proper choices primarily based on income impression and invoke transport APIs.
- The deployment bundle: This resolution runs Kubernetes 1.34 on Ubuntu 24.04 LTS with NVIDIA Driver 580.95.05 throughout each edge nodes and core AI POD infrastructure.
Cisco Intersight supplies centralized AI server fleet administration throughout core and edge, delivering infrastructure lifecycle management, coverage consistency, configuration governance, and operational visibility throughout distributed AI environments.
This ensures the underlying compute platform stays constant, safe, and scalable, whereas utility and container orchestration function inside a validated, enterprise-ready infrastructure basis.
Cisco AI Protection and complete safety for AI brokers and purposes
There’s a brand new actuality within the enterprise: multi-agent techniques. And Cisco is the one vendor that embeds safety into the material of the AI Manufacturing facility, defending all the pieces from the infrastructure to the brokers that dwell on it.
Cisco AI Protection supplies a dual-layer defend from the info heart to the sting:
- Mannequin integrity and scanning: AI Protection scans the LLMs and SLMs via their uncovered APIs/endpoints. This identifies potential vulnerabilities in mannequin recordsdata and identifies the “AI Invoice of Supplies” (AI-BOM) to make sure provide chain integrity.
- Runtime guardrails: As brokers talk, AI Protection applies real-time insurance policies to sanitize prompts and responses. It detects immediate injections, prevents the era of poisonous content material, and ensures that delicate information—together with PII, PHI, and PCI—by no means leaves the safe setting.
- Platform safety: Cisco Unified Edge provides a bodily and firmware layer of safety, together with firmware roots of belief, locking bezels with intrusion detection, and Intel TDX/SGX for confidential computing.
The Aible distributed agent resolution highlighted above advantages from all three layers of safety. It runs securely on Cisco Unified Edge and Cisco AI POD servers. The fashions utilized by it on the core and the sting are scanned by AI Protection. All language mannequin interactions of the brokers on the core and edge use the runtime guardrails by default.
The way forward for multi-agents in every single place
The transfer to multi-agent AI represents the subsequent industrial revolution of intelligence. By fixing the challenges of edge deployment and mannequin safety, Cisco helps prospects transfer previous the experimental section and into real-world manufacturing.
By bringing the NVIDIA Multi-Agent Clever Warehouse blueprint to life on Cisco structure, we’re lastly delivering the “chocolate” to either side of the enterprise. The Warehouse Supervisor positive aspects a 24/7 digital coordinator via Vaidio and Aible that automates essential workflows and eliminates “ghost stock.” Concurrently, the IT worker positive aspects a safe, “drift-free” platform managed with Cisco Intersight and guarded by AI Protection. This isn’t only a technical achievement; it’s a production-ready resolution that turns AI potential right into a aggressive benefit for the whole enterprise.
Keep tuned for our upcoming technical white paper, which can present a deep dive into the structure of the Safe Multi-Agent AI Manufacturing facility.
Able to speed up your time to worth? Contact your Cisco account consultant right now to learn to lengthen your safe AI technique from the core to the sting or click on right here to be taught extra in regards to the Cisco Safe AI Manufacturing facility with NVIDIA.
