FlexPod: Cisco UCS + NetApp ONTAP Converged Infrastructure
FlexPod is a validated converged infrastructure (CI) platform that pairs Cisco UCS compute and Nexus networking with NetApp ONTAP storage. This guide covers the architecture, the FlexPod family (Datacenter, Express, XCS, AI), the storage-side design decisions, a deployment runbook with real ONTAP 9.x commands, and day-2 operations.
Contents
What FlexPod actually is
FlexPod is a reference architecture, not a single SKU. NetApp and Cisco jointly publish validated designs (VVDs) that define exactly which UCS chassis/blades, Nexus switches, and NetApp controllers interoperate, with tested firmware combinations and configuration steps. You buy the components separately and assemble them — which is why FlexPod appeals to teams that want a pre-validated stack without being locked into a single-vendor appliance.
- Compute: Cisco UCS (B-series blades or C-series rack servers), managed through UCS Manager or Intersight.
- Network: Cisco Nexus 9000/9300 fabric, in classic NX-OS or ACI mode; UCS Fabric Interconnects connect the compute layer to the storage network.
- Storage: NetApp AFF or ASA A-Series all-flash arrays running ONTAP (or hybrid FAS where capacity matters more than latency).
- Software layer: optionally VMware vSphere (the most common hypervisor), plus the NetApp ecosystem: ONTAP Tools for VMware, SnapCenter, BlueXP, Active IQ.
The value proposition is validated integration: NetApp and Cisco test the full stack together, so the "who do I call when it breaks" question has a clear answer, and the firmware/ONTAP compatibility matrix is maintained by both vendors rather than by your team.
The FlexPod family
| Variant | Target | Key components |
|---|---|---|
| FlexPod Datacenter | General enterprise virtualization and databases | UCS B/C-series, Nexus 9000, AFF A-Series, vSphere optional |
| FlexPod Express | Smaller sites, remote/branch offices, ROBO | UCS C-series only, single or dual AFF/FAS, simplified cabling |
| FlexPod XCS | AI/ML training and inference, GPU workloads | UCS with NVIDIA GPUs, Nexus 9000, AFF A-Series with high-throughput NVMe/FC-NVMe |
| FlexPod AI (validated designs) | Enterprise GenAI, LLM fine-tuning, RAG | UCS + NVIDIA accelerated servers, AFF A/C-Series, NFS over RoCE-capable fabric |
All variants share the same DNA: a Cisco compute/network half and a NetApp storage half, joined by a documented cabling and zoning/export model. The AI variants add GPU servers and put more emphasis on storage throughput (FlexPod AI designs have been validated with NVIDIA GPUDirect-class workloads).
Architecture: compute, fabric, storage
A canonical two-rack-unit FlexPod Datacenter looks like this:
- UCS Fabric Interconnects (FIs) — a pair, always. Blades connect to both FIs; C-series servers connect via VIC adapters. The FIs also carry the storage VLANs, so end hosts reach storage without extra switches.
- Nexus 9000 pair — the campus/core or spine tier, carrying VM traffic and storage replication traffic (SnapMirror between FlexPods).
- NetApp AFF pair — two controllers in an HA pair, each with its own paths to the fabric. In a vSphere design, every ESXi host sees both controllers through dual fabrics, which is what makes the stack non-disruptive: any single component (switch, FI, controller, path) can fail without dropping storage.
- Management — UCS Manager or Intersight for compute, ONTAP System Manager/BlueXP for storage, and Active IQ for proactive monitoring. FlexPod designs mandate out-of-band management networks so a data-path outage never takes your management away.
The two key high-availability principles: no single point of failure (everything is paired) and non-disruptive operations (ONTAP takeover/giveback, UCS maintenance windows, and in-service software upgrades keep workloads online).
Storage design decisions
Protocol choice: NFS, FC, or iSCSI
- NFS (v3 or v4.1) — the most common FlexPod choice for vSphere: no zoning to manage, files are visible for backup/restore, and ONTAP features like FlexClone and SnapVault work natively. vSphere NFS 4.1 adds session-based multipathing.
- FC / FC-NVMe — preferred for heavy databases (SQL Server, Oracle RAC) where block semantics and low latency matter; requires zoning through the Nexus/FI FC ports. FC-NVMe gives NVMe command sets over existing FC infrastructure.
- iSCSI — a block option when FC hardware isn't available; software initiators on ESXi, jumbo frames and dedicated VLANs recommended.
Storage layout patterns
- One SVM per workload class — e.g. prod VMs, dev/test, databases. SVMs give you isolated namespaces, export/share policies, and DNS entries without separate arrays.
- Separate datastores by IO profile — boot/gold images on one FlexVol, user data on another, database LUNs on their own volume with a QoS policy group.
- QoS policy groups — FlexPod designs put noisy neighbors in check: a storage QoS policy on the database volume (e.g. 50k IOPS ceiling) stops a backup job from starving production.
- SnapMirror to a second FlexPod — the classic DR design: asynchronous SnapMirror over the Nexus pair, or SnapMirror Active Sync (SM-BC) for zero-RPO workloads if your ONTAP version supports it.
- FlexClone for dev/test — instant space-efficient copies of production volumes; the standard way FlexPod sites give developers real data without 3x the capacity.
Storage-side deployment runbook
Assuming the cluster is already joined and licensed, the storage half of a FlexPod build is: create the SVM, build the protocol endpoints, provision the first datastores/LUNs, and wire in protection.
# 1. Create the workload SVM (e.g. "flexpod-prod")
cluster1::> vserver create -vserver flexpod-prod -subtype default \
-rootvolume root_flexpod_prod -aggregate aggr1 -rootvolume-security-style unix
# 2. NFS: create data LIFs on the storage VLAN (one per node, per fabric)
cluster1::> network interface create -vserver flexpod-prod -lif nfs01a \
-role data -data-protocol nfs -home-node cluster1-01 -home-port e0d \
-address 10.10.20.11 -netmask 255.255.255.0
cluster1::> network interface create -vserver flexpod-prod -lif nfs01b \
-role data -data-protocol nfs -home-node cluster1-02 -home-port e0d \
-address 10.10.20.12 -netmask 255.255.255.0
# 3. Export policy: one rule per client subnet (ESXi management + vMotion + storage)
cluster1::> vserver export-policy rule create -vserver flexpod-prod \
-policy default -protocol nfs -clientmatch 10.10.20.0/24 -rorule any -rwrule any
# 4. FlexVol for VM datastores, with a sensible snapshot reserve
cluster1::> volume create -vserver flexpod-prod -volume prod_datastore1 \
-aggregate aggr1 -size 8t -space-guarantee none -snapshot-reserve 5
# 5. Block path (optional): iSCSI with per-node LIFs + igroup for ESXi hosts
cluster1::> vserver iscsi create -vserver flexpod-prod
cluster1::> igroup create -vserver flexpod-prod -igroup esxi_hosts -protocol iscsi \
-ostype vmware
cluster1::> igroup add -vserver flexpod-prod -igroup esxi_hosts -initiator iqn.1998-01.com.vmware:esxi01
# 6. Protection: daily SnapMirror to the DR FlexPod, snapshots on a schedule
cluster1::> snapshot policy create -vserver flexpod-prod -policy daily_keep7 \
-schedule daily -count 7
cluster1::> volume modify -vserver flexpod-prod -volume prod_datastore1 \
-snapshot-policy daily_keep7
On the compute side (Cisco), the equivalent steps are: UCS service profiles with the right firmware pack, VLANs for management/vMotion/storage, and (for FC) zones presented to the AFF WWPNs. The NetApp-side zoning targets come from network fcp adapter show / system node hardware unified-connect show.
Workload profiles
- Virtualized workloads (vSphere) — the default FlexPod shape: NFS datastores, ONTAP Tools for VMware for array-based snapshots and VAAI offload, Storage DRS across datastores.
- Databases (SQL Server, Oracle, SAP HANA) — block protocol (FC or iSCSI), QoS floors/ceilings, SnapCenter for application-consistent backups, SnapMirror for DR.
- VDI — boot storms are the classic FlexPod use case: all-flash AFF plus FlexClone gold images handles them (see the VDI guide).
- AI/ML — FlexPod XCS with GPU servers; storage tuning centers on high throughput, large NFS mount options, and checkpoint-friendly snapshots.
Day-2 operations & upgrade sequencing
- Upgrade order matters: the validated upgrade sequence is generally UCS firmware → Nexus NX-OS → ONTAP → vSphere/ESXi. Check the current FlexPod interoperability matrix (NetApp Interoperability Matrix Tool, IMT) before every firmware move — the VVDs pin exact minimum versions.
- ONTAP upgrades are non-disruptive (rolling node reboot via
cluster image update), but validate withcluster image validatefirst and runstorage failover showto confirm HA health. - Monitoring: Active IQ for predictive alerts (disk health, capacity, performance anomalies), EMS to syslog, and
statistics show-periodicfor on-box latency checks. Cisco side: Intersight and Nexus telemetry. - Capacity: watch
volume show -fields used,percentage-usedand aggregate watermarks; FlexPod designs usually include FabricPool cloud tiering as the capacity escape hatch.
Troubleshooting quick matrix
| Symptom | First checks | Likely fix |
|---|---|---|
| VM slow, storage latency high | statistics show-periodic on the volume; check QoS policy hits | Move workload off the noisy neighbor, raise QoS ceiling, verify LIF placement at home ports |
| NFS mount fails from ESXi | export policy rule for the client subnet; LIFs up (network interface show) | Add clientmatch rule; check VLAN trunking on the FI ports |
| FC path down after fabric change | network fcp adapter show, zone membership, storage show -path | Re-zone; re-scan HBAs; verify WWPNs didn't change after UCS service profile updates |
| Takeover/giveback events logged | storage failover show, EMS log | Usually planned (upgrades); if unplanned, check partner node health and interconnects |
| SnapMirror lag growing | snapmirror show -fields lag-time,last-transfer-end | Throttle other traffic (QoS), check WAN bandwidth, review transfer schedule |
FlexPod vs the alternatives
| Option | Model | Trade-off vs FlexPod |
|---|---|---|
| VxRail / vSAN | HCI — compute+storage in one node pool | Simpler to scale linearly, but storage is tied to servers; FlexPod scales compute and storage independently and has a stronger DR story (SnapMirror) |
| Pure FlashStack | Cisco + Pure converged | Same CI shape; ONTAP's snapshot/SnapMirror ecosystem and multi-protocol support are the differentiators |
| DIY (UCS + any storage) | Roll your own | Cheapest on paper; you own the validation, firmware testing, and support matrix — the exact cost FlexPod removes |
Note: exact supported hardware, ONTAP versions, and firmware combinations change with every release — always confirm against the NetApp Interoperability Matrix and the current FlexPod VVD before buying or upgrading.