Home / NCDA Study / Storage Networking

Storage Networking

How clients reach data on ONTAP: file protocols (NFS, SMB, S3), block protocols (FC, FCoE, iSCSI, NVMe/FC, NVMe/TCP), and the LIF/network layer underneath.

Storage networking: file, block and object clients reach ONTAP via LIFs

Protocol overview

ProtocolTypePort(s)Notes
NFSv3 / NFSv4.xFile (NAS)2049 (TCP/UDP), portmapper 111Unix/Linux, VMware (NFS), Kubernetes
SMB 2.1 / 3.0 / 3.1.1File (NAS)445 (TCP)Windows, macOS; AD/Kerberos
S3Object80 / 443Built-in object store on FlexVols (ONTAP 9.4+)
FCBlock (SAN)Zoning + LUN masking (igroups)
FCoEBlock (SAN)FC over Ethernet; less common now
iSCSIBlock (SAN)3260 (TCP)IP SAN; CHAP auth; MC/S for multipath
NVMe/FCBlock (SAN)NVMe over Fibre Channel (ONTAP 9.4+)
NVMe/TCPBlock (SAN)4420 (TCP)NVMe over Ethernet (ONTAP 9.10+)
Which to pick NAS (NFS/SMB) for file workloads and VMware; S3 for object/analytics workloads; FC/iSCSI for databases and Windows Server Failover Clustering; NVMe/FC or NVMe/TCP for very low-latency, high-I/O block workloads (SQL Server, Oracle, SAP HANA).

NAS: NFS

# NFS service + export policy
vserver nfs show -vserver vs1
vserver export-policy show
vserver export-policy rule show -vserver vs1 -policy default
# Add: allow 10.1.2.0/24 to mount /vol1 with sys auth
vserver export-policy rule create -vserver vs1 -policy default -v4client 10.1.2.0/24 -protocol nfs -rorule sys -rwrule sys
# Test what a client would see (very useful for troubleshooting)
vserver export-policy check-access -vserver vs1 -client-ip 10.1.2.50 -volume vol1 -authentication-method sys

NAS: SMB/CIFS

# SMB service + shares
vserver cifs show -vserver vs1
vserver cifs share show -vserver vs1
vserver cifs share create -vserver vs1 -share-name data -path /data -share-properties oplocks

Object: S3

# S3 object store server + bucket
vserver object-store-server create -vserver vs1 -object-store-server-name s3svm -root-user root -root-password MyP@ssw0rd
vserver object-store-server show
vserver object-store-server bucket create -vserver vs1 -bucket backups

SAN: FC, iSCSI, NVMe

# SAN objects
vserver fcp show -vserver vs1
vserver iscsi show -vserver vs1
iscsi initiator show
vserver iscsi connection show -vserver vs1
# LUN + igroup
lun create -vserver vs1 -volume lunvol -lun /vol/lunvol/lun0 -size 2t -ostype linux
igroup create -vserver vs1 -igroup host1 -protocol iscsi -initiator iqn.1994-05.com.example:host1
lun map -vserver vs1 -path /vol/lunvol/lun0 -igroup host1 -lun-id 0

LIFs and the network layer

# Network state
network interface show
network interface show -fields home-node,home-port,status-oper
network port show -fields link,duplex,speed
network route show -vserver vs1
# Create a data LIF
network interface create -vserver vs1 -lif data1 -role data -data-protocol nfs -home-node node1 -home-port e0c -address 10.0.0.5 -netmask 255.255.255.0
# Test connectivity to a LIF from the cluster
network ping-lif -vserver vs1 -lif data1

Exam traps to know

Next: Data protection →