Configuring the OmniSwitch OS6900 with an XNI-U12E Fiber-Channel module expansion module as an NPIV Gateway

OS6900 NPIV Gateway

Outlined Below are the list of Configuration steps to make the OS6900 act as an NPIV Gateway. The reference topology is attached.

! VLAN:
fcoe vlan 252 admin-state enable [ Create an FCOE vlan]
fcoe vlan 252 name “FCoE VLAN”

! FCOE:
fcoe fip-snooping admin-state enable [ Enable the Fiber-Channel/FCOE protocol on the Switch]

fibre-channel port 1/2/9 mode NP [Connect Fiber-Channel Port 1/2/9 to a Fiber-Channel Switch and configure the mode as NP]
fibre-channel vsan 252 admin-state enable name VSAN252 [ Create a Fiber-Channel VSAN ; Note that this a logical construct to bind the FCOE vlan to the Storage Area Network]
fibre-channel vsan 252 members port 1/2/9 [ Bind the VSAN to the Fiber-Channel NP port]
fcoe vsan-map vsan 252 vlan 252 [ Map Fiber-Channel VSAN with Fcoe VLAN]

! Virtual Flow Control:
qos qsp dcb 16 import qsp dcb “dcp-8” 802.3x-pause [ Create a Custom DataCenter bridging profile which enables PAUSE]

qos qsi port 1/2/9 dcb dcbx pfc tlv disable
qos qsi port 1/2/9 dcb dcbx pfc willing no
qos qsi port 1/2/9 qsp dcb “dcp-16”  [ Associate the Profile to the Port. This enables the Port to participate in Fiber-Channel Flow Control by transmitting/receiving R_RDY ]
qos qsi port 1/2/9 dcb dcbx admin-state disable [ Disable DataCenter bridging negotiations on the Fiber-Channel ports as it is only applicable on Ethernet ports]
qos qsi port 1/2/9 dcb dcbx ets willing no
qos qsi port 1/2/9 stats admin-state enable

Here are some Useful validation Commands to check if the OS6900 is indeed acting as an NPIV Gateway :

DC-EDGE-103-> show fcoe fcf
FCF-MAC         VLAN    Config     Sessions  A-bit   MaxFrmVer  Priority
——————–+——-+———–+———+——–+———+———-
E8:E7:32:36:1E:F6    252      Npiv        4         1         no        0        >>>> Note that the Switch has started to act as a FC Forwarder and sends Advertisements on the FCOE VLAN.

DC-EDGE-103-> show module status
Operational
Chassis/Slot     Status      Admin-Status       MAC
————–+————-+————+——————
1/CMM-A        UP             POWER ON      e8:e7:32:36:1e:f5
1/SLOT-1       UP             POWER ON      e8:e7:32:36:1e:fc
1/SLOT-2       UP             POWER ON      e8:e7:32:94:68:14

DC-EDGE-103-> show fibre-channel port info
Legend: NP=Proxy N_Port, F=Fabric Port connected to N_port, TE=Tunnel E-Port

ports  mode  fcid        wwpn                   state
——-+—-+——–+————————-+————-

1/2/9   NP   61:00:00  10:00:E8:E7:32:94:68:1C  Up             >>>> The NP Port is UP and it has received an FCID from the Fiber-Channel Switch.

DC-EDGE-103-> show interfaces 1/2/9
Chassis/Slot/Port  1/2/9  :
Operational Status     : up,
Last Time Link Changed : Thu Apr 28 17:35:20 2016,
Number of Status Change: 1,
Type                   : Fiber Channel,
SFP/XFP                : SFP_FC_2_4_8G,
EPP                    : Disabled,
Link-Quality           : N/A,
WWPN                   : 10:00:e8:e7:32:94:68:1c,
BandWidth (Megabits)   :     4000,             Duplex           : Full,  >>>> Port Speed at 4G ; Note that the Port can also negotiate to 8G with capable FC switches ( for ex: Qlogic 5810)
Autonegotiation        :   1  [ 8000-F 4000-F 2000-F         ],
Long Frame Size(Bytes) : 2148,
Rx              :
Bytes Received  :            530897348, Unicast Frames :               401568,
Broadcast Frames:                    0,
UnderSize Frames:                    0, OverSize Frames:                    0,
Lost Frames     :                    0, Error Frames   :                    0,
CRC Error Frames:                    0, Link Failures  :                    1,
B2B Credit zero :                    0
Tx              :
Bytes Xmitted   :              6107412, Unicast Frames :                92898,
Broadcast Frames:                    0,
Lost Frames     :                    0, Error Frames   :                    0,
B2B Credit zero :                  141

Here is the Output on the FC Switch

FC_SW_DC1:admin> switchshow
switchName:     FC_SW_DC1
switchType:     32.0
switchState:    Online
switchMode:     McDATA Fabric
switchRole:     Subordinate
DomainIDOffset: 0x60
switchDomain:   1
switchId:       fffc21
switchWwn:      10:00:00:05:1e:35:fd:42
zoning:         ON (CFG4)
switchBeacon:   OFF
FC Router:      OFF
FC Router BB Fabric ID: 1

Index Port Address Media Speed State     Proto
==============================================
0   0   610000   id    N4   Online      FC  F-Port  1 N Port + 5 NPIV public

FC_SW_DC1:admin> portshow 0 ( As you can see some of the initiators have already logged in, and I will show how this is done in subsequent posts)
portName:
portHealth: HEALTHY

Authentication: None
portDisableReason: None
portCFlags: 0x1
portFlags: 0x25b03       PRESENT ACTIVE F_PORT G_PORT U_PORT NPIV LOGICAL_ONLINE RRDY_MODE LOGIN NOELP LED ACCEPT FLOGI
portType:  10.0
POD Port: Port is licensed
portState: 1    Online
Protocol: FC
portPhys:  6    In_Sync         portScn:   32   F_Port
port generation number:    114
state transition count:    17

portId:    610000
portIfId:    43020001
portWwn:   20:00:00:05:1e:35:fd:42
portWwn of device(s) connected:
20:00:00:1b:21:d8:45:13
21:00:00:24:ff:37:dd:b8
21:00:00:0e:1e:11:5b:61
21:00:00:0e:1e:11:0e:61
10:00:e8:e7:32:94:68:1c
Distance:  normal
portSpeed: N4Gbps

LE domain: 0
FC Fastwrite: OFF
Interrupts:        166        Link_failure: 2          Frjt:         0
Unknown:           150323     Loss_of_sync: 49         Fbsy:         0
Lli:               166        Loss_of_sig:  52
Proc_rqrd:         26638996   Protocol_err: 0
Timed_out:         48         Invalid_word: 0
Rx_flushed:        0          Invalid_crc:  0
Tx_unavail:        0          Delim_err:    0
Free_buffer:       0          Address_err:  0
Overrun:           0          Lr_in:        6
Suspended:         0          Lr_out:       6
Parity_err:        0          Ols_in:       3
2_parity_err:      0          Ols_out:      6
CMI_bus_err:       0

Port part of other ADs: No

 

Leave a comment