Introduction

PICOS-powered Ethernet switches use Multi-Chassis Link Aggregation (MLAG) technology to connect devices, enabling each one to connect to a pair of Pica8 switches with all links running active/active to improve resiliency. There’s no need to block certain links, as with the spanning tree protocol (STP), resulting in improved bandwidth utilization and performance. With STP, while redundant links may exist between switches, traffic can only flow over one of them at a time, which effectively cuts the amount of available bandwidth in half. MLAG still supports redundancy, however, because peer switches synchronize forwarding state between them, so if a leaf or spine switch fails, traffic is automatically rerouted for continuous uptime.

This document describes how to configure MLAG with a Virtual eXtensible LAN (VXLAN), a method for running a Layer 2 overlay network on Layer 3 infrastructure.

Networking Requirements

Figure 1 illustrates an MLAG configured between Switch A and Switch B, the MLAG connections between the neighboring switches, and two downstream Network Devices.

Access Switches SwitchC and SwitchD are dual-homed to an MLAG domain through a VXLAN tunnel, achieving that Layer 2 devices on the access side can communicate with each other over Layer 3 networks.

Figure 1 MLAG Topology with VXLAN

Follow the configuration roadmap below to complete the configuration:

Configure MLAG. SwitchA, SwitchB and the aggregated port ae1connected to SwitchC form an MLAG, link ID is 1; SwitchA, SwitchB and the aggregated port ae2 connected to SwitchD form another MLAG, link ID is 2. MLAG peer-link implements a backup link aggregation group ae3 between SwitchA and SwitchB to carry MLAG control messages and improve network reliability.
Configure VXLAN functions on SwitchA and SwitchB.
Configure LACP LAG ports on Switch C and Switch D to implement dual-homing access.

Procedure

Configuring MLAG on SwitchA

Step1 Configure the aggregation interfaces with LACP mode.

admin@SwitchA# set interface aggregate-ethernet ae1 aggregated-ether-options lacp enable true

admin@SwitchA# set interface aggregate-ethernet ae2 aggregated-ether-options lacp enable true

Step2 Add member interfaces to a LAG.

admin@SwitchA# set interface gigabit-ethernet ge-1/1/1 ether-options 802.3ad ae1

admin@SwitchA# set interface gigabit-ethernet ge-1/1/2 ether-options 802.3ad ae2

admin@SwitchA# set interface gigabit-ethernet te-1/1/49 ether-options 802.3ad ae3

admin@SwitchA# set interface gigabit-ethernet te-1/1/50 ether-options 802.3ad ae3

Step3 Configure the VLANs.

admin@SwitchA# set vlans vlan-id 15

admin@SwitchA# set vlans vlan-id 16

admin@SwitchA# set vlans vlan-id 4088 l3-interface vlan4088

admin@SwitchA# set interface aggregate-ethernet ae1 family ethernet-switching port-mode trunk

admin@SwitchA# set interface aggregate-ethernet ae1 family ethernet-switching vlan members 15

admin@SwitchA# set interface aggregate-ethernet ae1 family ethernet-switching vlan members 16

admin@SwitchA# set interface aggregate-ethernet ae2 family ethernet-switching port-mode trunk

admin@SwitchA# set interface aggregate-ethernet ae2 family ethernet-switching vlan members 15

admin@SwitchA# set interface aggregate-ethernet ae2 family ethernet-switching vlan members 16

admin@SwitchA# set interface aggregate-ethernet ae3 family ethernet-switching native-vlan-id 4088

admin@SwitchA# set interface aggregate-ethernet ae3 family ethernet-switching port-mode trunk

admin@SwitchA# set interface aggregate-ethernet ae3 family ethernet-switching vlan members 15

admin@SwitchA# set interface aggregate-ethernet ae3 family ethernet-switching vlan members 16

Step4 Configure the L3 Interface IP Address.

admin@SwitchA# set l3-interface vlan-interface vlan4088 address 10.10.0.1 prefix-length 24

Step5 Configure MLAG domain ID.

admin@SwitchA# set protocols mlag domain 10

NOTE: Currently, only one MLAG domain is allowed to be configured on one MLAG device.

Step6 Specify SwitchA as MLAG Node 0.

admin@SwitchA# set protocols mlag domain 10 node 0

Step7 Configure the peer IP address and peer link port.

admin@SwitchA# set protocols mlag domain 10 peer-ip 10.10.0.2 peer-link ae3

NOTE: Peer-link port should be configured as a LAG port.

Step8 Configure the L3 interface IP address for peer link port on local MLAG peer device.

admin@SwitchA# set l3-interface vlan-interface vlan4088 address 10.10.0.1 prefix-length 24

Step9 Configure link ID for the MLAG member port.

admin@SwitchA# set protocols mlag domain 10 interface ae1 link 1

admin@SwitchA# set protocols mlag domain 10 interface ae2 link 2

NOTE: The paired MLAG member ports must be bound to the same MLAG link ID.

Step10 Configure MLAG peer VLAN.

admin@SwitchA# set protocols mlag domain 10 peer-ip 10.10.0.2 peer-vlan 4088

Step11 Commit the configurations.

admin@SwitchA# commit

Configuring VXLAN on SwitchA

Step1 Configure VXLAN soure interface.

admin@SwitchA# set l3-interface loopback lo address 10.10.10.1 prefix-length 32

admin@SwitchA# set vxlans source-interface loopback address 10.10.10.1

Step2 Create VXLAN VNI.

admin@SwitchA# set vxlans vni 100010

Step3 Configure vtep address for VXLAN VNI.

admin@SwitchA# set vxlans vni 100010 flood vtep 20.20.20.1

Step4 Add VXLAN port into VXLAN VNI.

admin@SwitchA# set vxlans vni 100010 vlan 15

Note that, in current version, only one VLAN is supported in one VNI.

Step5 Configure a static route.

admin@SwitchA# set protocols static route 20.20.20.1/24 next-hop 10.10.10.2

Step6 Enable IP routing.

admin@SwitchA# set ip routing enable true

Step7 Commit the configurations.

admin@SwitchA# commit

Configuring MLAG on SwitchB

Step1 Configure the aggregation interfaces with LACP mode.

admin@SwitchB# set interface aggregate-ethernet ae1 aggregated-ether-options lacp enable true

admin@SwitchB# set interface aggregate-ethernet ae2 aggregated-ether-options lacp enable true

Step2 Add the member interfaces to the LAG ports.

admin@SwitchB# set interface gigabit-ethernet ge-1/1/1 ether-options 802.3ad ae1

admin@SwitchB# set interface gigabit-ethernet ge-1/1/2 ether-options 802.3ad ae2

admin@SwitchB# set interface gigabit-ethernet te-1/1/49 ether-options 802.3ad ae3

admin@SwitchB# set interface gigabit-ethernet te-1/1/50 ether-options 802.3ad ae3

Step3 Configure the VLANs.

admin@SwitchB# set vlans vlan-id 15

admin@SwitchB# set vlans vlan-id 16

admin@SwitchB# set vlans vlan-id 4088 l3-interface vlan4088

admin@SwitchB# set interface aggregate-ethernet ae1 family ethernet-switching port-mode trunk

admin@SwitchB# set interface aggregate-ethernet ae1 family ethernet-switching vlan members 15

admin@SwitchB# set interface aggregate-ethernet ae1 family ethernet-switching vlan members 16

admin@SwitchB# set interface aggregate-ethernet ae2 family ethernet-switching port-mode trunk

admin@SwitchB# set interface aggregate-ethernet ae2 family ethernet-switching vlan members 15

admin@SwitchB# set interface aggregate-ethernet ae2 family ethernet-switching vlan members 16

admin@SwitchB# set interface aggregate-ethernet ae3 family ethernet-switching native-vlan-id 4088

admin@SwitchB# set interface aggregate-ethernet ae3 family ethernet-switching port-mode trunk

admin@SwitchB# set interface aggregate-ethernet ae3 family ethernet-switching vlan members 15

admin@SwitchB# set interface aggregate-ethernet ae3 family ethernet-switching vlan members 16

Step4 Configure the L3 Interface IP Address.

admin@SwitchB# set l3-interface vlan-interface vlan4088 address 10.10.0.2 prefix-length 24

Step5 Configure MLAG domain ID.

admin@SwitchB# set protocols mlag domain 10

NOTE: Currently, only one MLAG domain is allowed to be configured on one MLAG device.

Step6 Specify SwitchB as MLAG Node 1.

admin@SwitchB# set protocols mlag domain 10 node 1

Step7 Configure the peer IP address and peer link port.

admin@SwitchB# set protocols mlag domain 10 peer-ip 10.10.0.1 peer-link ae3

NOTE: Peer-link port should be configured as a LAG port.

Step8 Configure the L3 interface IP address for peer link port on local MLAG peer device.

admin@SwitchB# set l3-interface vlan-interface vlan4088 address 10.10.0.2 prefix-length 24

Step9 Configure link ID for the MLAG member port.

admin@SwitchB# set protocols mlag domain 10 interface ae1 link 1

admin@SwitchB# set protocols mlag domain 10 interface ae2 link 2

NOTE: The paired MLAG member ports must be bound to the same MLAG link ID.

Step10 Configure MLAG peer VLAN.

admin@SwitchB# set protocols mlag domain 10 peer-ip 10.10.0.1 peer-vlan 4088

Step11 Commit the configurations.

admin@SwitchB# commit

Configuring VXLAN on SwitchB

Step1 Configure VXLAN soure interface.

admin@SwitchB# set l3-interface loopback lo address 10.10.10.1 prefix-length 32

admin@SwitchB# set vxlans source-interface loopback address 10.10.10.1

Step2 Create VXLAN VNI.

admin@SwitchB# set vxlans vni 100010

Step3 Configure vtep address for VXLAN VNI.

admin@SwitchB# set vxlans vni 100010 flood vtep 20.20.20.1

Step4 Add VXLAN port into VXLAN VNI.

admin@SwitchB# set vxlans vni 100010 vlan 15

Note that, in current version, only one VLAN is supported in one VNI.

Step5 Configure a static route.

admin@SwitchB# set protocols static route 20.20.20.1/24 next-hop 10.10.20.2

Step6 Enable IP routing.

admin@SwitchB# set ip routing enable true

Step7 Commit the configurations.

admin@SwitchB# commit

Configuring LAG on SwitchC

Step1 Configure the aggregation interface with LACP mode.

admin@SwitchC# set interface aggregate-ethernet ae1 aggregated-ether-options lacp enable true

Step2 Add the member interfaces to the LAG ports.

admin@SwitchC# set interface gigabit-ethernet ge-1/1/1 ether-options 802.3ad ae1

admin@SwitchC# set interface gigabit-ethernet ge-1/1/2 ether-options 802.3ad ae1

Step3 Configure the VLANs.

admin@SwitchC# set vlans vlan-id 15

admin@SwitchC# set vlans vlan-id 16

admin@SwitchC# set interface aggregate-ethernet ae1 family ethernet-switching port-mode trunk

admin@SwitchC# set interface aggregate-ethernet ae1 family ethernet-switching vlan members 15

admin@SwitchC# set interface aggregate-ethernet ae1 family ethernet-switching vlan members 16

Step4 Commit the configurations.

admin@SwitchC# commit

Configuring LAG on SwitchD

Step1 Configure the aggregation interface with LACP mode.

admin@SwitchD# set interface aggregate-ethernet ae2 aggregated-ether-options lacp enable true

Step2 Add the member interfaces to the LAG ports.

admin@SwitchD# set interface gigabit-ethernet ge-1/1/1 ether-options 802.3ad ae2

admin@SwitchD# set interface gigabit-ethernet ge-1/1/2 ether-options 802.3ad ae2

Step3 Configure the VLANs.

admin@SwitchD# set vlans vlan-id 15

admin@SwitchD# set vlans vlan-id 16

admin@SwitchD# set interface aggregate-ethernet ae2 family ethernet-switching port-mode trunk

admin@SwitchD# set interface aggregate-ethernet ae2 family ethernet-switching vlan members 15

admin@SwitchD# set interface aggregate-ethernet ae2 family ethernet-switching vlan members 16

Step4 Commit the configurations.

admin@SwitchD# commit

Verifiy the Configuration

You can use the run show vxlan vni and run show vxlan tunnel commands to display the information of VXLAN tunnel.

admin@SwitchA# run show vxlan vni 100010
Interface    ID             Type           Egress     Vlan ID
-----------  -----------    -----------    -------    --------
ae1          0x80000001     Access         100078     15  
ae2          0x80000002     Access         100083     15 
ge-1/1/3     0x80000005     Network(UC)    100085            

admin@SwitchA# run show vxlan tunnel
Total number of tunnels: 1
 
VNI 100010, Encap:service-vlan-delete, Decap:service-vlan-add-replace
  src addr:10.10.10.1, dst addr:20.20.20.1, state:UP
  traffic type:all
  nexthops:10.10.10.2
  output ports:ge-1/1/3

You can use the run show vxlan address-table and run show mac-address table commands to display the VXLAN MAC address information.

admin@SwitchA# run show vxlan address-table
VNID           MAC address          Type       Interface          VTEP
-----------    -----------------    -------    ----------------    ---------------
100010         20:04:0f:0f:49:d1    Dynamic                        20.20.20.1
100010         22:22:22:44:44:44    Dynamic                        20.20.20.1
 
admin@SwitchB# run show vxlan address-table
VNID           MAC address          Type       Interface          VT EP
-----------    -----------------    -------    ----------------    ---------------
100010         20:04:0f:0f:49:d1    Sync                           10.10.10.1
100010         22:22:22:44:44:44    Sync                           10.10.10.1

admin@SwitchB# run show mac-address table
Total entries in switching table:   3909
Static entries in switching table:  6
Dynamic entries in switching table: 3903

VLAN      MAC address          Type         Age     Interfaces         User
----      -----------------    ---------    ----    ----------------   ----------
15        a0:01:0f:0f:49:f1    Dynamic      300     ae2                xorp     
N/A       20:04:0f:0f:49:d1    Peer-Sync    300     vxlan              xorp     
N/A       22:22:22:44:44:44    Peer-Sync    300     vxlan              xorp

You can use the run show mlag domain command to display the MLAG domain information.

admin@SwitchA# run show mlag domain summary
Domain ID: 10    Domain MAC: 48:6E:73:FF:00:0a    Node ID: 0
----------------------------------------------------------------------
Peer Link  Peer IP          Peer Vlan  Neighbor Status  Config Matched   MAC Synced   # of Links
---------  ---------------  ---------  ---------------  --------------  ----------  --------------
ae3        10.10.10.2       4088        ESTABLISHED     Yes              Yes         2

You can use the run show mlag link command to display MLAG link information.

admin@SwitchA# run show mlag link summary
# of Links: 2
Link   Local LAG   Link Status   Local Status   Peer-Status   Config Matched   Flood
----   ---------   -----------   ------------   -----------   --------------   -----
1      ae1         IDLE          UP             UNKNOWN       No               No  
2      ae2         IDLE          UP             UNKNOWN       No               No

After the configuration is complete, the access switches SwitchC and SwitchD can communicate with each other normally.

Browser not supported