Versions Compared

Version Old Version 1 New Version 2
Changes made by

Tracy Yang

Tracy Yang

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Table of Contents

Introduction

EVPN Multihoming (MH) is a standards based replacement for MLAG to achieve standards based all-active server redundancy in datacenters and enterprise networks. Multihoming eliminates the need to have MLAG and unlike MLAG, does not require the group of devices used to create a multihoming group to have inter-connecting peer links.

...

              Figure 1. EVPN Multihoming


Key Benefits

  • Interconnecting switch links between TOR switches in a redundancy group are not required.
  • There can be more than two TOR switches in the redundancy group. A maximum of 8 devices can form one redundancy group as opposed to a maximum of two devices in an MLAG group.
  • Ease of management as it provides a single BGP-EVPN control plane.
  • Allows multi-vendor interoperability because of standards based implementation. 

 Brief  Brief Mechanism

As shown in Figure 1, if VTEP1 loses direct connection to Server1, it will signal to VTEP2, VTEP3 and VTEP4 that Server1 is no longer accessible and to change their next-hop group for Server1 if there are alternative routes to this ES. Since VTEP2 also has a route to this ES, VTEP3 and VTEP4 will change their next hop groups for Server1 MAC address to go through VTEP2 instead of VTEP1.

...

Info
titleNote

It is strongly suggested to remove any MLAG related configuration from the overlay devices (VTEPs) if you plan on deploying EVPN MH in your network. The two technologies are designed to address almost similar requirements of redundancy but MLAG is a layer2 technique whereas EVPN MH is deployed in the overlay and is a layer3 technique. The two technologies hence do not mix well and users are urged to stick to EVPN MH for its standards based implementation and interoperability benefits as opposed to MLAG especially in the overlay network design.


Designated Forwarder Election

For BGP EVPN, a Designated Forwarder (DF) is responsible for handling Broadcast, Unknown Unicast and Multicast (BUM) traffic for Ethernet Segments. As shown in Figure 1, Server1 constitutes an Ethernet Segment as it is multihomed to two VTEPs in the EVPN overlay. Only one of the two VTEPs has to be elected a DF to deliver BUM traffic to Server1 from remote VTEPs (VTEP3 and VTEP4). The administrator needs to configure EVPN multihoming preference for the Ethernet Segment. A higher preference value wins the election process and assumes the role of the DF. If the preference on both the VTEPs is same then the VTEP with the smallest IP wins the election. It’s important to note that the interface connecting the Ethernet Segment must be an Aggregate-Ethernet interface.

...

set interface aggregate-ethernet <interface> evpn mh es-df-pref <preference>

VTEP Uplink Status Tracking

Overlay VTEPs are capable of tracking the state of uplinks connecting the overlay leaf devices with underlay spine switches. This feature is automatically enabled when the user enables the EVPN MH. All the downstream links connecting the MH hosts are put in protocol down state when all the uplinks go down. In Figure 1, all the links connecting the underlay spine switches must go down before the downstream links are put in protocol down state. The links will not be put in protocol down state if there is only one link up and active connecting the overlay devices with the underlay.

EVPN MH Split Horizon

Split-horizon technique is used to stop BUM traffic from forming a loop in the EVPN VXLAN network that employs multihoming. Using split-horizon, BUM traffic from the same Ethernet Segment will be dropped by the peer device. As can been seen in Figure 2, Host1 is multihomed into the EVPN VXLAN fabric and connected to both VTEP1 and VTEP2 forming Ethernet Segment ES1.

...

Info
titleNote

Note: Single homed ports connecting a single device with the EVPN VXLAN fabric are not yet supported on VTEP devices. If a server is dual homed to two VTEPs and the connecting link to one of the VTEP fails, the server will still be considered a dual homed device even if there is only one active link connecting it to the fabric.

EVPN MH Basic Configuration

To configure EVPN multihoming on a LAG interface, the user needs to configure an Ethernet Segment identifier (ES-ID) and an Ethernet Segment System MAC. A type-3 ESI value is automatically generated by using these two parameters. The resulting 10-byte ESI value has the following format, where the XXs denote the 6-byte ES System MAC and the YYs denote the 3-byte local ES ID.

03 : XX : XX : XX : XX : XX : XX : YY : YY : YY

For each Ethernet segment, both the ES System MAC and the ES ID must be the same on all the switches forming the EVPN MH redundancy group. However, switches can be configured with different system MACs for different Ethernet segments or share the same system MAC for all Ethernet segments.

Switch Configuration Example and Topology

In PICOS EVPN multihoming, there are two ways to forward BUM messages:

  • Head End Replication. This is the default way which needs no PIM configurations. The BUM message will be encapsulated and sent to all outgoing ports VTEPs of the same VNI by the access VTEP.
  • BUM tunnel. All VTEPs of the same VNI join the same multicast group, and use multicast routing protocol PIM to establish a multicast forwarding table entry for the multicast group. This method can reduce the traffic flooding caused by the head end replication of the BUM messages. This way needs extral PIM configurations.

EVPN Multihoming with Head End Replication

For this example configuration we have the following topology comprising of two spine switches, four leaf switches and four servers that are multihomed to this network. Two servers are multihomed to Leaf1 and Leaf2 switches whereas the other two servers are attached to Leaf3 and Leaf4 switches.

...

The two ES IDs are configured on each peer connected to the two downstream multihomed servers. On Leaf1, two physical ports connect to the multihomed servers; both the physical ports are first added to LAG interfaces. The LAG interface connected to Server1 is “ae2” whereas the interface connecting Server2 is “ae1”. For EVPN MH, it is a mandatory that the ports connecting the multihomed hosts must be LAG interfaces. Similarly, on all leaf switches there are two LAG interfaces and two ES IDs configured.

The following configuration examples use the topology illustrated below and configure EVPN multihoming with head end replication.


Figure 3. EVPN MH Example Topology

...

Code Block
admin@Leaf1# set interface aggregate-ethernet ae1 evpn mh es-sys-mac 00:22:22:22:22:22
admin@Leaf1# set interface aggregate-ethernet ae2 evpn mh es-sys-mac 00:22:22:22:22:22
admin@Leaf1# set interface gigabit-ethernet ge-1/1/719 familymtu ethernet-switching native-vlan-id 20
admin@Leaf1# set interface gigabit-ethernet ge-1/1/7 family ethernet-switching port-mode trunk
admin@Leaf1# set interface gigabit-ethernet ge-1/1/7 family ethernet-switching vlan members 30
admin@Leaf1# set3000
admin@Leaf1# set interface gigabit-ethernet ge-1/1/19 mtu 3000
admin@Leaf1# set interface gigabit-ethernet ge-1/1/19 family ethernet-switching native-vlan-id 4014
admin@Leaf1# set interface gigabit-ethernet ge-1/1/23 ether-options 802.3ad ae2
admin@Leaf1# set interface gigabit-ethernet ge-1/1/23 family ethernet-switching
admin@Leaf1# set interface gigabit-ethernet ge-1/1/24 disable true
admin@Leaf1# set interface gigabit-ethernet ge-1/1/27 mtu 3000
admin@Leaf1# set interface gigabit-ethernet ge-1/1/27 family ethernet-switching native-vlan-id 4012
admin@Leaf1# set interface gigabit-ethernet ge-1/1/37 ether-options 802.3ad ae1

...

Code Block
admin@Leaf1# set protocols ospf router-id 17.17.17.17
admin@Leaf1# set protocols ospf network 10.226.15.64/30 area 0.0.0.0
admin@Leaf1# set protocols ospf network 10.226.15.28/30 area 0.0.0.0
admin@Leaf1# set protocols ospf network 10.226.14.254/32 area 0.0.0.0
admin@Leaf1# set protocols ospf network 10.226.14.207/32 area 0.0.0.0

Step8. Configure PIMhostname, inband mode and VLANs.

Code Block
admin@Leaf1# set protocolssystem pim rp 202.202.202.202 group 224.1.1.1/32
hostname Leaf1
admin@Leaf1# set protocolssystem piminband rp 202.202.202.202 group 230.1.1.1/32
enable true
admin@Leaf1# set protocols pim vlans vlan-id 20 l3-interface lovlan20
admin@Leaf1# set protocols pim interface vlan4014
admin@Leaf1# set protocols pim interface vlan4012

Step9. Configure hostname, inband mode and VLANs.

Code Block
admin@Leaf1# set system hostname Leaf1
admin@Leaf1# set system inband enable true
admin@Leaf1# set vlans vlan-id 20 l3-interface vlan20
admin@Leaf1# set vlans vlan-id 30 l3-interface vlan30
admin@Leaf1# set vlans vlan-id 99 l3-interface vlan99
admin@Leaf1# set vlans vlan-id 4012 l3-interface vlan4012
admin@Leaf1# set vlans vlan-id 4014 l3-interface vlan4014
admin@Leaf1# set vlans vlan-id 4094 l3-interface vlan4094

Step10Step9. Configure VXLANs.

Code Block
admin@Leaf1# set vxlans source-interface lo address 10.226.14.254
admin@Leaf1# set vxlans vni 10030 decapsulation mode service-vlan-per-port
admin@Leaf1# set vxlans vni 10030 vlan 30
admin@Leaf1# set vxlans vni 10030 arp-nd-suppress disable false
admin@Leaf1# set vxlans vni 10020 decapsulation mode service-vlan-per-port
admin@Leaf1# set vxlans vni 10020 vlan 20
admin@Leaf1# set vxlans vni 10020 arp-nd-suppress disable false
admin@Leaf1# set vxlans vni 99 vlan 99
admin@Leaf1# set vxlans vrf vrf1 l3-vni 99
admin@Leaf1# set vxlans vni 10020 mcast-group 224.1.1.1
admin@Leaf1# set vxlans vni 10030 mcast-group 230.1.1.1
admin@Leaf1# commit

Leaf2 Configuration

Code Block
admin@Leaf2# set interface aggregate-ethernet ae1 aggregated-ether-options lacp enable true
admin@Leaf2# set interface aggregate-ethernet ae2 aggregated-ether-options lacp enable true
admin@Leaf2# set interface aggregate-ethernet ae1 family ethernet-switching port-mode trunk
admin@Leaf2# set interface aggregate-ethernet ae1 family ethernet-switching vlan members 30
admin@Leaf2# set interface aggregate-ethernet ae1 family ethernet-switching vlan members 20
admin@Leaf2# set interface aggregate-ethernet ae1 evpn mh es-id 4
admin@Leaf2# set interface aggregate-ethernet ae1 evpn mh es-sys-mac 00:22:22:22:22:22
admin@Leaf2# set interface aggregate-ethernet ae2 family ethernet-switching port-mode "trunk"
admin@Leaf2# set interface aggregate-ethernet ae2 family ethernet-switching vlan members 30
admin@Leaf2# set interface aggregate-ethernet ae2 family ethernet-switching vlan members 20
admin@Leaf2# set interface aggregate-ethernet ae2 evpn mh es-id 2
admin@Leaf2# set interface aggregate-ethernet ae2 evpn mh es-sys-mac 00:22:22:22:22:22
admin@Leaf2# set interface gigabit-ethernet te-1/1/117 mtu 3000
admin@Leaf2# set interface gigabit-ethernet te-1/1/5 mtu 300017 family ethernet-switching native-vlan-id 4014
admin@Leaf2# set interface gigabit-ethernet te-1/1/919 familymtu ethernet-switching native-vlan-id 20
3000
admin@Leaf2# set interface gigabit-ethernet te-1/1/919 family ethernet-switching port-mode trunk
admin@Leaf2# set interface gigabit-ethernet te-1/1/9 family ethernet-switching vlan members 30
admin@Leaf2# set interface gigabit-ethernet te-1/1/17 mtu 3000
admin@Leaf2# set interface gigabit-ethernet te-1/1/17 family ethernet-switching native-vlan-id 4014
admin@Leaf2# set interface gigabit-ethernet te-1/1/19 mtu 3000
admin@Leaf2# set interface gigabit-ethernet te-1/1/19 family ethernet-switching native-vlan-id 4013
admin@Leaf2# set interface gigabit-ethernet te-1/1/21 ether-options 802.3ad ae2
admin@Leaf2# set interface gigabit-ethernet te-1/1/23 ether-options 802.3ad ae1
admin@Leaf2# set interface ethernet-switching-options
admin@Leaf2# set ip routing enable true
admin@Leaf2# set ip vrf vrf1
admin@Leaf2# set l3-interface loopback lo address 10.226.14.253 prefix-length 32
admin@Leaf2# set l3-interface loopback vrf1 address 26.26.26.26 prefix-length 32
admin@Leaf2# set l3-interface vlan-interface vlan4013 address 10.226.15.25 prefix-length 30
admin@Leaf2# set l3-interface vlan-interface vlan4014 address 10.226.15.81 prefix-length 30
admin@Leaf2# set l3-interface vlan-interface vlan4094 address 10.226.13.25 prefix-length 30
admin@Leaf2# set l3-interface vlan-interface vlan99 vrf vrf1
admin@Leaf2# set l3-interface vlan-interface vlan20 vrf vrf1
admin@Leaf2# set l3-interface vlan-interface vlan20 address 192.168.0.3 prefix-length 24
admin@Leaf2# set l3-interface vlan-interface vlan20 address 2002:0:0:1::3 prefix-length 64
admin@Leaf2# set l3-interface vlan-interface vlan30 vrf vrf1
admin@Leaf2# set l3-interface vlan-interface vlan30 address 172.168.0.3 prefix-length 24
admin@Leaf2# set l3-interface vlan-interface vlan30 address 2003:0:0:1::3 prefix-length 64
admin@Leaf2# set l3-interface vlan-interface vlan20 router-mac 00:00:20:00:00:FE
admin@Leaf2# set l3-interface vlan-interface vlan30 router-mac 00:00:30:00:00:FE
admin@Leaf2# set protocols bgp local-as 65001
admin@Leaf2# set protocols bgp router-id 10.226.14.208
admin@Leaf2# set protocols bgp neighbor 10.226.14.48 remote-as internal
admin@Leaf2# set protocols bgp neighbor 10.226.14.48 update-source 10.226.14.208
admin@Leaf2# set protocols bgp neighbor 10.226.14.48 evpn activate true
admin@Leaf2# set protocols bgp neighbor 10.226.14.207 remote-as internal
admin@Leaf2# set protocols bgp neighbor 10.226.14.207 update-source 10.226.14.208
admin@Leaf2# set protocols bgp neighbor 10.226.14.207 evpn activate true
admin@Leaf2# set protocols bgp neighbor 10.226.14.24 remote-as internal
admin@Leaf2# set protocols bgp neighbor 10.226.14.24 update-source 10.226.14.208
admin@Leaf2# set protocols bgp neighbor 10.226.14.24 evpn activate true
admin@Leaf2# set protocols bgp ipv4-unicast
admin@Leaf2# set protocols bgp evpn advertise-all-vni
admin@Leaf2# set protocols bgp evpn advertise ipv4-unicast
admin@Leaf2# set protocols bgp evpn advertise ipv6-unicast
admin@Leaf2# set protocols bgp evpn advertise-svi-ip
admin@Leaf2# set protocols bgp vrf vrf1 local-as 65001
admin@Leaf2# set protocols bgp vrf vrf1 router-id 26.26.26.26
admin@Leaf2# set protocols bgp vrf vrf1 evpn advertise ipv4-unicast
admin@Leaf2# set protocols bgp vrf vrf1 evpn advertise ipv6-unicast
admin@Leaf2# set protocols evpn mh
admin@Leaf2# set protocols lldp enable true
admin@Leaf2# set protocols ospf router-id 110.110.110.110
admin@Leaf2# set protocols ospf network 10.226.15.24/30 area 0.0.0.0
admin@Leaf2# set protocols ospf network 10.226.15.80/30 area 0.0.0.0
admin@Leaf2# set protocols ospf network 10.226.14.208/32 area 0.0.0.0
admin@Leaf2# set protocols ospf network 10.226.14.253/32 area 0.0.0.0
admin@Leaf2# set protocols pim rp 202.202.202.202 group 224.1.1.1/32
admin@Leaf2# set protocols pim rp 202.202.202.202 group 230.1.1.1/32
admin@Leaf2# set protocols pim interface lo
admin@Leaf2# set protocols pim interface vlan4014
admin@Leaf2# set protocols pim interface vlan4013
admin@Leaf2# vlans vlan-id 20 l3-interface vlan20
admin@Leaf2# set vlans vlan-id 20 l3-interface vlan20
admin@Leaf2# set vlans vlan-id 30 l3-interface vlan30
admin@Leaf2# set vlans vlan-id 99 l3-interface vlan99
admin@Leaf2# set vlans vlan-id 4013 l3-interface vlan4013
admin@Leaf2# set vlans vlan-id 4014 l3-interface vlan4014
admin@Leaf2# set vlans vlan-id 4094 l3-interface vlan4094
admin@Leaf2# set vxlans source-interface lo address 10.226.14.253
admin@Leaf2# set vxlans vni 10030 decapsulation mode service-vlan-per-port
admin@Leaf2# set vxlans vni 10030 vlan 30
admin@Leaf2# set vxlans vni 10030 arp-nd-suppress disable false
admin@Leaf2# set vxlans vni 10020 decapsulation mode service-vlan-per-port
admin@Leaf2# set vxlans vni 10020 vlan 20
admin@Leaf2# set vxlans vni 10020 arp-nd-suppress disable false
admin@Leaf2# set vxlans vni 99 vlan 99
admin@Leaf2# set vxlans vrf vrf1 l3-vni 99
admin@Leaf2# set vxlans vni 10020 mcast-group 224.1.1.1
admin@Leaf2# set vxlans vni 10030 mcast-group 230.1.1.1
admin@Leaf2# commit


Leaf3 Configuration

Code Block
admin@Leaf3# set interface aggregate-ethernet ae1 aggregated-ether-options lacp enable true
admin@Leaf3# set interface aggregate-ethernet ae2 aggregated-ether-options lacp enable true
admin@Leaf3# set interface aggregate-ethernet ae1 family ethernet-switching port-mode trunk
admin@Leaf3# set interface aggregate-ethernet ae1 family ethernet-switching vlan members 30
admin@Leaf3# set interface aggregate-ethernet ae1 family ethernet-switching vlan members 20
admin@Leaf3# set interface aggregate-ethernet ae1 evpn mh es-id 3
admin@Leaf3# set interface aggregate-ethernet ae1 evpn mh es-sys-mac 00:00:00:22:22:22
admin@Leaf3# set interface aggregate-ethernet ae2 family ethernet-switching port-mode trunk
admin@Leaf3# set interface aggregate-ethernet ae2 family ethernet-switching vlan members 30
admin@Leaf3# set interface aggregate-ethernet ae2 family ethernet-switching vlan members 20
admin@Leaf3# set interface aggregate-ethernet ae2 evpn mh es-id 1
admin@Leaf3# set interface aggregate-ethernet ae2 evpn mh es-sys-mac 00:00:00:22:22:22
admin@Leaf3# set interface gigabit-ethernet ge-1/1/3 mtu 3000
admin@Leaf3# set interface gigabit-ethernet ge-1/1/3 family ethernet-switching native-vlan-id 4016
admin@Leaf3# set interface gigabit-ethernet ge-1/1/5 mtu 3000
admin@Leaf3# set interface gigabit-ethernet ge-1/1/5 family ethernet-switching native-vlan-id 3012
admin@Leaf3# set interface gigabit-ethernet ge-1/1/1921 family ethernetether-switching native-vlan-id 20options 802.3ad ae1
admin@Leaf3# set interface gigabit-ethernet ge-1/1/19 family22 ether-options 802.3ad ae2
admin@Leaf3# set interface ethernet-switching port-mode trunkoptions
admin@Leaf3# set interface gigabit-ethernet ge-1/1/19 family ethernet-switching vlan members 20ip routing enable true
admin@Leaf3# set ip vrf vrf1
admin@Leaf3# set l3-interface gigabit-ethernet ge-1/1/21 ether-options 802.3ad ae1loopback lo address 10.226.14.24 prefix-length 32
admin@Leaf3# set l3-interface gigabit-ethernet ge-1/1/22 ether-options 802.3ad ae2loopback lo address 10.226.14.201 prefix-length 32
admin@Leaf3# set l3-interface gigabitvlan-ethernet ge-1/1/23 family ethernet-switching native-vlan-idinterface vlan3011 address 10.226.0.98 prefix-length 30
admin@Leaf3# set l3-interface gigabit-ethernet ge-1/1/23 family ethernet-switching port-mode trunk
vlan-interface vlan3012 address 10.226.0.94 prefix-length 30
admin@Leaf3# set l3-interface gigabit-ethernet ge-1/1/23 family ethernet-switching vlan members 20vlan-interface vlan99 vrf vrf1
admin@Leaf3# set l3-interface vlan-interface vlan20 vrf vrf1
admin@Leaf3# set l3-interface gigabitvlan-ethernet te-1/1/3 family ethernet-switching native-vlan-id 3011interface vlan20 address 192.168.0.3 prefix-length 24
admin@Leaf3# set l3-interface ethernetvlan-switching-optionsinterface admin@Leaf3#vlan20 set ip routing enable true
admin@Leaf3# set ipaddress 2002:0:0:1::3 prefix-length 64
admin@Leaf3# set l3-interface vlan-interface vlan30 vrf vrf1
admin@Leaf3# set l3-interface loopbackvlan-interface lovlan30 address 10172.226168.140.243 prefix-length 3224
admin@Leaf3# set l3-interface loopbackvlan-interface lovlan30 address 10.226.14.2012003:0:0:1::3 prefix-length 3264
admin@Leaf3# set l3-interface vlan-interface vlan3011 address 10.226.0.98 prefix-length 30vlan20 router-mac 00:00:20:00:00:FE
admin@Leaf3# set l3-interface vlan-interface vlan3012 address 10.226.0.94 prefix-length 30vlan30 router-mac 00:00:30:00:00:FE
admin@Leaf3# set protocols l3-interfacebgp vlanlocal-interfaceas vlan9965001
vrf vrf1
admin@Leaf3# set protocols l3-interfacebgp vlanrouter-interface vlan20 vrf vrf1id 10.226.14.24
admin@Leaf3# set l3-interface vlan-interface vlan20 address 192.168.0.3 prefix-length 24protocols bgp neighbor 10.226.14.207 remote-as internal
admin@Leaf3# set l3-interface vlan-interface vlan20 address 2002:0:0:1::3 prefix-length 64 protocols bgp neighbor 10.226.14.207 timers delayopen 60
admin@Leaf3# set l3-interface vlan-interface vlan30 vrf vrf1protocols bgp neighbor 10.226.14.207 update-source "10.226.14.24"
admin@Leaf3# set l3-interface vlan-interface vlan30 address 172.168.0.3 prefix-length 24protocols bgp neighbor 10.226.14.207 evpn activate true
admin@Leaf3# set l3-interface vlan-interface vlan30 address 2003:0:0:1::3 prefix-length 64protocols bgp neighbor 10.226.14.208 remote-as "internal"
admin@Leaf3# set l3-interface vlan-interface vlan20 router-mac 00:00:20:00:00:FE protocols bgp neighbor 10.226.14.208 timers delayopen 60
admin@Leaf3# set l3-interface vlan-interface vlan30 router-mac 00:00:30:00:00:FE
admin@Leaf3# set protocols bgp local-as 65001protocols bgp neighbor 10.226.14.208 update-source 10.226.14.24
admin@Leaf3# set protocols bgp router-idneighbor 10.226.14.24208 evpn activate true
admin@Leaf3# set protocols bgp neighbor 10.226.14.20748 remote-as internal
admin@Leaf3# set protocols bgp neighbor 10.226.14.20748 timers delayopen 60
admin@Leaf3# set protocols bgp neighbor 10.226.14.20748 update-source "10.226.14.24"
admin@Leaf3# set protocols bgp neighbor 10.226.14.20748 evpn activate true
admin@Leaf3# set protocols bgp neighbor 10.226.14.208 remote-as "internal"ipv4-unicast
admin@Leaf3# set protocols bgp neighbor 10.226.14.208 timers delayopen 60
evpn advertise-all-vni
admin@Leaf3# set protocols bgp neighbor 10.226.14.208 update-source 10.226.14.24evpn advertise ipv4-unicast
admin@Leaf3# set protocols bgp neighbor 10.226.14.208 evpn activateadvertise trueipv6-unicast
admin@Leaf3# set protocols bgp neighbor 10.226.14.48 remote-as internal
evpn advertise-svi-ip
admin@Leaf3# set protocols bgplldp neighbor 10.226.14.48 timers delayopen 60
admin@Leaf3# set protocols bgp neighbor 10.226.14.48 update-source 10.226.14.24
admin@Leaf3# set protocols bgp neighbor 10.226.14.48 evpn activate true
admin@Leaf3# set protocols bgp ipv4-unicast
enable true
admin@Leaf3# set protocols bgp evpn advertise-all-vni
admin@Leaf3# set protocols bgp evpn advertise ipv4-unicast
admin@Leaf3# set protocols bgp evpn advertise ipv6-unicast
admin@Leaf3# set protocols bgp evpn advertise-svi-ip
admin@Leaf3# set protocols lldp enable true
admin@Leaf3# set protocols ospf router-id 24.24.24.24
admin@Leaf3# set protocols ospf network 10.226.0.96/30 area 0.0.0.0
admin@Leaf3# set protocols ospf network 10.226.0.92/30 area 0.0.0.0
admin@Leaf3# set protocols ospf network 10.226.14.201/32 area 0.0.0.0
admin@Leaf3# set protocols ospf network 10.226.14.24/32 area 0.0.0.0
admin@Leaf3# set vlans vlan-id 20 l3-interface vlan20
admin@Leaf3# set vlans vlan-id 30 l3-interface vlan30
admin@Leaf3# set vlans vlan-id 99 l3-interface vlan99
admin@Leaf3# set vlans vlan-id 30113012 l3-interface vlan3011vlan3012
admin@Leaf3# set vlans vlan-id 30124016 l3-interface vlan3012vlan4016
admin@Leaf3# set vxlans source-interface lo address 10.226.14.201
admin@Leaf3# set vxlans vni 10020 decapsulation mode service-vlan-per-port
admin@Leaf3# set vxlans vni 10020 vlan 20
admin@Leaf3# set vxlans vni 10020 arp-nd-suppress disable false
admin@Leaf3# set vxlans vni 10030 decapsulation mode service-vlan-per-port
admin@Leaf3# set vxlans vni 10030 vlan 30
admin@Leaf3# set vxlans vni 10030 arp-nd-suppress disable false
admin@Leaf3# set vxlans vni 99 vlan 99
admin@Leaf3# set vxlans traceoptions flag all disable false
admin@Leaf3# set vxlans vrf vrf1 l3-vni 99
admin@Leaf3# set vxlans vni 10020 mcast-group 224.1.1.1
admin@Leaf3# set vxlans vni 10030 mcast-group 230.1.1.1
admin@Leaf3# commit


Leaf4 Configuration

Code Block
admin@Leaf4# set interface aggregate-ethernet ae1 aggregated-ether-options lacp enable true
admin@Leaf4# set interface aggregate-ethernet ae2 aggregated-ether-options lacp enable true
admin@Leaf4# set interface aggregate-ethernet ae1 family ethernet-switching port-mode trunk
admin@Leaf4# set interface aggregate-ethernet ae1 family ethernet-switching vlan members 30
admin@Leaf4# set interface aggregate-ethernet ae1 family ethernet-switching vlan members 20
admin@Leaf4# set interface aggregate-ethernet ae1 evpn mh es-id 1
admin@Leaf4# set interface aggregate-ethernet ae1 evpn mh es-sys-mac 00:00:00:22:22:22
admin@Leaf4# set interface aggregate-ethernet ae2 mtu 3000
admin@Leaf4# set interface aggregate-ethernet ae2 family ethernet-switching port-mode trunk
admin@Leaf4# set interface aggregate-ethernet ae2 family ethernet-switching vlan members 30
admin@Leaf4# set interface aggregate-ethernet ae2 family ethernet-switching vlan members 20
admin@Leaf4# set interface aggregate-ethernet ae2 evpn mh es-id 3
admin@Leaf4# set interface aggregate-ethernet ae2 evpn mh es-sys-mac 00:00:00:22:22:22
admin@Leaf4# set interface gigabit-ethernet ge-1/1/1 disable true
admin@Leaf4# set interface gigabit-ethernet ge-1/1/3 mtu 3000
admin@Leaf4# set interface gigabit-ethernet ge-1/1/3 family ethernet-switching native-vlan-id 3011
admin@Leaf4# set interface gigabit-ethernet ge-1/1/5 mtu 3000
admin@Leaf4# set interface gigabit-ethernet ge-1/1/5 family ethernet-switching native-vlan-id 3012
admin@Leaf4# set interface gigabit-ethernet ge-1/1/1921 family ethernetether-switching native-vlan-id 20options 802.3ad ae1
admin@Leaf4# set interface gigabit-ethernet ge-1/1/1922 family ethernetether-switching port-mode trunkoptions 802.3ad ae2
admin@Leaf4# set ip interfacerouting gigabit-ethernet ge-1/1/19 family ethernet-switching vlan members 20enable true
admin@Leaf4# set ip vrf vrf1
admin@Leaf4# set l3-interface gigabit-ethernet ge-1/1/21 ether-options 802.3ad ae1loopback lo address 10.226.14.202 prefix-length 32
admin@Leaf4# set l3-interface gigabit-ethernet ge-1/1/22 ether-options 802.3ad ae2loopback lo address 10.226.14.48 prefix-length 32
admin@Leaf4# set l3-interface gigabit-ethernet ge-1/1/23 family ethernet-switching native-vlan-id 30loopback vrf1 address 48.48.48.48 prefix-length 32
admin@Leaf4# set l3-interface gigabitvlan-ethernet ge-1/1/23 family ethernet-switching port-mode trunkinterface vlan3011 address 10.226.15.70 prefix-length 30
admin@Leaf4# set l3-interface gigabit-ethernet ge-1/1/23 family ethernet-switching vlan members 20vlan-interface vlan3012 address 10.226.15.78 prefix-length 30
admin@Leaf4# set l3-interface vlan-interface vlan99 vrf vrf1
admin@Leaf4# set l3-interface gigabitvlan-ethernet te-1/1/3 family ethernet-switching native-vlan-id 3011
admin@Leaf4# set ip routing enable true
admin@Leaf4# set ip vrf interface vlan20 vrf vrf1
admin@Leaf4# set l3-interface loopbackvlan-interface lovlan20 address 10192.226168.140.2023 prefix-length 3224
admin@Leaf4# set l3-interface loopbackvlan-interface lovlan20 address 10.226.14.482002:0:0:1::3 prefix-length 3264
admin@Leaf4# set l3-interface loopbackvlan-interface vrf1vlan30 address 48.48.48.48 prefix-length 32vrf vrf1
admin@Leaf4# set l3-interface vlan-interface vlan3011vlan30 address 10172.226168.150.703 prefix-length 3024
admin@Leaf4# set l3-interface vlan-interface vlan3012vlan30 address 10.226.15.782003:0:0:1::3 prefix-length 3064
admin@Leaf4# set l3-interface vlan-interface vlan99vlan20 vrf vrf1router-mac 00:00:20:00:00:FE
admin@Leaf4# set l3-interface vlan-interface vlan20vlan30 vrf vrf1router-mac 00:00:30:00:00:FE
admin@Leaf4# set protocols bgp l3-interface vlan-interface vlan20 address 192.168.0.3 prefix-length 24local-as 65001
admin@Leaf4# set protocols bgp router-id 10.226.14.48
admin@Leaf4# set protocols bgp neighbor 10.226.14.207 remote-as internal
admin@Leaf4# set l3-interface vlan-interface vlan20 address 2002:0:0:1::3 prefix-length 64protocols bgp neighbor 10.226.14.207 update-source 10.226.14.48
admin@Leaf4# set l3-interface vlan-interface vlan30 vrf vrf1 protocols bgp neighbor 10.226.14.207 evpn activate true
admin@Leaf4# set l3-interface vlan-interface vlan30 address 172.168.0.3 prefix-length 24protocols bgp neighbor 10.226.14.208 remote-as internal
admin@Leaf4# set protocols l3-interface vlan-interface vlan30 address 2003:0:0:1::3 prefix-length 64
admin@Leaf4# set l3-interface vlan-interface vlan20 router-mac 00:00:20:00:00:FE
admin@Leaf4# set l3-interface vlan-interface vlan30 router-mac 00:00:30:00:00:FE
admin@Leaf4# set protocols bgp local-as 65001
admin@Leaf4# set protocols bgp router-idbgp neighbor 10.226.14.208 update-source 10.226.14.48
admin@Leaf4# set protocols bgp neighbor 10.226.14.48208 evpn activate true
admin@Leaf4# set protocols bgp neighbor 10.226.14.20724 remote-as internal
admin@Leaf4# set protocols bgp neighbor 10.226.14.20724 update-source 10.226.14.48
admin@Leaf4# set protocols bgp neighbor 10.226.14.20724 evpn activate true
admin@Leaf4# set protocols bgp neighbor 10.226.14.208 remote-as internal
ipv4-unicast
admin@Leaf4# set protocols bgp neighbor 10.226.14.208 update-source 10.226.14.48evpn advertise-all-vni
admin@Leaf4# set protocols bgp neighbor 10.226.14.208 evpn activate true
admin@Leaf4# set protocols bgp neighbor 10.226.14.24 remote-as internal
admin@Leaf4# set protocols bgp neighbor 10.226.14.24 update-source 10.226.14.48
admin@Leaf4# set protocols bgp neighbor 10.226.14.24 evpn activate true
admin@Leaf4# set protocols bgp ipv4-unicast
admin@Leaf4# set protocols bgp evpn advertise-all-vni
admin@Leaf4# set protocols bgp evpn advertise ipv4-unicast
admin@Leaf4# set protocols bgp evpn advertise ipv6-unicast
admin@Leaf4# set protocols bgp evpn advertise-svi-ip
admin@Leaf4# set protocols bgp vrf vrf1 local-as 65001
admin@Leaf4# set protocols bgp vrf vrf1 router-id 48.48.48.48
admin@Leaf4# set protocols bgp vrf vrf1 evpn advertise ipv4-unicast
admin@Leaf4# set protocols bgp vrf vrf1 evpn advertise ipv6-unicast
admin@Leaf4# set protocols evpn mh startup-delay 60
admin@Leaf4# set protocols lldp enable true
admin@Leaf4# set protocols ospf router-id 48.48.48.48
admin@Leaf4# set protocols ospf network 10.226.14.202/32 area 0.0.0.0
admin@Leaf4# set protocols ospf network 10.226.14.48/32 area 0.0.0.0
admin@Leaf4# set protocols ospf network 10.226.15.68/30 area 0.0.0.0
admin@Leaf4# set protocols ospf network 10.226.15.76/30 area 0.0.0.0
admin@Leaf4# set vlans vlan-id 20 l3-interface vlan20
admin@Leaf4# set vlans vlan-id 30 l3-interface vlan30
admin@Leaf4# set vlans vlan-id 99 l3-interface vlan99
admin@Leaf4# set vlans vlan-id 3011 l3-interface vlan3011
admin@Leaf4# set vlans vlan-id 3012 l3-interface vlan3012
admin@Leaf4# set vxlans source-interface lo address 10.226.14.202
admin@Leaf4# set vxlans vni 10020 decapsulation mode service-vlan-per-port
admin@Leaf4# set vxlans vni 10020 vlan 20
admin@Leaf4# set vxlans vni 10020 arp-nd-suppress disable false
admin@Leaf4# set vxlans vni 10030 decapsulation mode service-vlan-per-port
admin@Leaf4# set vxlans vni 10030 vlan 30
admin@Leaf4# set vxlans vni 10030 arp-nd-suppress disable false
admin@Leaf4# set vxlans vni 99 vlan 99
admin@Leaf4# set vxlans vrf vrf1 l3-vni 99
admin@Leaf4# commit


Spine1 Configuration

Code Block
admin@Spine1# set vxlans vni 10020 mcast-group 224.1.1.1
admin@Leaf4# set vxlans vni 10030 mcast-group 230.1.1.1
admin@Leaf4# commit

Spine1 Configuration

Code Block
admin@Spine1# set interface gigabit-interface gigabit-ethernet te-1/1/1123 mtu 2000
admin@Spine1# set interface gigabit-ethernet te-1/1/1123 family ethernet-switching native-vlan-id 4011
admin@Spine1# set interface gigabit-ethernet te-1/1/1123 speed 1000
admin@Spine1# set interface gigabit-ethernet te-1/1/21 mtu 2000
admin@Spine1# set interface gigabit-ethernet te-1/1/21 family ethernet-switching native-vlan-id 4092
admin@Spine1# set interface gigabit-ethernet te-1/1/21 speed 1000
admin@Spine1# set interface gigabit-ethernet te-1/1/35 mtu 2000
admin@Spine1# set interface gigabit-ethernet te-1/1/35 family ethernet-switching native-vlan-id 4013
admin@Spine1# set interface gigabit-ethernet te-1/1/39 disable true
admin@Spine1# set interface gigabit-ethernet te-1/1/41 mtu 2000
admin@Spine1# set interface gigabit-ethernet te-1/1/41 family ethernet-switching native-vlan-id 4014
admin@Spine1# set interface gigabit-ethernet te-1/1/44 mtu 2000
admin@Spine1# set interface gigabit-ethernet te-1/1/44 family ethernet-switching native-vlan-id 4016
admin@Spine1# set interface gigabit-ethernet te-1/1/45 family ethernet-switching native-vlan-id 4015
admin@Spine1# set ip routing enable true
admin@Spine1# set l3-interface loopback lo address 185.185.185.185 prefix-length 32
admin@Spine1# set l3-interface vlan-interface vlan4011 address 10.226.15.42 prefix-length 30
admin@Spine1# set l3-interface vlan-interface vlan4092 address 10.226.15.49 prefix-length 30
admin@Spine1# set l3-interface vlan-interface vlan4014 address 10.226.15.66 prefix-length 30
admin@Spine1# set l3-interface vlan-interface vlan4013 address 10.226.15.26 prefix-length 30
admin@Spine1# set l3-interface vlan-interface vlan4015 address 10.226.15.69 prefix-length 30
admin@Spine1# set l3-interface vlan-interface vlan4016 address 10.226.15.81 prefix-length 30
admin@Spine1# set protocols spanning-tree enable false
admin@Spine1# set protocols ospf router-id 185.185.185.185
admin@Spine1# set protocols ospf network 10.226.15.40/30 area 0.0.0.0
admin@Spine1# set protocols ospf network 10.226.15.48/30 area 0.0.0.0
admin@Spine1# set protocols ospf network 10.226.15.64/30 area 0.0.0.0
admin@Spine1# set protocols ospf network 10.226.15.24/30 area 0.0.0.0
admin@Spine1# set protocols ospf network 10.226.15.68/30 area 0.0.0.0
admin@Spine1# set protocols ospf network 10.226.15.80/30 area 0.0.0.0
admin@Spine1# set protocols ospf network 185.185.185.185/32 area 0.0.0.0
admin@Spine1# set protocolsvlans pimvlan-id rp 202.202.202.202 group 224.1.1.1/324011 l3-interface vlan4011
admin@Spine1# set protocolsvlans pimvlan-id rp 202.202.202.202 group 230.1.1.1/32
4013 l3-interface vlan4013
admin@Spine1# set protocols pim vlans vlan-id 4014 l3-interface lovlan4014
admin@Spine1# set protocols pim interface vlan4011
admin@Spine1# set protocols pim interface vlan4092
admin@Spine1# set protocols pim interface vlan4014
admin@Spine1# set protocols pim interface vlan4013
admin@Spine1# set protocols pim interface vlan4015
admin@Spine1# set protocols pim interface vlan4016
admin@Spine1# set vlans vlan-id 4011 l3-interface vlan4011
admin@Spine1# set vlans vlan-id 4013 l3-interface vlan4013
admin@Spine1# set vlans vlan-id 4014 l3-interface vlan4014
admin@Spine1# set vlans vlan-id vlans vlan-id 4015 l3-interface vlan4015
admin@Spine1# set vlans vlan-id 4016 l3-interface vlan4016
admin@Spine1# set vlans vlan-id 4092 l3-interface vlan4092
admin@Spine1# commit

...

Code Block
admin@Spine2# set interface gigabit-ethernet te-1/1/923 speedmtu 10002000
admin@Spine2# set interface gigabit-ethernet te-1/1/10 speed 100023 family ethernet-switching native-vlan-id 4011
admin@Spine2# set interface gigabit-ethernet te-1/1/1123 mtuspeed 20001000
admin@Spine2# set interface gigabit-ethernet te-1/1/1121 family ethernet-switching native-vlan-id 4011mtu 2000
admin@Spine2# set interface gigabit-ethernet te-1/1/11 speed 100021 family ethernet-switching native-vlan-id 4092
admin@Spine2# set interface gigabit-ethernet te-1/1/1221 speed 1000
admin@Spine2# set interface gigabit-ethernet te-1/1/2127 mtu 2000
admin@Spine2# set interface gigabit-ethernet te-1/1/2127 family ethernet-switching native-vlan-id 40924012
admin@Spine2# set interface gigabit-ethernet te-1/1/2127 speed 1000
admin@Spine2# set interface gigabit-ethernet te-1/1/2237 speedmtu 10002000
admin@Spine2# set interface gigabit-ethernet te-1/1/23 speed 100037 family ethernet-switching native-vlan-id 4014
admin@Spine2# set interface gigabit-ethernet te-1/1/2437 speed 1000
admin@Spine2# set interface gigabit-ethernet te-1/1/2544 speed 1000
admin@Spine2# set interface gigabit-ethernet te-1/1/2644 speedfamily 1000
admin@Spine2# set interface gigabit-ethernet te-1/1/27 mtu 2000
ethernet-switching native-vlan-id 4015
admin@Spine2# set interface gigabit-ethernet te-1/1/2745 family ethernet-switching native-vlan-id 40124015
admin@Spine2# set interface gigabit-ethernet te-1/1/2745 speed 1000
admin@Spine2# set interfaceip gigabit-ethernet te-1/1/28 speed 1000
routing enable true
admin@Spine2# set l3-interface gigabit-ethernet te-1/1/37 mtu 2000
loopback lo address 202.202.202.202 prefix-length 32
admin@Spine2# set l3-interface gigabitvlan-ethernet te-1/1/37 family ethernet-switching native-vlan-id 4014interface vlan4011 address 10.226.15.38 prefix-length 30
admin@Spine2# set l3-interface vlan-interface vlan4092 address 10.226.15.50 prefix-length 30
admin@Spine2# set l3-interface gigabit-ethernet te-1/1/37 speed 1000vlan-interface vlan4012 address 10.226.15.30 prefix-length 30
admin@Spine2# set l3-interface gigabit-ethernet te-1/1/38 speed 1000vlan-interface vlan4014 address 10.226.15.82 prefix-length 30
admin@Spine2# set l3-interface gigabit-ethernet te-1/1/39 speed 1000vlan-interface vlan4015 address 10.226.15.77 prefix-length 30
admin@Spine2# set interfaceprotocols gigabit-ethernet te-1/1/40 speed 1000
lldp enable true
admin@Spine2# set interfaceprotocols gigabitspanning-ethernet te-1/1/44 speed 1000
tree enable false
admin@Spine2# set interfaceprotocols gigabit-ethernet te-1/1/45 family ethernet-switching native-vlan-id 4015ospf router-id 202.202.202.202
admin@Spine2# set interface gigabit-ethernet te-1/1/45 family ethernet-switching native-vlan-id 4015
admin@Spine2# set interface gigabit-ethernet te-1/1/45 speed 1000protocols ospf network 10.226.15.36/30 area 0.0.0.0
admin@Spine2# set protocols ospf network 10.226.15.48/30 area 0.0.0.0
admin@Spine2# set interface gigabit-ethernet te-1/1/46 speed 1000protocols ospf network 10.226.15.28/30 area 0.0.0.0
admin@Spine2# set interfaceprotocols gigabit-ethernet te-1/1/47 speed 1000ospf network 10.226.15.80/30 area 0.0.0.0
admin@Spine2# set protocols interfaceospf gigabit-ethernet te-1/1/48 speed 1000network 10.226.15.76/30 area 0.0.0.0
admin@Spine2# set ipprotocols routing enable true
admin@Spine2# set l3-interface loopback lo address ospf network 202.202.202.202/32 prefix-length 32area 0.0.0.0
admin@Spine2# set vlans l3vlan-interfaceid 4011 vlanl3-interface vlan4011 address 10.226.15.38 prefix-length 30
admin@Spine2# set vlans vlan-id 4012 l3-interface vlan4012
admin@Spine2# set l3-interfacevlans vlan-interfaceid vlan4092 address 10.226.15.50 prefix-length 304014 l3-interface vlan4014
admin@Spine2# set l3-interfacevlans vlan-interfaceid vlan4012 address 10.226.15.30 prefix-length 304015 l3-interface vlan4015
admin@Spine2# set l3-interface vlanvlans vlan-id 4092 l3-interface vlan4014vlan4092
address 10.226.15.82 prefix-length 30
admin@Spine2# set l3-interface vlan-interface vlan4015 address 10.226.15.77 prefix-length 30
admin@Spine2# set protocols lldp enable true
admin@Spine2# set protocols spanning-tree enable false
admin@Spine2# set protocols ospf router-id 202.202.202.202
admin@Spine2# set protocols ospf network 10.226.15.36/30 area 0.0.0.0
admin@Spine2# set protocols ospf network 10.226.15.48/30 area 0.0.0.0
admin@Spine2# set protocols ospf network 10.226.15.28/30 area 0.0.0.0
admin@Spine2# set protocols ospf network 10.226.15.80/30 area 0.0.0.0
admin@Spine2# set protocols ospf network 10.226.15.76/30 area 0.0.0.0
admin@Spine2# set protocols ospf network 202.202.202.202/32 area 0.0.0.0
admin@Spine2# set protocols pim rp 202.202.202.202 group 224.1.1.1/32
admin@Spine2# set protocols pim rp 202.202.202.202 group 230.1.1.1/32
admin@Spine2# set protocols pim interface lo
admin@Spine2# set protocols pim interface vlan4011
admin@Spine2# set protocols pim interface vlan4092
admin@Spine2# set protocols pim interface vlan4012
admin@Spine2# set protocols pim interface vlan4014
admin@Spine2# set protocols pim interface vlan4015
admin@Spine2# set vlans vlan-id 4011 l3-interface vlan4011
admin@Spine2# set vlans vlan-id 4012 l3-interface vlan4012
admin@Spine2# set vlans vlan-id 4014 l3-interface vlan4014
admin@Spine2# set vlans vlan-id 4015 l3-interface vlan4015
admin@Spine2# set vlans vlan-id 4092 l3-interface vlan4092
admin@Spine2# commit

Verify Configuration

The above configuration uses the same default ES-DF preferences on all the three Leaf switches. The resulting effect is that the leaf switch with the smallest VTEP IP is selected as the DF. In the first EVPN MH redundancy group, Leaf2 is elected as the DF since it has the smallest VTEP IP in the group. Similarly in the second redundancy group, Leaf3 has the smallest VTEP IP and is elected the DF.

Code Block
admin@Leaf1#admin@Spine2# commit

Verify Configuration

The above configuration uses the same default ES-DF preferences on all the three Leaf switches. The resulting effect is that the leaf switch with the smallest VTEP IP is selected as the DF. In the first EVPN MH redundancy group, Leaf2 is elected as the DF since it has the smallest VTEP IP in the group. Similarly in the second redundancy group, Leaf3 has the smallest VTEP IP and is elected the DF.

Code Block
admin@Leaf1# run show evpn es 
Type: B bypass, L local, R remote, N non-DF
ESI                               Type   ES-IF           VTEPs
03:00:22:22:22:22:22:00:00:04     LRN   ae1           10.226.14.253
03:00:22:22:22:22:22:00:00:02     LRN   ae2           10.226.14.253

admin@Leaf2# run show evpn es 
Type: B bypass, L local, R remote, N non-DF
ESI                               Type   ES-IF            VTEPs
03:00:22:22:22:22:22:00:00:04     LR    ae1            10.226.14.254
03:00:22:22:22:22:22:00:00:02     LR    ae2            10.226.14.254

admin@Leaf3# run show evpn es

Type: B bypass, L local, R remote, N non-DF
ESI                                Type   ES-IF           VTEPs
03:00:2200:2200:22:22:22:00:00:0403      LRNLR    ae1           10.226.14.253202
03:00:2200:2200:22:22:22:00:00:0201      LR LRN   ae2           10.226.14.253202

admin@Leaf2#admin@Leaf4# run show evpn es 
Type: B bypass, L local, R remote, N non-DF
ESI                                Type   ES-IF            VTEPs
03:00:2200:2200:22:22:22:00:00:0401      LRLRN    ae1            10.226.14.254201
03:00:2200:2200:22:22:22:00:00:0203      LRLRN    ae2            10.226.14.254

admin@Leaf3# run show evpn es
201


Now let’s change the ES-DF preference on Leaf1 to 65535 and see the output again. This time Leaf1 assumes the role of DF.

Code Block
admin@Leaf1# set interface aggregate-ethernet ae1 evpn mh es-df-pref 65535
admin@Leaf1# set interface aggregate-ethernet ae2 evpn mh es-df-pref 65535
admin@Leaf1# commit 
Commit OK.
Save done

admin@Leaf1# run show evpn es 
Type: B bypass, L local, R remote, N non-DF
ESI                           Type    ES-IF Type   ES-IF          VTEPs
03:00:0022:0022:22:22:22:00:00:03 04     LR    ae1              10.226.14.202253
03:00:0022:0022:22:22:22:00:00:0102      LR    ae2              10.226.14.202253

admin@Leaf4#admin@Leaf2# run show evpn es 
Type: B bypass, L local, R remote, N non-DF 
ESI                                Type   ES-IF              VTEPs
03:00:0022:0022:22:22:22:00:00:0104      LRN    ae1            10.226.14.201254
03:00:0022:0022:22:22:22:00:00:03 02     LRN    ae2            10.226.14.201

...

254


To check the EVPN ES detail information, run the following show command. This command shows important information such as ESI, Type, interface, state, DF status and the VTEPs etc.

Code Block
admin@Leaf1#admin@Leaf3# set interface aggregate-ethernet ae1run show evpn mh es-df-pref 65535detail admin@Leaf1#
set interface aggregate-ethernet ae2 evpn mh es-df-pref 65535
admin@Leaf1# commit 
Commit OK.
Save done

admin@Leaf1# run show evpn es 
Type: B bypass, L local, R remote, N non-DF
ESI            ESI: 03:00:00:00:22:22:22:00:00:03
 Type: Local,Remote
 Interface: ae1
 State: up
 Bridge port: yes
 Ready for BGP: yes
 VNI Count: 2
 MAC Count: 0
 DF status: df 
 DF preference: 32767
 Nexthop group: 536870913
 VTEPs:
     10.226.14.202 df_alg: preference df_pref: 32767 nh:    Type   ES-IF              VTEPs
268435459
ESI: 03:00:2200:2200:22:22:22:00:00:0401
 Type: Local,Remote
 LRInterface: ae2
 State: ae1up
 Bridge port: yes
 Ready for BGP: yes
 VNI Count: 2
 10.226.14.253
03:00:22:22:22:22:22:00:00:02     LR    ae2       MAC Count: 0
 DF status: df 
 DF preference: 32767
 Nexthop group: 536870914
 VTEPs:
      10.226.14.253202 df_alg: admin@Leaf2# run show evpn es 
Type: B bypass, L local, R remote, N non-DF 
ESIpreference df_pref: 32767 nh: 268435459


Check the VXLAN address table with the following show command.

Code Block
admin@Leaf3# run show vxlan address-table 
VNID           MAC address          Type       Interface          VTEP
-----------    Type-----------------    ES-IF-------    ----------------    ---------------
99            VTEPs 0304:00f8:22f8:2220:22:22:22:00:00:0467:7b    Dynamic LRN    ae1                   10.226.14.254
03:00:22:22:22:22:22:00:00:02  
99             18:5a:58:37:55:e1    Dynamic        LRN    ae2            10.226.14.254

To check the EVPN ES detail information, run the following show command. This command shows important information such as ESI, Type, interface, state, DF status and the VTEPs etc.

Code Block
admin@Leaf3# run show evpn es detail 
ESI: 03:00:00:00:22:22:22:00:00:03
 Type: Local,Remote
 Interface: ae1
 State: up
 Bridge port: yes
 Ready for BGP: yes
 VNI Count: 2
 MAC Count: 0
 DF status: df 
 DF preference: 32767
 Nexthop group: 536870913
 VTEPs:
     10.226.14.202 df_alg: preference df_pref: 32767 nh: 268435459
ESI: 03:00:00:00:22:22:22:00:00:01
 Type: Local,Remote
 Interface: ae2
 State: up
 Bridge port: yes
 Ready for BGP: yes
 VNI Count: 2
 MAC Count: 0
 DF status: df 
 DF preference: 32767
 Nexthop group: 536870914
 VTEPs:253  
10020          00:1e:c9:bb:c0:3c    Dynamic       ge-1/1/19                          
10020          04:f8:f8:20:67:7b    Dynamic                        10.226.14.254  
10020          18:5a:58:37:55:e1    Dynamic                        10.226.14.202 df_alg: preference df_pref: 32767 nh: 268435459

Check the VXLAN address table with the following show command.

Code Block
admin@Leaf3# run show vxlan address-table 
VNID253  
10030          04:f8:f8:20:67:7b    Dynamic       MAC address          Type      10.226.14.254 Interface 
10030        VTEP -----------    -----------------    -------    ----------------    ---------------
99 18:5a:58:37:55:e1    Dynamic                         04:f8:f8:20:67:7b    Dynamic10.226.14.253  
10030              22:11:11:00:00:00    Dynamic       ae1 10.226.14.254   99             18:5a:58:37:55:e1    Dynamic           
Entries in access port:  2
Entries in network    10.226.14.253  
10020          00:1e:c9:bb:c0:3c    Dynamic       ge-1/1/19                          
10020          04:f8:f8:20:67:7b    Dynamic                        10.226.14.254  
10020 port: 7


To get the tunnel information within a VNI, run the following show command.

Code Block
admin@Leaf3# run show vxlan tunnel vni 10030 
Total number of tunnels: 2

VNI 10030, Encap:service-vlan-delete, Decap:service-vlan-per-port
  src addr:10.226.14.202, dst addr:10.226.14.253, state:UP
  traffic type:all
  Vtep type:EVPN 
  nexthops:10.226.15.69 10.226.15.77 
  output ports:ge-1/1/5 ge-1/1/3 

  src addr:10.226.14.202, dst addr:10.226.14.254, state:UP
  traffic type:all
  Vtep type:EVPN 
  nexthops:10.226.15.69 10.226.15.77 
  output ports:ge-1/1/5 ge-1/1/3


To get more info on interfaces belonging to a particular VNI, run the following show command.

Code Block
admin@Leaf3# run show vxlan vni 10030
Interface      ID         18:5a:58:37:55:e1    DynamicType           Egress     Vlan ID
-----------    -----------  10.226.14.253  
10030-----------    -------    --------
ae1  04:f8:f8:20:67:7b    Dynamic      0x80000005    Access          100012    10.226.14.254 30  10030    
ae2     18:5a:58:37:55:e1    Dynamic   0x80000006    Access          100013     30  10.226.14.253   10030 
ge-1/1/23      0x80000007  22:11:11:00:00:00  Access  Dynamic       ae1100014      30      
ge-1/1/5       0x80000008    Network(UC)    200258     Entries in access port:  2 Entries in network port: 7

To display the number of MACs learned both locally and remotely in a VNI run the following show command.

Code Block
admin@Leaf3# run show evpn mac vni 10030 
Number of MACs (local and remote) known for this VNI: 4
Flags: N=sync-neighs, I=local-inactive, P=peer-active, X=peer-proxy
MAC
ge-1/1/5       0x8000000a    Network(MC)    100020             
ge-1/1/5       0x8000000b Type   FlagsNetwork(UC)  Intf/Remote ES/VTEP 200258    VLAN  Seq #'s 22:11:11:00:00:00     local
ge-1/1/5   P    0x8000000d ae1   Network(MC)    100022             
ge-1/1/3 30    0/0 18:5a:58:37:55:e1  0x8000000f    remoteNetwork(MC)    100024    10.226.14.253         
ge-1/1/3       0x80000010   0/0
18:5a:58:37:64:61 Network(UC)    100017 local          vlan30


Show the VXLAN MAC address information on Leaf1. Port ge-1/1/7 is single homed host connected to a VXLAN access port in VNID 10030 with MAC address 22:00:00:00:00:00.

Code Block
admin@Leaf1# run show vxlan address-table 
VNID          30 MAC address  0/0 04:f8:f8:20:67:7b     remote  Type      10.226.14.254 Interface          VTEP
-----------        0/0

To get the tunnel information within a VNI, run the following show command.

Code Block
admin@Leaf3# run show vxlan tunnel vni 10030 
Total number of tunnels: 2

VNI 10030, Encap:service-vlan-delete, Decap:service-vlan-per-port
  src addr:10.226.14.202, dst addr:10.226.14.253, state:UP
  traffic type:all
  Vtep type:EVPN 
  nexthops:10.226.15.69 10.226.15.77 
  output ports:ge-1/1/5 ge-1/1/3 

  src addr:10.226.14.202, dst addr:10.226.14.254, state:UP
  traffic type:all
  Vtep type:EVPN 
  nexthops:10.226.15.69 10.226.15.77 
  output ports:ge-1/1/5 ge-1/1/3

To get more info on interfaces belonging to a particular VNI, run the following show command.

Code Block
admin@Leaf3# run show vxlan vni 10030
Interface      ID-----------------    -------    ----------------    ---------------
99             18:5a:58:37:55:e1    Dynamic                        10.226.14.253  
10020          18:5a:58:37:55:e1    Dynamic                        10.226.14.253  
10030          18:5a:58:37:55:e1    Dynamic                Type        10.226.14.253  
Egress10030     Vlan ID -----------    -----------    -----------   22:00:00:00:00:00    Dynamic    -------ge-1/1/7    -------- ae1            0x80000005    Access      
Entries in access 100012port:  1
Entries in 30network port: 3


Show the BGP EVPN route information.

Code Block
admin@Leaf1# run show bgp evpn ae2route
BGP table version is 19, local router ID is 10.226.14.207
Status 0x80000006codes: s suppressed, d Accessdamped, h history, * valid, > best, i - internal
100013Origin codes: i - IGP, 30e - EGP, ? - incomplete
EVPN getype-1/1/23      0x80000007    Access         100014      30 prefix: [1]:[ESI]:[EthTag]:[IPlen]:[VTEP-IP]
EVPN type-2 prefix: [2]:[EthTag]:[MAClen]:[MAC]:[IPlen]:[IP]
EVPN type-3 prefix: [3]:[EthTag]:[IPlen]:[OrigIP]
EVPN type-4 prefix: [4]:[ESI]:[IPlen]:[OrigIP]
EVPN type-5 prefix: [5]:[EthTag]:[IPlen]:[IP]

   Network          
ge-1/1/5Next Hop       0x80000008    Network(UC) Metric LocPrf Weight 200258Path
             ge-1/1/5       0x8000000aExtended Community
Route  Network(MC)    100020Distinguisher: 10.226.14.24:3
*>i[2]:[0]:[48]:[00:00:20:20:00:fe]:[32]:[192.168.20.1]
                ge-1/1/5    10.226.14.201   0x8000000b    Network(UC)    200258      100      0 i
ge-1/1/5       0x8000000d    Network(MC)    100022     RT:65001:99 RT:65001:10020 ET:8 Rmac:50:9a:4c:e6:7e:71
*>i[2]:[0]:[48]:[00:00:20:20:00:fe]:[128]:[2002:0:0:1::1]
    ge-1/1/3              0x8000000f  10.226.14.201  Network(MC)    100024           100   ge-1/1/3   0 i
  0x80000010    Network(UC)    100017          RT:65001:99 RT:65001:10020 ET:8

Show the VXLAN MAC address information on Leaf1. Port ge-1/1/7 is single homed host connected to a VXLAN access port in VNID 10030 with MAC address 22:00:00:00:00:00.

Code Block
admin@Leaf1# run show vxlan address-table 
VNIDRmac:50:9a:4c:e6:7e:71
*>i[2]:[0]:[48]:[00:00:20:20:00:fe]:[128]:[fe80::529a:4c20:1e6:7e71]
                MAC address    10.226.14.201      Type       Interface    100      VTEP
-----------0 i
   -----------------    -------    ----------------    --------------- 99    RT:65001:10020         18:5a:58:37:55:e1    DynamicET:8
*>i[2]:[0]:[48]:[00:0c:29:77:8b:15]
                       10.226.14.253201   10020          18:5a:58:37:55:e1    Dynamic100      0 i
                10.226.14.253   10030          18:5a:58:37:55:e1    Dynamic RT:65001:10020 ET:8
*>i[2]:[0]:[48]:[00:0c:29:77:8b:15]:[128]:[fe80::20c:29ff:fe77:8b15]
                       10.226.14.253201   10030          22:00:00:00:00:00    Dynamic100    ge-1/1/7  0 i
                    RT:65001:10020 ET:8
Route 
Entries in access port:  1
Entries in network port: 3

Show the BGP EVPN route information.

Code Block
admin@Leaf1# run show bgp evpn route
BGP table version is 19, local router ID isDistinguisher: 10.226.14.24:4
*>i[2]:[0]:[48]:[00:00:30:30:00:fe]:[32]:[192.168.30.1]
                    10.226.14.207
Status codes: s suppressed, d damped, h history, * valid, > best, i - internal
Origin codes: i - IGP, e - EGP, ? - incomplete
EVPN type-1 prefix: [1]:[ESI]:[EthTag]:[IPlen]:[VTEP-IP]
EVPN type-2 prefix: [2]:[EthTag]:[MAClen]:[MAC]:[IPlen]:[IP]
EVPN type-3 prefix: [3]:[EthTag]:[IPlen]:[OrigIP]
EVPN type-4 prefix: [4]:[ESI]:[IPlen]:[OrigIP]
EVPN type-5 prefix: [5]:[EthTag]:[IPlen]:[IP]

   Network          Next Hop201                 100      0 i
                    RT:65001:99 RT:65001:10030 ET:8 Rmac:50:9a:4c:e6:7e:71
*>i[2]:[0]:[48]:[00:00:30:30:00:fe]:[128]:[2003:0:0:1::1]
                    10.226.14.201                 100  Metric  LocPrf Weight Path0 i
                   Extended Community
Route Distinguisher: 10.226.14.24:3RT:65001:99 RT:65001:10030 ET:8 Rmac:50:9a:4c:e6:7e:71
*>i[2]:[0]:[48]:[00:00:2030:2030:00:fe]:[32128]:[192.168.20.1fe80::529a:4c20:2e6:7e71]
                    10.226.14.201                 100      0 i
                    RT:65001:99 RT:65001:10020 10030 ET:8
Rmac:50:9a:4c:e6:7e:71
**>i[2]:[0]:[48]:[00:000c:2029:2077:00:fe]:[128]:[2002:0:0:1::18b:15]
                    10.226.14.201                 100      0 i
                    RT:65001:99 RT:65001:1002010030 ET:8
Route Rmac:50:9a:4c:e6:7e:71Distinguisher: 10.226.14.48:3
*>i[21]:[0]:[48]03:[00:00:20:2022:22:22:22:22:00:00:fe01]:[12832]:[fe80::529a:4c20:1e6:7e710.0.0.0]
                    10.226.14.201202                 100      0 i
                    RT:65001:10020 ET:8
*>i[21]:[0]:[48]03:[00:0c:29:77:8b:1522:22:22:22:22:00:00:02]:[32]:[0.0.0.0]
                    10.226.14.201202                 100      0 i
                    RT:65001:10020 ET:8
*>i[2]:[0Route Distinguisher: 10.226.14.48:4
*>i[1]:[484294967295]:[03:00:0c:29:77:8b:15:22:22:22:22:22:00:00:01]:[12832]:[fe80::20c:29ff:fe77:8b150.0.0.0]
                    10.226.14.201202                 100      0 i
                    RT:65001:10020 RT:65001:10030 ET:8 Route Distinguisher: 10.226.14.24:4
ESI-label-Rt:AA
*>i[24]:[0]:[48]:[00:00:30:3003:00:22:22:22:22:22:00:00:fe01]:[32]:[19210.168226.3014.1202]
                    10.226.14.201202                 100      0 i
                    RT:65001:99 RT:65001:10030 ET:8 Rmac:50:9a:4c:e6:7e:71
*>i[2]:[0]:[48]:[00:00:30:30:00:fe]:[128]:[2003:0:0:1::1ES-Import-Rt:00:22:22:22:22:22 DF: (alg: 2, pref: 32767)
Route Distinguisher: 10.226.14.48:5
*>i[1]:[4294967295]:[03:00:22:22:22:22:22:00:00:02]:[32]:[0.0.0.0]
                    10.226.14.201202                 100      0 i
                    RT:65001:9910020 RT:65001:10030 ET:8 Rmac:50:9a:4c:e6:7e:71ESI-label-Rt:AA
*>i[24]:[0]:[48]:[00:00:30:3003:00:22:22:22:22:22:00:00:fe02]:[12832]:[fe80::529a:4c20:2e6:7e7110.226.14.202]
                    10.226.14.201202                 100      0 i

                   RT:65001:10030 ET:8 *>i[2]:[0]:[48]:[00:0c:29:77:8b:15]
                    10.226.14.201                 100      0 i
                    RT:65001:10030 ET:8ES-Import-Rt:00:22:22:22:22:22 DF: (alg: 2, pref: 32767)
Route Distinguisher: 10.226.14.48:36
*>i[1]:[0]:[03:00:22:22:22:22:22:00:00:01]:[32]:[0.0.0.0]
                    10.226.14.202                 100      0 i
                    RT:65001:1002010030 ET:8
*>i[1]:[0]:[03:00:22:22:22:22:22:00:00:02]:[32]:[0.0.0.0]
                    10.226.14.202                 100      0 i
                    RT:65001:1002010030 ET:8
Route Distinguisher: 10.226.14.48:4
*>i[12]:[42949672950]:[0348]:[00:221e:22c9:22bb:22:22:00:00:01c0:3c]:[32]:[0192.0168.030.042]
                    10.226.14.202                 100      0 i
                    RTESI:6500103:10020 RT:00:22:22:22:22:22:00:00:01 VNI: 0
                    RT:65001:99 RT:65001:10030 ET:8 ESI-label-Rt:AARmac:18:5a:58:37:64:61
*>i[2]:[40]:[0348]:[00:221e:22c9:22bb:22:22:00:00:01c0:3c]:[32128]:[10.226.14.2022003:0:0:1::42]
                    10.226.14.202                 100      0 i
                    ET:8 ES-Import-RtESI:03:00:22:22:22:22:22 DF: (alg: 2, pref: 32767)
Route Distinguisher: 10.226.14.48:5
*>i[1]:[4294967295]:[03:00:22:22:22:22:22:00:00:02]:[32]:[0.0.0.0:00:00:01 VNI: 0
                    RT:65001:99 RT:65001:10030 ET:8 Rmac:18:5a:58:37:64:61
*>i[2]:[0]:[48]:[00:1e:c9:bb:c0:3c]:[128]:[fe80::21e:c9ff:febb:c03c]
                    10.226.14.202                 100      0 i

                   RT:65001:10020 RT:65001:10030 ET:8 ESI-label-Rt:AA
*>i[4]:[03:00:22:22:22:22:22:00:00:02]:[32]:[10.226.14.202]01 VNI: 0
                    RT:65001:10030 ET:8
Route Distinguisher: 10.226.14.202207:3
                100      0 i
                    ET:8 ES-Import-Rt:00:22:22:22:22:22 DF: (alg: 2, pref: 32767)
Route Distinguisher: 10.226.14.48:6
*>i[1*> [1]:[0]:[03:00:22:22:22:22:22:00:00:01]:[32128]:[0.0.0.0::]
                    10.226.14.202 254                100      032768 i
                    ET:8 RT:65001:10030 ET:8
*>i10020
*> [1]:[0]:[03:00:22:22:22:22:22:00:00:02]:[32128]:[0.0.0.0::]
                    10.226.14.202 254                100      032768 i
                    ET:8 RT:65001:1003010020
ET:8
*>i*> [2]:[0]:[48]:[00:1e00:c920:bb00:c0:3c]:[32]:[192.168.30.4200:fe]
                    10.226.14.202254                 100      032768 i
                    ESI:03:00:22:22:22:22:22:00:00:01 VNI: 0
                    ET:8 RT:65001:99 RT:65001:10030 ET:8 Rmac:18:5a:58:37:64:61
*>i10020
*> [2]:[0]:[48]:[00:1e00:c920:bb00:c000:3cfe]:[12832]:[2003:0:0:1::42192.168.20.2]
                    10.226.14.202254                 100     32768 0 i
                    ESIET:038 RT:0065001:2210020 RT:22:22:22:2265001:99 Rmac:04:f8:f8:20:67:7b
*> [2]:[0]:[48]:[00:00:20:00:00:01 VNI: 0:fe]:[128]:[2002:0:0:1::2]
                    10.226.14.254                      32768 i
                    ET:8 RT:65001:9910020 RT:65001:1003099 ET:8 Rmac:1804:5af8:58f8:3720:6467:617b
*>i> [2]:[0]:[48]:[00:1e00:c920:bb00:c000:3cfe]:[128]:[fe80::21e6f8:c9fff810:febb120:c03c677b]
                    10.226.14.202254                 100     32768 0 i
                    ESI:03:00:22:22:22:22:22:00:00:01 VNI: 0
                    ET:8 RT:65001:10030 ET:810020
Route Distinguisher: 10.226.14.207:34
*> [1]:[04294967295]:[03:00:22:22:22:22:22:00:00:01]:[128]:[::]
                    10.226.14.254                      32768 i
                    ET:8 ESI-label-Rt:AA RT:65001:10020 RT:65001:10030
*> [14]:[0]:[03:00:22:22:22:22:22:00:00:0201]:[12832]:[::10.226.14.254]
                    10.226.14.254                      32768 i
                    ET:8 RT:65001:10020 ES-Import-Rt:00:22:22:22:22:22 DF: (alg: 2, pref: 1)
Route Distinguisher: 10.226.14.207:5
*> [21]:[04294967295]:[48]03:[00:00:2022:22:22:22:22:00:00:fe02]:[128]:[::]
                    10.226.14.254                      32768 i
                    ET:8 ESI-label-Rt:AA RT:65001:10020 RT:65001:10030
*> [24]:[0]:[48]:[00:00:2003:00:22:22:22:22:22:00:00:fe02]:[32]:[19210.168226.2014.2254]
                    10.226.14.254                      32768 i
                    ET:8 RT:65001:10020 RT:65001:99 Rmac:04:f8:f8:20:67:7bES-Import-Rt:00:22:22:22:22:22 DF: (alg: 2, pref: 1)
Route Distinguisher: 10.226.14.207:6
*> [21]:[0]:[48]03:[00:00:20:22:22:22:22:22:00:00:fe01]:[128]:[2002:0:0:1::2]
                    10.226.14.254                      32768 i
                    ET:8 RT:65001:10020 RT:65001:99 Rmac:04:f8:f8:20:67:7b
10030
*> [21]:[0]:[48]03:[00:00:20:22:22:22:22:22:00:00:fe02]:[128]:[fe80::6f8:f810:120:677b]
                    10.226.14.254                      32768 i
                    ET:8 RT:65001:10020
Route Distinguisher: 10.226.14.207:410030
*> [12]:[42949672950]:[0348]:[00:22:22:22:22:22:00:30:00:00:01]:[128]:[::fe]
                    10.226.14.254                      32768 i
                    ET:8 ESI-label-Rt:AA RT:65001:10020 RT:65001:10030
*> [2]:[40]:[0348]:[00:22:22:22:22:22:00:30:00:00:01fe]:[32]:[10192.226168.1430.2542]
                    10.226.14.254                      32768 i
                    ET:8 ES-Import-Rt:00:22:22:22:22:22 DF: (alg: 2, pref: 1)
Route Distinguisher: 10.226.14.207:5
*> [1]:[4294967295]:[03:00:22:22:22:22:22RT:65001:10030 RT:65001:99 Rmac:04:f8:f8:20:67:7b
*> [2]:[0]:[48]:[00:00:30:00:00:02fe]:[128]:[2003:0:0:1::2]
                    10.226.14.254                      32768 i
                    ET:8 ESI-label-Rt:AART:65001:10030 RT:65001:10020 RT:65001:1003099 Rmac:04:f8:f8:20:67:7b
*> [2]:[40]:[0348]:[00:22:22:22:22:2200:30:00:00:02fe]:[32128]:[10.226.14.254fe80::6f8:f810:220:677b]
                    10.226.14.254                      32768 i
                    ET:8 ES-Import-Rt:00:22:22:22:22:22 DF: (alg: 2, pref: 1)
Route Distinguisher: 10.226.14.207:6
RT:65001:10030
*> [12]:[0]:[0348]:[00:221e:22c9:22bb:22:22:00:00:01c0:3c]:[12832]:[::192.168.30.42]
                    10.226.14.254                      32768 i
                    ESI:03:00:22:22:22:22:22:00:00:01
                    ET:8 RT:65001:10030 RT:65001:99 Rmac:04:f8:f8:20:67:7b ND:Proxy
*> [12]:[0]:[0348]:[00:221e:22c9:22bb:22:22:00:00:02c0:3c]:[128]:[2003:0:0:1::42]
                    10.226.14.254                      32768 i
                    ETESI:8 RT03:65001:10030
*> [2]:[0]:[48]:[00:00:3000:22:22:22:22:22:00:00:fe]
                    10.226.14.254                      32768 i01
                    ET:8 RT:65001:10030 RT:65001:99 Rmac:04:f8:f8:20:67:7b ND:Proxy
*> [2]:[0]:[48]:[00:001e:30c9:00bb:00c0:fe3c]:[32128]:[192.168.30.2fe80::21e:c9ff:febb:c03c]
                    10.226.14.254                      32768 i
                    ETESI:8 RT03:6500100:10030 RT22:6500122:99 Rmac22:0422:f822:f800:20:67:7b
*> [2]:[0]:[48]:[00:00:3000:01
                    ET:8 RT:65001:10030 ND:Proxy
Route Distinguisher: 10.226.14.208:3
*>i[1]:[0]:[03:00:22:22:22:22:22:00:00:fe01]:[12832]:[2003:0:0:1::20.0.0.0]
                    10.226.14.254253                 100     32768 0 i
                    ET:8 RT:65001:1003010020 RT:65001:99 Rmac:04:f8:f8:20:67:7b
*> [2ET:8
*>i[1]:[0]:[48]03:[00:00:3022:22:22:22:22:00:00:fe02]:[12832]:[fe80::6f8:f810:220:677b0.0.0.0]
                    10.226.14.254253                 100     32768 0 i
                    ET:8 RT:65001:10030
*> [210020 ET:8
Route Distinguisher: 10.226.14.208:4
*>i[1]:[04294967295]:[48]03:[00:1e:c9:bb:c0:3c:22:22:22:22:22:00:00:01]:[32]:[1920.1680.300.420]
                    10.226.14.254253                 100     32768 0 i
                    RT:65001:10020 RT:65001:10030 ET:8 ESI-label-Rt:AA
*>i[4]:[03:00:22:22:22:22:22:00:00:01]:[32]:[10.226.14.253]
                    10.226.14.253         ET:8 RT:65001:10030 RT:65001:99 Rmac:04:f8:f8:20:67:7b ND:Proxy *> [2]:[0]:[48]:[00:1e:c9:bb:c0:3c]:[128]:[2003:0:0:1::42   100      0 i
                    ET:8 ES-Import-Rt:00:22:22:22:22:22 DF: (alg: 2, pref: 32767)
Route Distinguisher: 10.226.14.208:5
*>i[1]:[4294967295]:[03:00:22:22:22:22:22:00:00:02]:[32]:[0.0.0.0]
                    10.226.14.254253                 100      327680 i
                    ESIRT:0365001:0010020 RT:2265001:22:22:22:22:00:00:01
                    ET:8 RT:65001:10030 RT:65001:99 Rmac:04:f8:f8:20:67:7b ND:Proxy
*> [2]:[0]:[48]:[00:1e:c9:bb:c0:3c]:[128]:[fe80::21e:c9ff:febb:c03c10030 ET:8 ESI-label-Rt:AA
*>i[4]:[03:00:22:22:22:22:22:00:00:02]:[32]:[10.226.14.253]
                    10.226.14.254253                 100     32768 0 i
                    ESI:03ET:8 ES-Import-Rt:00:22:22:22:22:22 DF:00:00:01
                    ET:8 RT:65001:10030 ND:Proxy
Route Distinguisher: 10.226.14.208:3
*>i[ (alg: 2, pref: 32767)
Route Distinguisher: 10.226.14.208:6
*>i[1]:[0]:[03:00:22:22:22:22:22:00:00:01]:[32]:[0.0.0.0]
                    10.226.14.253                 100      0 i
                    RT:65001:1002010030 ET:8
*>i[1]:[0]:[03:00:22:22:22:22:22:00:00:02]:[32]:[0.0.0.0]
                    10.226.14.253                 100      0 i
                    RT:65001:1002010030 ET:8
Route Distinguisher: 10.226.14.208:4
*>i[12]:[42949672950]:[0348]:[00:221e:22c9:22bb:22:22:00:00:01c0:3c]:[32]:[0192.0168.030.042]
                    10.226.14.253                 100      0 i
 
                  RT:65001:10020 RT:65001:10030 ET:8 ESI-label-Rt:AA
*>i[4]:[03:00:22:22:22:22:22:00:00:01]:[32]:[10.226.14.253]
 VNI: 0
                   10.226.14.253                 100      0 i
                    ET:8 ES-Import-Rt:00:22:22:22:22:22 DF: (alg: 2, pref: 32767)
Route Distinguisher: 10.226.14.208:5
*>i[1]:[4294967295]:[03:00:22:22:22:22:22:00:00:02]:[32]:[0.0.0.0 RT:65001:99 RT:65001:10030 ET:8 Rmac:18:5a:58:37:55:e1 ND:Proxy
*>i[2]:[0]:[48]:[00:1e:c9:bb:c0:3c]:[128]:[2003:0:0:1::42]
                    10.226.14.253                 100      0 i
                    RTESI:03:6500100:10020 RT22:6500122:10030 ET:8 ESI-label-Rt:AA
*>i[4]:[03:00:22:22:22:22:22:00:00:02]:[32]:[10.226.14.25322:22:22:00:00:01 VNI: 0
                    RT:65001:99 RT:65001:10030 ET:8 Rmac:18:5a:58:37:55:e1 ND:Proxy
*>i[2]:[0]:[48]:[00:1e:c9:bb:c0:3c]:[128]:[fe80::21e:c9ff:febb:c03c]
                    10.226.14.253                 100      0 i
                    ET:8 ES-Import-RtESI:03:00:22:22:22:22:22 DF: (alg: 2, pref: 32767)
Route Distinguisher: 10.226.14.208:6
*>i[1]:[0]:[03:00:22:22:22:22:22:00:00:01]:[32]:[0.0:00:00:01 VNI: 0
                    RT:65001:10030 ET:8 ND:Proxy
Route Distinguisher: 24.24.24.24:2
*>i[5]:[0]:[24]:[172.16.0.0]
                    10.226.14.253201            0     100      0 i?
                    RT:65001:1003099 ET:8 Rmac:50:9a:4c:e6:7e:71
*>i[15]:[0]:[03:00:22:22:22:22:22:00:00:0224]:[32]:[0.0.0192.168.20.0]
                    10.226.14.253201            0     100      0 i?
                    RT:65001:1003099 ET:8 Rmac:50:9a:4c:e6:7e:71
*>i[25]:[0]:[4824]:[00:1e:c9:bb:c0:3c]:[32]:[192.168.30.42]192.168.30.0]
                    10.226.14.253201            0     100      0 i
                    ESI:03:00:22:22:22:22:22:00:00:01 VNI: 0?
                    RT:65001:99 RT:65001:10030 ET:8 Rmac:1850:5a9a:584c:37e6:557e:e171
ND:Proxy
*>i[25]:[0]:[4864]:[00:1e:c9:bb:c0:3c]:[128]:[2003:2002:0:0:1::42]
                    10.226.14.253201            0     100      0 i?
                    ESIRT:0365001:00:22:22:22:22:22:00:00:01 VNI: 099 ET:8 Rmac:50:9a:4c:e6:7e:71
*>i[5]:[0]:[64]:[2003:0:0:1::]
                    10.226.14.201            0    100      0 ?
                    RT:65001:99 RT:65001:10030 ET:8 Rmac:1850:5a9a:584c:37e6:557e:e171
ND:Proxy
*>i[25]:[0]:[4864]:[002006:1e0:c90:bb1:c0:3c]:[128]:[fe80::21e:c9ff:febb:c03c]
                    10.226.14.253                 100      0 i
                    ESI:03:00:22:22:22:22:22:00:00:01 VNI: 0
                    RT:65001:10030 ET:8 ND:Proxy
Route Distinguisher: 24.24.24.24:2
*>i[5]:[0]:[24]:[172.16.0.0]
                    10.226.14.201            0    100      0 ?
                    RT:65001:99 ET:8 Rmac:50:9a:4c:e6:7e:71
*>i[5]:[0]:[24]:[192.168.20.0]
                    10.226.14.201            0    100      0 ?
                    RT:65001:99 ET:8 Rmac:50:9a:4c:e6:7e:71
*>i[5]:[0]:[24]:[192.168.30.0]
                    10.226.14.201            0    100      0 ?
                    RT:65001:99 ET:8 Rmac:50:9a:4c:e6:7e:71
*>i[5]:[0]:[64]:[2002:0:0:1::]
                    10.226.14.201            0    100      0 ?
                    RT:65001:99 ET:8 Rmac:50:9a:4c:e6:7e:71
*>i[5]:[0]:[64]:[2003:0:0:1::]
                    10.226.14.201            0    100      0 ?
       ]
                    10.226.14.201            0    100      0 ?
                    RT:65001:99 ET:8 Rmac:50:9a:4c:e6:7e:71

Displayed 56 prefixes (56 paths)

EVPN Multihoming with BUM Tunnel

To enable EVPN multihoming with BUM tunnel, besides above configurations of head end replication, we need to add the following configurations:

  • Configure PIM on each device, and configure one of the devices as static RP (Spine2 in this example).
  • Configure the same VNI to join the same multicast group.

Leaf1 Configuration

Step 1. Configure PIM and configure Spine2 as static RP.

Code Block
admin@Leaf1# set protocols pim rp 202.202.202.202 group 224.1.1.1/32
admin@Leaf1# set protocols pim rp 202.202.202.202 group 230.1.1.1/32
admin@Leaf1# set protocols pim interface lo
admin@Leaf1# set protocols pim interface vlan4014
admin@Leaf1# set protocols pim interface vlan4012

Step 2. Configure the same VNI to join the same multicast group.

Code Block
admin@Leaf1# set vxlans vni 10020 mcast-group 224.1.1.1
admin@Leaf1# set vxlans vni 10030 mcast-group 230.1.1.1
admin@Leaf1# commit

Leaf2 Configuration

Code Block
admin@Leaf2# set protocols pim rp 202.202.202.202 group 224.1.1.1/32
admin@Leaf2# set protocols pim rp 202.202.202.202 group 230.1.1.1/32
admin@Leaf2# set protocols pim interface lo
admin@Leaf2# set protocols pim interface vlan4014
admin@Leaf2# set protocols pim interface vlan4013
admin@Leaf2# set vxlans vni 10020 mcast-group 224.1.1.1
admin@Leaf2# set vxlans vni 10030 mcast-group 230.1.1.1
admin@Leaf2# commit

Leaf3 Configuration

Code Block
admin@Leaf3# set protocols pim rp 202.202.202.202 group 224.1.1.1/32
admin@Leaf3# set protocols pim rp 202.202.202.202 group 230.1.1.1/32
admin@Leaf3# set protocols pim interface lo
admin@Leaf3# set protocols pim interface vlan4016
admin@Leaf3# set protocols pim interface vlan3012
admin@Leaf3# set vxlans vni 10020 mcast-group 224.1.1.1
admin@Leaf3# set vxlans vni 10030 mcast-group 230.1.1.1
admin@Leaf3# commit

Leaf4 Configuration

Code Block
admin@Leaf4# set protocols pim rp 202.202.202.202 group 224.1.1.1/32
admin@Leaf4# set protocols pim rp 202.202.202.202 group 230.1.1.1/32
admin@Leaf4# set protocols pim interface lo
admin@Leaf4# set protocols pim interface vlan3011
admin@Leaf4# set protocols pim interface vlan3012
admin@Leaf4# set vxlans vni 10020 mcast-group 224.1.1.1
admin@Leaf4# set vxlans vni 10030 mcast-group 230.1.1.1
admin@Leaf4# commit

Spine1 Configuration

Code Block
admin@Spine1# set protocols pim rp 202.202.202.202 group 224.1.1.1/32
admin@Spine1# set protocols pim rp 202.202.202.202 group 230.1.1.1/32
admin@Spine1# set protocols pim interface lo
admin@Spine1# set protocols pim interface vlan4011
admin@Spine1# set protocols pim interface vlan4092
admin@Spine1# set protocols pim interface vlan4014
admin@Spine1# set protocols pim interface vlan4013
admin@Spine1# set protocols pim interface vlan4015
admin@Spine1# set protocols pim interface vlan4016
admin@Spine1# commit

Spine2 Configuration

Code Block
admin@Spine2# set protocols pim rp 202.202.202.202 group 224.1.1.1/32
admin@Spine2# set protocols pim rp 202.202.202.202 group 230.1.1.1/32
admin@Spine2# set protocols pim interface lo
admin@Spine2# set protocols pim interface vlan4011
admin@Spine2# set protocols pim interface vlan4092
admin@Spine2# set protocols pim interface vlan4012
admin@Spine2# set protocols pim interface vlan4014
admin@Spine2# set protocols pim interface vlan4015
admin@Spine2# commit

Verify Configuration

In addition to the above show command to verify the results, you can also use the run show vxlan mcast tunnel VNI command to view the establishment of the BUM tunnel.

The following example shows the result on Leaf 3:

Code Block
admin@Leaf3# run show vxlan mcast-tunnel vni 10020
VNI       Src-addr         Mcast-addr       Out-Vlan  Out-Interface    Tunnel-ID     Egress-ID
--------  ---------------  ---------------  --------  ---------------  ------------  ------------
10020     10.226.14.201    224.1.1.1        3012      ge-1/1/5         0x4c000000    0           

admin@Leaf3# run show vxlan mcast-tunnel vni 10030
VNI       Src-addr         Mcast-addr    RT:65001:99 ET:8 Rmac:50:9a:4c:e6:7e:71
*>i[5]:[0]:[64]:[2006:0:0:1::]
  Out-Vlan  Out-Interface    Tunnel-ID     Egress-ID
--------  ---------------  ---------------  --------   10.226.14.201    ---------------  ------------  ------------
10030     10.226.14.201   0 230.1.1.1   100     3012 0 ?    ge-1/1/5         0x4c000001    0    RT:65001:99 ET:8 Rmac:50:9a:4c:e6:7e:71  Displayed 56 prefixes (56 paths)