Show Menu
Cheatography

Arista VXLAN Indirect Routing Cheat Sheet (DRAFT) by

Details on VXLAN Indirect Routing Model

This is a draft cheat sheet. It is a work in progress and is not finished yet.

VXLAN Indirect Routing

To route between VLANs which are crossing the VXLAN overlay (also known as "­str­etc­hed­" or "­ext­end­ed" VLANs), Switched Virtual Interfaces (SVIs) need to be added to the VTEPs to perform the routing. With the indirect routing model, the dest host is not directly attached to the VTEP(s) where the SVIs are config­ured. As packets might need to go through multiple hops in the overlay to reach the final destin­ation, this model is called "­ind­ire­ct". This scales better than direct routing as each VTEP is only respon­sible for routing a subset of the overlay subnets (fewer ARP entries, fewer routes.)

VXLAN and NAT cannot coexist on a switch.

 

Simple Topology

Troubl­esh­ooting

show interface vxlan 1
should be "­up"; correctly reflect configured VLAN-t­o-VNI mappings; confirm control plane (multi­cast, HER, CVX, EVPN)
show mac addres­s-table
The L2 forwarding table should show that mac addresses are either learned locally or from across the VXLAN overlay - "­Vx1­"; if we are not learning MACs from another VTEP confirm flood list and L3 reacha­bility between VTEPs
show vxlan addres­s-table
Shows the VXLAN MAC info, including the Host MAC, remote VTEP IP, and MAC moves.
show ip route
All VTEP IPs (primary and secondary) should have L3 reacha­bility (ping to confirm)
show vxlan counters software
See "­Arista VXLAN Bridgi­ng" for more info.
show platform fap arp
Confirm ARP in hardware.
show platform fap ip route
Confirms the prefix points to an L3Floo­dFap0 interface used for recirc­ula­tion. These ports are 100G.
VXLAN encaps­ulated protocol packets (BGP/I­SIS­/OSPF) use the CoppSy­ste­mL2­Bcast queue.
 

Config­uration

VTEP1
Configure a loopback as the L3 source interface for the VXLAN tunnel/VTEP.
!
interface loopback 1 
  ip address 1.1.1.1/32 
Configure a second IP, the virtual VTEP IP, on routing VTEPs.
  ip address 100.100.100.100/32 secondary
!
Add DGs for routing - aka "anycast gateway"; can use VARP as seen here or "ip address virtual" to save IP space.
!
interface vlan 10
  ip address 10.0.0.1/24
  ip virtual-router address 10.0.0.254
!
Configure the VXLAN tunnel interface.
!
interface vxlan 1
Add the source interface configured earlier.
  vxlan source-interface loopback1
Configure the UDP destination port; be consistent across VTEPs.
  vxlan udp-port 4789
Configure the VLAN to VNI bindings for any extended VLANs.
  vxlan vlan 10 vni 10010
Configure the static flood-set if using HER for control-plane; include all VTEP IPs that need to receive BUM traffic.
  vxlan flood vtep 2.2.2.2 3.3.3.3
!
Configure the virtual MAC to be used with all virtual IPs.
!
ip virtual-router mac-address 00:00:11:22:33:44
!
Ensure routing is enabled.
ip routing
!

VTEP2
!
interface loopback 1 
  ip address 2.2.2.2/32
Ensure the virtual VTEP IP is identical across all routing VTEPs.
  ip address 100.100.100.100/32 secondary
!
interface vlan 10
Here using "ip address virtual" as the anycast gateway IP.
  ip address virtual 10.0.0.254/24
!
interface vlan 20
  ip address virtual 20.0.0.254/24
!
interface vxlan 1
  vxlan source-interface loopback1
  vxlan udp-port 4789
  vxlan vlan 10 vni 10010
  vxlan vlan 20 vni 10020
  vxlan flood vtep 1.1.1.1 3.3.3.3
!
ip virtual-router mac-address 00:00:11:22:33:44
!
ip routing
!

VTEP 3
!
interface loopback 1
  ip address 3.3.3.3/32 
  ip address 100.100.100.100/32 secondary
!
interface vxlan 1
  vxlan source-interface loopback1
  vxlan udp-port 4789
  vxlan vlan 30 vni 10030
  vxlan flood vtep 1.1.1.1 2.2.2.2
!
ip routing
All routing VTEPs have secondary IPs, called Virtual VTEP IPs, configured that are identical.

In order to learn routes to remote destin­ations, routing protocols such as OSPF/B­GP/ISIS can be configured in the overlay.

There is no "­ind­ire­ct" specific config­uration necessary.