- 
                Notifications
    You must be signed in to change notification settings 
- Fork 391
T7949: VPP add the ability to configure bond subinterfaces for NAT #4808
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: current
Are you sure you want to change the base?
Conversation
| 👍 | 
| CI integration 👍 passed! Details
 | 
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Unfortunately, NAT does not work
VPP
set interfaces ethernet eth0 address '192.168.122.101/24'
set interfaces ethernet eth1
set system option kernel memory hugepage-size 2M hugepage-count '1800'
set vpp settings interface eth0 driver 'dpdk'
set vpp settings interface eth1 dpdk-options promisc
set vpp settings interface eth1 driver 'dpdk'
set vpp settings unix poll-sleep-usec '2222'
set vpp interfaces bonding bond1 kernel-interface 'vpptun1'
set vpp interfaces bonding bond1 member interface 'eth1'
set vpp kernel-interfaces vpptun1 vif 12 address '100.64.12.1/24'
set vpp nat44 address-pool translation address '192.168.122.101'
set vpp nat44 interface inside 'bond1.12'
set vpp nat44 interface outside 'eth0'
client:
set interfaces bonding bond1 member interface 'eth1'
set interfaces bonding bond1 vif 12 address '100.64.12.2/24'
set protocols static route 0.0.0.0/0 next-hop 100.64.12.1
The client can ping only its own gateway and nothing else
As we can see in the dump (r1-vpp eth0) packets are not NATted
 
show Trace
vpp# show trace     
------------------- Start of thread 0 vpp_main -------------------
Packet 1
00:32:31:348445: dpdk-input
  eth1 rx queue 0
  buffer 0x8e1a5: current data 0, length 124, buffer-pool 0, ref-count 1, trace handle 0x0
                  ext-hdr-valid 
  PKT MBUF: port 1, nb_segs 1, pkt_len 124
    buf_len 2176, data_len 124, ol_flags 0x0, data_off 128, phys_addr 0x197869c0
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  SLOW_PROTOCOLS: 0c:9f:74:88:00:01 -> 01:80:c2:00:00:02
00:32:31:350739: bond-input
  src 0c:9f:74:88:00:01, dst 01:80:c2:00:00:02, eth1 -> eth1
00:32:31:350743: ethernet-input
  SLOW_PROTOCOLS: 0c:9f:74:88:00:01 -> 01:80:c2:00:00:02
00:32:31:350745: lacp-input
  eth1:
Length: 110
  LACPv1
  Actor Information TLV: length 20
    System da:f4:f6:a6:96:4e
    System priority 65535                                                      
    Key 15
    Port priority 255
    Port number 1
    State 0x3d
      LACP_STATE_LACP_ACTIVITY (0)
      LACP_STATE_AGGREGATION (2)
      LACP_STATE_SYNCHRONIZATION (3)
      LACP_STATE_COLLECTIING (4)
      LACP_STATE_DISTRIBUTING (5)
  Partner Information TLV: length 20
    System 0c:f0:ff:a1:00:01
    System priority 65535
    Key 5
    Port priority 255
    Port number 1
    State 0x3f
      LACP_STATE_LACP_ACTIVITY (0)
      LACP_STATE_LACP_TIMEOUT (1)
      LACP_STATE_AGGREGATION (2)
      LACP_STATE_SYNCHRONIZATION (3)
      LACP_STATE_COLLECTIING (4)
      LACP_STATE_DISTRIBUTING (5)
  0x0000:  0101 0114 ffff daf4 f6a6 964e 000f 00ff                             
  0x0010:  0001 3d00 0000 0214 ffff 0cf0 ffa1 0001
  0x0020:  0005 00ff 0001 3f00 0000 0310 0000 0000
  0x0030:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0040:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0050:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0060:  0000 0000 0000 0000 0000 0000 0000
00:32:31:350746: error-drop
  rx:eth1
00:32:31:350747: drop
  lacp-input: good lacp packets -- cache hit
Packet 2
00:32:31:556946: dpdk-input
  eth1 rx queue 0
  buffer 0x95129: current data 0, length 102, buffer-pool 0, ref-count 1, trace handle 0x1
                  ext-hdr-valid 
  PKT MBUF: port 1, nb_segs 1, pkt_len 102
    buf_len 2176, data_len 102, ol_flags 0x0, data_off 128, phys_addr 0x19544ac0
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  IP4: da:f4:f6:a6:96:4e -> 02:fe:22:cd:c5:82 802.1q vlan 12                   
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x8857 dscp CS0 ecn NON_ECN
    fragment id 0x400e, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x1bad id 2959
00:32:31:559246: bond-input
  src da:f4:f6:a6:96:4e, dst 02:fe:22:cd:c5:82, eth1 -> BondEthernet1
00:32:31:559249: ethernet-input
  IP4: da:f4:f6:a6:96:4e -> 02:fe:22:cd:c5:82 802.1q vlan 12
00:32:31:559251: ip4-input
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x8857 dscp CS0 ecn NON_ECN
    fragment id 0x400e, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x1bad id 2959
00:32:31:559253: ip4-sv-reassembly-feature
  [not-fragmented]
00:32:31:559254: nat-pre-in2out
  in2out next_index 2 arc_next_index 10
00:32:31:559255: nat44-ed-in2out
  NAT44_IN2OUT_ED_FAST_PATH: sw_if_index 7, next index 3
  search key local 100.64.12.2:2959 remote 1.1.1.1:2959 proto ICMP fib 0 thread-index 0 session-index 0
00:32:31:559258: nat44-ed-in2out-slowpath
  NAT44_IN2OUT_ED_SLOW_PATH: sw_if_index 7, next index 10                      
00:32:31:559259: ip4-lookup
  fib 0 dpo-idx 14 flow hash: 0x00000000
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x8857 dscp CS0 ecn NON_ECN
    fragment id 0x400e, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x1bad id 2959
00:32:31:559261: ip4-rewrite
  tx_sw_if_index 1 dpo-idx 14 : ipv4 via 192.168.122.1 eth0: mtu:1500 next:5 flags:[] 525400d4d9a10cf0ffa100000800 flow hash: 0x00000000
  00000000: 525400d4d9a10cf0ffa10000080045000054400e40003f01895764400c020101
  00000020: 010108001bad0b8f001de996fb680000000025d40700000000001011
00:32:31:559262: eth0-output
  eth0 flags 0x1018000d
  IP4: 0c:f0:ff:a1:00:00 -> 52:54:00:d4:d9:a1
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 63, length 84, checksum 0x8957 dscp CS0 ecn NON_ECN
    fragment id 0x400e, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x1bad id 2959
00:32:31:559264: eth0-tx
  eth0 tx queue 0
  buffer 0x95129: current data 4, length 98, buffer-pool 0, ref-count 1, trace handle 0x1
                  ext-hdr-valid                                                
                  vlan-1-deep l2-hdr-offset 0 l3-hdr-offset 18 
  PKT MBUF: port 1, nb_segs 1, pkt_len 98
    buf_len 2176, data_len 98, ol_flags 0x0, data_off 132, phys_addr 0x19544ac0
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  IP4: 0c:f0:ff:a1:00:00 -> 52:54:00:d4:d9:a1
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 63, length 84, checksum 0x8957 dscp CS0 ecn NON_ECN
    fragment id 0x400e, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x1bad id 2959
Packet 3
00:32:31:618819: dpdk-input
  eth0 rx queue 0
  buffer 0x9551f: current data 0, length 52, buffer-pool 0, ref-count 1, trace handle 0x2
                  ext-hdr-valid 
  PKT MBUF: port 0, nb_segs 1, pkt_len 52
    buf_len 2176, data_len 52, ol_flags 0x0, data_off 128, phys_addr 0x19554840
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  0x0026: 5a:9e:34:cc:82:e7 -> 01:80:c2:00:00:00                               
00:32:31:621115: ethernet-input
  frame: flags 0x1, hw-if-index 1, sw-if-index 1
  0x0026: 5a:9e:34:cc:82:e7 -> 01:80:c2:00:00:00
00:32:31:621119: llc-input
  LLC bpdu -> bpdu
00:32:31:621121: error-drop
  rx:eth0
00:32:31:621122: drop
  llc-input: unknown llc ssap/dsap
Packet 4
00:32:32:283343: dpdk-input
  eth1 rx queue 0
  buffer 0x958c7: current data 0, length 124, buffer-pool 0, ref-count 1, trace handle 0x3
                  ext-hdr-valid 
  PKT MBUF: port 1, nb_segs 1, pkt_len 124
    buf_len 2176, data_len 124, ol_flags 0x0, data_off 128, phys_addr 0x19563240
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  SLOW_PROTOCOLS: 0c:9f:74:88:00:01 -> 01:80:c2:00:00:02
00:32:32:285652: bond-input                                                    
  src 0c:9f:74:88:00:01, dst 01:80:c2:00:00:02, eth1 -> eth1
00:32:32:285656: ethernet-input
  SLOW_PROTOCOLS: 0c:9f:74:88:00:01 -> 01:80:c2:00:00:02
00:32:32:285658: lacp-input
  eth1:
Length: 110
  LACPv1
  Actor Information TLV: length 20
    System da:f4:f6:a6:96:4e
    System priority 65535
    Key 15
    Port priority 255
    Port number 1
    State 0x3d
      LACP_STATE_LACP_ACTIVITY (0)
      LACP_STATE_AGGREGATION (2)
      LACP_STATE_SYNCHRONIZATION (3)
      LACP_STATE_COLLECTIING (4)
      LACP_STATE_DISTRIBUTING (5)
  Partner Information TLV: length 20
    System 0c:f0:ff:a1:00:01
    System priority 65535
    Key 5                                                                      
    Port priority 255
    Port number 1
    State 0x3f
      LACP_STATE_LACP_ACTIVITY (0)
      LACP_STATE_LACP_TIMEOUT (1)
      LACP_STATE_AGGREGATION (2)
      LACP_STATE_SYNCHRONIZATION (3)
      LACP_STATE_COLLECTIING (4)
      LACP_STATE_DISTRIBUTING (5)
  0x0000:  0101 0114 ffff daf4 f6a6 964e 000f 00ff
  0x0010:  0001 3d00 0000 0214 ffff 0cf0 ffa1 0001
  0x0020:  0005 00ff 0001 3f00 0000 0310 0000 0000
  0x0030:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0040:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0050:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0060:  0000 0000 0000 0000 0000 0000 0000
00:32:32:285660: error-drop
  rx:eth1
00:32:32:285661: drop
  lacp-input: good lacp packets -- cache hit
Packet 5
                                                                               
00:32:32:580952: dpdk-input
  eth1 rx queue 0
  buffer 0x954f8: current data 0, length 102, buffer-pool 0, ref-count 1, trace handle 0x4
                  ext-hdr-valid 
  PKT MBUF: port 1, nb_segs 1, pkt_len 102
    buf_len 2176, data_len 102, ol_flags 0x0, data_off 128, phys_addr 0x19553e80
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  IP4: da:f4:f6:a6:96:4e -> 02:fe:22:cd:c5:82 802.1q vlan 12
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x8786 dscp CS0 ecn NON_ECN
    fragment id 0x40df, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x684e id 2959
00:32:32:583255: bond-input
  src da:f4:f6:a6:96:4e, dst 02:fe:22:cd:c5:82, eth1 -> BondEthernet1
00:32:32:583258: ethernet-input
  IP4: da:f4:f6:a6:96:4e -> 02:fe:22:cd:c5:82 802.1q vlan 12
00:32:32:583259: ip4-input
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x8786 dscp CS0 ecn NON_ECN
    fragment id 0x40df, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x684e id 2959                                    
00:32:32:583261: ip4-sv-reassembly-feature
  [not-fragmented]
00:32:32:583263: nat-pre-in2out
  in2out next_index 2 arc_next_index 10
00:32:32:583263: nat44-ed-in2out
  NAT44_IN2OUT_ED_FAST_PATH: sw_if_index 7, next index 3
  search key local 100.64.12.2:2959 remote 1.1.1.1:2959 proto ICMP fib 0 thread-index 0 session-index 0
00:32:32:583266: nat44-ed-in2out-slowpath
  NAT44_IN2OUT_ED_SLOW_PATH: sw_if_index 7, next index 10
00:32:32:583267: ip4-lookup
  fib 0 dpo-idx 14 flow hash: 0x00000000
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x8786 dscp CS0 ecn NON_ECN
    fragment id 0x40df, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x684e id 2959
00:32:32:583269: ip4-rewrite
  tx_sw_if_index 1 dpo-idx 14 : ipv4 via 192.168.122.1 eth0: mtu:1500 next:5 flags:[] 525400d4d9a10cf0ffa100000800 flow hash: 0x00000000
  00000000: 525400d4d9a10cf0ffa1000008004500005440df40003f01888664400c020101
  00000020: 01010800684e0b8f001eea96fb6800000000d7310800000000001011
00:32:32:583270: eth0-output
  eth0 flags 0x1018000d                                                        
  IP4: 0c:f0:ff:a1:00:00 -> 52:54:00:d4:d9:a1
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 63, length 84, checksum 0x8886 dscp CS0 ecn NON_ECN
    fragment id 0x40df, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x684e id 2959
00:32:32:583271: eth0-tx
  eth0 tx queue 0
  buffer 0x954f8: current data 4, length 98, buffer-pool 0, ref-count 1, trace handle 0x4
                  ext-hdr-valid 
                  vlan-1-deep l2-hdr-offset 0 l3-hdr-offset 18 
  PKT MBUF: port 1, nb_segs 1, pkt_len 98
    buf_len 2176, data_len 98, ol_flags 0x0, data_off 132, phys_addr 0x19553e80
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  IP4: 0c:f0:ff:a1:00:00 -> 52:54:00:d4:d9:a1
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 63, length 84, checksum 0x8886 dscp CS0 ecn NON_ECN
    fragment id 0x40df, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x684e id 2959
Packet 6
                                                                               
00:32:33:220005: dpdk-input
  eth1 rx queue 0
  buffer 0x99347: current data 0, length 124, buffer-pool 0, ref-count 1, trace handle 0x5
                  ext-hdr-valid 
  PKT MBUF: port 1, nb_segs 1, pkt_len 124
    buf_len 2176, data_len 124, ol_flags 0x0, data_off 128, phys_addr 0x1924d240
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  SLOW_PROTOCOLS: 0c:9f:74:88:00:01 -> 01:80:c2:00:00:02
00:32:33:222302: bond-input
  src 0c:9f:74:88:00:01, dst 01:80:c2:00:00:02, eth1 -> eth1
00:32:33:222306: ethernet-input
  SLOW_PROTOCOLS: 0c:9f:74:88:00:01 -> 01:80:c2:00:00:02
00:32:33:222308: lacp-input
  eth1:
Length: 110
  LACPv1
  Actor Information TLV: length 20
    System da:f4:f6:a6:96:4e
    System priority 65535
    Key 15
    Port priority 255                                                          
    Port number 1
    State 0x3d
      LACP_STATE_LACP_ACTIVITY (0)
      LACP_STATE_AGGREGATION (2)
      LACP_STATE_SYNCHRONIZATION (3)
      LACP_STATE_COLLECTIING (4)
      LACP_STATE_DISTRIBUTING (5)
  Partner Information TLV: length 20
    System 0c:f0:ff:a1:00:01
    System priority 65535
    Key 5
    Port priority 255
    Port number 1
    State 0x3f
      LACP_STATE_LACP_ACTIVITY (0)
      LACP_STATE_LACP_TIMEOUT (1)
      LACP_STATE_AGGREGATION (2)
      LACP_STATE_SYNCHRONIZATION (3)
      LACP_STATE_COLLECTIING (4)
      LACP_STATE_DISTRIBUTING (5)
  0x0000:  0101 0114 ffff daf4 f6a6 964e 000f 00ff
  0x0010:  0001 3d00 0000 0214 ffff 0cf0 ffa1 0001
  0x0020:  0005 00ff 0001 3f00 0000 0310 0000 0000                             
  0x0030:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0040:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0050:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0060:  0000 0000 0000 0000 0000 0000 0000
00:32:33:222309: error-drop
  rx:eth1
00:32:33:222310: drop
  lacp-input: good lacp packets -- cache hit
Packet 7
00:32:33:604876: dpdk-input
  eth1 rx queue 0
  buffer 0x9540e: current data 0, length 102, buffer-pool 0, ref-count 1, trace handle 0x6
                  ext-hdr-valid 
  PKT MBUF: port 1, nb_segs 1, pkt_len 102
    buf_len 2176, data_len 102, ol_flags 0x0, data_off 128, phys_addr 0x19550400
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  IP4: da:f4:f6:a6:96:4e -> 02:fe:22:cd:c5:82 802.1q vlan 12
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x8569 dscp CS0 ecn NON_ECN          
    fragment id 0x42fc, flags DONT_FRAGMENT
  ICMP echo_request checksum 0xa5ef id 2959
00:32:33:607171: bond-input
  src da:f4:f6:a6:96:4e, dst 02:fe:22:cd:c5:82, eth1 -> BondEthernet1
00:32:33:607175: ethernet-input
  IP4: da:f4:f6:a6:96:4e -> 02:fe:22:cd:c5:82 802.1q vlan 12
00:32:33:607177: ip4-input
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x8569 dscp CS0 ecn NON_ECN
    fragment id 0x42fc, flags DONT_FRAGMENT
  ICMP echo_request checksum 0xa5ef id 2959
00:32:33:607179: ip4-sv-reassembly-feature
  [not-fragmented]
00:32:33:607180: nat-pre-in2out
  in2out next_index 2 arc_next_index 10
00:32:33:607181: nat44-ed-in2out
  NAT44_IN2OUT_ED_FAST_PATH: sw_if_index 7, next index 3
  search key local 100.64.12.2:2959 remote 1.1.1.1:2959 proto ICMP fib 0 thread-index 0 session-index 0
00:32:33:607184: nat44-ed-in2out-slowpath
  NAT44_IN2OUT_ED_SLOW_PATH: sw_if_index 7, next index 10
00:32:33:607185: ip4-lookup
  fib 0 dpo-idx 14 flow hash: 0x00000000                                       
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x8569 dscp CS0 ecn NON_ECN
    fragment id 0x42fc, flags DONT_FRAGMENT
  ICMP echo_request checksum 0xa5ef id 2959
00:32:33:607187: ip4-rewrite
  tx_sw_if_index 1 dpo-idx 14 : ipv4 via 192.168.122.1 eth0: mtu:1500 next:5 flags:[] 525400d4d9a10cf0ffa100000800 flow hash: 0x00000000
  00000000: 525400d4d9a10cf0ffa1000008004500005442fc40003f01866964400c020101
  00000020: 01010800a5ef0b8f001feb96fb6800000000988f0800000000001011
00:32:33:607188: eth0-output
  eth0 flags 0x1018000d
  IP4: 0c:f0:ff:a1:00:00 -> 52:54:00:d4:d9:a1
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 63, length 84, checksum 0x8669 dscp CS0 ecn NON_ECN
    fragment id 0x42fc, flags DONT_FRAGMENT
  ICMP echo_request checksum 0xa5ef id 2959
00:32:33:607189: eth0-tx
  eth0 tx queue 0
  buffer 0x9540e: current data 4, length 98, buffer-pool 0, ref-count 1, trace handle 0x6
                  ext-hdr-valid 
                  vlan-1-deep l2-hdr-offset 0 l3-hdr-offset 18 
  PKT MBUF: port 1, nb_segs 1, pkt_len 98                                      
    buf_len 2176, data_len 98, ol_flags 0x0, data_off 132, phys_addr 0x19550400
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  IP4: 0c:f0:ff:a1:00:00 -> 52:54:00:d4:d9:a1
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 63, length 84, checksum 0x8669 dscp CS0 ecn NON_ECN
    fragment id 0x42fc, flags DONT_FRAGMENT
  ICMP echo_request checksum 0xa5ef id 2959
Packet 8
00:32:33:669066: dpdk-input
  eth0 rx queue 0
  buffer 0x95915: current data 0, length 52, buffer-pool 0, ref-count 1, trace handle 0x7
                  ext-hdr-valid 
  PKT MBUF: port 0, nb_segs 1, pkt_len 52
    buf_len 2176, data_len 52, ol_flags 0x0, data_off 128, phys_addr 0x195645c0
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  0x0026: 5a:9e:34:cc:82:e7 -> 01:80:c2:00:00:00
00:32:33:671362: ethernet-input
  frame: flags 0x1, hw-if-index 1, sw-if-index 1                               
  0x0026: 5a:9e:34:cc:82:e7 -> 01:80:c2:00:00:00
00:32:33:671366: llc-input
  LLC bpdu -> bpdu
00:32:33:671368: error-drop
  rx:eth0
00:32:33:671369: drop
  llc-input: unknown llc ssap/dsap
Packet 9
00:32:34:466966: dpdk-input
  eth1 rx queue 0
  buffer 0x99395: current data 0, length 124, buffer-pool 0, ref-count 1, trace handle 0x8
                  ext-hdr-valid 
  PKT MBUF: port 1, nb_segs 1, pkt_len 124
    buf_len 2176, data_len 124, ol_flags 0x0, data_off 128, phys_addr 0x1924e5c0
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  SLOW_PROTOCOLS: 0c:9f:74:88:00:01 -> 01:80:c2:00:00:02
00:32:34:469262: bond-input
  src 0c:9f:74:88:00:01, dst 01:80:c2:00:00:02, eth1 -> eth1
00:32:34:469266: ethernet-input                                                
  SLOW_PROTOCOLS: 0c:9f:74:88:00:01 -> 01:80:c2:00:00:02
00:32:34:469268: lacp-input
  eth1:
Length: 110
  LACPv1
  Actor Information TLV: length 20
    System da:f4:f6:a6:96:4e
    System priority 65535
    Key 15
    Port priority 255
    Port number 1
    State 0x3d
      LACP_STATE_LACP_ACTIVITY (0)
      LACP_STATE_AGGREGATION (2)
      LACP_STATE_SYNCHRONIZATION (3)
      LACP_STATE_COLLECTIING (4)
      LACP_STATE_DISTRIBUTING (5)
  Partner Information TLV: length 20
    System 0c:f0:ff:a1:00:01
    System priority 65535
    Key 5
    Port priority 255
    Port number 1                                                              
    State 0x3f
      LACP_STATE_LACP_ACTIVITY (0)
      LACP_STATE_LACP_TIMEOUT (1)
      LACP_STATE_AGGREGATION (2)
      LACP_STATE_SYNCHRONIZATION (3)
      LACP_STATE_COLLECTIING (4)
      LACP_STATE_DISTRIBUTING (5)
  0x0000:  0101 0114 ffff daf4 f6a6 964e 000f 00ff
  0x0010:  0001 3d00 0000 0214 ffff 0cf0 ffa1 0001
  0x0020:  0005 00ff 0001 3f00 0000 0310 0000 0000
  0x0030:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0040:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0050:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0060:  0000 0000 0000 0000 0000 0000 0000
00:32:34:469270: error-drop
  rx:eth1
00:32:34:469271: drop
  lacp-input: good lacp packets -- cache hit
Packet 10
00:32:34:627521: dpdk-input
  eth1 rx queue 0                                                              
  buffer 0x9fcda: current data 0, length 102, buffer-pool 0, ref-count 1, trace handle 0x9
                  ext-hdr-valid 
  PKT MBUF: port 1, nb_segs 1, pkt_len 102
    buf_len 2176, data_len 102, ol_flags 0x0, data_off 128, phys_addr 0x193f3700
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  IP4: da:f4:f6:a6:96:4e -> 02:fe:22:cd:c5:82 802.1q vlan 12
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x851a dscp CS0 ecn NON_ECN
    fragment id 0x434b, flags DONT_FRAGMENT
  ICMP echo_request checksum 0xe690 id 2959
00:32:34:629817: bond-input
  src da:f4:f6:a6:96:4e, dst 02:fe:22:cd:c5:82, eth1 -> BondEthernet1
00:32:34:629821: ethernet-input
  IP4: da:f4:f6:a6:96:4e -> 02:fe:22:cd:c5:82 802.1q vlan 12
00:32:34:629823: ip4-input
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x851a dscp CS0 ecn NON_ECN
    fragment id 0x434b, flags DONT_FRAGMENT
  ICMP echo_request checksum 0xe690 id 2959
00:32:34:629825: ip4-sv-reassembly-feature
  [not-fragmented]                                                             
00:32:34:629826: nat-pre-in2out
  in2out next_index 2 arc_next_index 10
00:32:34:629827: nat44-ed-in2out
  NAT44_IN2OUT_ED_FAST_PATH: sw_if_index 7, next index 3
  search key local 100.64.12.2:2959 remote 1.1.1.1:2959 proto ICMP fib 0 thread-index 0 session-index 0
00:32:34:629830: nat44-ed-in2out-slowpath
  NAT44_IN2OUT_ED_SLOW_PATH: sw_if_index 7, next index 10
00:32:34:629831: ip4-lookup
  fib 0 dpo-idx 14 flow hash: 0x00000000
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x851a dscp CS0 ecn NON_ECN
    fragment id 0x434b, flags DONT_FRAGMENT
  ICMP echo_request checksum 0xe690 id 2959
00:32:34:629833: ip4-rewrite
  tx_sw_if_index 1 dpo-idx 14 : ipv4 via 192.168.122.1 eth0: mtu:1500 next:5 flags:[] 525400d4d9a10cf0ffa100000800 flow hash: 0x00000000
  00000000: 525400d4d9a10cf0ffa10000080045000054434b40003f01861a64400c020101
  00000020: 01010800e6900b8f0020ec96fb680000000056ed0800000000001011
00:32:34:629834: eth0-output
  eth0 flags 0x1018000d
  IP4: 0c:f0:ff:a1:00:00 -> 52:54:00:d4:d9:a1
  ICMP: 100.64.12.2 -> 1.1.1.1                                                 
    tos 0x00, ttl 63, length 84, checksum 0x861a dscp CS0 ecn NON_ECN
    fragment id 0x434b, flags DONT_FRAGMENT
  ICMP echo_request checksum 0xe690 id 2959
00:32:34:629835: eth0-tx
  eth0 tx queue 0
  buffer 0x9fcda: current data 4, length 98, buffer-pool 0, ref-count 1, trace handle 0x9
                  ext-hdr-valid 
                  vlan-1-deep l2-hdr-offset 0 l3-hdr-offset 18 
  PKT MBUF: port 1, nb_segs 1, pkt_len 98
    buf_len 2176, data_len 98, ol_flags 0x0, data_off 132, phys_addr 0x193f3700
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  IP4: 0c:f0:ff:a1:00:00 -> 52:54:00:d4:d9:a1
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 63, length 84, checksum 0x861a dscp CS0 ecn NON_ECN
    fragment id 0x434b, flags DONT_FRAGMENT
  ICMP echo_request checksum 0xe690 id 2959
Packet 11
00:32:35:402913: dpdk-input
  eth1 rx queue 0                                                              
  buffer 0x9940a: current data 0, length 124, buffer-pool 0, ref-count 1, trace handle 0xa
                  ext-hdr-valid 
  PKT MBUF: port 1, nb_segs 1, pkt_len 124
    buf_len 2176, data_len 124, ol_flags 0x0, data_off 128, phys_addr 0x19250300
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  SLOW_PROTOCOLS: 0c:9f:74:88:00:01 -> 01:80:c2:00:00:02
00:32:35:405220: bond-input
  src 0c:9f:74:88:00:01, dst 01:80:c2:00:00:02, eth1 -> eth1
00:32:35:405224: ethernet-input
  SLOW_PROTOCOLS: 0c:9f:74:88:00:01 -> 01:80:c2:00:00:02
00:32:35:405227: lacp-input
  eth1:
Length: 110
  LACPv1
  Actor Information TLV: length 20
    System da:f4:f6:a6:96:4e
    System priority 65535
    Key 15
    Port priority 255
    Port number 1
    State 0x3d                                                                 
      LACP_STATE_LACP_ACTIVITY (0)
      LACP_STATE_AGGREGATION (2)
      LACP_STATE_SYNCHRONIZATION (3)
      LACP_STATE_COLLECTIING (4)
      LACP_STATE_DISTRIBUTING (5)
  Partner Information TLV: length 20
    System 0c:f0:ff:a1:00:01
    System priority 65535
    Key 5
    Port priority 255
    Port number 1
    State 0x3f
      LACP_STATE_LACP_ACTIVITY (0)
      LACP_STATE_LACP_TIMEOUT (1)
      LACP_STATE_AGGREGATION (2)
      LACP_STATE_SYNCHRONIZATION (3)
      LACP_STATE_COLLECTIING (4)
      LACP_STATE_DISTRIBUTING (5)
  0x0000:  0101 0114 ffff daf4 f6a6 964e 000f 00ff
  0x0010:  0001 3d00 0000 0214 ffff 0cf0 ffa1 0001
  0x0020:  0005 00ff 0001 3f00 0000 0310 0000 0000
  0x0030:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0040:  0000 0000 0000 0000 0000 0000 0000 0000                             
  0x0050:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0060:  0000 0000 0000 0000 0000 0000 0000
00:32:35:405229: error-drop
  rx:eth1
00:32:35:405230: drop
  lacp-input: good lacp packets -- cache hit
Packet 12
00:32:35:652165: dpdk-input
  eth0 rx queue 0
  buffer 0x8cfab: current data 0, length 52, buffer-pool 0, ref-count 1, trace handle 0xb
                  ext-hdr-valid 
  PKT MBUF: port 0, nb_segs 1, pkt_len 52
    buf_len 2176, data_len 52, ol_flags 0x0, data_off 128, phys_addr 0x1973eb40
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  0x0026: 5a:9e:34:cc:82:e7 -> 01:80:c2:00:00:00
00:32:35:654467: ethernet-input
  frame: flags 0x1, hw-if-index 1, sw-if-index 1
  0x0026: 5a:9e:34:cc:82:e7 -> 01:80:c2:00:00:00
00:32:35:654474: llc-input                                                     
  LLC bpdu -> bpdu
00:32:35:654476: error-drop
  rx:eth0
00:32:35:654478: drop
  llc-input: unknown llc ssap/dsap
Packet 13
00:32:35:652165: dpdk-input
  eth1 rx queue 0
  buffer 0x95d0b: current data 0, length 102, buffer-pool 0, ref-count 1, trace handle 0xc
                  ext-hdr-valid 
  PKT MBUF: port 1, nb_segs 1, pkt_len 102
    buf_len 2176, data_len 102, ol_flags 0x0, data_off 128, phys_addr 0x19574340
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  IP4: da:f4:f6:a6:96:4e -> 02:fe:22:cd:c5:82 802.1q vlan 12
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x82eb dscp CS0 ecn NON_ECN
    fragment id 0x457a, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x2532 id 2959
00:32:35:654472: bond-input                                                    
  src da:f4:f6:a6:96:4e, dst 02:fe:22:cd:c5:82, eth1 -> BondEthernet1
00:32:35:654475: ethernet-input
  IP4: da:f4:f6:a6:96:4e -> 02:fe:22:cd:c5:82 802.1q vlan 12
00:32:35:654477: ip4-input
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x82eb dscp CS0 ecn NON_ECN
    fragment id 0x457a, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x2532 id 2959
00:32:35:654479: ip4-sv-reassembly-feature
  [not-fragmented]
00:32:35:654481: nat-pre-in2out
  in2out next_index 2 arc_next_index 10
00:32:35:654482: nat44-ed-in2out
  NAT44_IN2OUT_ED_FAST_PATH: sw_if_index 7, next index 3
  search key local 100.64.12.2:2959 remote 1.1.1.1:2959 proto ICMP fib 0 thread-index 0 session-index 0
00:32:35:654484: nat44-ed-in2out-slowpath
  NAT44_IN2OUT_ED_SLOW_PATH: sw_if_index 7, next index 10
00:32:35:654486: ip4-lookup
  fib 0 dpo-idx 14 flow hash: 0x00000000
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x82eb dscp CS0 ecn NON_ECN
    fragment id 0x457a, flags DONT_FRAGMENT                                    
  ICMP echo_request checksum 0x2532 id 2959
00:32:35:654487: ip4-rewrite
  tx_sw_if_index 1 dpo-idx 14 : ipv4 via 192.168.122.1 eth0: mtu:1500 next:5 flags:[] 525400d4d9a10cf0ffa100000800 flow hash: 0x00000000
  00000000: 525400d4d9a10cf0ffa10000080045000054457a40003f0183eb64400c020101
  00000020: 0101080025320b8f0021ed96fb6800000000164b0900000000001011
00:32:35:654489: eth0-output
  eth0 flags 0x1018000d
  IP4: 0c:f0:ff:a1:00:00 -> 52:54:00:d4:d9:a1
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 63, length 84, checksum 0x83eb dscp CS0 ecn NON_ECN
    fragment id 0x457a, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x2532 id 2959
00:32:35:654490: eth0-tx
  eth0 tx queue 0
  buffer 0x95d0b: current data 4, length 98, buffer-pool 0, ref-count 1, trace handle 0xc
                  ext-hdr-valid 
                  vlan-1-deep l2-hdr-offset 0 l3-hdr-offset 18 
  PKT MBUF: port 1, nb_segs 1, pkt_len 98
    buf_len 2176, data_len 98, ol_flags 0x0, data_off 132, phys_addr 0x19574340
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0                                            
  IP4: 0c:f0:ff:a1:00:00 -> 52:54:00:d4:d9:a1
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 63, length 84, checksum 0x83eb dscp CS0 ecn NON_ECN
    fragment id 0x457a, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x2532 id 2959
Packet 14
00:32:36:340515: dpdk-input
  eth1 rx queue 0
  buffer 0x915e6: current data 0, length 124, buffer-pool 0, ref-count 1, trace handle 0xd
                  ext-hdr-valid 
  PKT MBUF: port 1, nb_segs 1, pkt_len 124
    buf_len 2176, data_len 124, ol_flags 0x0, data_off 128, phys_addr 0x19457a00
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  SLOW_PROTOCOLS: 0c:9f:74:88:00:01 -> 01:80:c2:00:00:02
00:32:36:342808: bond-input
  src 0c:9f:74:88:00:01, dst 01:80:c2:00:00:02, eth1 -> eth1
00:32:36:342811: ethernet-input
  SLOW_PROTOCOLS: 0c:9f:74:88:00:01 -> 01:80:c2:00:00:02
00:32:36:342813: lacp-input                                                    
  eth1:
Length: 110
  LACPv1
  Actor Information TLV: length 20
    System da:f4:f6:a6:96:4e
    System priority 65535
    Key 15
    Port priority 255
    Port number 1
    State 0x3d
      LACP_STATE_LACP_ACTIVITY (0)
      LACP_STATE_AGGREGATION (2)
      LACP_STATE_SYNCHRONIZATION (3)
      LACP_STATE_COLLECTIING (4)
      LACP_STATE_DISTRIBUTING (5)
  Partner Information TLV: length 20
    System 0c:f0:ff:a1:00:01
    System priority 65535
    Key 5
    Port priority 255
    Port number 1
    State 0x3f
      LACP_STATE_LACP_ACTIVITY (0)                                             
      LACP_STATE_LACP_TIMEOUT (1)
      LACP_STATE_AGGREGATION (2)
      LACP_STATE_SYNCHRONIZATION (3)
      LACP_STATE_COLLECTIING (4)
      LACP_STATE_DISTRIBUTING (5)
  0x0000:  0101 0114 ffff daf4 f6a6 964e 000f 00ff
  0x0010:  0001 3d00 0000 0214 ffff 0cf0 ffa1 0001
  0x0020:  0005 00ff 0001 3f00 0000 0310 0000 0000
  0x0030:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0040:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0050:  0000 0000 0000 0000 0000 0000 0000 0000
  0x0060:  0000 0000 0000 0000 0000 0000 0000
00:32:36:342816: error-drop
  rx:eth1
00:32:36:342817: drop
  lacp-input: good lacp packets -- cache hit
Packet 15
00:32:36:674895: dpdk-input
  eth1 rx queue 0
  buffer 0x9228b: current data 0, length 102, buffer-pool 0, ref-count 1, trace 
handle 0xe                                                                     
                  ext-hdr-valid 
  PKT MBUF: port 1, nb_segs 1, pkt_len 102
    buf_len 2176, data_len 102, ol_flags 0x0, data_off 128, phys_addr 0x1948a340
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  IP4: da:f4:f6:a6:96:4e -> 02:fe:22:cd:c5:82 802.1q vlan 12
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x81ed dscp CS0 ecn NON_ECN
    fragment id 0x4678, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x59d3 id 2959
00:32:36:677198: bond-input
  src da:f4:f6:a6:96:4e, dst 02:fe:22:cd:c5:82, eth1 -> BondEthernet1
00:32:36:677202: ethernet-input
  IP4: da:f4:f6:a6:96:4e -> 02:fe:22:cd:c5:82 802.1q vlan 12
00:32:36:677203: ip4-input
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x81ed dscp CS0 ecn NON_ECN
    fragment id 0x4678, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x59d3 id 2959
00:32:36:677205: ip4-sv-reassembly-feature
  [not-fragmented]
00:32:36:677207: nat-pre-in2out
  in2out next_index 2 arc_next_index 10                                        
00:32:36:677208: nat44-ed-in2out
  NAT44_IN2OUT_ED_FAST_PATH: sw_if_index 7, next index 3
  search key local 100.64.12.2:2959 remote 1.1.1.1:2959 proto ICMP fib 0 thread-index 0 session-index 0
00:32:36:677210: nat44-ed-in2out-slowpath
  NAT44_IN2OUT_ED_SLOW_PATH: sw_if_index 7, next index 10
00:32:36:677212: ip4-lookup
  fib 0 dpo-idx 14 flow hash: 0x00000000
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 64, length 84, checksum 0x81ed dscp CS0 ecn NON_ECN
    fragment id 0x4678, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x59d3 id 2959
00:32:36:677213: ip4-rewrite
  tx_sw_if_index 1 dpo-idx 14 : ipv4 via 192.168.122.1 eth0: mtu:1500 next:5 flags:[] 525400d4d9a10cf0ffa100000800 flow hash: 0x00000000
  00000000: 525400d4d9a10cf0ffa10000080045000054467840003f0182ed64400c020101
  00000020: 0101080059d30b8f0022ee96fb6800000000e0a80900000000001011
00:32:36:677214: eth0-output
  eth0 flags 0x1018000d
  IP4: 0c:f0:ff:a1:00:00 -> 52:54:00:d4:d9:a1
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 63, length 84, checksum 0x82ed dscp CS0 ecn NON_ECN
    fragment id 0x4678, flags DONT_FRAGMENT                                    
  ICMP echo_request checksum 0x59d3 id 2959
00:32:36:677216: eth0-tx
  eth0 tx queue 0
  buffer 0x9228b: current data 4, length 98, buffer-pool 0, ref-count 1, trace handle 0xe
                  ext-hdr-valid 
                  vlan-1-deep l2-hdr-offset 0 l3-hdr-offset 18 
  PKT MBUF: port 1, nb_segs 1, pkt_len 98
    buf_len 2176, data_len 98, ol_flags 0x0, data_off 132, phys_addr 0x1948a340
    packet_type 0x0 l2_len 0 l3_len 0 outer_l2_len 0 outer_l3_len 0 
    rss 0x0 fdir.hi 0x0 fdir.lo 0x0
  IP4: 0c:f0:ff:a1:00:00 -> 52:54:00:d4:d9:a1
  ICMP: 100.64.12.2 -> 1.1.1.1
    tos 0x00, ttl 63, length 84, checksum 0x82ed dscp CS0 ecn NON_ECN
    fragment id 0x4678, flags DONT_FRAGMENT
  ICMP echo_request checksum 0x59d3 id 2959
vpp#            show ip fib
vpp# show ip fib
ipv4-VRF:0, fib_index:0, flow hash:[src dst sport dport proto flowlabel ] epoch:0 flags:none locks:[adjacency:1, default-route:1, lcp-rt:1, nat-low:1, nat-hi:2, ]
0.0.0.0/0
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:1 buckets:1 uRPF:29 to:[360:30240]]
    [0] [@5]: ipv4 via 192.168.122.1 eth0: mtu:1500 next:5 flags:[] 525400d4d9a10cf0ffa100000800
0.0.0.0/32
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:2 buckets:1 uRPF:1 to:[0:0]]
    [0] [@0]: dpo-drop ip4
100.64.12.0/32
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:19 buckets:1 uRPF:22 to:[0:0]]
    [0] [@0]: dpo-drop ip4
100.64.12.0/24
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:18 buckets:1 uRPF:21 to:[0:0]]
    [0] [@4]: ipv4-glean: [src:100.64.12.0/24] BondEthernet1.12: mtu:9000 next:2 flags:[] ffffffffffff02fe22cdc5828100000c0806
100.64.12.1/32
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:21 buckets:1 uRPF:26 to:[0:0]]      
    [0] [@12]: dpo-receive: 100.64.12.1 on BondEthernet1.12
100.64.12.2/32
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:23 buckets:1 uRPF:20 to:[0:0]]
    [0] [@5]: ipv4 via 100.64.12.2 BondEthernet1.12: mtu:9000 next:7 flags:[] daf4f6a6964e02fe22cdc5828100000c0800
100.64.12.255/32
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:20 buckets:1 uRPF:24 to:[0:0]]
    [0] [@0]: dpo-drop ip4
192.168.122.0/32
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:12 buckets:1 uRPF:12 to:[0:0]]
    [0] [@0]: dpo-drop ip4
192.168.122.1/32
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:22 buckets:1 uRPF:10 to:[0:0]]
    [0] [@5]: ipv4 via 192.168.122.1 eth0: mtu:1500 next:5 flags:[] 525400d4d9a10cf0ffa100000800
192.168.122.0/24
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:11 buckets:1 uRPF:11 to:[0:0]]
    [0] [@4]: ipv4-glean: [src:192.168.122.0/24] eth0: mtu:9000 next:1 flags:[] ffffffffffff0cf0ffa100000806
192.168.122.101/32
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:14 buckets:1 uRPF:16 to:[52:4008]]
    [0] [@12]: dpo-receive: 192.168.122.101 on eth0
192.168.122.255/32
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:13 buckets:1 uRPF:14 to:[0:0]]
    [0] [@0]: dpo-drop ip4
224.0.0.0/4
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:4 buckets:1 uRPF:3 to:[0:0]]
    [0] [@0]: dpo-drop ip4
240.0.0.0/4
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:3 buckets:1 uRPF:2 to:[0:0]]
    [0] [@0]: dpo-drop ip4
255.255.255.255/32
  unicast-ip4-chain
  [@0]: dpo-load-balance: [proto:ip4 index:5 buckets:1 uRPF:15 to:[0:0]]
    [0] [@12]: dpo-receive: 0.0.0.0 on local0
vpp#        show nat
vpp# show nat44 interfaces
NAT44 interfaces:
 BondEthernet1.12 in
 eth0 out
vpp# 
vpp# 
vpp# show nat44 sessions  
NAT44 ED sessions:
-------- thread 0 vpp_main: 26 sessions --------
    i2o 192.168.122.101 proto UDP port 52969 fib 0
    o2i 192.168.122.101 proto UDP port 52969 fib 0
       external host 122.248.201.177:123
       i2o flow: match: saddr 192.168.122.101 sport 52969 daddr 122.248.201.177 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 0
       last heard 885.49
       timeout in -979.67
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 58307 fib 0
    o2i 192.168.122.101 proto UDP port 58307 fib 0
       external host 18.193.41.138:123
       i2o flow: match: saddr 192.168.122.101 sport 58307 daddr 18.193.41.138 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 1                                                                 
       last heard 948.61
       timeout in -916.55
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 59977 fib 0
    o2i 192.168.122.101 proto UDP port 59977 fib 0
       external host 34.206.168.146:123
       i2o flow: match: saddr 192.168.122.101 sport 59977 daddr 34.206.168.146 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 2
       last heard 949.69
       timeout in -915.47
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 52704 fib 0
    o2i 192.168.122.101 proto UDP port 52704 fib 0
       external host 122.248.201.177:123                                       
       i2o flow: match: saddr 192.168.122.101 sport 52704 daddr 122.248.201.177 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 3
       last heard 950.01
       timeout in -915.15
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 50608 fib 0
    o2i 192.168.122.101 proto UDP port 50608 fib 0
       external host 18.193.41.138:123
       i2o flow: match: saddr 192.168.122.101 sport 50608 daddr 18.193.41.138 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 4
       last heard 1013.93
       timeout in -851.23
       total pkts 1, total bytes 0
       dynamic translation                                                     
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 48811 fib 0
    o2i 192.168.122.101 proto UDP port 48811 fib 0
       external host 34.206.168.146:123
       i2o flow: match: saddr 192.168.122.101 sport 48811 daddr 34.206.168.146 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 5
       last heard 1014.69
       timeout in -850.47
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 40817 fib 0
    o2i 192.168.122.101 proto UDP port 40817 fib 0
       external host 18.193.41.138:123
       i2o flow: match: saddr 192.168.122.101 sport 40817 daddr 18.193.41.138 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HO
P_BY_HOP_OPTIONS fib_idx 0                                                     
       index 6
       last heard 1078.03
       timeout in -787.13
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 44813 fib 0
    o2i 192.168.122.101 proto UDP port 44813 fib 0
       external host 122.248.201.177:123
       i2o flow: match: saddr 192.168.122.101 sport 44813 daddr 122.248.201.177 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 7
       last heard 1078.45
       timeout in -786.71
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 54422 fib 0
    o2i 192.168.122.101 proto UDP port 54422 fib 0                             
       external host 34.206.168.146:123
       i2o flow: match: saddr 192.168.122.101 sport 54422 daddr 34.206.168.146 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 8
       last heard 1143.80
       timeout in -721.36
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 40163 fib 0
    o2i 192.168.122.101 proto UDP port 40163 fib 0
       external host 18.193.41.138:123
       i2o flow: match: saddr 192.168.122.101 sport 40163 daddr 18.193.41.138 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 9
       last heard 1206.57
       timeout in -658.60
       total pkts 1, total bytes 0                                             
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 38128 fib 0
    o2i 192.168.122.101 proto UDP port 38128 fib 0
       external host 122.248.201.177:123
       i2o flow: match: saddr 192.168.122.101 sport 38128 daddr 122.248.201.177 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 10
       last heard 1207.34
       timeout in -657.82
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 56278 fib 0
    o2i 192.168.122.101 proto UDP port 56278 fib 0
       external host 34.206.168.146:123
       i2o flow: match: saddr 192.168.122.101 sport 56278 daddr 34.206.168.146 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 11
       last heard 1274.29
       timeout in -590.87
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 42063 fib 0
    o2i 192.168.122.101 proto UDP port 42063 fib 0
       external host 122.248.201.177:123
       i2o flow: match: saddr 192.168.122.101 sport 42063 daddr 122.248.201.177 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 12
       last heard 1336.08
       timeout in -529.08
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 45427 fib 0                             
    o2i 192.168.122.101 proto UDP port 45427 fib 0
       external host 18.193.41.138:123
       i2o flow: match: saddr 192.168.122.101 sport 45427 daddr 18.193.41.138 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 13
       last heard 1336.69
       timeout in -528.47
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 43427 fib 0
    o2i 192.168.122.101 proto UDP port 43427 fib 0
       external host 34.206.168.146:123
       i2o flow: match: saddr 192.168.122.101 sport 43427 daddr 34.206.168.146 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 14
       last heard 1403.85
       timeout in -461.31                                                      
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 45459 fib 0
    o2i 192.168.122.101 proto UDP port 45459 fib 0
       external host 18.193.41.138:123
       i2o flow: match: saddr 192.168.122.101 sport 45459 daddr 18.193.41.138 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 15
       last heard 1465.15
       timeout in -400.01
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 46871 fib 0
    o2i 192.168.122.101 proto UDP port 46871 fib 0
       external host 34.206.168.146:123
       i2o flow: match: saddr 192.168.122.101 sport 46871 daddr 34.206.168.146 d
port 123 proto UDP fib_idx 0 rewrite: txfib 0                                  
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 16
       last heard 1662.75
       timeout in -202.41
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 45921 fib 0
    o2i 192.168.122.101 proto UDP port 45921 fib 0
       external host 34.206.168.146:123
       i2o flow: match: saddr 192.168.122.101 sport 45921 daddr 34.206.168.146 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 17
       last heard 1534.41
       timeout in -330.76
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
                                                                               
    i2o 192.168.122.101 proto UDP port 37445 fib 0
    o2i 192.168.122.101 proto UDP port 37445 fib 0
       external host 122.248.201.177:123
       i2o flow: match: saddr 192.168.122.101 sport 37445 daddr 122.248.201.177 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 18
       last heard 1593.41
       timeout in -271.75
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 57676 fib 0
    o2i 192.168.122.101 proto UDP port 57676 fib 0
       external host 18.193.41.138:123
       i2o flow: match: saddr 192.168.122.101 sport 57676 daddr 18.193.41.138 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 19
       last heard 1594.20                                                      
       timeout in -270.96
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 37353 fib 0
    o2i 192.168.122.101 proto UDP port 37353 fib 0
       external host 18.193.41.138:123
       i2o flow: match: saddr 192.168.122.101 sport 37353 daddr 18.193.41.138 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 20
       last heard 1724.12
       timeout in -141.04
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 46260 fib 0
    o2i 192.168.122.101 proto UDP port 46260 fib 0
       external host 122.248.201.177:123
       i2o flow: match: saddr 192.168.122.101 sport 46260 daddr 122.248.201.177 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 21
       last heard 1852.26
       timeout in -12.90
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 46331 fib 0
    o2i 192.168.122.101 proto UDP port 46331 fib 0
       external host 34.206.168.146:123
       i2o flow: match: saddr 192.168.122.101 sport 46331 daddr 34.206.168.146 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 22
       last heard 1919.83
       timeout in 54.67
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass                                                       
    i2o 192.168.122.101 proto UDP port 33293 fib 0
    o2i 192.168.122.101 proto UDP port 33293 fib 0
       external host 18.193.41.138:123
       i2o flow: match: saddr 192.168.122.101 sport 33293 daddr 18.193.41.138 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 23
       last heard 1981.14
       timeout in 115.97
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 58598 fib 0
    o2i 192.168.122.101 proto UDP port 58598 fib 0
       external host 122.248.201.177:123
       i2o flow: match: saddr 192.168.122.101 sport 58598 daddr 122.248.201.177 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 24                                                                
       last heard 1981.17
       timeout in 116.01
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
    i2o 192.168.122.101 proto UDP port 57890 fib 0
    o2i 192.168.122.101 proto UDP port 57890 fib 0
       external host 122.248.201.177:123
       i2o flow: match: saddr 192.168.122.101 sport 57890 daddr 122.248.201.177 dport 123 proto UDP fib_idx 0 rewrite: txfib 0 
       o2i flow: match: saddr 0.0.0.0 sport 0 daddr 0.0.0.0 dport 0 proto IP6_HOP_BY_HOP_OPTIONS fib_idx 0 
       index 25
       last heard 2111.79
       timeout in 246.63
       total pkts 1, total bytes 0
       dynamic translation
       forwarding-bypass
vpp#                                                                           
vpp# show nat
nat    nat44  
vpp# show nat44 addresses 
NAT44 pool addresses:
192.168.122.101
  tenant VRF: 0
  synced with interface address
NAT44 twice-nat pool addresses:
vpp# 
show interfaces
vyos@r1:~$ sudo vppctl show int
              Name               Idx    State  MTU (L3/IP4/IP6/MPLS)     Counter          Count     
BondEthernet1                     5      up          9000/0/0/0     rx packets                    34
                                                                    rx bytes                    4216
                                                                    tx packets                     4
                                                                    tx bytes                     368
                                                                    drops                          2
BondEthernet1.12                  7      up          9000/0/0/0     tx packets                     2
                                                                    tx bytes                     188
eth0                              1      up          1500/0/0/0     rx packets                    54
                                                                    rx bytes                    4393
                                                                    tx packets                    25
                                                                    tx bytes                    2214
                                                                    drops                         40
                                                                    ip4                           16
                                                                    ip6                            5
eth1                              2      up          1500/0/0/0     rx packets                    58
                                                                    rx bytes                    7010
                                                                    tx packets                    18
                                                                    tx bytes                    1984
                                                                    drops                         53
                                                                    punt                           5
                                                                    ip6                           11
local0                            0     down          0/0/0/0       
tap4096                           3      up          9000/0/0/0     rx packets                    23
                                                                    rx bytes                    2042
                                                                    tx packets                    16
                                                                    tx bytes                    1450
                                                                    ip4                           13
                                                                    ip6                            9
tap4097                           4      up          9000/0/0/0     rx packets                     9
                                                                    rx bytes                     926
                                                                    ip6                            9
tap4098                           6      up          9000/0/0/0     rx packets                     4
                                                                    rx bytes                     368
                                                                    ip6                            2
tap4098.12                        8      up           0/0/0/0       rx packets                     2
                                                                    rx bytes                     188
                                                                    ip6                            2
vyos@r1:~$ There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
with set vpp settings nat44 no-forwarding option it works
Change summary
Types of changes
Related Task(s)
Related PR(s)
How to test / Smoketest result
Checklist: