rte_eth_tx_burst无法将数据包发送出去

Question

DPDK应用程序生成一些ARP请求数据包并致电rte_eth_tx_burst将它们发送出去，而Peer NIC端口未收到一些数据包（可以使用Wireshark从PEER NIC捕获数据包， dpdk-- proc-info 显示没有错误计数。 但是，在拨打rte_eth_tx_burst之前让应用程序睡觉10s，它可以发送所有数据包。

示例代码：

main(){
  port_init();
  sleep(10);
  gen_pkt(mbuf);
  rte_eth_tx_burst(mbuf);
}

系统设置：ubuntu 20.04.2 lts，dpdk-stable-20.11.3，i350 gigabit网络连接1521，igb_uio驱动程序

root@k8s-node:/home/dpdk-stable-20.11.3/build/app# ./dpdk-proc-info -- --xstats
EAL: No legacy callbacks, legacy socket not created
###### NIC extended statistics for port 0  #########
####################################################
rx_good_packets: 10
tx_good_packets: 32
rx_good_bytes: 1203
tx_good_bytes: 1920
rx_missed_errors: 0
rx_errors: 0
tx_errors: 0
rx_mbuf_allocation_errors: 0
rx_q0_packets: 0
rx_q0_bytes: 0
rx_q0_errors: 0
tx_q0_packets: 0
tx_q0_bytes: 0
rx_crc_errors: 0
rx_align_errors: 0
rx_symbol_errors: 0
rx_missed_packets: 0
tx_single_collision_packets: 0
tx_multiple_collision_packets: 0
tx_excessive_collision_packets: 0
tx_late_collisions: 0
tx_total_collisions: 0
tx_deferred_packets: 0
tx_no_carrier_sense_packets: 0
rx_carrier_ext_errors: 0
rx_length_errors: 0
rx_xon_packets: 0
tx_xon_packets: 0
rx_xoff_packets: 0
tx_xoff_packets: 0
rx_flow_control_unsupported_packets: 0
rx_size_64_packets: 4
rx_size_65_to_127_packets: 3
rx_size_128_to_255_packets: 3
rx_size_256_to_511_packets: 0
rx_size_512_to_1023_packets: 0
rx_size_1024_to_max_packets: 0
rx_broadcast_packets: 0
rx_multicast_packets: 10
rx_undersize_errors: 0
rx_fragment_errors: 0
rx_oversize_errors: 0
rx_jabber_errors: 0
rx_management_packets: 0
rx_management_dropped: 0
tx_management_packets: 0
rx_total_packets: 10
tx_total_packets: 32
rx_total_bytes: 1203
tx_total_bytes: 1920
tx_size_64_packets: 32
tx_size_65_to_127_packets: 0
tx_size_128_to_255_packets: 0
tx_size_256_to_511_packets: 0
tx_size_512_to_1023_packets: 0
tx_size_1023_to_max_packets: 0
tx_multicast_packets: 0
tx_broadcast_packets: 32
tx_tso_packets: 0
tx_tso_errors: 0
rx_sent_to_host_packets: 0
tx_sent_by_host_packets: 0
rx_code_violation_packets: 0
interrupt_assert_count: 0
####################################################

root@k8s-node:/home/dpdk-stable-20.11.3/build/app# ./dpdk-proc-info -- --stats
EAL: No legacy callbacks, legacy socket not created

  ######################## NIC statistics for port 0  ########################
  RX-packets: 5           RX-errors:  0           RX-bytes:  785       
  RX-nombuf:  0         
  TX-packets: 32          TX-errors:  0           TX-bytes:  1920      

  Stats reg  0 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg  1 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg  2 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg  3 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg  4 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg  5 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg  6 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg  7 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg  8 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg  9 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg 10 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg 11 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg 12 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg 13 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg 14 RX-packets: 0           RX-errors: 0           RX-bytes: 0         
  Stats reg 15 RX-packets: 0           RX-errors: 0           RX-bytes: 0         

  Stats reg  0 TX-packets: 0           TX-bytes: 0         
  Stats reg  1 TX-packets: 0           TX-bytes: 0         
  Stats reg  2 TX-packets: 0           TX-bytes: 0         
  Stats reg  3 TX-packets: 0           TX-bytes: 0         
  Stats reg  4 TX-packets: 0           TX-bytes: 0         
  Stats reg  5 TX-packets: 0           TX-bytes: 0         
  Stats reg  6 TX-packets: 0           TX-bytes: 0         
  Stats reg  7 TX-packets: 0           TX-bytes: 0         
  Stats reg  8 TX-packets: 0           TX-bytes: 0         
  Stats reg  9 TX-packets: 0           TX-bytes: 0         
  Stats reg 10 TX-packets: 0           TX-bytes: 0         
  Stats reg 11 TX-packets: 0           TX-bytes: 0         
  Stats reg 12 TX-packets: 0           TX-bytes: 0         
  Stats reg 13 TX-packets: 0           TX-bytes: 0         
  Stats reg 14 TX-packets: 0           TX-bytes: 0         
  Stats reg 15 TX-packets: 0           TX-bytes: 0         
  ############################################################################

更新：
感谢您的回复，我修改了代码：

main(){
  uint32_t port_mask = 0x1;
  port_init();
  check_all_ports_link_status(port_mask);
  gen_pkt(mbuf);
  rte_eth_tx_burst(mbuf);
}

获得了打印日志：

Checking link status...............................
done
Port0 Link Up. Speed 1000 Mbps - full-duplex

我认为NIC应该完全启动，但是Peer NIC端口仍然错过了很多数据包。

Answer 1

在大多数工作案例中，物理NIC用于双链体（全/半），速度（1、10、25、40、50、100、200），并在1秒内就（自动/禁用）进行协商。超过2或3秒的任何内容都是连接机器或开关无法与双工，速度或自动谈判进行协商的迹象。因此，建议是

1. 更新驱动程序，如果接口进行了NIC测试，则两侧的固件是
2. 可能无法正常达到
3. 不同的连接电缆，因为链接 - 固定电源在集线器的情况下
4. 或尝试固定速度速度和自动调用。我不建议从完整的双链体更改为半双链（因为可能是电缆或SFI问题）。

随着暂时的临时工作，您可以使用 rte_eth_eth_link_get 可能还需要它可能需要的它可能需要等待9秒。

注意：测试是否是电缆问题的简便方法，两端都在运行DPDK，以检查链接所需的时间。

修改的代码段：

main(){
  port_init();
  
  RTE_ETH_FOREACH_DEV(portid) {
   struct rte_eth_link link;
   memset(&link, 0, sizeof(link));

   do {
        retval = rte_eth_link_get_nowait(port, &link);
        if (retval < 0) {
            printf("Failed link get (port %u): %s\n",
                port, rte_strerror(-retval));
            return retval;
        } else if (link.link_status)
            break;
        printf("Waiting for Link up on port %"PRIu16"\n", port);
        sleep(1);
    } while (!link.link_status);
  }

  gen_pkt(mbuf);
  rte_eth_tx_burst(mbuf);
}

或

main(){
  port_init();
  
  RTE_ETH_FOREACH_DEV(portid) {
   struct rte_eth_link link;
   memset(&link, 0, sizeof(link));
   ret = rte_eth_link_get(portid, &link);
   if (ret < 0) {
            printf("Port %u link get failed: err=%d\n", portid, ret);
            continue;
    }

  gen_pkt(mbuf);
  rte_eth_tx_burst(mbuf);
}

Answer 2

在物理链接上升之前，无法发送数据包，这不足为奇。这需要一些时间，并且可以使用 rte_eth_link_get（） 自动等待。