DELL 万兆 X550T 网卡 debian 连接交换机 10G,但 iperf 最高只能到 1G,信息如下。 哪里出问题了? - V2EX
V2EX = way to explore
V2EX 是一个关于分享和探索的地方
现在注册
已注册用户请  登录
axiauk
V2EX    宽带症候群

DELL 万兆 X550T 网卡 debian 连接交换机 10G,但 iperf 最高只能到 1G,信息如下。 哪里出问题了?

  •  
  •   axiauk 2020-07-13 03:32:52 +08:00 3477 次点击
    这是一个创建于 1919 天前的主题,其中的信息可能已经有所发展或是发生改变。

    ethtool -i enp2s0f0

    driver: ixgbe

    version: 5.1.0-k

    firmware-version: 0x80000f32, 19.5.12

    expansion-rom-version:

    bus-info: 0000:02:00.0

    supports-statistics: yes

    supports-test: yes

    supports-eeprom-access: yes

    supports-register-dump: yes

    supports-priv-flags: yes

    ethtool enp2s0f0

    Settings for enp2s0f0:

     Supported ports: [ TP ] Supported link modes: 100baseT/Full 1000baseT/Full 10000baseT/Full Supported pause frame use: Symmetric Supports auto-negotiation: Yes Supported FEC modes: Not reported Advertised link modes: 100baseT/Full 1000baseT/Full 10000baseT/Full Advertised pause frame use: Symmetric Advertised auto-negotiation: Yes Advertised FEC modes: Not reported Speed: 10000Mb/s Duplex: Full Port: Twisted Pair PHYAD: 0 Transceiver: internal Auto-negotiation: on MDI-X: Unknown Supports Wake-on: d Wake-on: d Current message level: 0x00000007 (7) drv probe link Link detected: yes 

    ifconfig

    enp2s0f0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500

     inet 192.168.1.7 netmask 255.255.255.0 broadcast 192.168.1.255 inet6 2408:****:****:9b80:b696:91ff:fe6f:5a78 prefixlen 64 scopeid 0x0<global> inet6 fe80::b696:91ff:fe6f:5a78 prefixlen 64 scopeid 0x20<link> ether b4:96:91:6f:5a:78 txqueuelen 1000 (Ethernet) RX packets 42383 bytes 5799527 (5.5 MiB) RX errors 0 dropped 0 overruns 0 frame 0 TX packets 14906 bytes 7721794 (7.3 MiB) TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0 

    dmesg | grep ixgbe

    [ 2.028447] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k

    [ 2.028447] ixgbe: Copyright (c) 1999-2016 Intel Corporation.

    [ 2.729215] ixgbe 0000:02:00.0: Multiqueue Enabled: Rx Queue count = 16, Tx Queue count = 16 XDP Queue count = 0

    [ 2.830695] ixgbe 0000:02:00.0: 31.504 Gb/s available PCIe bandwidth (8 GT/s x4 link)

    [ 2.943322] ixgbe 0000:02:00.0: MAC: 4, PHY: 0, PBA No: J69754-003

    [ 2.943326] ixgbe 0000:02:00.0: b4:96:91:6f:5a:78

    [ 3.106565] ixgbe 0000:02:00.0: Intel(R) 10 Gigabit Network Connection

    [ 3.106594] libphy: ixgbe-mdio: probed

    [ 3.808299] ixgbe 0000:02:00.1: Multiqueue Enabled: Rx Queue count = 16, Tx Queue count = 16 XDP Queue count = 0

    [ 3.910503] ixgbe 0000:02:00.1: 31.504 Gb/s available PCIe bandwidth (8 GT/s x4 link)

    [ 4.026732] ixgbe 0000:02:00.1: MAC: 4, PHY: 0, PBA No: J69754-003

    [ 4.026733] ixgbe 0000:02:00.1: b4:96:91:6f:5a:7a

    [ 4.188871] ixgbe 0000:02:00.1: Intel(R) 10 Gigabit Network Connection

    [ 4.188899] libphy: ixgbe-mdio: probed

    [ 4.189542] ixgbe 0000:02:00.1 enp2s0f1: renamed from eth1

    [ 4.214902] ixgbe 0000:02:00.0 enp2s0f0: renamed from eth0

    [ 5.897838] ixgbe 0000:02:00.1: registered PHC device on enp2s0f1

    [ 6.117558] ixgbe 0000:02:00.0: registered PHC device on enp2s0f0

    [ 11.258783] ixgbe 0000:02:00.1 enp2s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX

    [ 11.543897] ixgbe 0000:02:00.0 enp2s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX

    [ 11.738770] ixgbe 0000:02:00.0 enp2s0f0: NIC Link is Down

    [ 12.166518] ixgbe 0000:02:00.1 enp2s0f1: NIC Link is Down

    [ 12.454863] ixgbe 0000:02:00.0 enp2s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX

    [ 12.478795] ixgbe 0000:02:00.1 enp2s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX

    [12563.001690] ixgbe 0000:02:00.0 enp2s0f0: NIC Link is Up 10 Gbps, Flow Control: RX/TX

    8 条回复    2020-07-14 02:12:30 +08:00
    ericbize
        1
    ericbize  
       2020-07-13 07:05:02 +08:00 via iPhone
    我的话会换 iperf3 先看看
    mason961125
        2
    mason961125  
       2020-07-13 07:11:48 +08:00 via iPhone
    最重要的 iperf3 log 你却不发……
    VYSE
        3
    VYSE  
       2020-07-13 09:06:57 +08:00 via Android
    iperf 是 1GB?
    ethtool Speed: 10000Mb/s
    axiauk
        4
    axiauk  
    OP
       2020-07-13 11:55:47 +08:00
    是的,不知为何实际只有标准的千兆网卡速度。 在 NFS 和 SMB 上也是标准的千兆。
    # iperf3 -c 192.168.1.3

    Connecting to host 192.168.1.3, port 5201

    [ 5] local 192.168.1.10 port 43088 connected to 192.168.1.3 port 5201

    [ ID] Interval Transfer Bitrate Retr Cwnd

    [ 5] 0.00-1.00 sec 113 MBytes 949 Mbits/sec 0 1.45 MBytes

    [ 5] 1.00-2.00 sec 110 MBytes 923 Mbits/sec 0 1.45 MBytes

    [ 5] 2.00-3.00 sec 110 MBytes 923 Mbits/sec 0 1.45 MBytes

    [ 5] 3.00-4.00 sec 110 MBytes 923 Mbits/sec 0 1.46 MBytes

    [ 5] 4.00-5.00 sec 110 MBytes 923 Mbits/sec 0 1.46 MBytes

    [ 5] 5.00-6.00 sec 110 MBytes 923 Mbits/sec 0 1.96 MBytes

    [ 5] 6.00-7.00 sec 110 MBytes 923 Mbits/sec 0 1.96 MBytes

    [ 5] 7.00-8.00 sec 109 MBytes 912 Mbits/sec 0 1.96 MBytes

    [ 5] 8.00-9.00 sec 111 MBytes 933 Mbits/sec 0 1.96 MBytes

    [ 5] 9.00-10.00 sec 110 MBytes 923 Mbits/sec 0 1.96 MBytes

    - - - - - - - - - - - - - - - - - - - - - - - - -

    [ ID] Interval Transfer Bitrate Retr

    [ 5] 0.00-10.00 sec 1.08 GBytes 925 Mbits/sec 0 sender

    [ 5] 0.00-10.00 sec 1.07 GBytes 923 Mbits/sec receiver
    axiauk
        5
    axiauk  
    OP
       2020-07-13 12:05:35 +08:00
    折腾两天无果。之前装 windows 10 下 iperf3 都没问题的。难道是姿势不对,默认配置有问题?
    下面这条命令不知道是干嘛的
    # ethtool -g enp2s0f0

    Ring parameters for enp2s0f0:

    Pre-set maximums:

    RX: 4096

    RX Mini: 0

    RX Jumbo: 0

    TX: 4096

    Current hardware settings:

    RX: 512

    RX Mini: 0

    RX Jumbo: 0

    TX: 512
    yelocat
        6
    yelocat  
       2020-07-13 14:40:19 +08:00
    我比较奇怪,网卡插在 pcie2.0 8x 的插槽,每次开机都只能运行在 2x 模式下,显示 10G,实际 3G,重启之后才会运行在 8x 模式。
    axiauk
        7
    axiauk  
    OP
       2020-07-14 01:11:06 +08:00
    已经解决了。但是没搞明白。NUC9 接了一个千兆网卡管理口 连接 AMT ( 192.168.1.10 )万兆( 192.168.1.7 ),安装 OMV 配置这两个网卡和 IP,删掉 千兆网卡带宽就正常了。 之前出问题也怪,iperf 无论主 /客 都是到 192.168.1.7 流量只有千兆,难道都通过 192.168.1.10 中转?
    geekvcn
        8
    geekvcn  
       2020-07-14 02:12:30 +08:00
    @axiauk 按你的描述,是非对称路由的关系,每个网卡单独设个路由表就行了
    关于     帮助文档     自助推广系统     博客     API     FAQ &nbs;   Solana     3314 人在线   最高记录 6679       Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 31ms UTC 11:56 PVG 19:56 LAX 04:56 JFK 07:56
    Do have faith in what you're doing.
    ubao snddm index pchome yahoo rakuten mypaper meadowduck bidyahoo youbao zxmzxm asda bnvcg cvbfg dfscv mmhjk xxddc yybgb zznbn ccubao uaitu acv GXCV ET GDG YH FG BCVB FJFH CBRE CBC GDG ET54 WRWR RWER WREW WRWER RWER SDG EW SF DSFSF fbbs ubao fhd dfg ewr dg df ewwr ewwr et ruyut utut dfg fgd gdfgt etg dfgt dfgd ert4 gd fgg wr 235 wer3 we vsdf sdf gdf ert xcv sdf rwer hfd dfg cvb rwf afb dfh jgh bmn lgh rty gfds cxv xcv xcs vdas fdf fgd cv sdf tert sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf shasha9178 shasha9178 shasha9178 shasha9178 shasha9178 liflif2 liflif2 liflif2 liflif2 liflif2 liblib3 liblib3 liblib3 liblib3 liblib3 zhazha444 zhazha444 zhazha444 zhazha444 zhazha444 dende5 dende denden denden2 denden21 fenfen9 fenf619 fen619 fenfe9 fe619 sdf sdf sdf sdf sdf zhazh90 zhazh0 zhaa50 zha90 zh590 zho zhoz zhozh zhozho zhozho2 lislis lls95 lili95 lils5 liss9 sdf0ty987 sdft876 sdft9876 sdf09876 sd0t9876 sdf0ty98 sdf0976 sdf0ty986 sdf0ty96 sdf0t76 sdf0876 df0ty98 sf0t876 sd0ty76 sdy76 sdf76 sdf0t76 sdf0ty9 sdf0ty98 sdf0ty987 sdf0ty98 sdf6676 sdf876 sd876 sd876 sdf6 sdf6 sdf9876 sdf0t sdf06 sdf0ty9776 sdf0ty9776 sdf0ty76 sdf8876 sdf0t sd6 sdf06 s688876 sd688 sdf86