运行./dpvs &报错。 about dpvs

[ywc689]

May be not enough memory, try to allocate more hugepages.

…

Sent from my iPhone

On 5 Nov 2017, at 12:17, 李伟 ***@***.***> wrote: 在运行./dpvs &报错如下： 求助^_^: ***@***.*** bin]# ./dpvs & [1] 1187 ***@***.*** bin]# EAL: Detected 5 lcore(s) EAL: Probing VFIO support... EAL: WARNING: cpu flags constant_tsc=yes nonstop_tsc=no -> using unreliable clock cycles ! PMD: bnxt_rte_pmd_init() called for (null) EAL: PCI device 0000:00:03.0 on NUMA socket -1 EAL: probe driver: 1af4:1000 rte_virtio_pmd EAL: PCI device 0000:00:09.0 on NUMA socket -1 EAL: probe driver: 8086:100e rte_em_pmd CFG_FILE: Opening configuration file '/etc/dpvs.conf'. CFG_FILE: log_level = WARNING NETIF: dpdk0:rx_queue_number = 2 NETIF: worker cpu1:dpdk0 rx_queue_id += 0 NETIF: worker cpu1:dpdk0 tx_queue_id += 0 EAL: Error - exiting with code: 1 Cause: Cannot init mbuf pool on socket 1 [1]+ Exit 1 ./dpvs — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or mute the thread.

[liwei0526vip]

我分配的大内存页是1024，按照文档来配置的，不过我配置为2048也照样有问题。
配置文件/etc/dpvs.conf设置mbuf的大小没有改变，按照下载下来的配置设置的，应该是够的。
但是查到：

[root@localhost bin]# dmesg |grep -i numa
[    0.000000] No NUMA configuration found
``` 这个貌似显示NUMA没有开启，是否可能是这个原因？

[ywc689]

Are you running dpvs on a virtual machine? Dpvs has not been tuned for virtual server.

EAL: PCI device 0000:00:03.0 on NUMA socket -1
EAL:   probe driver: 1af4:1000 rte_virtio_pmd
EAL: PCI device 0000:00:09.0 on NUMA socket -1
EAL:   probe driver: 8086:100e rte_em_pmd

[beacer]

Pls try to modify DPVS_MAX_SOCKET to 1, at include/common.h.

[liwei0526vip]

@beacer 修改DPVS_MAX_SOCKET为1后，重新编译，还是上述报错。

[yangxingwu]

更新一下，前几天修了这个bug，

#36

[beacer]

@yangxingwu 👍

[liuflylove666]

@beacer
NETIF: worker cpu7:dpdk0 rx_queue_id += 6
NETIF: worker cpu7:dpdk0 tx_queue_id += 6
NETIF: worker cpu8:dpdk0 rx_queue_id += 7
NETIF: worker cpu8:dpdk0 tx_queue_id += 7
USER1: rte_ip_frag_table_create: allocation of 25165952 bytes at socket 0 failed do
IP4FRAG: [21] fail to create frag table.
EAL: Error - exiting with code: 1
Cause: Fail to init inet: failed dpdk api

./tools/dpdk-devbind.py --st

Network devices using DPDK-compatible driver

0000:06:00.2 'I350 Gigabit Network Connection' drv=igb_uio unused=

Network devices using kernel driver

0000:06:00.0 'I350 Gigabit Network Connection' if=eth0 drv=igb unused=igb_uio Active
0000:06:00.1 'I350 Gigabit Network Connection' if=eth1 drv=igb unused=igb_uio
0000:06:00.3 'I350 Gigabit Network Connection' if=eth3 drv=igb unused=igb_uio

Other network devices

cat /etc/dpvs.conf
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
! This is dpvs default configuration file.
!
! The attribute "" denotes the configuration item at initialization stage. Item of
! this type is configured oneshoot and not reloadable. If invalid value configured in the
! file, dpvs would use its default value.
!
! Note that dpvs configuration file supports the following comment type:
! * line comment: using '#" or '!'
! * inline range comment: using '<' and '>', put comment in between
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

! global config
global_defs {
log_level WARNING
! log_file /var/log/dpvs.log
}

! netif config
netif_defs {
pktpool_size 524287
pktpool_cache 256

<init> device dpdk0 {
    rx {
        queue_number        8
        descriptor_number   1024
        rss                 tcp
    }
    tx {
        queue_number        8
        descriptor_number   1024
    }
!    promisc_mode
    kni_name                dpdk0.kni
}

}

! worker config (lcores)
worker_defs {
worker cpu0 {
type master
cpu_id 0
}

<init> worker cpu1 {
    type    slave
    cpu_id  1
    port    dpdk0 {
        rx_queue_ids     0
        tx_queue_ids     0
        ! isol_rx_cpu_ids  9
        ! isol_rxq_ring_sz 1048576
    }
}

<init> worker cpu2 {
    type    slave
    cpu_id  2
    port    dpdk0 {
        rx_queue_ids     1
        tx_queue_ids     1
        ! isol_rx_cpu_ids  10
        ! isol_rxq_ring_sz 1048576
    }
}

<init> worker cpu3 {
    type        slave
    cpu_id      3
    port        dpdk0 {
        rx_queue_ids     2
        tx_queue_ids     2
        ! isol_rx_cpu_ids  11
        ! isol_rxq_ring_sz 1048576
    }
}

<init> worker   cpu4 {
    type        slave
    cpu_id      4
    port        dpdk0 {
        rx_queue_ids     3
        tx_queue_ids     3
        ! isol_rx_cpu_ids  12
        ! isol_rxq_ring_sz 1048576
    }
}

<init> worker   cpu5 {
    type        slave
    cpu_id      5
    port        dpdk0 {
        rx_queue_ids     4
        tx_queue_ids     4
        ! isol_rx_cpu_ids  13
        ! isol_rxq_ring_sz 1048576
    }
}

<init> worker   cpu6 {
    type        slave
    cpu_id      6
    port        dpdk0 {
        rx_queue_ids     5
        tx_queue_ids     5
        ! isol_rx_cpu_ids  14
        ! isol_rxq_ring_sz 1048576
    }
}

<init> worker   cpu7 {
    type        slave
    cpu_id      7
    port        dpdk0 {
        rx_queue_ids     6
        tx_queue_ids     6
        ! isol_rx_cpu_ids  15
        ! isol_rxq_ring_sz 1048576
    }
}

<init> worker   cpu8 {
    type        slave
    cpu_id      8
    port        dpdk0 {
        rx_queue_ids     7
        tx_queue_ids     7
        ! isol_rx_cpu_ids  16
        ! isol_rxq_ring_sz 1048576
    }
}

}

! timer config
timer_defs {
# cpu job loops to schedule dpdk timer management
schedule_interval 500
}

! dpvs neighbor config
neigh_defs {
unres_queue_length 128
pktpool_size 1023
pktpool_cache 32
timeout 60
}

! dpvs ipv4 config
ipv4_defs {
default_ttl 64
fragment {
bucket_number 4096
bucket_entries 16
max_entries 4096
ttl 1
}
}

! control plane config
ctrl_defs {
lcore_msg {
ring_size 4096
multicast_queue_length 256
sync_msg_timeout_us 2000
}
ipc_msg {
unix_domain /var/run/dpvs_ctrl
}
}

! ipvs config
ipvs_defs {
conn {
conn_pool_size 2097152
conn_pool_cache 256
conn_init_timeout 3
! expire_quiescent_template
! fast_xmit_close
}

udp {
    defence_udp_drop
    timeout {
        normal      300
        last        3
    }
}

tcp {
    defence_tcp_drop
    timeout {
        none        2
        established 90
        syn_sent    3
        syn_recv    30
        fin_wait    7
        time_wait   7
        close       3
        close_wait  7
        last_ack    7
        listen      120
        synack      30
        last        2
    }
    synproxy {
        synack_options {
            mss             1452
            ttl             63
            sack
        !    wscale
        !    timestamp
        }
    !    defer_rs_syn
        rs_syn_max_retry    3
        ack_storm_thresh    10
        max_ack_saved       3
        conn_reuse_state {
            close
            time_wait
        !    fin_wait
        !    close_wait
        !    last_ack
       }
    }
}

}

! sa_pool config
sa_pool {
pool_hash_size 16
}

[beacer]

@liuflylove666 what's the hugepage size ? pls use a bigger one, like echo 4096 > ... or 10240

[liuflylove666]

@beacer

use 10240

error info:

rte_eal_init 2 arc:1,*argv:./bin/dpvs
EAL: Detected 32 lcore(s)
ready rte_eal_pci_init
EAL: Probing VFIO support...
ready rte_eal_memory_init
rte_eal_memzone_init
ready rte_eal_dev_init
driver->type:0
driver->type:0
driver->type:1
PMD: bnxt_rte_pmd_init() called for (null)
froad:rte_eth_driver_register
driver->type:1
froad:rte_eth_driver_register
driver->type:1
froad:rte_eth_driver_register
driver->type:1
froad:rte_eth_driver_register
driver->type:1
froad:rte_eth_driver_register
driver->type:1
froad:rte_eth_driver_register
driver->type:1
froad:rte_eth_driver_register
driver->type:1
froad:rte_eth_driver_register
driver->type:1
froad:rte_eth_driver_register
driver->type:1
froad:rte_eth_driver_register
driver->type:1
froad:rte_eth_driver_register
driver->type:1
froad:rte_eth_driver_register
driver->type:0
driver->type:0
driver->type:1
froad:rte_eth_driver_register
driver->type:0
driver->type:0
driver->type:1
froad:rte_eth_driver_register
driver->type:0
ready rte_eal_intr_init
EAL: PCI device 0000:06:00.0 on NUMA socket -1
EAL: probe driver: 8086:1521 rte_igb_pmd
EAL: PCI device 0000:06:00.1 on NUMA socket -1
EAL: probe driver: 8086:1521 rte_igb_pmd
EAL: PCI device 0000:06:00.2 on NUMA socket -1
EAL: probe driver: 8086:1521 rte_igb_pmd
EAL: PCI device 0000:06:00.3 on NUMA socket -1
EAL: probe driver: 8086:1521 rte_igb_pmd
CFG_FILE: Opening configuration file '/etc/dpvs.conf'.
CFG_FILE: log_level = WARNING
NETIF: dpdk0:rx_queue_number = 8
NETIF: worker cpu1:dpdk0 rx_queue_id += 0
NETIF: worker cpu1:dpdk0 tx_queue_id += 0
NETIF: worker cpu2:dpdk0 rx_queue_id += 1
NETIF: worker cpu2:dpdk0 tx_queue_id += 1
NETIF: worker cpu3:dpdk0 rx_queue_id += 2
NETIF: worker cpu3:dpdk0 tx_queue_id += 2
NETIF: worker cpu4:dpdk0 rx_queue_id += 3
NETIF: worker cpu4:dpdk0 tx_queue_id += 3
NETIF: worker cpu5:dpdk0 rx_queue_id += 4
NETIF: worker cpu5:dpdk0 tx_queue_id += 4
NETIF: worker cpu6:dpdk0 rx_queue_id += 5
NETIF: worker cpu6:dpdk0 tx_queue_id += 5
NETIF: worker cpu7:dpdk0 rx_queue_id += 6
NETIF: worker cpu7:dpdk0 tx_queue_id += 6
NETIF: worker cpu8:dpdk0 rx_queue_id += 7
NETIF: worker cpu8:dpdk0 tx_queue_id += 7
PANIC in rte_kni_init():
Can not open /dev/kni
8: [./bin/dpvs() [0x42f321]]
7: [/lib64/libc.so.6(__libc_start_main+0xf5) [0x7f0402d0aaf5]]
6: [./bin/dpvs(main+0x102) [0x42e8f2]]
5: [./bin/dpvs(netif_init+0x102) [0x43bd72]]
4: [./bin/dpvs() [0x439ba0]]
3: [./bin/dpvs(rte_kni_init+0x388) [0x46b598]]
2: [./bin/dpvs(__rte_panic+0xbe) [0x42b0de]]
1: [./bin/dpvs(rte_dump_stack+0x1a) [0x4a42ea]]
Aborted (core dumped)

[beacer]

/dev/kni is not exist, is rte_kni.ko installed ? if yes, pls try DPDK 's kni sample to see if there's compatible issue for kni and NIC.
http://dpdk.org/doc/guides/sample_app_ug/kernel_nic_interface.html

[liuflylove666]

@beacer thanks, now it is running

[liuflylove666]

@beacer 你们能开发支持一下Broadcom Corporation NetXtreme BCM5720 Gigabit Ethernet PCIe 的网卡驱动吗？在bnxt_ethdev.c添加：
#define BROADCOM_DEV_ID_5720 0x165f
无效。

[beacer]

@liuflylove666 DPDK的网卡驱动，你问下dpdk吧，www.dpdk.org。里面应该有maillist.