[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-16 Thread Take Ceara
On Thu, Jun 16, 2016 at 10:19 PM, Wiles, Keith wrote: > > On 6/16/16, 3:16 PM, "dev on behalf of Wiles, Keith" on behalf of keith.wiles at intel.com> wrote: > >> >>On 6/16/16, 3:00 PM, "Take Ceara" wrote: >> >>>On Thu, Jun 16, 2016 at 9:33 PM, Wiles, Keith >>>wrote: On 6/16/16, 1:20 PM, "

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-16 Thread Take Ceara
On Thu, Jun 16, 2016 at 9:33 PM, Wiles, Keith wrote: > On 6/16/16, 1:20 PM, "Take Ceara" wrote: > >>On Thu, Jun 16, 2016 at 6:59 PM, Wiles, Keith >>wrote: >>> >>> On 6/16/16, 11:56 AM, "dev on behalf of Wiles, Keith" >> dpdk.org on behalf of keith.wiles at intel.com> wrote: >>> On 6/16

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-16 Thread Take Ceara
On Thu, Jun 16, 2016 at 6:59 PM, Wiles, Keith wrote: > > On 6/16/16, 11:56 AM, "dev on behalf of Wiles, Keith" dpdk.org on behalf of keith.wiles at intel.com> wrote: > >> >>On 6/16/16, 11:20 AM, "Take Ceara" wrote: >> >>>On Thu, Jun 16, 2016 at 5:29 PM, Wiles, Keith >>>wrote: >>> Rig

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-16 Thread Wiles, Keith
On 6/16/16, 3:16 PM, "dev on behalf of Wiles, Keith" wrote: > >On 6/16/16, 3:00 PM, "Take Ceara" wrote: > >>On Thu, Jun 16, 2016 at 9:33 PM, Wiles, Keith >>wrote: >>> On 6/16/16, 1:20 PM, "Take Ceara" wrote: >>> On Thu, Jun 16, 2016 at 6:59 PM, Wiles, Keith wrote: > > On 6/

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-16 Thread Wiles, Keith
On 6/16/16, 3:00 PM, "Take Ceara" wrote: >On Thu, Jun 16, 2016 at 9:33 PM, Wiles, Keith wrote: >> On 6/16/16, 1:20 PM, "Take Ceara" wrote: >> >>>On Thu, Jun 16, 2016 at 6:59 PM, Wiles, Keith >>>wrote: On 6/16/16, 11:56 AM, "dev on behalf of Wiles, Keith" >>> dpdk.org on behalf of k

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-16 Thread Wiles, Keith
On 6/16/16, 1:20 PM, "Take Ceara" wrote: >On Thu, Jun 16, 2016 at 6:59 PM, Wiles, Keith wrote: >> >> On 6/16/16, 11:56 AM, "dev on behalf of Wiles, Keith" > dpdk.org on behalf of keith.wiles at intel.com> wrote: >> >>> >>>On 6/16/16, 11:20 AM, "Take Ceara" wrote: >>> On Thu, Jun 16, 2016 at

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-16 Thread Take Ceara
On Thu, Jun 16, 2016 at 5:29 PM, Wiles, Keith wrote: > > Right now I do not know what the issue is with the system. Could be too many > Rx/Tx ring pairs per port and limiting the memory in the NICs, which is why > you get better performance when you have 8 core per port. I am not really > seei

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-16 Thread Take Ceara
On Thu, Jun 16, 2016 at 4:58 PM, Wiles, Keith wrote: > > From the output below it appears the x710 devices 01:00.[0-3] are on socket 0 > And the x710 devices 02:00.[0-3] sit on socket 1. > I assume there's a mistake here. The x710 devices on socket 0 are: $ lspci | grep -ie "01:.*x710" 01:00.0 Et

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-16 Thread Wiles, Keith
On 6/16/16, 11:56 AM, "dev on behalf of Wiles, Keith" wrote: > >On 6/16/16, 11:20 AM, "Take Ceara" wrote: > >>On Thu, Jun 16, 2016 at 5:29 PM, Wiles, Keith >>wrote: >> >>> >>> Right now I do not know what the issue is with the system. Could be too >>> many Rx/Tx ring pairs per port and limit

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-16 Thread Wiles, Keith
On 6/16/16, 11:20 AM, "Take Ceara" wrote: >On Thu, Jun 16, 2016 at 5:29 PM, Wiles, Keith wrote: > >> >> Right now I do not know what the issue is with the system. Could be too many >> Rx/Tx ring pairs per port and limiting the memory in the NICs, which is why >> you get better performance whe

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-16 Thread Take Ceara
Hi Keith, On Tue, Jun 14, 2016 at 3:47 PM, Wiles, Keith wrote: >>> Normally the limitation is in the hardware, basically how the PCI bus is >>> connected to the CPUs (or sockets). How the PCI buses are connected to the >>> system depends on the Mother board design. I normally see the buses >>>

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-16 Thread Wiles, Keith
On 6/16/16, 10:16 AM, "Take Ceara" wrote: >On Thu, Jun 16, 2016 at 4:58 PM, Wiles, Keith wrote: >> >> From the output below it appears the x710 devices 01:00.[0-3] are on socket 0 >> And the x710 devices 02:00.[0-3] sit on socket 1. >> > >I assume there's a mistake here. The x710 devices on sock

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-16 Thread Wiles, Keith
On 6/16/16, 9:36 AM, "Take Ceara" wrote: >Hi Keith, > >On Tue, Jun 14, 2016 at 3:47 PM, Wiles, Keith wrote: Normally the limitation is in the hardware, basically how the PCI bus is connected to the CPUs (or sockets). How the PCI buses are connected to the system depends on the M

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-14 Thread Wiles, Keith
On 6/14/16, 2:46 AM, "Take Ceara" wrote: >Hi Keith, > >On Mon, Jun 13, 2016 at 9:35 PM, Wiles, Keith wrote: >> >> On 6/13/16, 9:07 AM, "dev on behalf of Take Ceara" > on behalf of dumitru.ceara at gmail.com> wrote: >> >>>Hi, >>> >>>I'm reposting here as I didn't get any answers on the dpdk-user

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-14 Thread Take Ceara
Hi Bruce, On Mon, Jun 13, 2016 at 4:28 PM, Bruce Richardson wrote: > On Mon, Jun 13, 2016 at 04:07:37PM +0200, Take Ceara wrote: >> Hi, >> >> I'm reposting here as I didn't get any answers on the dpdk-users mailing >> list. >> >> We're working on a stateful traffic generator (www.warp17.net) usi

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-14 Thread Take Ceara
Hi Keith, On Mon, Jun 13, 2016 at 9:35 PM, Wiles, Keith wrote: > > On 6/13/16, 9:07 AM, "dev on behalf of Take Ceara" on behalf of dumitru.ceara at gmail.com> wrote: > >>Hi, >> >>I'm reposting here as I didn't get any answers on the dpdk-users mailing list. >> >>We're working on a stateful traff

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-13 Thread Wiles, Keith
On 6/13/16, 9:07 AM, "dev on behalf of Take Ceara" wrote: >Hi, > >I'm reposting here as I didn't get any answers on the dpdk-users mailing list. > >We're working on a stateful traffic generator (www.warp17.net) using >DPDK and we would like to control two XL710 NICs (one on each socket) >to maxi

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-13 Thread Take Ceara
Hi, I'm reposting here as I didn't get any answers on the dpdk-users mailing list. We're working on a stateful traffic generator (www.warp17.net) using DPDK and we would like to control two XL710 NICs (one on each socket) to maximize CPU usage. It looks that we run into the following limitation:

[dpdk-dev] Performance hit - NICs on different CPU sockets

2016-06-13 Thread Bruce Richardson
On Mon, Jun 13, 2016 at 04:07:37PM +0200, Take Ceara wrote: > Hi, > > I'm reposting here as I didn't get any answers on the dpdk-users mailing list. > > We're working on a stateful traffic generator (www.warp17.net) using > DPDK and we would like to control two XL710 NICs (one on each socket) > t