[Click] 10GE Click performance

[Ricard Vilalta]

Exactly. I did apply affinity manually, mapping each IRQ to an especific 
core.

Ricard

On 01/19/2012 06:55 PM, rchertov wrote:
> Ricard,
> One other question.  When you used affinity settings, you just assigned
> one cpu to /proc/irq/XXX/smp_affinity, right? (XXX is the IRQ of your
> 10GE NIC).
>
> Roman
>
> On 01.18.2012 23:02, Ricard Vilalta wrote:
>> Roman,
>>
>> On 01/18/2012 07:44 PM, rchertov wrote:
>>> Ricard,
>>>
>>> What driver and kernel version are you using.  I also assume that
>>> you
>>> did not modify the myricom driver to work with click's polling mode,
>>> right?
>> I was using click 1.8-trunk with patchless kernel 2.6.32 without any
>> driver modification.
>> The results obtained where about 600kpkts/sec processed (I was not
>> generating the packets, only processing the incomming ones).
>>
>> Regards,
>> Ricard
>>
>> P.S. I noticed that with myricom NIC small packets (64B) where
>> processed
>> slowlier, than 128B.
>>
>>> I am using myricom cards for packet generation, and a dual port
>>> Intel
>>> for bridge duties.
>>>
>>> Roman
>>>
>>> On 01.18.2012 05:38, Ricard Vilalta wrote:
>>>> Hi Roman,
>>>>
>>>> I have recently published the following paper using click and 10GE
>>>> transceivers.
>>>> http://www.cttc.es/resources/doc/110728-hpsr-mplstp-final-46195.pdf
>>>>
>>>> I hope an extended version will be published soon in a journal.
>>>>
>>>> Best Regards,
>>>> Ricard
>>>>
>>>> On 01/18/2012 02:29 PM, Luigi Rizzo wrote:
>>>>> On Wed, Jan 18, 2012 at 2:13 AM, rchertov<rchertov at cs.ucsb.edu>
>>>>> wrote:
>>>>>> I finally got my hands on some 10GE equipment and started to play
>>>>>> around with Click.  So I noticed the following.  On 2.6.24.7
>>>>>> patched
>>>>>> kernel using 3.7.17 ixgbe driver, I get around 200K pps when
>>>>>> running a
>>>>>> node as a bridge (click pulled from git today).  However, when on
>>>>>> exactly the same node I run the exactly same test but I use
>>>>>> click-1.7.0rc1, then I can easily achieve 300K pps.  I have also
>>>>>> tried
>>>>>> 2.6.35.14-106.fc14.i686 using the latest Click and I still got
>>>>>> around
>>>>>> 200K pps.
>>>>>>
>>>>>>
>>>>>> I am curious of people's experiences when running Click on 10GE
>>>>>> equipment.  Has anybody got the RouteBricks MQ code running?
>>>>>> Everything
>>>>>> compiled for me, but I get pretty strange packet forwarding
>>>>>> performance,
>>>>>> where the data is either delayed by quite a bit or it is just
>>>>>> corrupted.
>>>>>>
>>>>>> My fancy one way bridge config
>>>>>>
>>>>>> fd :: FromDevice(eth2, PROMISC true, BURST 32)
>>>>>>       ->    ctr1 :: AverageCounter
>>>>>>       ->    q :: Queue(4096)
>>>>>>       ->    ctr2 :: AverageCounter
>>>>>>       ->    ToDevice(eth3, BURST 64);
>>>>> remember that fetching timestamps, even staying in-kernel,
>>>>> is extremely expensive (in the order of 250-500ns) so if you use
>>>>> one of those elements in your pipeline you won't be able
>>>>> to get decent performance.
>>>>>
>>>>> try to remove one or both counters and see if that improves
>>>>> the throughput (this said, 200 or 300kpps really seems too
>>>>> low to be explained by timestamps)
>>>>>
>>>>> cheers
>>>>> luigi
>>>>>
>>>>>
>>>>>
>>>> --
>>>> ______________________________________________________________
>>>>
>>>> Ricard Vilalta
>>>> Research Engineer
>>>> Optical Networking Area (ONA) http://wikiona.cttc.es/
>>>> CTTC - Centre Tecnològic de Telecomunicacions de Catalunya
>>>> Parc Mediterrani de la Tecnologia (PMT)
>>>> Av. Carl Friedrich Gauss 7,
>>>> 08860 Castelldefels (Barcelona), Spain
>>>> http://www.cttc.es/
>>>> Phone: +34 93 396 71 70 (ext. 2232). Fax: +34 93 645 29 01
>>>> E-mail: ricard.vilalta at cttc.es
>>>>
>>>> _______________________________________________
>>>> click mailing list
>>>> click at amsterdam.lcs.mit.edu
>>>> https://amsterdam.lcs.mit.edu/mailman/listinfo/click
>>> _______________________________________________
>>> click mailing list
>>> click at amsterdam.lcs.mit.edu
>>> https://amsterdam.lcs.mit.edu/mailman/listinfo/click
>>
>> --
>> ______________________________________________________________
>>
>> Ricard Vilalta
>> Research Engineer
>> Optical Networking Area (ONA) http://wikiona.cttc.es/
>> CTTC - Centre Tecnològic de Telecomunicacions de Catalunya
>> Parc Mediterrani de la Tecnologia (PMT)
>> Av. Carl Friedrich Gauss 7,
>> 08860 Castelldefels (Barcelona), Spain
>> http://www.cttc.es/
>> Phone: +34 93 396 71 70 (ext. 2232). Fax: +34 93 645 29 01
>> E-mail: ricard.vilalta at cttc.es
>>
>>
>> _______________________________________________
>> click mailing list
>> click at amsterdam.lcs.mit.edu
>> https://amsterdam.lcs.mit.edu/mailman/listinfo/click
>
> _______________________________________________
> click mailing list
> click at amsterdam.lcs.mit.edu
> https://amsterdam.lcs.mit.edu/mailman/listinfo/click


-- 
______________________________________________________________

Ricard Vilalta
Research Engineer
Optical Networking Area (ONA) http://wikiona.cttc.es/
CTTC - Centre Tecnològic de Telecomunicacions de Catalunya
Parc Mediterrani de la Tecnologia (PMT)
Av. Carl Friedrich Gauss 7,
08860 Castelldefels (Barcelona), Spain
http://www.cttc.es/
Phone: +34 93 396 71 70 (ext. 2232). Fax: +34 93 645 29 01
E-mail: ricard.vilalta at cttc.es