Effects of adaptive wormhole routing in event builder networks

G. Bauer; V. Boyer; J. Branson; A. Brett; E. Cano; A. Carboni; M. Ciganek; S. Cittolin; S. Erhan; D. Gigi; F. Glege; R. Gomez-Reino; M. Gulmini; E. Gutierrez Mlot; J. Gutleber; C. Jacobs; J. C. Kim; M. Klute; E. Lipeles; J. A Lopez Perez; G. Maron; F. Meijers; E. Meschi; R. Moser; S. Murray; A. Oh; L. Orsini; C. Pans; A. Petrueci; M. Pieri; T. Pollet; A. Racz; H. Sakulin; M. Sani; P. Schieferdecker; C. Schwiele; K. Sumorok; I. Suzulci; D. Tsirigkas; J. Varela

doi:10.1109/RTC.2007.4382749

Effects of adaptive wormhole routing in event builder networks

G. Bauer, V. Boyer, J. Branson, A. Brett, E. Cano, A. Carboni, M. Ciganek, S. Cittolin, S. Erhan, D. Gigi, F. Glege, R. Gomez-Reino, M. Gulmini, E. Gutierrez Mlot, J. Gutleber, C. Jacobs, J. C. Kim, M. Klute, E. Lipeles, J. A Lopez PerezG. Maron, F. Meijers, E. Meschi, R. Moser, S. Murray, A. Oh, L. Orsini, C. Pans, A. Petrueci, M. Pieri, T. Pollet, A. Racz, H. Sakulin, M. Sani, P. Schieferdecker, C. Schwiele, K. Sumorok, I. Suzulci, D. Tsirigkas, J. Varela

Research output: Chapter in Book/Conference proceeding › Chapter › peer-review

Abstract

The data acquisition system of the CMS experiment at the Large Hadron Collider features a two-stage event builder, which combines data from about 500 sources into full events at an aggregate throughput of 100 GByte/s. To meet the requirements, several architectures and interconnect technologies have been quantitatively evaluated. Both Gigabit Ethernet and Myrinet networks will be employed during the first ran. Nearly full bi-section throughput can be obtained using a custom software driver for Myrinet based on barrel shifter traffic shaping. This paper discusses the use of Myrinet dual-port network interface cards supporting channel bonding to achieve virtual 5GBit s links with adaptive routing to alleviate the throughput limitations associated with wormhole routing. Adaptive routing is not expected to be suitable for high throughput event builder applications in high energy physics. To corroborate this claim, results from the CMS event builder preserles installation at CERN are presented and the problems of wormhole routing networks are discussed. © 2007 IEEE.

Original language	English
Title of host publication	2007 15th IEEE-NPSS Real-Time Conference
Subtitle of host publication	April 29 2007-May 4 2007, Batavia, IL, USA
Publisher	IEEE
ISBN (Print)	978-1-4244-0866-5
DOIs	https://doi.org/10.1109/RTC.2007.4382749
Publication status	Published - 2007

Access to Document

10.1109/RTC.2007.4382749

Cite this

Bauer, G., Boyer, V., Branson, J., Brett, A., Cano, E., Carboni, A., Ciganek, M., Cittolin, S., Erhan, S., Gigi, D., Glege, F., Gomez-Reino, R., Gulmini, M., Mlot, E. G., Gutleber, J., Jacobs, C., Kim, J. C., Klute, M., Lipeles, E., ... Varela, J. (2007). Effects of adaptive wormhole routing in event builder networks. In 2007 15th IEEE-NPSS Real-Time Conference : April 29 2007-May 4 2007, Batavia, IL, USA IEEE. https://doi.org/10.1109/RTC.2007.4382749

@inbook{655825637d154ef3a5a8900a8581aafd,

title = "Effects of adaptive wormhole routing in event builder networks",

abstract = "The data acquisition system of the CMS experiment at the Large Hadron Collider features a two-stage event builder, which combines data from about 500 sources into full events at an aggregate throughput of 100 GByte/s. To meet the requirements, several architectures and interconnect technologies have been quantitatively evaluated. Both Gigabit Ethernet and Myrinet networks will be employed during the first ran. Nearly full bi-section throughput can be obtained using a custom software driver for Myrinet based on barrel shifter traffic shaping. This paper discusses the use of Myrinet dual-port network interface cards supporting channel bonding to achieve virtual 5GBit s links with adaptive routing to alleviate the throughput limitations associated with wormhole routing. Adaptive routing is not expected to be suitable for high throughput event builder applications in high energy physics. To corroborate this claim, results from the CMS event builder preserles installation at CERN are presented and the problems of wormhole routing networks are discussed. {\textcopyright} 2007 IEEE.",

author = "G. Bauer and V. Boyer and J. Branson and A. Brett and E. Cano and A. Carboni and M. Ciganek and S. Cittolin and S. Erhan and D. Gigi and F. Glege and R. Gomez-Reino and M. Gulmini and Mlot, \{E. Gutierrez\} and J. Gutleber and C. Jacobs and Kim, \{J. C.\} and M. Klute and E. Lipeles and Perez, \{J. A Lopez\} and G. Maron and F. Meijers and E. Meschi and R. Moser and S. Murray and A. Oh and L. Orsini and C. Pans and A. Petrueci and M. Pieri and T. Pollet and A. Racz and H. Sakulin and M. Sani and P. Schieferdecker and C. Schwiele and K. Sumorok and I. Suzulci and D. Tsirigkas and J. Varela",

year = "2007",

doi = "10.1109/RTC.2007.4382749",

language = "English",

isbn = "978-1-4244-0866-5 ",

booktitle = "2007 15th IEEE-NPSS Real-Time Conference",

publisher = "IEEE",

address = "United States",

}

Bauer, G, Boyer, V, Branson, J, Brett, A, Cano, E, Carboni, A, Ciganek, M, Cittolin, S, Erhan, S, Gigi, D, Glege, F, Gomez-Reino, R, Gulmini, M, Mlot, EG, Gutleber, J, Jacobs, C, Kim, JC, Klute, M, Lipeles, E, Perez, JAL, Maron, G, Meijers, F, Meschi, E, Moser, R, Murray, S, Oh, A, Orsini, L, Pans, C, Petrueci, A, Pieri, M, Pollet, T, Racz, A, Sakulin, H, Sani, M, Schieferdecker, P, Schwiele, C, Sumorok, K, Suzulci, I, Tsirigkas, D & Varela, J 2007, Effects of adaptive wormhole routing in event builder networks. in 2007 15th IEEE-NPSS Real-Time Conference : April 29 2007-May 4 2007, Batavia, IL, USA. IEEE. https://doi.org/10.1109/RTC.2007.4382749

TY - CHAP

T1 - Effects of adaptive wormhole routing in event builder networks

AU - Bauer, G.

AU - Boyer, V.

AU - Branson, J.

AU - Brett, A.

AU - Cano, E.

AU - Carboni, A.

AU - Ciganek, M.

AU - Cittolin, S.

AU - Erhan, S.

AU - Gigi, D.

AU - Glege, F.

AU - Gomez-Reino, R.

AU - Gulmini, M.

AU - Mlot, E. Gutierrez

AU - Gutleber, J.

AU - Jacobs, C.

AU - Kim, J. C.

AU - Klute, M.

AU - Lipeles, E.

AU - Perez, J. A Lopez

AU - Maron, G.

AU - Meijers, F.

AU - Meschi, E.

AU - Moser, R.

AU - Murray, S.

AU - Oh, A.

AU - Orsini, L.

AU - Pans, C.

AU - Petrueci, A.

AU - Pieri, M.

AU - Pollet, T.

AU - Racz, A.

AU - Sakulin, H.

AU - Sani, M.

AU - Schieferdecker, P.

AU - Schwiele, C.

AU - Sumorok, K.

AU - Suzulci, I.

AU - Tsirigkas, D.

AU - Varela, J.

PY - 2007

Y1 - 2007

N2 - The data acquisition system of the CMS experiment at the Large Hadron Collider features a two-stage event builder, which combines data from about 500 sources into full events at an aggregate throughput of 100 GByte/s. To meet the requirements, several architectures and interconnect technologies have been quantitatively evaluated. Both Gigabit Ethernet and Myrinet networks will be employed during the first ran. Nearly full bi-section throughput can be obtained using a custom software driver for Myrinet based on barrel shifter traffic shaping. This paper discusses the use of Myrinet dual-port network interface cards supporting channel bonding to achieve virtual 5GBit s links with adaptive routing to alleviate the throughput limitations associated with wormhole routing. Adaptive routing is not expected to be suitable for high throughput event builder applications in high energy physics. To corroborate this claim, results from the CMS event builder preserles installation at CERN are presented and the problems of wormhole routing networks are discussed. © 2007 IEEE.

AB - The data acquisition system of the CMS experiment at the Large Hadron Collider features a two-stage event builder, which combines data from about 500 sources into full events at an aggregate throughput of 100 GByte/s. To meet the requirements, several architectures and interconnect technologies have been quantitatively evaluated. Both Gigabit Ethernet and Myrinet networks will be employed during the first ran. Nearly full bi-section throughput can be obtained using a custom software driver for Myrinet based on barrel shifter traffic shaping. This paper discusses the use of Myrinet dual-port network interface cards supporting channel bonding to achieve virtual 5GBit s links with adaptive routing to alleviate the throughput limitations associated with wormhole routing. Adaptive routing is not expected to be suitable for high throughput event builder applications in high energy physics. To corroborate this claim, results from the CMS event builder preserles installation at CERN are presented and the problems of wormhole routing networks are discussed. © 2007 IEEE.

U2 - 10.1109/RTC.2007.4382749

DO - 10.1109/RTC.2007.4382749

M3 - Chapter

SN - 978-1-4244-0866-5

BT - 2007 15th IEEE-NPSS Real-Time Conference

PB - IEEE

ER -

Effects of adaptive wormhole routing in event builder networks

Abstract

Access to Document

Fingerprint

Cite this