2710799 SzGeCERN 20200224234044.0 DOI IEEE 10.1109/TNS.2015.2435902 oai:inspirehep.net:1479848 cerncds:FULLTEXT cerncds:CERN:FULLTEXT cerncds:CERN INSPIRE:HEP ForCDS CDS http://inspirehep.net/oai2d oai:inspirehep.net:1479848 2020-02-21T22:06:03Z 2020-02-22T05:00:07Z marcxml Inspire 1479848 eng Schwemmer, Rainer INSPIRE-00260360 rainer.schwemmer@cern.ch CERN author data acquisition author high energy physics instrumentation computing author linear accelerators author optical interconnections author COTS components author Large Hadron Collider beauty data acquisition author high-rate data acquisition system author optical interconnects author Bandwidth author Buildings author Data acquisition author Detectors author Field programmable gate arrays author Hardware author Servers author multiprocessor interconnection networks author network topology author next generation networking author real-time systems; CERN CERN LHC LHCb Neufeld, Niko INSPIRE-00260260 CERN 1747-1751 4 IEEE Trans. Nucl. Sci. 62 2015 Conference paper 19th IEEE-NPSS 2054017 1601115 557599 http://cds.cern.ch/record/2710799/files/07153573.pdf Fulltext 1601115 20805 http://cds.cern.ch/record/2710799/files/07153573.gif?subformat=icon icon Fulltext 1601115 21456 http://cds.cern.ch/record/2710799/files/07153573.jpg?subformat=icon-180 icon-180 Fulltext 1601115 226719 http://cds.cern.ch/record/2710799/files/07153573.jpg?subformat=icon-700 icon-700 Fulltext 13 ARTICLE 5 p IEEE The Large Hadron Collider beauty (LHCb) data acquisition after 2019 will need to perform event-building at an aggregated band-width of 32 Tbit/s. Apart from the technological challenges described in various papers also at this conference, the key challenge is to come up with an architecture which minimises the cost, while providing a system which can be maintained by a small team for a long time and which scales well. In this paper we present the analyses we have been doing to minimise the cost, the R&D; topics we derived from that and how we combined all this into a coherent proposal which allows us to come up with a system which not only today fits the budgetary constraints of LHCb, but also will allow profiting from any main-stream technological development. We achieve this by aligning our system needs as much as possible to data-centre mass-market commercial of the shelf (COTS) products; by minimising the number of optical interconnects and by optimising the physical layout of the system. This system requires only one piece of custom-made hardware, and even this could, for a smaller setup be replaced by a commercially available item. We believe that the reasoning behind this design can be beneficial to any large, high-rate data acquisition system. publication CC-BY-3.0 http://creativecommons.org/licenses/by/3.0/ SzGeCERN Computing and Computers 796248 doi:10.1088/1748-0221/3/08/S08005 Collaboration The LHCb / The LHCb Detector at the LHC 1 [1] The LHCb Collaboration et al., The LHCb Detector at the LHC, 2008,DOI: 10.1088/1748-0221/3/08/S08005. 2008 0 1614090 LHCb Trigger and Online Upgrade Technical Design Report 2 CERN-LHCC-2014-016 LHCB-TDR-01 https://cds.cern.ch/record/1701361 [2] LHCb Trigger and Online Upgrade Technical Design Report,CERN-LHCC-2014-016; LHCB-TDR-016 [Online]. Available:https://cds.cern.ch/record/1701361 0 1614076 Collaboration The LHCb / Framework TDR for the LHCbUpgrade: Technical Design Report / LHCb-TDR-12,[Online]. Available: 3 CERN-LHCC-2012-007 http://cds.cern.ch/record/1443882 [3] The LHCb Collaboration et al., Framework TDR for the LHCbUpgrade: Technical Design Report, CERN-LHCC-2012-007LHCb-TDR-12, 2012 [Online]. Available: http://cds.cern.ch/record/1443882/files/LHCB-TDR-012.pdf 2012 0 IntelCorporation,IntelXeonProcessorE5v2Family:Datasheet,vol. 1 [Online]. Available: 4 http://http.com//www.intel.com/content/www/us/en/processors/xeon/xeon-e5-v2-datasheet-vol-1.html [4] IntelCorporation,IntelXeonProcessorE5v2Family:Datasheet2014,vol. 1 [Online]. Available: http://http://www.intel.com/content/www/us/en/processors/xeon/xeon-e5-v2-datasheet-vol-1.html 2014 0 Neufeldet, N. al / inProc. RealTime Conf 5 Improvements in the LHCb DAQ [5] N. Neufeldet al., “Improvements in the LHCb DAQ,” inProc. RealTime Conf., 2014. 2014 0 1301921 doi:10.1088/1742-6596/513/1/012023 Bellatoet, M. al 6 J.Phys.Conf.Ser.,513,012023 APCIeGen3basedreadoutfortheLHCbupgrade [6] M. Bellatoet al.,“APCIeGen3basedreadoutfortheLHCbupgrade,”J. Phys., Conf. Ser., vol. 513, p. 012023, 2014, DOI: 10.1088/1742-6596/513/1/012023. 2014 0 1269653 doi:10.1088/1748-0221/8/12/C12016 Engel, H. Kebschull, U. 7 JINST,8,C12016 Common read-out receiver card forALICE Run2 [7] H. Engel and U. Kebschull, “Common read-out receiver card forALICE Run2,”J. Instrum., vol. 8, C12016, DOI: 10.1088/1748-0221/8/12/C12016. 0 780187 doi:10.1088/1748-0221/3/01/T01002 Cranfieldet, R. al 8 JINST,3,T01002 The ATLAS ROBIN [8] R. Cranfieldet al., “The ATLAS ROBIN,”J. Instrum., vol. 3, T01002,2008, DOI: 10.1088/1748-0221/3/01/T01002. 2008 0 929362 Breton, D. Charlet, D. SPECS: The Serial Protocol for the Experi-ment Control System of LHCb 9 CERN-LHCB-2003-004 [9] D. Breton and D. Charlet, SPECS: The Serial Protocol for the Experi-ment Control System of LHCb, CERN-LHCb 2003-004, 2003. 2003 0 Jacobssonet, R. al., The LHCb Timing and Fast Control System 10 CERN-LHCB-2001-16 [10] R. Jacobssonet al., The LHCb Timing and Fast Control System,CERN-LHCb 2001-16, 2000. 2000 0 1654171 doi:10.5170/CERN-2009-006.342 Moreiraet, P. al / inProc. Topical WorkshopElectronics for Particle Physics, Paris, France, Sep. 21-25,, pp.342-346 11 The GBT project [11] P. Moreiraet al., “The GBT project,” inProc. Topical WorkshopElectronics for Particle Physics, Paris, France, Sep. 21–25, 2009, pp.342–346, DOI: 10.5170/CERN-2009-006.342. 2009 0 Perez, D.H. Campora Schwemmer, R. Neufeld, N. inProc. Real Time Conf 12 Protocol-In-dependent Event Building Evaluator for the LHCb DAQ System [12] D. H. Campora Perez, R. Schwemmer, and N. Neufeld, “Protocol-In-dependent Event Building Evaluator for the LHCb DAQ System,” inProc. Real Time Conf., 2014. 2014 0 Connect-IB: Architecture for Scalable High Performance Com-puting, Mellanox Technologies [Online]. Available: 13 http://www.mel-lanox.com/related-docs/applications/SB_Connect-IB.pdf [13] Connect-IB: Architecture for Scalable High Performance Com-puting, Mellanox Technologies [Online]. Available: http://www.mel-lanox.com/related-docs/applications/SB_Connect-IB.pdf 0 A 32 Terabit/s Data Acquisition from Mostly COTS Components IEEE 2015