Porting DIRAC Benchmark to Python3: impact of the discrepancies and solutions - Université Clermont Auvergne Access content directly
Conference Papers Year : 2022

Porting DIRAC Benchmark to Python3: impact of the discrepancies and solutions

Christophe Haen
  • Function : Author
  • PersonId : 1095356
Alexandre F Boyer
Federico Stagni

Abstract

To progress in their research, scientific communities generally rely on shared computing resources aggregated into clusters. To provide fair use of the computing resources to every user, administrators of these clusters set up Local Resources Management Systems. They orchestrate the scientific workloads and the resources by allowing a given workload to be executed for a certain time on a definite number of CPUs or machines. To maximize the use of the computing resources and avoid running out of time, users may assess their environments by executing fast CPU benchmarking solutions such as DIRAC Benchmark. Developed in Python 2 in 2012, DIRAC Benchmark has been mainly and successfully employed in the context of the LHCb experiment. Now that Python 2 is deprecated, DIRAC Benchmark has to be ported to Python 3. This paper describes this transition, the impact brought by the changes, and the considered solutions. The main contributions of this paper are: (i) an extensive description of the CPU Benchmarking tools in High-Energy Physics; (ii) various methods to improve and maintain the program, such as unit tests, a Continuous Integration and Delivery pipeline; (iii) a comprehensive analysis of the discrepancies that could have caused 22% of the workloads to fail; (iv) a review of the advantages and drawbacks of the considered solutions. The problems were addressed by applying a constant factor on the scores depending on the underlying CPU model and Python version used.
Not file

Dates and versions

hal-04045256 , version 1 (24-03-2023)

Identifiers

  • HAL Id : hal-04045256 , version 1

Cite

David R.C. Hill, Christophe Haen, Alexandre F Boyer, Federico Stagni. Porting DIRAC Benchmark to Python3: impact of the discrepancies and solutions. 41st International Conference on High Energy physics – ICHEP, Jul 2022, Bologna (ITALY), Italy. pp.1-4. ⟨hal-04045256⟩
6 View
0 Download

Share

Gmail Facebook Twitter LinkedIn More