Porting DIRAC Benchmark to Python3: impact of the discrepancies and solutions - Université Clermont Auvergne
Communication Dans Un Congrès Année : 2022

Porting DIRAC Benchmark to Python3: impact of the discrepancies and solutions

Christophe Haen
  • Fonction : Auteur
  • PersonId : 1095356
Alexandre F Boyer
Federico Stagni

Résumé

To progress in their research, scientific communities generally rely on shared computing resources aggregated into clusters. To provide fair use of the computing resources to every user, administrators of these clusters set up Local Resources Management Systems. They orchestrate the scientific workloads and the resources by allowing a given workload to be executed for a certain time on a definite number of CPUs or machines. To maximize the use of the computing resources and avoid running out of time, users may assess their environments by executing fast CPU benchmarking solutions such as DIRAC Benchmark. Developed in Python 2 in 2012, DIRAC Benchmark has been mainly and successfully employed in the context of the LHCb experiment. Now that Python 2 is deprecated, DIRAC Benchmark has to be ported to Python 3. This paper describes this transition, the impact brought by the changes, and the considered solutions. The main contributions of this paper are: (i) an extensive description of the CPU Benchmarking tools in High-Energy Physics; (ii) various methods to improve and maintain the program, such as unit tests, a Continuous Integration and Delivery pipeline; (iii) a comprehensive analysis of the discrepancies that could have caused 22% of the workloads to fail; (iv) a review of the advantages and drawbacks of the considered solutions. The problems were addressed by applying a constant factor on the scores depending on the underlying CPU model and Python version used.
Fichier non déposé

Dates et versions

hal-04045256 , version 1 (24-03-2023)

Identifiants

  • HAL Id : hal-04045256 , version 1

Citer

David R.C. Hill, Christophe Haen, Alexandre F Boyer, Federico Stagni. Porting DIRAC Benchmark to Python3: impact of the discrepancies and solutions. 41st International Conference on High Energy physics – ICHEP, Jul 2022, Bologna (ITALY), Italy. pp.1-4. ⟨hal-04045256⟩
23 Consultations
0 Téléchargements

Partager

More