Towards accelerating smoothed particle hydrodynamics simulations for free-surface flows on multi-GPU clusters

Daniel Valdez-Balderas, José M. Domínguez, Benedict D. Rogers, Alejandro J C Crespo, J M Dom??nguez, AJC Crespo

    Research output: Contribution to journalArticlepeer-review


    Starting from the single graphics processing unit (GPU) version of the Smoothed Particle Hydrodynamics (SPH) code DualSPHysics, a multi-GPU SPH program is developed for free-surface flows. The approach is based on a spatial decomposition technique, whereby different portions (sub-domains) of the physical system under study are assigned to different GPUs. Communication between devices is achieved with the use of Message Passing Interface (MPI) application programming interface (API) routines. The use of the sorting algorithm radix sort for inter-GPU particle migration and sub-domain "halo" building (which enables interaction between SPH particles of different sub-domains) is described in detail. With the resulting scheme it is possible, on the one hand, to carry out simulations that could also be performed on a single GPU, but they can now be performed even faster than on one of these devices alone. On the other hand, accelerated simulations can be performed with up to 32 million particles on the current architecture, which is beyond the limitations of a single GPU due to memory constraints. A study of weak and strong scaling behaviour, speedups and efficiency of the resulting program is presented including an investigation to elucidate the computational bottlenecks. Last, possibilities for reduction of the effects of overhead on computational efficiency in future versions of our scheme are discussed. © 2013 Elsevier Ltd. All rights reserved.
    Original languageEnglish
    Pages (from-to)1483-1493
    Number of pages10
    JournalJournal of Parallel and Distributed Computing
    Issue number11
    Publication statusPublished - 2013


    • Computational fluid dynamics
    • CUDA
    • GPU
    • Graphics processing unit
    • Molecular dynamics
    • Multi-GPU
    • Smoothed particle hydrodynamics
    • SPH


    Dive into the research topics of 'Towards accelerating smoothed particle hydrodynamics simulations for free-surface flows on multi-GPU clusters'. Together they form a unique fingerprint.

    Cite this