Cross platform MPI support in CI tests.

[adrienbernede]

I was trying to turn on MPI test on Tioga and Lassen, since they were turned off only for those two.
However, there is no trace of using "MPIEXEC_EXECUTABLE" in Caliper build system or test driver, which may explain why MPI tests are not "cross platform".
Looking into Caliper testing framework, I was hoping that using BLT could provide an answer to your need. However, Caliper has its own test driver, written in python, which appears to prevent us to leverage BLT in a straightforward fashion.
For example, in Umpire, BLT handles the various MPI providers depending on variables.
Back to Caliper, the Spack package already sets MPIEXEC_EXECUTABLE in the CMakeCache file, making the CMake config ready to run MPI tests, provided that the project uses BLT (or BLT-like) MPI support.
Something to think about when trying to support MPI in Caliper tests.

Originally posted by @adrienbernede in #624 (comment)