A score of 0 is given when the error was not detected.
A score of 1 is given for error messages with the correct error name.
A score of 2 is given for error messages with the correct error name and line number where the error occurred but not the file name where the error occurred.
A score of 3 is given for error messages with the correct error name, line number and the name of the file where the error occurred.
A score of 4 is given for error messages which contain the information for a score of 3 but less information than needed for a score of 5.
A score of 5 is given in all cases when the error message contains all the information needed for the quick fixing of the error.
You can sort the tables below by clicking on the table headers with one click sorting from best to worst and another click to sort from worst to best.
(MPIVERSION=2) in the table title means that all tests have been used for grading, while (MPIVERSION=1) means that only those tests that conform to MPI Standard 1.1 were used.
FORTRAN results (MPIVERSION=2)
| OS/Compiler/MPI/ Runtime Tool | Buffer out of Bounds | Buffer Overlap | Datatype Errors | Rank Errors | Other Argument Errors | Wrong Order of MPI Calls | Negative Message Length | Deadlock | Race Condition | Implementation Dependent Errors | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Linux/ EKOPath Fortran 3.2/OpenMPI | 0.02 | 0.05 | 0.10 | 0.73 | 0.20 | 0.57 | 0.81 | 0.03 | 0.00 | 0.04 | 0.26 |
| Linux/ Pathscale/ Marmot | 0.05 | 0.14 | 0.20 | 1.62 | 0.33 | 1.30 | 1.42 | 2.71 | 0.67 | 3.22 | 1.17 |
| Linux/ Pathscale/ MPI-CHECK | 2.13 | 0.62 | 1.80 | 2.81 | 0.30 | 0.56 | 1.95 | 1.79 | 0.09 | 3.18 | 1.52 |
| IBM AIX/IBM XLF | 0.16 | 0.00 | 0.30 | 0.87 | 0.38 | 0.93 | 0.96 | 0.23 | 0.00 | 0.19 | 0.40 |
| Unicos/lc/PGI pgf90 | 0.01 | 0.00 | 0.10 | 0.72 | 0.24 | 0.56 | 0.83 | 0.03 | 0.00 | 0.17 | 0.27 |
| UNICOS/mp/Cray Fortran | 0.02 | 0.00 | 0.00 | 2.00 | 0.45 | 0.92 | 2.89 | 0.04 | 0.08 | 0.00 | 0.64 |
| IRIX64/MIPSpro Fortran | 0.00 | 0.00 | 0.00 | 0.08 | 0.12 | 0.32 | 1.86 | 0.00 | 0.00 | 0.00 | 0.24 |
| Cray XT4/ PGI Fortran/ MPICH2 | 0.01 | 0.00 | 0.10 | 0.54 | 0.22 | 0.48 | 0.98 | 0.02 | 0.00 | 0.04 | 0.24 |
| SunOS/sparc/Sun Fortran95/MPICH2 | 0.01 | 0.00 | 0.10 | 0.73 | 0.34 | 0.52 | 0.88 | 0.11 | 0.00 | 0.19 | 0.29 |
| Linux/Intel Fortran 9.0/MPICH-gm | 0.01 | 0.00 | 0.13 | 0.73 | 0.13 | 0.56 | 0.88 | 0.02 | 0.00 | 0.00 | 0.25 |
| Intel Fortran 10.1.015/ MPICH 1.2/ Intel Trace Analyzer | 0.06 | 0.71 | 0.40 | 0.76 | 0.59 | 0.69 | 0.91 | 0.17 | 0.06 | 0.31 | 0.47 |
C results (MPIVERSION=2)
| OS/Compiler/MPI/ Runtime Tool | Buffer out of Bounds | Buffer Overlap | Datatype Errors | Rank Errors | Other Argument Errors | Wrong Order of MPI Calls | Negative Message Length | Deadlock | Race Condition | Implementation Dependent Errors | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|
| IBM AIX/IBM XLC | 0.16 | 0.00 | 0.30 | 0.90 | 1.00 | 0.89 | 0.94 | 0.23 | 0.00 | 0.13 | 0.46 |
| Unicos/lc/PGI pgcc | 0.02 | 0.00 | 0.10 | 0.70 | 0.90 | 0.52 | 0.80 | 0.03 | 0.00 | 0.16 | 0.32 |
| Linux/ EKOPath C 3.2/ OpenMPI | 0.02 | 0.05 | 0.10 | 0.75 | 0.90 | 0.43 | 0.88 | 0.00 | 0.00 | 0.04 | 0.32 |
| Linux/ Pathscale/ Marmot | 0.05 | 0.14 | 0.20 | 1.65 | 1.25 | 1.44 | 1.38 | 2.87 | 0.66 | 3.22 | 1.29 |
| UNICOS/mp/Cray C++ | 0.02 | 0.00 | 0.00 | 1.82 | 2.00 | 0.85 | 2.69 | 0.06 | 0.08 | 0.02 | 0.75 |
| IRIX64/MIPSpro C | 0.00 | 0.00 | 0.00 | 0.00 | 0.32 | 0.36 | 1.54 | 0.00 | 0.00 | 0.00 | 0.22 |
| Cray XT4/ PGI C/MPICH2 | 0.01 | 0.00 | 0.10 | 0.41 | 1.00 | 0.65 | 1.00 | 0.01 | 0.00 | 0.04 | 0.32 |
| SunOS/sparc/Sun C/MPICH2 | 0.01 | 0.00 | 0.10 | 0.77 | 0.90 | 0.50 | 0.79 | 0.10 | 0.00 | 0.19 | 0.34 |
| Linux/Intel C++ 9.0/MPICH-gm | 0.01 | 0.00 | 0.13 | 0.69 | 0.71 | 0.56 | 0.81 | 0.01 | 0.00 | 0.00 | 0.29 |
| Intel C 10.1.015/ MPICH 1.2/ Intel Trace Analyzer | 0.05 | 0.71 | 0.40 | 0.72 | 0.90 | 0.65 | 0.96 | 0.17 | 0.04 | 0.35 | 0.50 |
C++ results (MPIVERSION=2)
| OS/Compiler/MPI/ Runtime Tool | Buffer out of Bounds | Buffer Overlap | Datatype Errors | Rank Errors | Other Argument Errors | Wrong Order of MPI Calls | Negative Message Length | Deadlock | Race Condition | Implementation Dependent Errors | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|
| IBM AIX/IBM XLC | 0.16 | 0.00 | 0.30 | 0.89 | 0.87 | 0.78 | 0.90 | 0.24 | 0.00 | 0.16 | 0.43 |
| Unicos/lc/PGI pgCC | 0.02 | 0.00 | 0.15 | 0.70 | 0.85 | 0.51 | 0.84 | 0.01 | 0.00 | 0.18 | 0.33 |
| Linux/ EKOPath C++ 3.2/ OpenMPI | 0.02 | 0.05 | 0.10 | 0.75 | 0.81 | 0.40 | 0.80 | 0.01 | 0.00 | 0.03 | 0.30 |
| Linux/ Pathscale/ Marmot | 0.14 | 0.19 | 0.15 | 1.28 | 1.03 | 1.00 | 1.10 | 1.46 | 0.42 | 1.92 | 0.87 |
| UNICOS/mp/Cray C++ | 0.02 | 0.00 | 0.00 | 1.98 | 2.38 | 1.01 | 2.74 | 0.02 | 0.00 | 0.00 | 0.82 |
| IRIX64/MIPSpro C++ | 0.00 | 0.00 | 0.00 | 0.06 | 0.24 | 0.25 | 1.41 | 0.00 | 0.00 | 0.00 | 0.20 |
| Cray XT4/ PGI C++/ MPICH2 | 0.01 | 0.00 | 0.10 | 0.43 | 0.94 | 0.60 | 0.95 | 0.02 | 0.00 | 0.04 | 0.31 |
| SunOS/sparc/Sun C++/MPICH2 | 0.01 | 0.00 | 0.10 | 0.76 | 0.85 | 0.46 | 0.73 | 0.09 | 0.00 | 0.22 | 0.32 |
| Linux/Intel C++ 9.0/MPICH-gm | 0.01 | 0.00 | 0.13 | 0.72 | 0.75 | 0.61 | 0.66 | 0.01 | 0.00 | 0.06 | 0.30 |
| Intel C++ 10.1.015/ MPICH 1.2/ Intel Trace Analyzer | 0.05 | 0.71 | 0.40 | 0.73 | 0.83 | 0.57 | 0.96 | 0.13 | 0.06 | 0.35 | 0.48 |
FORTRAN results (MPIVERSION=1)
| OS/Compiler/MPI/ Runtime Tool | Buffer out of Bounds | Buffer Overlap | Datatype Errors | Rank Errors | Other Argument Errors | Wrong Order of MPI Calls | Negative Message Length | Deadlock | Race Condition | Implementation Dependent Errors | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|
| Linux/ Intel/ MPI-CHECK | 2.76 | 0.87 | 2.13 | 3.71 | 0.28 | 1.57 | 1.00 | 2.88 | 0.31 | 3.57 | 1.91 |
| Linux/ Pathscale/ MPI-CHECK | 2.52 | 0.75 | 2.50 | 3.61 | 0.27 | 1.48 | 1.00 | 2.75 | 0.31 | 3.40 | 1.86 |
| IBM AIX/IBM XLF | 0.03 | 0.00 | 0.13 | 0.84 | 0.22 | 1.03 | 1.00 | 0.30 | 0.00 | 0.17 | 0.37 |
| SunOS/sparc/Sun Fortran95/MPICH2 | 0.01 | 0.00 | 0.13 | 0.77 | 0.29 | 0.80 | 1.22 | 0.14 | 0.00 | 0.17 | 0.35 |
| Linux/Intel Fortran 9.0/MPICH-gm | 0.01 | 0.00 | 0.13 | 0.73 | 0.14 | 0.83 | 1.00 | 0.03 | 0.00 | 0.00 | 0.29 |
| Intel Fortran 10.1.015/ MPICH 1.2/ Intel Trace Analyzer | 0.07 | 0.94 | 0.50 | 0.81 | 0.55 | 0.80 | 1.00 | 0.23 | 0.24 | 0.31 | 0.55 |
| Linux/EKOPath Fortran 2.4/MPICH-gm | 0.01 | 0.00 | 0.13 | 0.71 | 0.18 | 0.80 | 1.00 | 0.03 | 0.00 | 0.00 | 0.29 |
| UNICOS/mp/Cray Fortran | 0.03 | 0.00 | 0.00 | 2.13 | 0.45 | 1.37 | 3.00 | 0.06 | 0.00 | 0.00 | 0.70 |
| IRIX64/MIPSpro Fortran | 0.00 | 0.00 | 0.00 | 0.06 | 0.02 | 0.03 | 0.00 | 0.00 | 0.00 | 0.00 | 0.01 |
C results (MPIVERSION=1)
| OS/Compiler/MPI/ Runtime Tool | Buffer out of Bounds | Buffer Overlap | Datatype Errors | Rank Errors | Other Argument Errors | Wrong Order of MPI Calls | Negative Message Length | Deadlock | Race Condition | Implementation Dependent Errors | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|
| IBM AIX/IBM XLC | 0.03 | 0.00 | 0.13 | 0.87 | 1.00 | 0.97 | 1.00 | 0.32 | 0.00 | 0.11 | 0.44 |
| SunOS/sparc/Sun C/MPICH2 | 0.01 | 0.00 | 0.13 | 0.81 | 1.00 | 0.80 | 1.00 | 0.14 | 0.00 | 0.18 | 0.41 |
| Linux/Intel C++ 9.0/MPICH-gm | 0.01 | 0.00 | 0.13 | 0.53 | 1.00 | 0.77 | 1.00 | 0.06 | 0.00 | 0.00 | 0.35 |
| Intel C 10.1.015/ MPICH 1.2/ Intel Trace Analyzer | 0.06 | 0.94 | 0.50 | 0.74 | 1.00 | 0.80 | 1.00 | 0.28 | 0.17 | 0.39 | 0.59 |
| Linux/EKOPath C++ 2.4/MPICH-gm | 0.04 | 0.13 | 0.13 | 0.68 | 1.00 | 0.73 | 1.00 | 0.04 | 0.00 | 0.02 | 0.38 |
| UNICOS/mp/Cray C++ | 0.03 | 0.00 | 0.00 | 2.02 | 3.00 | 1.30 | 2.33 | 0.09 | 0.00 | 0.00 | 0.88 |
| IRIX64/MIPSpro C | 0.00 | 0.00 | 0.00 | 0.02 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
C++ results (MPIVERSION=1)
| OS/Compiler/MPI/ Runtime Tool | Buffer out of Bounds | Buffer Overlap | Datatype Errors | Rank Errors | Other Argument Errors | Wrong Order of MPI Calls | Negative Message Length | Deadlock | Implementation Dependent Errors | Average | |
|---|---|---|---|---|---|---|---|---|---|---|---|
| IBM AIX/IBM XLC | 0.03 | 0.00 | 0.13 | 0.87 | 1.00 | 0.93 | 1.00 | 0.27 | 0.06 | 0.48 | |
| SunOS/sparc/Sun C++/MPICH2 | 0.01 | 0.00 | 0.13 | 0.81 | 1.00 | 0.80 | 1.00 | 0.10 | 0.31 | 0.46 | |
| Linux/Intel C++ 9.0/MPICH-gm | 0.01 | 0.00 | 0.13 | 0.69 | 1.00 | 0.83 | 1.00 | 0.00 | 0.00 | 0.41 | |
| Intel C++ 10.1.015/ MPICH 1.2/ Intel Trace Analyzer | 0.06 | 0.94 | 0.50 | 0.74 | 1.00 | 0.80 | 1.00 | 0.18 | 0.00 | 0.36 | 0.56 |
| Linux/EKOPath C++ 2.4/MPICH-gm | 0.01 | 0.00 | 0.13 | 0.52 | 1.00 | 0.77 | 1.00 | 0.00 | 0.00 | 0.38 | |
| UNICOS/mp/Cray C++ | 0.03 | 0.00 | 0.00 | 2.02 | 3.00 | 1.30 | 2.33 | 0.00 | 0.00 | 0.96 | |
| IRIX64/MIPSpro C++ | 0.00 | 0.00 | 0.00 | 0.02 | 0.00 | 0.00 | 0.11 | 0.00 | 0.00 | 0.01 |
.
.
.
.
.
.