MPI Test Suite Result Details for

IBM_MPI MPI 10.1.0.0 on Hokulea (HOKULEA.MHPCC.HPC.MIL)

Run Environment

  • HPC Center:MHPCC
  • HPC System: IBM Power8 (Hokulea)
  • Run Date: Wed Jan 17 14:59:10 HST 2018
  • MPI: IBM_MPI MPI 10.1.0.0 (Implements MPI 3.1 Standard)
  • Shell:/bin/bash
  • Launch Command:/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/bin/mpirun
Compilers Used
Language Executable Path
C mpicc /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/bin/mpicc
C++ mpicxx /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/bin/mpicxx
F77 mpif77 /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/bin/mpif77
F90 mpif90 /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/bin/mpif90

The following modules were loaded when the MPI Test Suite was run:

  • pbs/14.1.0
  • xlc/13.1.5
  • xlf/15.1.5
  • spectrum-mpi/10.1.0.3
MPI Environment Variables
Variable Name Value
MPI_UNIVERSE 33

Topology - Score: 75% Passed

The Network Topology tests are designed to examine the operation of specific communication patterns such as Cartesian and Graph topology.

Passed MPI_Cart_create() test 1 - cartcreates

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test creates a cartesian mesh and tests for errors.

No errors

Failed MPI_Cart_map() test 2 - cartmap1

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 4

Test Description:

This test creates a cartesian map and tests for errrors.

rank outside of input communicator not UNDEFINED
rank outside of input communicator not UNDEFINED
rank outside of input communicator not UNDEFINED
rank outside of input communicator not UNDEFINED
rank outside of input communicator not UNDEFINED
rank outside of input communicator not UNDEFINED
Found 6 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[59265,1],2]
  Exit code:    1
--------------------------------------------------------------------------

Passed MPI_Cart_shift() test - cartshift1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test exercises MPI_Cart_shift().

No errors

Failed MPI_Cart_sub() test - cartsuball

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 4

Test Description:

This test exercises MPI_Cart_sub().

cart sub to size 0 did not give null
cart sub to size 0 did not give null
cart sub to size 0 did not give null
Found 3 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[58422,1],3]
  Exit code:    1
--------------------------------------------------------------------------

Failed MPI_Cartdim_get() test - cartzero

Build: Passed

Execution: Failed

Exit Status: Failed with signal 13

MPI Processes: 4

Test Description:

Check that the MPI implementation properly handles zero-dimensional Cartesian communicators - the original standard implies that these should be consistent with higher dimensional topologies and therefore should work with any MPI implementation. MPI 2.1 made this requirement explicit.

[cr1cn13:76346] *** An error occurred in MPI_Dims_create
[cr1cn13:76346] *** reported by process [3892838401,0]
[cr1cn13:76346] *** on communicator MPI_COMM_WORLD
[cr1cn13:76346] *** MPI_ERR_ARG: invalid argument of some other kind
[cr1cn13:76346] *** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
[cr1cn13:76346] ***    and potentially your MPI job)

Passed MPI_Topo_test() test - dgraph_unwgt

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Specify a distributed graph of a bidirectional ring of the MPI_COMM_WORLD communicator. Thus each node in the graph has a left and right neighbor.

No errors

Passed MPI_Dims_create() test - dims1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test uses multiple varies for the arguments of MPI_Dims_create() and tests whether the product of ndims (number of dimensions) and the returned dimensions are equal to nnodes (number of nodes) thereby determining if the decomposition is correct. The test also checks for compliance with the MPI_- standard section 6.5 regarding decomposition with increasing dimensions. The test considers dimensions 2-4.

No errors

Passed MPI_Dims_create() test - dims2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test is similar to topo/dims1 but only exercises dimensions 2 and 4 including test cases whether all all dimensions are specified.

No errors

Passed MPI_Dims_create() test - dims3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test is similar to topo/dims1 but only considers special cases using dimensions 3 and 4.

No errors

Passed MPI_Dist_graph_create test - distgraph1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test excercises MPI_Dist_graph_create() and MPI_Dist_graph_adjacent().

No errors

Passed MPI_Graph_create() test 1 - graphcr2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Create a communicator with a graph that contains null edges and one that contains duplicate edges.

No errors

Passed MPI_Graph_create() test 2 - graphcr

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Create a communicator with a graph that contains no processes.

No errors

Failed MPI_Graph_map() test - graphmap1

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 4

Test Description:

Simple test of MPI_Graph_map().

Graph map with no local nodes did not return MPI_UNDEFINED
Graph map with no local nodes did not return MPI_UNDEFINED
Graph map with no local nodes did not return MPI_UNDEFINED
Found 3 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[58681,1],3]
  Exit code:    1
--------------------------------------------------------------------------

Passed Neighborhood routines test - neighb_coll

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

A basic test for the 10 (5 patterns x {blocking,non-blocking}) MPI-3 neighborhood collective routines.

No errors

Passed MPI_Topo_test dup test - topodup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Create a cartesian topology, get its characteristics, then dup it and check that the new communicator has the same properties.

No errors

Passed MPI_Topo_test datatype test - topotest

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Check that topo test returns the correct type, including MPI_UNDEFINED.

No errors

Basic Functionality - Score: 91% Passed

This group features tests that emphasize basic MPI functionality such as initializing MPI and retrieving its rank.

Passed Intracomm communicator test - mtestcheck

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This program calls MPI_Reduce with all Intracomm Communicators.

No errors

Passed MPI_Abort() return exit test - abortexit

Build: Passed

Execution: Failed

Exit Status: Intentional_failure_was_successful

MPI Processes: 1

Test Description:

This program calls MPI_Abort and confirms that the exit status in the call is returned to the envoking environment.

MPI_Abort() with return exit code:6
--------------------------------------------------------------------------
MPI_ABORT was invoked on rank 0 in communicator MPI_COMM_WORLD
with errorcode 6.
NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.
--------------------------------------------------------------------------

Passed Send/Recv test 1 - srtest

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This is a basic test of the send/receive with a barrier using MPI_Send() and MPI_Recv().

No errors

Passed Send/Recv test 2 - self

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test uses MPI_Sendrecv() sent from and to rank=0.

No errors.

Passed Basic Send/Recv Test - sendrecv

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test sends the length of a message, followed by the message body.

No errors.

Passed Message patterns test - patterns

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test sends/receives a number of messages in different patterns to make sure that all messages are received in the order they are sent. Two processes are used in the test.

No errors.

Passed Elapsed walltime test - wtime

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test measures how accuractly MPI can measure 1 second.

sleep(1): start:1.82276e+06, finish:1.82276e+06, duration:1.00006
No errors.

Failed Const test - const

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 2

Test Description:

This test is designed to test the new MPI-3.0 const cast applied to a "const *" buffer pointer.

[cr1cn13:48714] *** Process received signal ***
[cr1cn13:48714] Signal: Segmentation fault (11)
[cr1cn13:48714] Signal code: Invalid permissions (2)
[cr1cn13:48714] Failing at address: 0x10002004
[cr1cn13:48714] [ 0] [0x3fff955d0478]
[cr1cn13:48714] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_errmgr_default_app.so(+0x14a0)[0x3fff94c114a0]
[cr1cn13:48714] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-rte.so.2(orte_errmgr_base_select+0x84)[0x3fff94eea004]
[cr1cn13:48714] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-rte.so.2(orte_ess_base_app_setup+0x854)[0x3fff94eec2b4]
[cr1cn13:48714] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_ess_pmi.so(+0x3138)[0x3fff94b93138]
[cr1cn13:48714] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-rte.so.2(orte_init+0x324)[0x3fff94eaab34]
[cr1cn13:48714] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_init+0x47c)[0x3fff954d174c]
[cr1cn13:48714] [ 7] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Init+0x94)[0x3fff954fb454]
[cr1cn13:48714] [ 8] ./const[0x10002184]
[cr1cn13:48714] [ 9] /lib64/libc.so.6(+0x24700)[0x3fff95254700]
[cr1cn13:48714] [10] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff952548f4]
[cr1cn13:48714] *** End of error message ***
[cr1cn13:48713] *** Process received signal ***
[cr1cn13:48713] Signal: Segmentation fault (11)
[cr1cn13:48713] Signal code: Invalid permissions (2)
[cr1cn13:48713] Failing at address: 0x10002004
[cr1cn13:48713] [ 0] [0x3fffaf050478]
[cr1cn13:48713] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_errmgr_default_app.so(+0x14a0)[0x3fffae6114a0]
[cr1cn13:48713] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-rte.so.2(orte_errmgr_base_select+0x84)[0x3fffae96a004]
[cr1cn13:48713] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-rte.so.2(orte_ess_base_app_setup+0x854)[0x3fffae96c2b4]
[cr1cn13:48713] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_ess_pmi.so(+0x3138)[0x3fffae593138]
[cr1cn13:48713] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-rte.so.2(orte_init+0x324)[0x3fffae92ab34]
[cr1cn13:48713] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_init+0x47c)[0x3fffaef5174c]
[cr1cn13:48713] [ 7] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Init+0x94)[0x3fffaef7b454]
[cr1cn13:48713] [ 8] ./const[0x10002184]
[cr1cn13:48713] [ 9] /lib64/libc.so.6(+0x24700)[0x3fffaecd4700]
[cr1cn13:48713] [10] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffaecd48f4]
[cr1cn13:48713] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 1 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Passed Init argument test - init_args

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

In MPI-1.1, it is explicitly stated that an implementation is allowed to require that the arguments argc and argv passed by an application to MPI_Init in C be the same arguments passed into the application as the arguments to main. In MPI-2 implementations are not allowed to impose this requirement. Conforming implementations of MPI allow applications to pass NULL for both the argc and argv arguments of MPI_Init(). This test prints the result of the error status of MPI_Init(). If the test completes without error, it reports 'No errors.'

MPI_INIT accepts Null arguments for MPI_init().
No errors

Passed MPI Attribues test - attrself

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This is a test of creating and inserting attribues in different orders to ensure that the list management code handles all cases.

No errors

Passed MPI_Finalized() test - finalized

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This tests when MPI_Finalized() will work correctly if MPI_INit() was not called. This behaviour is not defined by the MPI standard, therefore this test is not garanteed.

No errors

Passed MPI_{Is,Query}_thread() test - initstat

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test examines the MPI_Is_thread() and MPI_Query_thread() call after being initilized using MPI_Init_thread().

No errors

Passed MPI_Get_library_version test - library_version

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

MPI-3.0 Test returns MPI library version.

Open MPI v10.1.0, package: IBM Spectrum MPI, ident: IBM Spectrum MPI, repo rev: IBM_SPECTRUM_MPI_10.01.00.03_2017.02.16, Feb 27, 2017
No errors

Passed MPI_Wtime() test - timeout

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This program tests the ability of mpiexec to timeout a process after no more than 3 minutes. By default, it will run for 30 secs.

No errors

Passed MPI_Get_version() test - version

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This MPI_3.0 test prints the MPI version. If running a version of MPI < 3.0, it simply prints "No Errors".

No errors

Passed MPI_ANY_{SOURCE,TAG} test - anyall

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test uses MPI_ANY_SOURCE and MPI_ANY_TAG on an MPI_Irecv().

No errors

Passed MPI_Status large count test - big_count_status

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test manipulates an MPI status object using MPI_Status_set_elements_x() with a large count value.

No errors

Passed MPI_BOTTOM test - bottom

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test makes use of MPI_BOTTOM in communication.

No errors

Passed MPI_Bsend() test 1 - bsend1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This is a simple program that tests MPI_Bsend().

No errors

Passed MPI_Bsend() test 2 - bsend2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This is a simple program that tests bsend.

No errors

Passed MPI_Bsend() test 3 - bsend3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This is a simple program that tests bsend.

No errors

Passed MPI_Bsend() test 4 - bsend4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This is a simple program that tests bsend.

No errors

Passed MPI_Bsend() test 5 - bsend5

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a simple program that tests bsend.

No errors

Passed MPI_Bsend() alignment test - bsendalign

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test bsend with a buffer with alignment between 1 and 7 bytes.

No errors

Passed MPI_Bsend() ordered test - bsendfrag

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test bsend message handling where different messages are received in different orders.

No errors

Passed MPI_Bsend() detach test - bsendpending

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test the handling of MPI_Bsend() operations when a detach occurs before the bsend data has been sent.

No errors

Failed MPI_Irecv() cancelled test - cancelrecv

Build: Passed

Execution: Failed

Exit Status: Application_timed_out

MPI Processes: 2

Test Description:

This test attempts to cancel a receive request.

Test Output: None.

Passed Input queuing test - eagerdt

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test of a large number of messages of MPI datatype messages with no preposted receive so that an MPI implementation may have to queue up messages on the sending side.

No errors

Passed Generalized request test - greq1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Simple test of generalized requests.This simple code allows us to check that requests can be created, tested, and waited on in the case where the request is complete before the wait is called.

No errors

Passed MPI_Send() intercomm test - icsend

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Simple test of intercommunicator send and receive.

No errors

Failed MPI_Test() pt2pt test - inactivereq

Build: Passed

Execution: Failed

Exit Status: Application_timed_out

MPI Processes: 1

Test Description:

This test program checks that the point-to-point completion routines can be applied to an inactive persistent request, as required by the MPI-1 standard. See section 3.7.3, It is allowed to call MPI TEST with a null or inactive request argument. In such a case the operation returns with flag = true and empty status.

Test Output: None.

Passed MPI_Isend() root test 1 - isendself

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This is a simple test case of sending a non-blocking message to the root process.

No errors

Passed MPI_Isend() root test 2 - isendselfprobe

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This is a simple test case of sending a non-blocking message to the root process.

No errors

Passed MPI_Isend() root test 3 - issendselfcancel

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test case sends a non-blocking synchonous send to the root process, cancels it, then attempts to read it.

No errors

Passed MPI_Mprobe() test - mprobe1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test MPI_Mprobe() to get the status of a pending receive, then calls MPI_Mrecv() with that status value.

No errors

Passed Ping flood test - pingping

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test sends a large number of messages in a loop in the source processes, and receives a large number of messages in a loop in the destination process.

No errors

Passed MPI_Probe() test 2 - probenull

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This program checks that MPI_Iprobe and MPI_Probe correctly handle a source of MPI_PROC_NULL.

No errors

Passed MPI_Probe() test 1 - probe-unexp

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This program verifies that MPI_Probe() is operating properly in the face of unexpected messages arriving after MPI_Probe() has been called. This program may hang if MPI_Probe() does not return when the message finally arrives.

No errors

Failed Many send/cancel test 1 - pscancel

Build: Passed

Execution: Failed

Exit Status: Application_timed_out

MPI Processes: 2

Test Description:

Test of various send cancel calls.

Failed to cancel a persistent send request
Failed to cancel a persistent bsend request

Passed Many send/cancel test 2 - rcancel

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test of various receive cancel calls, with multiple requests to cancel.

No errors

Passed MPI_Isend()/MPI_Request test - rqfreeb

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test MPI_Ibsend and MPI_Request_free.

No errors

Passed MPI_Request_get_status() test - rqstatus

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test MPI_Request_get_status(). The test also checks that MPI_REQUEST_NULL and MPI_STATUS_IGNORE work as arguments as required beginning with MPI-2.2.

No errors

Passed MPI_Cancel() test 2 - scancel2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test of send cancel (failure) calls.

No errors

Failed MPI_Cancel() test 1 - scancel

Build: Passed

Execution: Failed

Exit Status: Application_timed_out

MPI Processes: 2

Test Description:

Test of various send cancel calls.

Failed to cancel an Isend request
Failed to cancel an Ibsend request

Passed MPI_Request() test 3 - sendall

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test issues many non-blocking receives followed by many blocking MPI_Send() calls, then issues an MPI_Wait() on all pending receives. When complete, the program prints the amount of time transpired using MPI_Wtime().

No errors

Passed Race condition test - sendflood

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

Run this test with 8 processes. This test was submitted as a result of problems seen with the ch3:shm device on a Solaris system. The symptom is that the test hangs; this is due to losing a message, probably due to a race condition in a message-queue update.

No errors

Passed MPI_{Send,Receive} test 1 - sendrecv1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a simple test of Send-Recv.

No errors

Passed MPI_{Send,Receive} test 2 - sendrecv2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This is a simple test of various Send-Recv.

No errors

Passed MPI_{Send,Receive} test 3 - sendrecv3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Head to head send-recv to test backoff in device when large messages are being transferred.

No errors

Passed Preposted receive test - sendself

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Test of sending to self (root) (with a preposted receive).

No errors

Passed MPI_Waitany() test 1 - waitany-null

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Rhis is a simple test of MPI_Waitany().

No errors

Passed MPI_Waitany() test 2 - waittestnull

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This program checks that the various MPI_Test and MPI_Wait routines allow both null requests and in the multiple completion cases, empty lists of requests.

No errors

Passed Simple thread test 1 - initth2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

The test initializes a thread, then calls MPI_Finalize() and prints "No errors".

No errors

Passed Simple thread test 2 - initth

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

The test here is a simple one that Finalize exits, so the only action is to write no error.

No errors

Communicator Testing - Score: 98% Passed

This group features tests that emphasize MPI calls that create, manipulate, and delete MPI Communicators.

Passed Comm_split test 2 - cmsplit2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 12

Test Description:

This test ensures that MPI_Comm_split breaks ties in key values by using the original rank in the input communicator. This typically corresponds to the difference between using a stable sort or using an unstable sort. It checks all sizes from 1..comm_size(world)-1, so this test does not need to be run multiple times at process counts from a higher-level test driver.

No errors

Passed Comm_split test 3 - cmsplit

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test comm split.

No errors

Passed Comm_split test 4 - cmsplit_type

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test only checks that the MPI_Comm_split_type routine doesn't fail. It does not check for correct behavior.

No errors

Passed Comm creation test - commcreate1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

Check that Communicators can be created from various subsets of the processes in the communicator.

No errors

Passed Comm_create_group test 2 - comm_create_group4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This routine creates/frees groups using different schemes.

No errors

Passed Comm_create_group test 3 - comm_create_group8

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

This routine creates/frees groups using different schemes.

No errors

Passed Comm_create_group test 4 - comm_group_half2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This routine creates/frees groups using different schemes.

No errors

Passed Comm_create_group test 5 - comm_group_half4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This routine creates/frees groups using different schemes.

No errors

Passed Comm_creation_group test 6 - comm_group_half8

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

This routine creates/frees groups using different schemes.

No errors

Passed Comm_create_group test 7 - comm_group_rand2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This routine creates/frees groups using even-odd pairs.

No errors

Passed Comm_create_group test 8 - comm_group_rand4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This routine create/frees groups using modulus 4 random numbers.

No errors

Passed Comm_create_group test 1 - comm_group_rand8

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

This test is create/frees groups using different schemes.

No errors

Passed Comm_idup test 1 - comm_idup2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test exercises MPI_Comm_idup().

No errors

Passed Comm_idup test 2 - comm_idup4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test plan: Make rank 0 wait in a blocking recv until all other processes have posted their MPI_Comm_idup ops, then post last. Should ensure that idup doesn't block on the non-zero ranks, otherwise we'll get a deadlock.

No errors

Passed Comm_idup test 3 - comm_idup9

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 9

Test Description:

Test plan: Make rank 0 wait in a blocking recv until all other processes have posted their MPI_Comm_idup ops, then post last. Should ensure that idup doesn't block on the non-zero ranks, otherwise we'll get a deadlock.

No errors

Passed Comm_idup test 4 - comm_idup_mul

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test creating multiple communicators with MPI_Comm_idup.

No errors

Passed Comm_idup test 5 - comm_idup_overlap

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Each pair dups the communicator such that the dups are overlapping. If this were done with MPI_Comm_dup, this should deadlock.

No errors

Passed MPI_Info_create() test - comm_info

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 6

Test Description:

Comm_{set,get}_info test

No errors

Passed Comm_{get,set}_name test - commname

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test MPI_Comm_get_name().

No errors

Failed Comm_{dup,free} test - ctxalloc

Build: Passed

Execution: Failed

Exit Status: Application_timed_out

MPI Processes: 2

Test Description:

This program tests the allocation (and deallocation) of contexts.

No errors

Passed Context split test - ctxsplit

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This check is intended to fail if there is a leak of context ids. Because this is trying to exhaust the number of context ids, it needs to run for a longer time than many tests. The for loop uses 10000 iterations, which is adequate for MPICH (with only about 1k context ids available).

No errors

Passed Comm_dup test 1 - dup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test exercises MPI_Comm_dup().

No errors

Passed Comm_dup test 2 - dupic

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Check that there are separate contexts. We do this by setting up non-blocking received on both communicators, and then sending to them. If the contexts are different, tests on the unsatisfied communicator should indicate no available message.

No errors

Passed Comm_with_info() test 1 - dup_with_info2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test exercises MPI_Comm_dup_with_info().

No errors

Passed Comm_with_info test 2 - dup_with_info4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test exercises MPI_Comm_dup_with_info().

No errors

Passed Comm_with_info test 3 - dup_with_info9

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 9

Test Description:

This test exercises MPI_Comm_dup_with_info().

No errors

Passed Intercomm_create test 1 - ic1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

A simple test of the intercomm create routine, with a communication test.

No errors

Passed Intercomm_create test 2 - ic2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 33

Test Description:

Regression test based on test code from N. Radclif@Cray.

No errors

Passed Comm_create() test - iccreate

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

This program tests that MPI_Comm_create applies to intercommunicators. This is an extension added in MPI-2.

No errors

Passed Comm_create group tests - icgroup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

Get the group of an intercommunicator.The following illustrates the use of the routines to run through a selection of communicators and datatypes.

No errors

Passed Intercomm_merge test - icm

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

Test intercomm merge, including the choice of the high value.

No errors

Passed Comm_split Test 1 - icsplit

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

This tests whether MPI_Comm_split() applies to intercommunicators which is an extension of MPI-2.

No errors

Passed Intercomm_probe test - probe-intercomm

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test MPI_Probe() with an intercomm communicator.

No errors

Passed Threaded group test - comm_create_group_threads

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

In this test a number of threads are created with a distinct MPI communicator (or comm) group distringuished by its thread-id (used as a tag). Threads on even ranks join an even comm and threads on odd ranks join the odd comm.

No errors

Passed Thread Group creation test - comm_create_threads

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Every thread paticipates in a distinct MPI_Comm_create group, distinguished by its thread-id (used as the tag). Threads on even ranks join an even comm and threads on odd ranks join the odd comm.

No errors

Passed Easy thread test 1 - comm_dup_deadlock

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a simple test of threads in MPI.

No errors

Passed Easy thread test 2 - comm_idup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a simple test of threads in MPI

No Errors

Passed Multiple threads test 1 - ctxdup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test creates communications concurrently in different threads.

No errors

Passed Multiple threads test 2 - ctxidup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test creates communications concurrently in different threads.

No errors

Passed Multiple threads test 3 - dup_leak_test

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test repeatedly duplicates and frees communicators with multiple threads concurrently to stress the multithreaded aspects of the context ID allocation code. Thanks to IBM for providing the original version of this test.

No errors

Error Processing - Score: 88% Passed

This group features tests of MPI error processing.

Passed Error Handling test - errors

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Reports the default action taken on an error. It also reports if error handling can be changed to "returns", and if so, if this functions properly.

MPI errors are fatal by default.
MPI errors can be changed to MPI_ERRORS_RETURN.
Call MPI_Send() with a bad destination rank.
Error code: 4
Error string: MPI_ERR_TAG: invalid tag
No errors

Passed MPI FILE I/O test - userioerr

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test exercises MPI I/O and MPI error handling techniques.

No errors

Failed MPI_Add_error_class() test - adderr

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 1

Test Description:

Create NCLASSES new classes, each with 5 codes (160 total).

Error class 0 is not a valid error code e 5d
Error class 1 is not a valid error code e 63
Error class 2 is not a valid error code e 69
Error class 3 is not a valid error code e 6f
Error class 4 is not a valid error code e 75
Error class 5 is not a valid error code e 7b
Error class 6 is not a valid error code e 81
Error class 7 is not a valid error code e 87
Error class 8 is not a valid error code e 8d
Error class 9 is not a valid error code e 93
Error class 10 is not a valid error code e 99
Error class 11 is not a valid error code e 9f
Error class 12 is not a valid error code e a5
Error class 13 is not a valid error code e ab
Error class 14 is not a valid error code e b1
Error class 15 is not a valid error code e b7
Error class 16 is not a valid error code e bd
Error class 17 is not a valid error code e c3
Error class 18 is not a valid error code e c9
Error class 19 is not a valid error code e cf
Error class 20 is not a valid error code e d5
Error class 21 is not a valid error code e db
Error class 22 is not a valid error code e e1
Error class 23 is not a valid error code e e7
Error class 24 is not a valid error code e ed
Error class 25 is not a valid error code e f3
Error class 26 is not a valid error code e f9
Error class 27 is not a valid error code e ff
Error class 28 is not a valid error code e 105
Error class 29 is not a valid error code e 10b
Error class 30 is not a valid error code e 111
Error class 31 is not a valid error code e 117
Found 32 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[20040,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Passed MPI_Comm_errhandler() test - commcall

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test comm_{set,call}_errhandle.

No errors

Passed MPI_Error_string() test 1 - errstring

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Test that prints out MPI error codes from 0-53.

msg for 0 is MPI_SUCCESS: no errors
msg for 1 is MPI_ERR_BUFFER: invalid buffer pointer
msg for 2 is MPI_ERR_COUNT: invalid count argument
msg for 3 is MPI_ERR_TYPE: invalid datatype
msg for 4 is MPI_ERR_TAG: invalid tag
msg for 5 is MPI_ERR_COMM: invalid communicator
msg for 6 is MPI_ERR_RANK: invalid rank
msg for 7 is MPI_ERR_REQUEST: invalid request
msg for 8 is MPI_ERR_ROOT: invalid root
msg for 9 is MPI_ERR_GROUP: invalid group
msg for 10 is MPI_ERR_OP: invalid reduce operation
msg for 11 is MPI_ERR_TOPOLOGY: invalid communicator topology
msg for 12 is MPI_ERR_DIMS: invalid topology dimension
msg for 13 is MPI_ERR_ARG: invalid argument of some other kind
msg for 14 is MPI_ERR_UNKNOWN: unknown error
msg for 15 is MPI_ERR_TRUNCATE: message truncated
msg for 16 is MPI_ERR_OTHER: known error not in list
msg for 17 is MPI_ERR_INTERN: internal error
msg for 18 is MPI_ERR_IN_STATUS: error code in status
msg for 19 is MPI_ERR_PENDING: pending request
msg for 20 is MPI_ERR_ACCESS: invalid access mode
msg for 21 is MPI_ERR_AMODE: invalid amode argument
msg for 22 is MPI_ERR_ASSERT: invalid assert argument
msg for 23 is MPI_ERR_BAD_FILE: bad file
msg for 24 is MPI_ERR_BASE: invalid base
msg for 25 is MPI_ERR_CONVERSION: error in data conversion
msg for 26 is MPI_ERR_DISP: invalid displacement
msg for 27 is MPI_ERR_DUP_DATAREP: error duplicating data representation
msg for 28 is MPI_ERR_FILE_EXISTS: file exists alreay
msg for 29 is MPI_ERR_FILE_IN_USE: file already in use
msg for 30 is MPI_ERR_FILE: invalid file
msg for 31 is MPI_ERR_INFO_KEY: invalid key argument for info object
msg for 32 is MPI_ERR_INFO_NOKEY: unknown key for given info object
msg for 33 is MPI_ERR_INFO_VALUE: invalid value argument for info object
msg for 34 is MPI_ERR_INFO: invalid info object
msg for 35 is MPI_ERR_IO: input/output error
msg for 36 is MPI_ERR_KEYVAL: invalid key value
msg for 37 is MPI_ERR_LOCKTYPE: invalid lock
msg for 38 is MPI_ERR_NAME: invalid name argument
msg for 39 is MPI_ERR_NO_MEM: out of memory
msg for 40 is MPI_ERR_NOT_SAME: objects are not identical
msg for 41 is MPI_ERR_NO_SPACE: no space left on device
msg for 42 is MPI_ERR_NO_SUCH_FILE: no such file or directory
msg for 43 is MPI_ERR_PORT: invalid port
msg for 44 is MPI_ERR_QUOTA: out of quota
msg for 45 is MPI_ERR_READ_ONLY: file is read only
msg for 46 is MPI_ERR_RMA_CONFLICT: rma conflict during operation
msg for 47 is MPI_ERR_RMA_SYNC: error executing rma sync
msg for 48 is MPI_ERR_SERVICE: unknown service name
msg for 49 is MPI_ERR_SIZE: invalid size
msg for 50 is MPI_ERR_SPAWN: could not spawn processes
msg for 51 is MPI_ERR_UNSUPPORTED_DATAREP: data representation not supported
msg for 52 is MPI_ERR_UNSUPPORTED_OPERATION: operation not supported
msg for 53 is MPI_ERR_WIN: invalid window
No errors.

Passed MPI_Error_string() test 2 - errstring2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Simple test where an MPI error class is created, and an error string introduced for that string.

No errors

Passed User error handling test 2 - predef_eh2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Ensure that setting a user-defined error handler on predefined communicators does not cause a problem at finalize time. Regression test for ticket #1591.

No errors

Passed User error handling test 1 - predef_eh

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Ensure that setting a user-defined error handler on predefined communicators does not cause a problem at finalize time. Regressiontest for ticket #1591.

No errors

UTK Test Suite - Score: 83% Passed

This group features the test suite developed at the University of Tennesss Knoxville for MPI-2.2 and earlier specifications. Though techically not a functional group, it was retained to allow comparison with the previous benchmark suite.

Passed Alloc_mem test - alloc

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks if MPI_Alloc_mem() is supported. If test passes, then the following is reported "MPI_Alloc_mem is supported." else, "MPI_Alloc_mem NOT supported" is reported.

No errors

Passed Communicator attributes test - attributes

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Returns all communicator attributes that are not supported. The test is run as a single process MPI job.

No errors

Passed Extended collectives test - collectives

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Checks if "extended collectives" are supported. If the test fails to compile, then "extended collectives" are not supported. If the test compiles, then a 4-process MPI job is executed. If the job aborts, then "Extended collectives NOT supported" is reported. If the job executes and the correct value is returned, then "Extended collectives ARE supported" is reported.

No errors

Passed Deprecated routines test - deprecated

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks all MPI deprecated routines as of MPI-2.2.

MPI_Address(): is functional.
MPI_Attr_delete(): is functional.
MPI_Attr_get(): is functional.
MPI_Attr_put(): is functional.
MPI_Errhandler_create(): is functional.
MPI_Errhandler_get(): is functional.
MPI_Errhandler_set(): is functional.
MPI_Keyval_create(): is functional.
MPI_Keyval_free(): is functional.
MPI_Type_extent(): is functional.
MPI_Type_hindexed(): is functional.
MPI_Type_hvector(): is functional.
MPI_Type_lb(): is functional.
MPI_Type_struct(): is functional.
MPI_Type_ub(): is functional.
No errors

Passed Dynamic process management test - dynamic

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks if the dynamic process management routines through MPI-2.2 are defined. If the test passes, then "No errors" is reported.

MPI_Comm_spawn(): verified
MPI_Comm_get_parrent(): verified
MPI_Open_port(): verified
MPI_Comm_accept(): verified
MPI_Comm_connect(): verified
MPI_Publish_name(): verified
MPI_Unpublish_name(): verified
MPI_Lookup_name(): verified
MPI_Comm_disconnect(): verified
MPI_Comm_join(): verified
Dynamic process management routines: verified
No errors

Passed Error Handling test - errors

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Reports the default action taken on an error. It also reports if error handling can be changed to "returns", and if so, if this functions properly.

MPI errors are fatal by default.
MPI errors can be changed to MPI_ERRORS_RETURN.
Call MPI_Send() with a bad destination rank.
Error code: 4
Error string: MPI_ERR_TAG: invalid tag
No errors

Passed Init argument test - init_args

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

In MPI-1.1, it is explicitly stated that an implementation is allowed to require that the arguments argc and argv passed by an application to MPI_Init in C be the same arguments passed into the application as the arguments to main. In MPI-2 implementations are not allowed to impose this requirement. Conforming implementations of MPI allow applications to pass NULL for both the argc and argv arguments of MPI_Init(). This test prints the result of the error status of MPI_Init(). If the test completes without error, it reports 'No errors.'

MPI_INIT accepts Null arguments for MPI_init().
No errors

Passed C/Fortran interoperability test - interoperability

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks if the C-Fortran (F77) interoperability functions are supported using MPI-2.2 specification.

No errors

Passed I/O modes test - io_modes

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks if all MPI predefined I/O modes are supported. If test passes, "No errors" is reported. Any modes not supported are indicated individually as not being supported.

MPI_MODE_APPEND:128
MPI_MODE_CREATE:1
MPI_MODE_DELETE_ON_CLOSE:16
MPI_MODE_EXCL:64
MPI_MODE_RDONLY:2
MPI_MODE_RDWR:8
MPI_MODE_SEQUENTIAL:256
MPI_MODE_UNIQUE_OPEN:32
MPI_MODE_WRONLY:4
No errors

Passed I/O verification test 1 - io_test

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Reports if MPI I/O is supported. If the MPI-I/O routines terminate normally and provide correct results, MPI-I/O reportes "No errors", otherwise error messages are generated.

rank:1/4 MPI-I/O is supported.
rank:3/4 MPI-I/O is supported.
rank:2/4 MPI-I/O is supported.
rank:0/4 MPI-I/O is supported.
No errors

Passed I/O verification test 2 - io_verify

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test is used to verify that the file created by io_test,c holds the correct values. If the test fails, the problem is reported. If all tests pass successfully it is reported that MPI-I/O is supported.

MPI-I/O: MPI_File_open() is verified.
MPI-I/O: MPI_File_read() is verified.
MPI-I/O: MPI_FILE_close() is verified.
No errors

Failed Master/slave test - master

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 1

Test Description:

This test running as a single MPI process spawns four slave processes using MPI_Comm_spawn(). The master process sends and receives a message from each slave. If the test completes, it will report 'No errors.', otherwise specific error messages are listed.

[cr1cn13:57691] *** Process received signal ***
[cr1cn13:57691] Signal: Segmentation fault (11)
[cr1cn13:57691] Signal code: Invalid permissions (2)
[cr1cn13:57691] Failing at address: 0x100020b4
[cr1cn13:57691] [ 0] [0x3fff8fc20478]
[cr1cn13:57691] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_errmgr_default_app.so(+0x14a0)[0x3fff8f1e14a0]
[cr1cn13:57691] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-rte.so.2(orte_errmgr_base_select+0x84)[0x3fff8f53a004]
[cr1cn13:57691] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-rte.so.2(orte_ess_base_app_setup+0x854)[0x3fff8f53c2b4]
[cr1cn13:57691] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_ess_pmi.so(+0x3138)[0x3fff8f163138]
[cr1cn13:57691] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-rte.so.2(orte_init+0x324)[0x3fff8f4fab34]
[cr1cn13:57691] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_init+0x47c)[0x3fff8fb2174c]
[cr1cn13:57691] [ 7] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Init+0x94)[0x3fff8fb4b454]
[cr1cn13:57691] [ 8] ./master[0x1000221c]
[cr1cn13:57691] [ 9] /lib64/libc.so.6(+0x24700)[0x3fff8f8a4700]
[cr1cn13:57691] [10] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff8f8a48f4]
[cr1cn13:57691] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Passed MPI-2 Routines test 2 - mpi_2_functions_bcast

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test simply checks all MPI-2 routines that replaced some MPI-1 routines. Since these routines were added to avoid ambiquity with MPI-2 functionality, they do not add functionality to the test suite.

No errors

Passed MPI-2 routines test 1 - mpi_2_functions

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks all MPI-2.2 routines that replaced deprecated routines. If the test passes, then "No errors" is reported, otherwise, specific errors are reported."

errHandler() MPI_ERR_Other returned.
errHandler() MPI_ERR_Other returned.
errHandler() MPI_ERR_Other returned.
No errors

Passed One-sided fences test - one_sided_fences

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test Verifies that one-sided communication with active target synchronization with fences functions properly. If all operations succeed, one-sided communication with active target synchronization with fences is reported as supported. If one or more operations fail, the failures are reported and one-sided-communication with active target synchronization with fences is reported as NOT supported.

No errors

Passed One-sided communication test - one_sided_modes

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks MPI-2.2 one-sided communication modes reporting those that are not defined. If the test compiles, then "No errors" is reported, else, all undefined modes are reported as "not defined."

No errors

Passed One-sided passive test - one_sided_passive

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Verifies one-sided-communication with passive target synchronization functions properly. If all operations succeed, one-sided-communication with passive target synchronization is reported as supported. If one or more operations fail, the failures are reported and one-sided-communication with passive target synchronization with fences is reported as NOT supported.

No errors

Passed One-sided post test - one_sided_post

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Verifies one-sided-communication with active target synchronization with post/start/complete/wait functions properly. If all operations succeed, one-sided communication with active target synchronization with post/start/complete/wait is reported as supported. If one or more operations fail, the failures are reported and one-sided-communication with active target synchronization with post/start/complete/wait is reported as NOT supported.

No errors

Passed One-sided routines test - one_sided_routines

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Reports if one-sided communication routines are defined. If this test compiles, one-sided communication is reported as defined, otherwise "not supported".

No errors

Passed Thread support test - thread_safety

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Reports the level of thread support provided. This is either MPI_THREAD_SINGLE, MPI_THREAD_FUNNELED, MPI_THREAD_SERIALIZED, or MPI_THREAD_MULTIPLE.

MPI_THREAD_MULTIPLE requested.
MPI_THREAD_MULTIPLE is supported.
No errors

Failed Errorcodes test - process_errorcodes

Build: Failed

Execution: Failed

Exit Status: Build_errors

MPI Processes: 0

Test Description:

The MPI-3.0 specifications require that the same constants be available for the C language and FORTRAN. The report includes a record for each errorcode of the form "X MPI_ERRCODE is [not] verified" where X is either 'c' for the C compiler, or 'F' for the FORTRAN 77 compiler. The report sumarizes with the number of errorcodes for each compiler that were successfully verified.

Test Output: None.

Failed Assignment constants test - process_assignment_constants

Build: Failed

Execution: Failed

Exit Status: Build_errors

MPI Processes: 0

Test Description:

This test was added to the UTK suite as a partial replacement for the "utk/constants" test for Named Constants supported in MPI-1.0 and higher. The test is a perl script that constructs a small seperate main program in either C or Fortran for each constant. The constants for this test are used to assign a value to a const integer type in C and an integer type in Fortran. This test is the de facto test for any constant recognized by the compiler.

NOTE: The constants used in this test are tested against both C and Fortran compilers. Some of the constants are optional and may not be supported by the MPI implementation. Failure to verify these constants does not necessarily constitute failure of the MPI implementation to satisfy the MPI specifications.

Test Output: None.

Failed Compiletime constants test - process_compiletime_constants

Build: Failed

Execution: Failed

Exit Status: Build_errors

MPI Processes: 0

Test Description:

The MPI-3.0 specifications require that some named constants be known at compiletime. The report includes a record for each constant of this class in the form "X MPI_CONSTANT is [not] verified by METHOD" where X is either 'c' for the C compiler, or 'F' for the FORTRAN 77 compiler. For a C langauge compile, the constant is used as a case label in a switch statement. For a FORTRAN language compile, the constant is assigned to a PARAMETER. The report sumarizes with the number of constants for each compiler that was successfully verified.

Test Output: None.

Passed Datatypes test - process_datatypes

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 0

Test Description:

This test was added to the UTK suite as a replacement for the "utk/datatypes" test for constants in MPI-1.0 and higher. The test is a constructs small seperate main programs in either C, FORTRAN77, or C++ for each datatype. If a test fails to compile, the datatype is reported as "not verified: (compilation)". If the test executes successfully, the report includes the size of the datatype (in bytes) and includes the words "is verified."

c "MPI_2DOUBLE_PRECISION" Size = 16 is verified.
c "MPI_2INT" Size = 8 is verified.
c "MPI_2INTEGER" Size = 8 is verified.
c "MPI_2REAL" Size = 8 is verified.
c "MPI_AINT" Size = 8 is verified.
c "MPI_BYTE" Size = 1 is verified.
c "MPI_C_BOOL" Size = 1 is verified.
c "MPI_C_COMPLEX" Size = 8 is verified.
c "MPI_C_DOUBLE_COMPLEX" Size = 16 is verified.
c "MPI_C_FLOAT_COMPLEX" Size = 8 is verified.
c "MPI_C_LONG_DOUBLE_COMPLEX" Size = 32 is verified.
c "MPI_CHAR" Size = 1 is verified.
c "MPI_CHARACTER" Size = 1 is verified.
c "MPI_COMPLEX" Size = 8 is verified.
c "MPI_COMPLEX2" is not verified: (compilation).
c "MPI_COMPLEX4" is not verified: (compilation).
c "MPI_COMPLEX8" Size = 8 is verified.
c "MPI_COMPLEX16" Size = 16 is verified.
c "MPI_COMPLEX32" Size = 32 is verified.
c "MPI_DOUBLE" Size = 8 is verified.
c "MPI_DOUBLE_INT" Size = 12 is verified.
c "MPI_DOUBLE_COMPLEX" Size = 16 is verified.
c "MPI_DOUBLE_PRECISION" Size = 8 is verified.
c "MPI_FLOAT" Size = 4 is verified.
c "MPI_FLOAT_INT" Size = 8 is verified.
c "MPI_INT" Size = 4 is verified.
c "MPI_INT8_T" Size = 1 is verified.
c "MPI_INT16_T" Size = 2 is verified.
c "MPI_INT32_T" Size = 4 is verified.
c "MPI_INT64_T" Size = 8 is verified.
c "MPI_INTEGER" Size = 4 is verified.
c "MPI_INTEGER1" Size = 1 is verified.
c "MPI_INTEGER2" Size = 2 is verified.
c "MPI_INTEGER4" Size = 4 is verified.
c "MPI_INTEGER8" Size = 8 is verified.
c "MPI_INTEGER16" is not verified: (compilation).
c "MPI_LB" Size = 0 is verified.
c "MPI_LOGICAL" Size = 4 is verified.
c "MPI_LONG" Size = 8 is verified.
c "MPI_LONG_INT" Size = 12 is verified.
c "MPI_LONG_DOUBLE" Size = 16 is verified.
c "MPI_LONG_DOUBLE_INT" Size = 20 is verified.
c "MPI_LONG_LONG" Size = 8 is verified.
c "MPI_LONG_LONG_INT" Size = 8 is verified.
c "MPI_OFFSET" Size = 8 is verified.
c "MPI_PACKED" Size = 1 is verified.
c "MPI_REAL" Size = 4 is verified.
c "MPI_REAL2" is not verified: (compilation).
c "MPI_REAL4" Size = 4 is verified.
c "MPI_REAL8" Size = 8 is verified.
c "MPI_REAL16" Size = 16 is verified.
c "MPI_SHORT" Size = 2 is verified.
c "MPI_SHORT_INT" Size = 6 is verified.
c "MPI_SIGNED_CHAR" Size = 1 is verified.
c "MPI_UB" Size = 0 is verified.
c "MPI_UNSIGNED_CHAR" Size = 1 is verified.
c "MPI_UNSIGNED_SHORT" Size = 2 is verified.
c "MPI_UNSIGNED" Size = 4 is verified.
c "MPI_UNSIGNED_LONG" Size = 8 is verified.
c "MPI_WCHAR" Size = 4 is verified.
c "MPI_LONG_LONG_INT" Size = 8 is verified.
c "MPI_FLOAT_INT" Size = 8 is verified.
c "MPI_DOUBLE_INT" Size = 12 is verified.
c "MPI_LONG_INT" Size = 12 is verified.
c "MPI_LONG_DOUBLE_INT" Size = 20 is verified.
c "MPI_2INT" Size = 8 is verified.
c "MPI_SHORT_INT" Size = 6 is verified.
c "MPI_LONG_DOUBLE_INT" Size = 20 is verified.
c "MPI_2REAL" Size = 8 is verified.
c "MPI_2DOUBLE_PRECISION" Size = 16 is verified.
c "MPI_2INTEGER" Size = 8 is verified.
C "MPI_CXX_BOOL" Size = 1 is verified.
C "MPI_CXX_FLOAT_COMPLEX" Size = 8 is verified.
C "MPI_CXX_DOUBLE_COMPLEX" Size = 16 is verified.
C "MPI_CXX_LONG_DOUBLE_COMPLEX" Size = 32 is verified.
f "MPI_BYTE" Size =1 is verified.
f "MPI_CHARACTER" Size =1 is verified.
f "MPI_COMPLEX" Size =8 is verified.
f "MPI_DOUBLE_COMPLEX" Size =16 is verified.
f "MPI_DOUBLE_PRECISION" Size =8 is verified.
f "MPI_INTEGER" Size =4 is verified.
f "MPI_INTEGER1" Size =1 is verified.
f "MPI_INTEGER2" Size =2 is verified.
f "MPI_INTEGER4" Size =4 is verified.
f "MPI_LOGICAL" Size =4 is verified.
f "MPI_REAL" Size =4 is verified.
f "MPI_REAL2" Size =0 is verified.
f "MPI_REAL4" Size =4 is verified.
f "MPI_REAL8" Size =8 is verified.
f "MPI_PACKED" Size =1 is verified.
f "MPI_2REAL" Size =8 is verified.
f "MPI_2DOUBLE_PRECISION" Size =16 is verified.
f "MPI_2INTEGER" Size =8 is verified.
No errors.

Group Communicator - Score: 86% Passed

This group features tests of MPI communicator group calls.

Passed Win_get_group test - getgroup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a simple test of MPI_Win_get_group().

No errors

Passed MPI_Group_incl() test 1 - groupcreate

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a simple test of creating a group array.

No errors

Passed MPI_Group_incl() test 2 - groupnullincl

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a test to determine if an empty group can be created.

No errors

Passed MPI_Group_translate_ranks test - grouptest2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a test of MPI_Group_translate_ranks().

No errors

Passed MPI_Group_excl() test - grouptest

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

This is a test of MPI_Group_excl().

No errors

Passed MPI_Group irregular test - gtranks

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

This is a test comparing small groups against larger groups, and use groups with irregular members (to bypass optimizations in group_translate_ranks for simple groups).

No errors

Failed MPI_Group_Translate_ranks() test - gtranksperf

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 20

Test Description:

Measure and compare the relative performance of MPI_Group_translate_ranks with small and large group2 sizes but a constant number of ranks. This serves as a performance sanity check for the Scalasca use case where we translate to MPI_COMM_WORLD ranks. The performance should only depend on the number of ranks passed, not the size of either group (especially group2). This test is probably only meaningful for large-ish process counts.

too much difference in MPI_Group_translate_ranks performance:
time1=2.271215 time2=0.235363
(fabs(time1-time2)/time2)=8.649858
Found 1 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[21271,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Parallel Input/Output - Score: 93% Passed

This group features tests that involve MPI parallel input/output operations.

Passed I/O modes test - io_modes

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks if all MPI predefined I/O modes are supported. If test passes, "No errors" is reported. Any modes not supported are indicated individually as not being supported.

MPI_MODE_APPEND:128
MPI_MODE_CREATE:1
MPI_MODE_DELETE_ON_CLOSE:16
MPI_MODE_EXCL:64
MPI_MODE_RDONLY:2
MPI_MODE_RDWR:8
MPI_MODE_SEQUENTIAL:256
MPI_MODE_UNIQUE_OPEN:32
MPI_MODE_WRONLY:4
No errors

Passed I/O verification test 1 - io_test

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Reports if MPI I/O is supported. If the MPI-I/O routines terminate normally and provide correct results, MPI-I/O reportes "No errors", otherwise error messages are generated.

rank:1/4 MPI-I/O is supported.
rank:3/4 MPI-I/O is supported.
rank:2/4 MPI-I/O is supported.
rank:0/4 MPI-I/O is supported.
No errors

Passed I/O verification test 2 - io_verify

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test is used to verify that the file created by io_test,c holds the correct values. If the test fails, the problem is reported. If all tests pass successfully it is reported that MPI-I/O is supported.

MPI-I/O: MPI_File_open() is verified.
MPI-I/O: MPI_File_read() is verified.
MPI-I/O: MPI_FILE_close() is verified.
No errors

Passed Asynchronous IO test - async_any

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test asynchronous I/O with multiple completion. Each process writes to separate files and reads them back.

No errors

Passed Asynchronous IO test - async

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test contig asynchronous I/O. Each process writes to separate files and reads them back. The file name is taken as a command-line argument, and the process rank is appended to it.

No errors

Passed MPI_File_get_type_extent test - getextent

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test file_get_extent.

No errors

Passed Non-blocking I/O test - i_noncontig

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Tests noncontiguous reads/writes using non-blocking I/O.

No errors

Passed MPI_File_write_ordered test 1 - rdwrord

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test reading and writing ordered output.

No errors

Passed MPI_File_write_ordered test 2 - rdwrzero

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test reading and writing data with zero length. The test then looks for errors in the MPI IO routines and reports any that were found, otherwise "No errors" is reported.

No errors

Failed MPI_Type_create_resized test - resized2

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 1

Test Description:

Test file views with MPI_Type_create_resized.

file size is 20, should be 16
newbuf[0] is 55, should be 10,
 newbuf[1] is 10, should be 55,
 newbuf[2] is 55, should be 55,
 newbuf[3] is 55, should be 20
Found 2 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[58966,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Passed MPI_Type_create_resized test - resized

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Test file views with MPI_Type_create_resized.

No errors

Passed MPI_Info_set() test - setinfo

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test file_set_view. Access style is explicitly described as modifiable. Values include read_once, read_mostly, write_once, write_mostly, random.

No errors

Passed MPI_File_set_view() test - setviewcur

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test set_view with DISPLACEMENT_CURRENT. This test reads a header then sets the view to every "size" int, using set view and current displacement. The file is first written using a combination of collective and ordered writes.

No errors

Passed MPI FILE I/O test - userioerr

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test exercises MPI I/O and MPI error handling techniques.

No errors

Datatypes - Score: 90% Passed

This group features tests that involve named MPI and user defined datatypes.

Passed Datatypes test - process_datatypes

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 0

Test Description:

This test was added to the UTK suite as a replacement for the "utk/datatypes" test for constants in MPI-1.0 and higher. The test is a constructs small seperate main programs in either C, FORTRAN77, or C++ for each datatype. If a test fails to compile, the datatype is reported as "not verified: (compilation)". If the test executes successfully, the report includes the size of the datatype (in bytes) and includes the words "is verified."

c "MPI_2DOUBLE_PRECISION" Size = 16 is verified.
c "MPI_2INT" Size = 8 is verified.
c "MPI_2INTEGER" Size = 8 is verified.
c "MPI_2REAL" Size = 8 is verified.
c "MPI_AINT" Size = 8 is verified.
c "MPI_BYTE" Size = 1 is verified.
c "MPI_C_BOOL" Size = 1 is verified.
c "MPI_C_COMPLEX" Size = 8 is verified.
c "MPI_C_DOUBLE_COMPLEX" Size = 16 is verified.
c "MPI_C_FLOAT_COMPLEX" Size = 8 is verified.
c "MPI_C_LONG_DOUBLE_COMPLEX" Size = 32 is verified.
c "MPI_CHAR" Size = 1 is verified.
c "MPI_CHARACTER" Size = 1 is verified.
c "MPI_COMPLEX" Size = 8 is verified.
c "MPI_COMPLEX2" is not verified: (compilation).
c "MPI_COMPLEX4" is not verified: (compilation).
c "MPI_COMPLEX8" Size = 8 is verified.
c "MPI_COMPLEX16" Size = 16 is verified.
c "MPI_COMPLEX32" Size = 32 is verified.
c "MPI_DOUBLE" Size = 8 is verified.
c "MPI_DOUBLE_INT" Size = 12 is verified.
c "MPI_DOUBLE_COMPLEX" Size = 16 is verified.
c "MPI_DOUBLE_PRECISION" Size = 8 is verified.
c "MPI_FLOAT" Size = 4 is verified.
c "MPI_FLOAT_INT" Size = 8 is verified.
c "MPI_INT" Size = 4 is verified.
c "MPI_INT8_T" Size = 1 is verified.
c "MPI_INT16_T" Size = 2 is verified.
c "MPI_INT32_T" Size = 4 is verified.
c "MPI_INT64_T" Size = 8 is verified.
c "MPI_INTEGER" Size = 4 is verified.
c "MPI_INTEGER1" Size = 1 is verified.
c "MPI_INTEGER2" Size = 2 is verified.
c "MPI_INTEGER4" Size = 4 is verified.
c "MPI_INTEGER8" Size = 8 is verified.
c "MPI_INTEGER16" is not verified: (compilation).
c "MPI_LB" Size = 0 is verified.
c "MPI_LOGICAL" Size = 4 is verified.
c "MPI_LONG" Size = 8 is verified.
c "MPI_LONG_INT" Size = 12 is verified.
c "MPI_LONG_DOUBLE" Size = 16 is verified.
c "MPI_LONG_DOUBLE_INT" Size = 20 is verified.
c "MPI_LONG_LONG" Size = 8 is verified.
c "MPI_LONG_LONG_INT" Size = 8 is verified.
c "MPI_OFFSET" Size = 8 is verified.
c "MPI_PACKED" Size = 1 is verified.
c "MPI_REAL" Size = 4 is verified.
c "MPI_REAL2" is not verified: (compilation).
c "MPI_REAL4" Size = 4 is verified.
c "MPI_REAL8" Size = 8 is verified.
c "MPI_REAL16" Size = 16 is verified.
c "MPI_SHORT" Size = 2 is verified.
c "MPI_SHORT_INT" Size = 6 is verified.
c "MPI_SIGNED_CHAR" Size = 1 is verified.
c "MPI_UB" Size = 0 is verified.
c "MPI_UNSIGNED_CHAR" Size = 1 is verified.
c "MPI_UNSIGNED_SHORT" Size = 2 is verified.
c "MPI_UNSIGNED" Size = 4 is verified.
c "MPI_UNSIGNED_LONG" Size = 8 is verified.
c "MPI_WCHAR" Size = 4 is verified.
c "MPI_LONG_LONG_INT" Size = 8 is verified.
c "MPI_FLOAT_INT" Size = 8 is verified.
c "MPI_DOUBLE_INT" Size = 12 is verified.
c "MPI_LONG_INT" Size = 12 is verified.
c "MPI_LONG_DOUBLE_INT" Size = 20 is verified.
c "MPI_2INT" Size = 8 is verified.
c "MPI_SHORT_INT" Size = 6 is verified.
c "MPI_LONG_DOUBLE_INT" Size = 20 is verified.
c "MPI_2REAL" Size = 8 is verified.
c "MPI_2DOUBLE_PRECISION" Size = 16 is verified.
c "MPI_2INTEGER" Size = 8 is verified.
C "MPI_CXX_BOOL" Size = 1 is verified.
C "MPI_CXX_FLOAT_COMPLEX" Size = 8 is verified.
C "MPI_CXX_DOUBLE_COMPLEX" Size = 16 is verified.
C "MPI_CXX_LONG_DOUBLE_COMPLEX" Size = 32 is verified.
f "MPI_BYTE" Size =1 is verified.
f "MPI_CHARACTER" Size =1 is verified.
f "MPI_COMPLEX" Size =8 is verified.
f "MPI_DOUBLE_COMPLEX" Size =16 is verified.
f "MPI_DOUBLE_PRECISION" Size =8 is verified.
f "MPI_INTEGER" Size =4 is verified.
f "MPI_INTEGER1" Size =1 is verified.
f "MPI_INTEGER2" Size =2 is verified.
f "MPI_INTEGER4" Size =4 is verified.
f "MPI_LOGICAL" Size =4 is verified.
f "MPI_REAL" Size =4 is verified.
f "MPI_REAL2" Size =0 is verified.
f "MPI_REAL4" Size =4 is verified.
f "MPI_REAL8" Size =8 is verified.
f "MPI_PACKED" Size =1 is verified.
f "MPI_2REAL" Size =8 is verified.
f "MPI_2DOUBLE_PRECISION" Size =16 is verified.
f "MPI_2INTEGER" Size =8 is verified.
No errors.

Passed Blockindexed contiguous test 1 - blockindexed-misc

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test converts a block indexed datatype to a contiguous datatype.

No errors

Passed Blockindexed contiguous test 2 - blockindexed-zero-count

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This tests the behaviour with a zero-count blockindexed datatype.

No errors

Passed Type_get_envelope test - contents

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This tests the functionality of MPI_Type_get_envelope() and MPI_Type_get_contents().

No errors

Passed Simple datatype test 1 - contigstruct

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test checks to see if we can create a simple datatype made from many contiguous copies of a single struct. The struct is built with monotone decreasing displacements to avoid any struct->config optimizations.

No errors

Failed Simple datatype test 2 - contig-zero-count

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 1

Test Description:

Tests behaviour with a zero count contig.

Found 1 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[55523,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Passed C++ datatype test - cxx-types

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test checks for the existence of four new C++ named predefined datatypes that should be accessible from C and Fortran.

No errors

Passed Type_create_darray test - darray-cyclic

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 12

Test Description:

Cyclic check of a custom struct darray.

No errors

Passed Type_create_darray test - darray-pack_72

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 32

Test Description:

The default behavior of the test is be to indicate the cause of any errors.

No errors

Passed Type_create_darray packing test - darray-pack

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 9

Test Description:

Performs a sequence of tests building darrays with single-element blocks, running through all the various positions that the element might come from. Returns the number of errors encountered.

No errors

Passed Type_struct() alignment test - dataalign

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This routine checks the alignment of a custom datatype.

No errors

Passed Get_address test - gaddress

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This routine shows how math can be used on MPI addresses.

No errors

Passed Get_elements test - get-elements

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

We use a contig of a struct in order to satisfy two properties: (A) a type that contains more than one element type (the struct portion) (B) a type that has an odd number of ints in its "type contents" (1 in this case). This triggers a specific bug in some versions of MPICH.

No errors

Failed Get_elements Pair test - get-elements-pairtype

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 1

Test Description:

Send a { double, int, double} tuple and receive as a pair of MPI_DOUBLE_INTs. this should (a) be valid, and (b) result in an element count of 3.

Found 1 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[56469,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Passed Get_elements test - getpartelm

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Receive partial datatypes and check that MPI_Getelements gives the correct version.

No errors

Passed Datatype structs test - get-struct

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test was motivated by the failure of an example program for RMA involving simple operations on a struct that included a struct. The observed failure was a SEGV in the MPI_Get.

No errors

Passed Type_create_hindexed_block test 1 - hindexed_block

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Tests behavior with a hindexed_block that can be converted to a contig easily. This is specifically for coverage. Returns the number of errors encountered.

No errors

Passed Type_create_hindexed_block test 2 - hindexed_block_contents

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test is a simple check of MPI_Type_create_hindexed_block() using MPI_Type_get_envelope() and MPI_Type_get_contents().

No errors

Passed Type_hindexed test - hindexed-zeros

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Tests with an hindexed type with all zero length blocks.

No errors

Passed Type_hvector_blklen test - hvecblklen

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Inspired by the Intel MPI_Type_hvector_blklen test. Added to include a test of a dataloop optimization that failed.

No errors

Passed Type_indexed test - indexed-misc

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Tests behavior with an indexed array that can be compacted but should continue to be stored as an indexed type. Specifically for coverage. Returns the number of errors encountered.

No errors

Failed Large count test - large-count

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 1

Test Description:

This test checks for large count functionality ("MPI_Count") mandated by MPI-3, as well as behavior of corresponding pre-MPI-3 interfaces that have better defined behavior when an "int" quantity would overflow.

check failed: (elements == (2147483647)), line 227
check failed: (elements_x == (2147483647)), line 227
check failed: (count == 1), line 227
check failed: (elements == (2147483647)), line 227
check failed: (elements_x == (2147483647)), line 227
check failed: (count == 1), line 227
check failed: (elements == (4)), line 228
check failed: (elements_x == (4)), line 228
check failed: (count == 1), line 228
found 18 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[56053,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Passed Type_contiguous test - large_type

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test checks that MPI can handle large datatypes.

No errors

Passed Contiguous bounds test - lbub

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

The default behavior of the test is be to indicate the cause of any errors.

No errors

Passed Pack test - localpack

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test users MPI_Pack() on a communication buffer, then call MPU_Unpack() to confirm that the unpacked data matches the original. This routine performs all work within a simple processor.

No errors

Passed LONG_DOUBLE size test - longdouble

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test ensures that simplistic build logic/configuration did not result in a defined, yet incorrectly sized, MPI predefined datatype for long double and long double Complex. Based on a test suggested by Jim Hoekstra @ Iowa State University. The test also considers other datatypes that are optional in the MPI-3 specification.

No errors

Passed Type_indexed test - lots-of-types

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Author: Rob Ross
Date: November 2, 2005

This test allocates 1024 indexed datatypes with 1024 distinct blocks each. It's possible that a low memory machine will run out of memory running this test. This test requires approximately 25MBytes of memory at this time.

No errors

Passed Datatypes test 1 - pairtype-size-extent

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Check for optional datatypes such as LONG_DOUBLE_INT.

No errors

Passed Datatypes test 2 - sendrecvt2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This program is derived from one in the MPICH-1 test suite. It tests a wide variety of basic and derived datatypes.

No errors

Passed Datatypes test 3 - sendrecvt4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This program is derived from one in the MPICH-1 test suite. This test sends and receives EVERYTHING from MPI_BOTTOM, by putting the data into a structure.

No errors

Passed Type_commit test - simple-commit

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Tests that verifies that the MPI_Type_commit succeeds.

No errors

Passed Pack test - simple-pack

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Tests functionality of MPI_Type_get_envelope() and MPI_Type_get_contents() on a MPI_FLOAT. Returns the number of errors encountered.

No errors

Passed Pack_external_size test - simple-pack-external

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Tests functionality of MPI_Type_get_envelope() and MPI_Type_get_contents() on a MPI_FLOAT. Returns the number of errors encountered.

No errors

Passed Type_create_resized test - simple-resized

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Tests behavior with resizing of a simple derived type.

No errors

Passed Type_get_extent test - simple-size-extent

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test confirms that MPI_Type_get_extent() works properly.

No errors

Passed Pack, Unpack test - slice-pack

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test confirms that sliced array pack and unpack properly.

No errors

Passed Type_hvector test - struct-derived-zeros

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Based on code from Jeff Parker at IBM.

No errors

Passed Type_struct test - struct-empty-el

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test creates an MPI_Type_struct() datatype, assigns data and sends the strufcture to a second process. The second process receives the structure and conforms that the information contained in the structure agrees with the original data.

No errors

Passed MPI_Type_struct test 1 - struct-ezhov

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This is a very simple where a MPI_Type-struct() datatype is created and transfered to a second processor where the size of the structure is confirmed.

No errors

Failed MPI_Type_struct test 2 - struct-no-real-types

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 1

Test Description:

Tests behavior with an empty struct type.

error: extent is 9223372036854775798 but should be -10 in no_real_types_test()
type map is { (LB,10) }, so UB is 0 and extent is ub-lb
1 errors in blockindexed test.
Found 1 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[57031,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Passed Pack, Unpack test 1 - structpack2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test confirms that packed structures unpack properly.

No errors

Passed Pack,Unpack test 2 - struct-pack

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test confirms that packed structures unpack properly.

No errors

Passed Derived HDF5 test - struct-verydeep

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test simulates a HDF5 structure type encountered by the HDF5 library. The test is run using 1 processor (submitted by Rob Latham robl@mcs.anl.gov.

No errors

Failed MPI datatype test - struct-zero-count

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 1

Test Description:

Tests behavior with a zero-count struct of builtins.

Found 1 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[54127,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Passed Type_create_subarray test 1 - subarray

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test creates a subarray and confirms its contents.

No errors

Passed Type_create_subarray test 2 - subarray-pack

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test confirms that a packed sub-array can be properly unpacked.

No errors

Passed Datatype reference count test - tfree

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test to check if freed datatypes have reference count semantics. The idea here is to create a simple but non-contiguous datatype, perform an irecv with it, free it, and then create many new datatypes. If the datatype was freed and the space was reused, this test may detect an error.

No errors

Passed Datatype match test - tmatchsize

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Test of type_match_size. Check the most likely cases. Note that it is an error to free the type returned by MPI_Type_match_size. Also note that it is an error to request a size not supported by the compiler, so Type_match_size should generate an error in that case.

No errors

Passed Pack,Unpack test - transpose-pack

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test confirms that an MPI packed matrix can be unpacked correctly by the MPI infrastructure.

No errors

Passed Type_create_resized() test 1 - tresized2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test of MPI datatype resized with non-zero lower bound.

No errors

Passed Type_create_resized() test 2 - tresized

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test of MPI datatype resized with 0 lower bound.

No errors

Passed Type_commit test - typecommit

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test builds datatypes using various components and confirms that MPI_Type_commit() succeeded.

No errors

Passed Type_free test - typefree

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test is used to confirm that memory is properly recovered from freed datatypes. The test may be run with valgrind or similar tools, or it may be run with MPI implementation specific options. For this test it is run only with standard MPI error checking enabled.

No errors

Passed Type_{lb,ub,extent} test - typelb

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test checks that both the upper and lower boundary of an hindexed MPI type is correct.

No errors

Failed Datatype inclusive test - typename

Build: Failed

Execution: NA

Exit Status: Build_errors

MPI Processes: 1

Test Description:

Sample some datatypes. See 8.4, "Naming Objects" in MPI-2. The default name is the same as the datatype name.

Test Output: None.

Passed Unpack() test - unpack

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Test sent in by Avery Ching to report a bug in MPICH. Adding it as a regression test. Note: Unpack without a Pack is not technically correct, but should work with MPICH. This may not be supported with other MPI variants.

No errors

Passed Noncontiguous datatypes test - unusual-noncontigs

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test uses a structure datatype that describes data that is contiguous, but is is manipulated as if it is noncontiguous. The test is designed to expose flaws in MPI memory management should they exist.

No errors

Passed Type_vector_blklen test - vecblklen

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test is inspired by the Intel MPI_Type_vector_blklen test. The test fundamentally tries to deceive MPI into scrambling the data using padded struct types, and MPI_Pack() and MPI_Unpack(). The data is then checked to make sure the original data was not lost in the process. If "No errors" is reported, then the MPI functions that manipulated the data did not corrupt the test data.

No errors

Passed Zero size block test - zeroblks

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test creates an empty packed indexed type, and then checks that the last 40 entrines of the unpacked recv_buffer have the corresponding elements from the send buffer.

No errors

Passed Datatype test - zeroparms

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test creates a valid datatype, commits and frees the datatype, then repeats the process for a second datatype of the same size.

No errors

Collectives - Score: 78% Passed

This group features tests of utilizing MPI collectives.

Failed Allgather test 1 - allgather2

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 10

Test Description:

This is a test of MPI_Allgather() using the MPI_IN_PLACE argument.

Found 10 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[50472,1],3]
  Exit code:    1
--------------------------------------------------------------------------

Passed Allgather test 2 - allgather3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

This test is similar to coll/allgather2, but it tests a zero byte gather operation.

No errors

Failed Allgather test 3 - allgatherv2

Build: Passed

Execution: Failed

Exit Status: Failed with signal 6

MPI Processes: 10

Test Description:

Gather data from a vector to contiguous datatype. Use IN_PLACE. This is the trivial version based on the coll/allgather test with constant data sizes.

Error lpstart 100178e page_start 1001788 lpend 100178e
allgatherv2: /__unresolved_path_____________/ibmsrc/pami/pami/buildtools/pami_build_port/../pami/common/ibunix/MemregionCache.h:434: PAMI::MRElement* PAMI::MemregionCache::createOrMerge(size_t, size_t): Assertion `lpstart < page_start' failed.
[cr1cn13:66269] *** Process received signal ***
[cr1cn13:66269] Signal: Aborted (6)
[cr1cn13:66269] Signal code:  (-6)
[cr1cn13:66269] [ 0] [0x3fffa8740478]
[cr1cn13:66269] [ 1] /lib64/libc.so.6(abort+0x280)[0x3fffa83e0d70]
[cr1cn13:66269] [ 2] /lib64/libc.so.6(+0x348a4)[0x3fffa83d48a4]
[cr1cn13:66269] [ 3] /lib64/libc.so.6(__assert_fail+0x64)[0x3fffa83d4994]
[cr1cn13:66269] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/pami_port/libpami.so(_ZN4PAMI14MemregionCache13createOrMergeEmm+0x5f4)[0x3fffa51bb614]
[cr1cn13:66269] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/pami_port/libpami.so(PAMI_Memregion_create+0x1e0)[0x3fffa51790f0]
[cr1cn13:66269] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/pami_port/libpami.so(_ZN4PAMI8Protocol4Send9EagerRgetINS_6Device5Shmem11PacketModelINS3_11ShmemDeviceINS_4Fifo10LinearFifoINS7_10FifoPacketILj64ELj4096EEENS_7Counter8IndirectINSB_6NativeEEELj128EEESE_NS4_9CMAShaddrELj256ELj512EEEEENS4_8DmaModelISH_Lb0EEEE17dispatch_envelopeEPvSM_mSM_SM_+0x134)[0x3fffa51d2364]
[cr1cn13:66269] [ 7] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/pami_port/libpami.so(PAMI_Context_advancev+0x4ec)[0x3fffa517714c]
[cr1cn13:66269] [ 8] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libcollectives.so(LIBCOLL_Advance+0x34)[0x3fffa4e9b3a4]
[cr1cn13:66269] [ 9] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_ibm.so(mca_coll_ibm_allgatherv+0x218)[0x3fffa5023598]
[cr1cn13:66269] [10] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Allgatherv+0x1ac)[0x3fffa865398c]
[cr1cn13:66269] [11] ./allgatherv2[0x10002340]
[cr1cn13:66269] [12] /lib64/libc.so.6(+0x24700)[0x3fffa83c4700]
[cr1cn13:66269] [13] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffa83c48f4]
[cr1cn13:66269] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node cr1cn13 exited on signal 6 (Aborted).
--------------------------------------------------------------------------

Passed Allgather test 4 - allgatherv3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

Gather data from a vector to contiguous datatype. This is the trivial version based on the allgather test (allgatherv but with constant data sizes).

No errors

Passed Allreduce test 2 - allred2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

MPI_Allreduce() Test using MPI_IN_PLACE.

No errors

Passed Allreduce test 3 - allred3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

This test implements a simple matrix-matrix multiply. This is an associative but not commutative operation where matSize=matrix. The number of matrices is the count argument. The matrix is stored in C order, so that c(i,j) = cin[j+i*matSize].

No errors

Passed Allreduce test 4 - allred4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This example is similar to coll/allred3, but uses 3x3 matrices with integer-valued entries. This is an associative but not commutative operation. The number of matrices is the count argument. The matrix is stored in C order, such that

c(i,j) is cin[j+i*3]
I = identity matrix

A = (1 0 0    B = (0 1 0
     0 0 1         1 0 0
     0 1 0)        0 0 1)

The product:

I^k A I^(p-2-k-j) B I^j

is

(0 1 0
0 0 1
1 0 0)

for all values of k, p, and j.

No errors

Passed Allreduce test 5 - allred5

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

This test implements a simple matrix-matrix multiply. The operation is associative but not commutative where matSize=matrix. The number of matrices is the count argument. The matrix is stored in C order, so that c(i,j) is cin[j+i*matSize].

No errors

Passed Allreduce test 6 - allred6

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

This is a comprehensive test of MPI_Allreduce().

No errors

Passed Allreduce test 1 - allred

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

This test all possible MPI operation codes using the MPI_Allreduce() routine.

No errors

Passed Allreduce test 7 - allredmany

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This example should be run with 2 processes and tests the ability of the implementation to handle a flood of one-way messages.

No errors

Failed Alltoall test 8 - alltoall1

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 8

Test Description:

The test illustrates the use of MPI_Alltoall() to run through a selection of communicators and datatypes.

Found 8 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[3256,1],4]
  Exit code:    1
--------------------------------------------------------------------------

Passed Alltoallv test 1 - alltoallv0

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

This tests MPI_Alltoallv() by having each processor send data to two neighbors only, using counts of 0 for the other neighbors. This idiom is sometimes used for halo exchange operations. The test uses MPI_INT which is adequate for testing systems that use point-to-point operations.

No errors

Failed Alltoallv test 2 - alltoallv

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 10

Test Description:

This program tests MPI_Alltoallv() by having each processor send different amounts of data to each neighboring processor. The test uses only MPI_INT which is adequate for testing systems that use point-to-point operations.

Found 65 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[54343,1],5]
  Exit code:    1
--------------------------------------------------------------------------

Passed Matrix transpose test 1 - alltoallw1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

This somewhat detailed example test was taken from MPI-The complete reference, Vol 1, p 222-224. Please refer to this reference for more details of the test.

No errors

Failed Matrix transpose test 2 - alltoallw2

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 10

Test Description:

This program tests MPI_Alltoallw() by having the ith processor send different amounts of data to all processors. This is similar to the coll/alltoallv test, but with displacements in bytes rather than units of the datatype. Currently, the test uses only MPI_INT which is adequate for testing systems that use point-to-point operations.

Found 65 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[3910,1],3]
  Exit code:    1
--------------------------------------------------------------------------

Failed Alltoallw test - alltoallw_zeros

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 8

Test Description:

Based on a test case contributed by Michael Hofmann. This test makes sure that zero counts with non-zero-sized types on the send (recv) side match and don't cause a problem with non-zero counts and zero-sized types on the recv (send) side when using MPI_Alltoallw and MPI_Alltoallv.

[cr1cn13:61261] *** Process received signal ***
[cr1cn13:61261] Signal: Segmentation fault (11)
[cr1cn13:61261] Signal code: Address not mapped (1)
[cr1cn13:61261] Failing at address: 0x20
[cr1cn13:61262] *** Process received signal ***
[cr1cn13:61262] Signal: Segmentation fault (11)
[cr1cn13:61262] Signal code: Address not mapped (1)
[cr1cn13:61262] Failing at address: 0x20
[cr1cn13:61262] [ 0] [0x3fff9de70478]
[cr1cn13:61262] [ 1] [cr1cn13:61263] *** Process received signal ***
[cr1cn13:61263] Signal: Segmentation fault (11)
[cr1cn13:61263] Signal code: Address not mapped (1)
[cr1cn13:61263] Failing at address: 0x20
[cr1cn13:61263] [ 0] [cr1cn13:61264] *** Process received signal ***
[cr1cn13:61264] Signal: Segmentation fault (11)
[cr1cn13:61264] Signal code: Address not mapped (1)
[cr1cn13:61264] Failing at address: 0x20
[cr1cn13:61264] [ 0] [0x3fffb2180478]
[cr1cn13:61264] [ 1] [0x0]
[cr1cn13:61264] [ 2] [cr1cn13:61265] *** Process received signal ***
[cr1cn13:61265] Signal: Segmentation fault (11)
[cr1cn13:61265] Signal code: Address not mapped (1)
[cr1cn13:61265] Failing at address: 0x20
[cr1cn13:61265] [ 0] [0x3fffa02c0478]
[cr1cn13:61265] [ 1] [cr1cn13:61266] *** Process received signal ***
[cr1cn13:61266] Signal: Segmentation fault (11)
[cr1cn13:61266] Signal code: Address not mapped (1)
[cr1cn13:61266] Failing at address: 0x20
[cr1cn13:61266] [ 0] [0x3fff7afb0478]
[cr1cn13:61266] [ 1] [0x0]
[cr1cn13:61266] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_ibm.so(mca_coll_ibm_alltoallv+0x60c)[0x3fff73905fec]
[cr1cn13:61267] *** Process received signal ***
[cr1cn13:61267] Signal: Segmentation fault (11)
[cr1cn13:61267] Signal code: Address not mapped (1)
[cr1cn13:61267] Failing at address: 0x20
[cr1cn13:61267] [ 0] [0x3fff81f40478]
[cr1cn13:61267] [ 1] [0x0]
[cr1cn13:61267] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_ibm.so(mca_coll_ibm_alltoallv+0x60c)[0x3fff7a8a5fec]
[cr1cn13:61267] [ 3] [cr1cn13:61268] *** Process received signal ***
[cr1cn13:61268] Signal: Segmentation fault (11)
[cr1cn13:61268] Signal code: Address not mapped (1)
[cr1cn13:61268] Failing at address: 0x20
[cr1cn13:61268] [ 0] [0x3fff8bc20478]
[cr1cn13:61268] [ 1] [0x0]
[cr1cn13:61268] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_ibm.so(mca_coll_ibm_alltoallv+0x60c)[0x3fff88585fec]
[cr1cn13:61268] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Alltoallv+0x1c0)[0x3fff8bb35340]
[cr1cn13:61261] [ 0] [0x3fffb0540478]
[cr1cn13:61261] [ 1] [0x0]
[cr1cn13:61261] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_ibm.so(mca_coll_ibm_alltoallv+0x60c)[0x3ffface25fec]
[cr1cn13:61261] [ 3] [0x0]
[cr1cn13:61262] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_ibm.so(mca_coll_ibm_alltoallv+0x60c)[0x3fff967d5fec]
[cr1cn13:61262] [ 3] [0x3fff7d1f0478]
[cr1cn13:61263] [ 1] [0x0]
[cr1cn13:61263] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_ibm.so(mca_coll_ibm_alltoallv+0x60c)[0x3fff79b55fec]
[cr1cn13:61263] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_ibm.so(mca_coll_ibm_alltoallv+0x60c)[0x3fffb00b5fec]
[cr1cn13:61264] [ 3] [0x0]
[cr1cn13:61265] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_ibm.so(mca_coll_ibm_alltoallv+0x60c)[0x3fff9cc25fec]
[cr1cn13:61265] [ 3] [cr1cn13:61266] [ 3] [cr1cn13:61268] [ 4] ./alltoallw_zeros[0x100023b8]
[cr1cn13:61268] [ 5] /lib64/libc.so.6(+0x24700)[0x3fff8b8a4700]
[cr1cn13:61268] [ 6] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff8b8a48f4]
[cr1cn13:61268] *** End of error message ***
/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Alltoallv+0x1c0)[0x3fff7aec5340]
[cr1cn13:61266] [ 4] ./alltoallw_zeros[0x100023b8]
[cr1cn13:61266] [ 5] /lib64/libc.so.6(+0x24700)[0x3fff7ac34700]
[cr1cn13:61266] [ 6] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff7ac348f4]
[cr1cn13:61266] *** End of error message ***
/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Alltoallv+0x1c0)[0x3fffb0455340]
[cr1cn13:61261] [ 4] ./alltoallw_zeros[0x100023b8]
[cr1cn13:61261] [ 5] /lib64/libc.so.6(+0x24700)[0x3fffb01c4700]
[cr1cn13:61261] [ 6] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffb01c48f4]
[cr1cn13:61261] *** End of error message ***
/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Alltoallv+0x1c0)[0x3fff9dd85340]
[cr1cn13:61262] [ 4] ./alltoallw_zeros[0x100023b8]
[cr1cn13:61262] [ 5] /lib64/libc.so.6(+0x24700)[0x3fff9daf4700]
[cr1cn13:61262] [ 6] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff9daf48f4]
[cr1cn13:61262] *** End of error message ***
/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Alltoallv+0x1c0)[0x3fff7d105340]
[cr1cn13:61263] [ 4] ./alltoallw_zeros[0x100023b8]
[cr1cn13:61263] [ 5] /lib64/libc.so.6(+0x24700)[0x3fff7ce74700]
[cr1cn13:61263] [ 6] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff7ce748f4]
[cr1cn13:61263] *** End of error message ***
/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Alltoallv+0x1c0)[0x3fffb2095340]
[cr1cn13:61264] [ 4] ./alltoallw_zeros[0x100023b8]
[cr1cn13:61264] [ 5] /lib64/libc.so.6(+0x24700)[0x3fffb1e04700]
[cr1cn13:61264] [ 6] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffb1e048f4]
[cr1cn13:61264] *** End of error message ***
/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Alltoallv+0x1c0)[0x3fffa01d5340]
[cr1cn13:61265] [ 4] ./alltoallw_zeros[0x100023b8]
[cr1cn13:61265] [ 5] /lib64/libc.so.6(+0x24700)[0x3fff9ff44700]
[cr1cn13:61265] [ 6] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff9ff448f4]
[cr1cn13:61265] *** End of error message ***
/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Alltoallv+0x1c0)[0x3fff81e55340]
[cr1cn13:61267] [ 4] ./alltoallw_zeros[0x100023b8]
[cr1cn13:61267] [ 5] /lib64/libc.so.6(+0x24700)[0x3fff81bc4700]
[cr1cn13:61267] [ 6] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff81bc48f4]
[cr1cn13:61267] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 5 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Passed Bcast test 1 - bcast2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

Test of broadcast with various roots and datatypes and sizes that are not powers of two.

No errors

Passed Bcast test 2 - bcast3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

Test of broadcast with various roots and datatypes and sizes that are not powers of two.

No errors

Passed Bcast test 3 - bcasttest

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

Various tests of MPI_Bcast() using MPI_INIT with data sizes that are in powers of two.

No errors

Passed Bcast test 4 - bcastzerotype

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

Tests broadcast behavior with non-zero counts but zero-sized types.

No errors

Passed Reduce/Bcast tests - coll10

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

The operation is inoutvec[i] = invec[i] op inoutvec[i] (see MPI-1.3 Message-Passing INterface section 4.9.4). The order of operation is important. Note that the computation is in process rank (in the communicator) order independant of the root process.

No errors

Passed MScan test - coll11

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

The operation is inoutvec[i] = invec[i] op inoutvec[i] (see MPI-1.3 Message-Passing INterface section 4.9.4). The order of operation is important. Note that the computation is in process rank (in the communicator) order independant of the root process.

No errors

Passed Reduce/Bcast/Allreduce test - coll12

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test uses various calls to MPI_Reduce(), MPI_Bcast(), and MPI_Allreduce().

No errors

Passed Alltoall test - coll13

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a test contributed by hook@nas.nasa.gov. It is another test of MPI_Alltoall().

No errors

Passed Gather test - coll2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

This test uses MPI_Gather() to define a two-dimensional table.

No errors

Passed Gatherv test - coll3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

This test uses MPI_Gatherv() to define a two-dimensional table. This test is similar to coll/coll2.

No errors

Passed Scatter test - coll4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test uses MPI_Scatter() to define a two-dimensional table. See also test coll2 and coll3 for similar tests.

No errors

Passed Scatterv test - coll5

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test uses MPI_SCatterv() to define a two-dimensional table.

No errors

Passed Allgatherv test - coll6

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

This test uses MPI_Allgatherv() to define a two-dimensional table.

No errors

Passed Allgatherv test - coll7

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

This test if the same as coll/coll6 except that the size of the table is greater than the number of processors.

No errors

Passed Reduce/Bcast test - coll8

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test repeats pairs of calls to MPI_Reduce() and MPI_Bcast() using different reduction operations while looking for errors.

No errors

Passed Reduce/Bcast test - coll9

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test uses various calls to MPI_Reduce(), MPI_Bcast(), and MPI_Allreduce().

No errors

Passed Exscan Exclusive Scan test - exscan2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

Test Simple test of MPI_Exscan().

No errors

Failed Exscan exclusive scan test - exscan

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 10

Test Description:

The following illustrates the use of the routines to run through a selection of communicators and datatypes. Use subsets of these for tests that do not involve combinations of communicators, datatypes, and counts of datatypes.

Found 1040 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[52051,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Passed Gather test - gather2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This tests gathers data from a vector to contiguous datatype. The test uses the IN_PLACE option.

No errors

Failed Gather test - gather

Build: Passed

Execution: Failed

Exit Status: Application_timed_out

MPI Processes: 4

Test Description:

This test gathers data from a vector to contiguous datatype. The test does not use MPI_IN_PLACE.

Test Output: None.

Failed Iallreduce test - iallred

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 2

Test Description:

This test illustrates the use of MPI_Iallreduce() and MPI_Allreduce().

-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[55608,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Passed Ibarrier test - ibarrier

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test calls MPI_Ibarrier() followed by an conditional loop containing usleep(1000) and MPI_Test(). This test hung indefinitely under some MPI implementations. Successfully completing this test indicates the error has been corrected.

No errors

Passed Allgather test - icallgather

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

Simple intercomm allgather test.

No errors

Passed Allgatherv test - icallgatherv

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

Simple intercomm allgatherv test.

No errors

Passed Allreduce test - icallreduce

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

Simple intercomm allreduce test.

No errors

Passed Alltoall test - icalltoall

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

Simple intercomm alltoall test.

No errors

Passed Alltoallv test - icalltoallv

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

This program tests MPI_Alltoallv by having processor i send different amounts of data to each processor. Because there are separate send and receive types to alltoallv, there need to be tests to rearrange data on the fly. The first test sends i items to processor i from all processors. Currently, the test uses only MPI_INT which is adequate for testing systems using point-to-point operations.

No errors

Passed Alltoallw test - icalltoallw

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

This program tests MPI_Alltoallw by having processor i send different amounts of data to each processor. This is just the MPI_Alltoallv test, but with displacements in bytes rather than units of the datatype. Because there are separate send and receive types to alltoallw, there need to be tests to rearrange data on the fly.

The first test sends i items to processor i from all processors. Currently, the test uses only MPI_INT; this is adequate for testing systems that use point-to-point operations.

No errors

Passed Barrier test - icbarrier

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

This only checks that the Barrier operation accepts intercommunicators. It does not check for the semantics of a intercomm barrier (all processes in the local group can exit when (but not before) all processes in the remote group enter the barrier.

No errors

Passed Bcast test - icbcast

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

Simple intercomm broadcast test.

No errors

Passed Gather test - icgather

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

Simple intercomm gather test.

No errors

Passed Gatherv test - icgatherv

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

Simple intercomm gatherv test.

No errors

Passed Reduce test - icreduce

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

Simple intercomm reduce test.

No errors

Passed Scatter test - icscatter

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

Simple intercomm scatter test.

No errors

Passed Scatterv test - icscatterv

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

Simple intercomm scatterv test.

No errors

Passed Allreduce test - longuser

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

User-defined operation on a long value (tests proper handling of possible pipelining in the implementation of reductions with user-defined operations).

No errors

Failed Ibcast,Wait,Ibarrier test 1 - nonblocking2

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 5

Test Description:

This is a basic test of all 17 non-blocking collective operations specified by the MPI-3 standard. It only exercises the intracommunicator functionality, does not use MPI_IN_PLACE, and only transmits/receives simple integer types with relatively small counts. It does check a few fancier issues, such as ensuring that "premature user releases" of MPI_Op and MPI_Datatype objects does not result in a segfault.

[cr1cn13:52750] *** Process received signal ***
[cr1cn13:52750] Signal: Segmentation fault (11)
[cr1cn13:52750] Signal code: Address not mapped (1)
[cr1cn13:52750] Failing at address: (nil)
[cr1cn13:52750] [ 0] [0x3fff7a8c0478]
[cr1cn13:52750] [ 1] [cr1cn13:52752] *** Process received signal ***
[cr1cn13:52752] Signal: Segmentation fault (11)
[cr1cn13:52752] Signal code: Address not mapped (1)
[cr1cn13:52752] Failing at address: (nil)
[cr1cn13:52752] [ 0] [0x3fff93060478]
[cr1cn13:52752] [ 1] [0x0]
[cr1cn13:52752] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_libnbc.so(NBC_Progress+0x348)[0x3fff8ba07fd8]
[0x0]
[cr1cn13:52750] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_libnbc.so(NBC_Progress+0x348)[0x3fff781f7fd8]
[cr1cn13:52750] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_libnbc.so(ompi_coll_libnbc_progress+0xc8)[0x3fff781f6568]
[cr1cn13:52750] [ 4] [cr1cn13:52752] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_libnbc.so(ompi_coll_libnbc_progress+0xc8)[0x3fff8ba06568]
[cr1cn13:52752] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-pal.so.2(opal_progress+0x70)[0x3fff9288b9e0]
[cr1cn13:52752] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_request_default_wait+0x184)[0x3fff92f5f9a4]
[cr1cn13:52752] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Wait+0xa0)[0x3fff92fa32d0]
[cr1cn13:52752] [ 7] ./nonblocking2[0x10002fa4]
[cr1cn13:52752] [ 8] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-pal.so.2(opal_progress+0x70)[0x3fff7a0eb9e0]
[cr1cn13:52750] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_request_default_wait+0x184)[0x3fff7a7bf9a4]
[cr1cn13:52750] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Wait+0xa0)[0x3fff7a8032d0]
[cr1cn13:52750] [ 7] ./nonblocking2[0x10002fa4]
[cr1cn13:52750] [ 8] /lib64/libc.so.6(+0x24700)[0x3fff7a544700]
[cr1cn13:52750] [ 9] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff7a5448f4]
[cr1cn13:52750] *** End of error message ***
/lib64/libc.so.6(+0x24700)[0x3fff92ce4700]
[cr1cn13:52752] [ 9] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff92ce48f4]
[cr1cn13:52752] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 2 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Failed Ibcast,Wait,Ibarrier test 2 - nonblocking3

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 5

Test Description:

This test attempts to execute multiple simultaneous non-blocking collective (NBC) MPI routines at the same time, and manages their completion with a variety of routines (MPI_{Wait,Test}{,_all,_any,_some}). The test also exercises a few point-to-point operations.

[cr1cn13:61461] *** Process received signal ***
[cr1cn13:61462] *** Process received signal ***
[cr1cn13:61462] Signal: Segmentation fault (11)
[cr1cn13:61462] Signal code: Address not mapped (1)
[cr1cn13:61462] Failing at address: 0x98cce8c098cce8d0
[cr1cn13:61464] *** Process received signal ***
[cr1cn13:61464] Signal: Segmentation fault (11)
[cr1cn13:61464] Signal code: Address not mapped (1)
[cr1cn13:61464] Failing at address: 0x8722e8c08722e8d0
[cr1cn13:61461] Signal: Segmentation fault (11)
[cr1cn13:61461] Signal code: Address not mapped (1)
[cr1cn13:61461] Failing at address: 0x7c4ae8c07c4ae8d0
[cr1cn13:61461] [ 0] [cr1cn13:61462] [ 0] [0x3fff98d20478]
[cr1cn13:61464] [ 0] [0x3fff87280478]
[cr1cn13:61464] [ 1] [0x0]
[cr1cn13:61464] [ 2] ./nonblocking3[0x100043e0]
[cr1cn13:61464] [ 3] ./nonblocking3[0x10006eec]
[cr1cn13:61464] [ 4] /lib64/libc.so.6(+0x24700)[0x3fff86f04700]
[cr1cn13:61464] [ 5] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff86f048f4]
[cr1cn13:61464] *** End of error message ***
[cr1cn13:61462] [ 1] [0x0]
[cr1cn13:61462] [ 2] ./nonblocking3[0x100043e0]
[cr1cn13:61462] [ 3] ./nonblocking3[0x10006eec]
[cr1cn13:61462] [ 4] /lib64/libc.so.6(+0x24700)[0x3fff989a4700]
[cr1cn13:61462] [ 5] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff989a48f4]
[cr1cn13:61462] *** End of error message ***
[0x3fff7c500478]
[cr1cn13:61461] [ 1] [0x0]
[cr1cn13:61461] [ 2] ./nonblocking3[0x100043e0]
[cr1cn13:61461] [ 3] ./nonblocking3[0x10006eec]
[cr1cn13:61461] [ 4] /lib64/libc.so.6(+0x24700)[0x3fff7c184700]
[cr1cn13:61461] [ 5] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff7c1848f4]
[cr1cn13:61461] *** End of error message ***
[cr1cn13:61465] *** Process received signal ***
[cr1cn13:61463] *** Process received signal ***
[cr1cn13:61463] Signal: Segmentation fault (11)
[cr1cn13:61463] Signal code: Address not mapped (1)
[cr1cn13:61463] Failing at address: 0x7d2de8c07d2de8d0
[cr1cn13:61463] [ 0] [0x3fff7d330478]
[cr1cn13:61463] [ 1] [0x0]
[cr1cn13:61463] [ 2] ./nonblocking3[0x100043e0]
[cr1cn13:61463] [ 3] ./nonblocking3[0x10006eec]
[cr1cn13:61463] [ 4] [cr1cn13:61465] Signal: Segmentation fault (11)
[cr1cn13:61465] Signal code: Address not mapped (1)
[cr1cn13:61465] Failing at address: 0x935be8c0935be8d0
[cr1cn13:61465] [ 0] [0x3fff93610478]
[cr1cn13:61465] [ 1] [0x0]
[cr1cn13:61465] [ 2] ./nonblocking3[0x100043e0]
[cr1cn13:61465] [ 3] ./nonblocking3[0x10006eec]
[cr1cn13:61465] [ 4] /lib64/libc.so.6(+0x24700)[0x3fff93294700]
[cr1cn13:61465] [ 5] /lib64/libc.so.6(+0x24700)[0x3fff7cfb4700]
[cr1cn13:61463] [ 5] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff932948f4]
[cr1cn13:61465] *** End of error message ***
/lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff7cfb48f4]
[cr1cn13:61463] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Failed Non-blocking collectives test - nonblocking4

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 4

Test Description:

This is a weak sanity test that all non-blocking collectives specified by MPI-3 are present in the library and accept arguments as expected. This test does not check for progress, matching issues, or sensible output buffer values.

[cr1cn13:71082] *** Process received signal ***
[cr1cn13:71082] Signal: Segmentation fault (11)
[cr1cn13:71082] Signal code: Address not mapped (1)
[cr1cn13:71082] Failing at address: 0x80d2e8c080d2e8d0
[cr1cn13:71082] [ 0] [0x3fff80d80478]
[cr1cn13:71082] [ 1] [0x0]
[cr1cn13:71082] [ 2] ./nonblocking4[0x10002c24]
[cr1cn13:71082] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff80a04700]
[cr1cn13:71082] [ 4] [cr1cn13:71081] *** Process received signal ***
[cr1cn13:71081] Signal: Segmentation fault (11)
[cr1cn13:71081] Signal code: Address not mapped (1)
[cr1cn13:71081] Failing at address: 0xaeb9e8c0aeb9e8d0
[cr1cn13:71081] [ 0] [0x3fffaebf0478]
[cr1cn13:71081] [ 1] [0x0]
[cr1cn13:71081] [ 2] ./nonblocking4[0x10002c24]
[cr1cn13:71081] [ 3] [cr1cn13:71083] *** Process received signal ***
[cr1cn13:71083] Signal: Segmentation fault (11)
[cr1cn13:71083] Signal code: Address not mapped (1)
[cr1cn13:71083] Failing at address: 0xace7e8c0ace7e8d0
[cr1cn13:71083] [ 0] [0x3fffaced0478]
[cr1cn13:71083] [ 1] [0x0]
[cr1cn13:71083] [ 2] ./nonblocking4[0x10002c24]
[cr1cn13:71083] [ 3] /lib64/libc.so.6(+0x24700)[0x3fffae874700]
[cr1cn13:71081] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffae8748f4]
[cr1cn13:71081] *** End of error message ***
/lib64/libc.so.6(+0x24700)[0x3fffacb54700]
[cr1cn13:71083] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffacb548f4]
[cr1cn13:71083] *** End of error message ***
/lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff80a048f4]
[cr1cn13:71082] *** End of error message ***
[cr1cn13:71069] *** Process received signal ***
[cr1cn13:71069] Signal: Segmentation fault (11)
[cr1cn13:71069] Signal code: Address not mapped (1)
[cr1cn13:71069] Failing at address: 0xa80ee8c0a80ee8d0
[cr1cn13:71069] [ 0] [0x3fffa8140478]
[cr1cn13:71069] [ 1] [0x0]
[cr1cn13:71069] [ 2] ./nonblocking4[0x10002c24]
[cr1cn13:71069] [ 3] /lib64/libc.so.6(+0x24700)[0x3fffa7dc4700]
[cr1cn13:71069] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffa7dc48f4]
[cr1cn13:71069] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 2 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Failed Wait test - nonblocking

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 10

Test Description:

This is a very weak sanity test that all non-blocking collectives specified by MPI-3 are present in the library and take arguments as expected. This test does not check for progress, matching issues, or sensible output buffer values.

[cr1cn13:52144] *** Process received signal ***
[cr1cn13:52144] Signal: Segmentation fault (11)
[cr1cn13:52144] Signal code: Address not mapped (1)
[cr1cn13:52144] Failing at address: 0x86fae8c086fae8d0
[cr1cn13:52147] *** Process received signal ***
[cr1cn13:52147] Signal: Segmentation fault (11)
[cr1cn13:52147] Signal code: Address not mapped (1)
[cr1cn13:52147] Failing at address: 0x833be8c0833be8d0
[cr1cn13:52147] [cr1cn13:52129] *** Process received signal ***
[cr1cn13:52129] Signal: Segmentation fault (11)
[cr1cn13:52129] Signal code: Address not mapped (1)
[cr1cn13:52129] Failing at address: 0xa434e8c0a434e8d0
[cr1cn13:52129] [ 0] [cr1cn13:52130] *** Process received signal ***
[cr1cn13:52130] Signal: Segmentation fault (11)
[cr1cn13:52130] Signal code: Address not mapped (1)
[cr1cn13:52130] Failing at address: 0x93e9e8c093e9e8d0
[cr1cn13:52130] [ 0] [cr1cn13:52131] *** Process received signal ***
[cr1cn13:52131] Signal: Segmentation fault (11)
[cr1cn13:52131] Signal code: Address not mapped (1)
[cr1cn13:52131] Failing at address: 0x82d7e8c082d7e8d0
[cr1cn13:52131] [ 0] [0x3fff82dd0478]
[cr1cn13:52131] [cr1cn13:52133] *** Process received signal ***
[cr1cn13:52133] Signal: Segmentation fault (11)
[cr1cn13:52133] Signal code: Address not mapped (1)
[cr1cn13:52133] Failing at address: 0x996ce8c0996ce8d0
[cr1cn13:52133] [ 0] [0x3fff99720478]
[cr1cn13:52134] *** Process received signal ***
[cr1cn13:52134] Signal: Segmentation fault (11)
[cr1cn13:52134] Signal code: Address not mapped (1)
[cr1cn13:52134] Failing at address: 0xa4b3e8c0a4b3e8d0
[cr1cn13:52134] [ 0] [0x3fffa4b90478]
[cr1cn13:52134] [ 1] [cr1cn13:52137] *** Process received signal ***
[cr1cn13:52137] Signal: Segmentation fault (11)
[cr1cn13:52137] Signal code: Address not mapped (1)
[cr1cn13:52137] Failing at address: 0x93cfe8c093cfe8d0
[cr1cn13:52137] [ 0] [0x3fff93d50478]
[cr1cn13:52137] [ 1] [0x0]
[cr1cn13:52139] *** Process received signal ***
[cr1cn13:52139] Signal: Segmentation fault (11)
[cr1cn13:52139] Signal code: Address not mapped (1)
[cr1cn13:52139] Failing at address: 0x93eae8c093eae8d0
[cr1cn13:52139] [ 0] [0x3fff93f00478]
[cr1cn13:52139] [ 1] [0x0]
[cr1cn13:52139] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52141] *** Process received signal ***
[cr1cn13:52141] Signal: Segmentation fault (11)
[cr1cn13:52141] Signal code: Address not mapped (1)
[cr1cn13:52141] Failing at address: 0xacf2e8c0acf2e8d0
[cr1cn13:52141] [ 0] [0x3fffacf80478]
[cr1cn13:52141] [ 1] [0x0]
[cr1cn13:52141] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52144] [ 0] [0x3fff87000478]
[cr1cn13:52144] [ 1] [0x0]
[cr1cn13:52144] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52144] [ 3] [cr1cn13:52141] [ 3] /lib64/libc.so.6(+0x24700)[0x3fffacc04700]
[cr1cn13:52141] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffacc048f4]
[cr1cn13:52141] *** End of error message ***
[ 0] [0x3fff83410478]
[cr1cn13:52147] [ 1] [0x0]
[cr1cn13:52147] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52147] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff83094700]
[cr1cn13:52147] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff830948f4]
[cr1cn13:52147] *** End of error message ***
[0x3fffa43a0478]
[cr1cn13:52129] [ 1] [0x0]
[cr1cn13:52129] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52129] [ 3] /lib64/libc.so.6(+0x24700)[0x3fffa4024700]
[cr1cn13:52129] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffa40248f4]
[cr1cn13:52129] *** End of error message ***
[0x3fff93ef0478]
[cr1cn13:52130] [ 1] [0x0]
[cr1cn13:52130] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52130] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff93b74700]
[cr1cn13:52130] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff93b748f4]
[cr1cn13:52130] *** End of error message ***
[ 1] [0x0]
[cr1cn13:52131] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52131] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff82a54700]
[cr1cn13:52131] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff82a548f4]
[cr1cn13:52131] *** End of error message ***
[cr1cn13:52133] [ 1] [0x0]
[cr1cn13:52133] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52133] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff993a4700]
[cr1cn13:52133] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff993a48f4]
[cr1cn13:52133] *** End of error message ***
[0x0]
[cr1cn13:52134] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52134] [ 3] /lib64/libc.so.6(+0x24700)[0x3fffa4814700]
[cr1cn13:52134] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffa48148f4]
[cr1cn13:52134] *** End of error message ***
[cr1cn13:52137] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52137] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff939d4700]
[cr1cn13:52137] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff939d48f4]
[cr1cn13:52137] *** End of error message ***
[cr1cn13:52139] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff93b84700]
[cr1cn13:52139] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff93b848f4]
[cr1cn13:52139] *** End of error message ***
/lib64/libc.so.6(+0x24700)[0x3fff86c84700]
[cr1cn13:52144] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff86c848f4]
[cr1cn13:52144] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 8 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Passed BAND operations test 1 - opband

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test MPI_BAND operations on optional datatypes.

No errors

Passed BOR operations test 2 - opbor

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test MPI_BOR operations on optional datatypes.

No errors

Passed BOR Operations test - opbxor

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test MPI_BXOR operations on optional datatypes.

No errors

Passed Op_{create,commute,free} test - op_commutative

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

A simple test of MPI_Op_Create/commute/free.

No errors

Failed LAND operations test - opland

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 4

Test Description:

Test MPI_LAND operations on optional datatypes.

MPI_LAND and MPI_FLOAT: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LAND and MPI_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LAND and MPI_FLOAT: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LAND and MPI_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LAND and MPI_LONG_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LAND and MPI_FLOAT: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LAND and MPI_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LAND and MPI_LONG_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LAND and MPI_FLOAT: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LAND and MPI_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LAND and MPI_LONG_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LAND and MPI_LONG_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
Found 12 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[53583,1],2]
  Exit code:    1
--------------------------------------------------------------------------

Failed LOR operations test - oplor

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 4

Test Description:

Test MPI_LOR operations on optional datatypes.

MPI_LOR and MPI_FLOAT: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LOR and MPI_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LOR and MPI_LONG_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LOR and MPI_FLOAT: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LOR and MPI_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LOR and MPI_LONG_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LOR and MPI_FLOAT: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LOR and MPI_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LOR and MPI_LONG_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LOR and MPI_FLOAT: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LOR and MPI_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LOR and MPI_LONG_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
Found 12 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[53343,1],1]
  Exit code:    1
--------------------------------------------------------------------------

Failed LXOR operations test - oplxor

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 5

Test Description:

Test MPI_LXOR operations on optional datatypes.

MPI_LXOR and MPI_FLOAT: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_LONG_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_FLOAT: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_FLOAT: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_LONG_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_LONG_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_FLOAT: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_LONG_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_FLOAT: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
MPI_LXOR and MPI_LONG_DOUBLE: Error class 10 (MPI_ERR_OP: invalid reduce operation)
Found 15 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[15781,1],1]
  Exit code:    1
--------------------------------------------------------------------------

Passed MAX operations test - opmax

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

Test MPI_MAX operations on optional datatypes.

No errors

Passed MAXLOC operations test - opmaxloc

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

Test MPI_LAXLOC operations on optional datatypes.

No errors

Passed MIN operations test - opmin

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test MPI_Min operations on optional datatypes.

No errors

Passed MINLOC operations test - opminloc

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test MPI_MINLOC operations on optional datatypes.

No errors

Passed PROD operations test - opprod

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 6

Test Description:

Test MPI_PROD operations on optional datatypes.

No errors

Passed SUM operations test - opsum

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test looks at integer or integer drelated atatypes not required my the MPI-3.0 standard (e.g. long long). Note that failure to support these datatypes is not an indication of a non-compliant MPI implementation.

No errors

Passed Reduce test 1 - red3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

This tests implements a simple matrix-matrix multiply. This is an associative but not comutative operation. For a matrix size of matsize, the matrix is stored in C order where c(i,j) is cin[j+i*matSize].

No errors

Passed Reduce test 2 - red4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

This tests implements a simple matrix-matrix multiply. This is an associative but not comutative operation. For a matrix size of matsize, the matrix is stored in C order where c(i,j) is cin[j+i*matSize].

No errors

Passed Reduce_Scatter test 1 - redscat2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

Test of reduce scatter. Checks that the non-communcative operations are not commuted and that all of the operations are performed.

No errors

Failed Reduce_Scatter test 2 - redscat3

Build: Passed

Execution: Failed

Exit Status: Failed with signal 6

MPI Processes: 8

Test Description:

Test of reduce scatter with large data (needed to trigger the long-data algorithm). Each processor contributes its rank + index to the reduction, then receives the "ith" sum. Can be run with any number of processors, bit currently uses 1 processor due to the high demand on memory.

redscat3: ../../ccmi/executor/Allreduce.h:556: void CCMI::Executor::Allreduce<T_Conn>::notifyRecv(void*, LibColl::PipeWorkQueue**, void (**)(libcoll_context_t, void*, libcoll_result_t), void**) [with T_Conn = CCMI::ConnectionManager::CommSeqConnMgr; libcoll_event_function = void (*)(void*, void*, libcoll_result_t); libcoll_context_t = void*]: Assertion `_scache.getNumSrcRanks(cdata->_phase) > 0' failed.
[cr1cn13:67030] *** Process received signal ***
[cr1cn13:67030] Signal: Aborted (6)
[cr1cn13:67030] Signal code:  (-6)
[cr1cn13:67030] [ 0] [0x3fff7ee70478]
[cr1cn13:67030] [ 1] /lib64/libc.so.6(abort+0x280)[0x3fff7eb10d70]
[cr1cn13:67030] [ 2] /lib64/libc.so.6(+0x348a4)[0x3fff7eb048a4]
[cr1cn13:67030] [ 3] /lib64/libc.so.6(__assert_fail+0x64)[0x3fff7eb04994]
[cr1cn13:67030] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libcollectives.so(_ZN4CCMI8Executor9AllreduceINS_17ConnectionManager14CommSeqConnMgrEE10notifyRecvEPvPPN7LibColl13PipeWorkQueueEPPFvS5_S5_16libcoll_result_tEPS5_+0x1c8)[0x3fff776032a8]
[cr1cn13:67030] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libcollectives.so(_ZN4CCMI9Protocols9Allreduce22AsyncAllreduceFactoryTINS1_15AsyncAllreduceTINS_17ConnectionManager14CommSeqConnMgrE16libcoll_reduce_tNS_8Executor9AllreduceIS5_EELN7LibColl15topologyIndex_tE0ELm256EEES5_S6_XadL_ZNSA_7Adapter6getKeyEjjjPPvEEE8cb_asyncESE_SE_PKvjjmPPNSA_13PipeWorkQueueEPPFvSE_SE_16libcoll_result_tESF_+0x354)[0x3fff77632a94]
[cr1cn13:67030] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libcollectives.so(_ZN7LibColl18NativeInterfaceP2PILb1ELb0EE14dispatch_mcastEPvS2_PKvmS4_mjP11pami_recv_t+0x294)[0x3fff77612134]
[cr1cn13:67030] [ 7] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/pami_port/libpami.so(_ZN4PAMI8Protocol4Send9EagerRgetINS_6Device5Shmem11PacketModelINS3_11ShmemDeviceINS_4Fifo10LinearFifoINS7_10FifoPacketILj64ELj4096EEENS_7Counter8IndirectINSB_6NativeEEELj128EEESE_NS4_9CMAShaddrELj256ELj512EEEEENS4_8DmaModelISH_Lb0EEEE17dispatch_envelopeEPvSM_mSM_SM_+0x114)[0x3fff77902344]
[cr1cn13:67030] [ 8] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/pami_port/libpami.so(PAMI_Context_advancev+0x4ec)[0x3fff778a714c]
[cr1cn13:67030] [ 9] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libcollectives.so(LIBCOLL_Advance+0x34)[0x3fff775cb3a4]
[cr1cn13:67030] [10] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_ibm.so(mca_coll_ibm_reduce+0x1e8)[0x3fff77759ae8]
[cr1cn13:67030] [11] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Reduce+0x284)[0x3fff7eda4604]
[cr1cn13:67030] [12] ./redscat3[0x10002c58]
[cr1cn13:67030] [13] ./redscat3[0x100025d8]
[cr1cn13:67030] [14] /lib64/libc.so.6(+0x24700)[0x3fff7eaf4700]
[cr1cn13:67030] [15] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff7eaf48f4]
[cr1cn13:67030] *** End of error message ***
redscat3: ../../ccmi/executor/Allreduce.h:556: void CCMI::Executor::Allreduce<T_Conn>::notifyRecv(void*, LibColl::PipeWorkQueue**, void (**)(libcoll_context_t, void*, libcoll_result_t), void**) [with T_Conn = CCMI::ConnectionManager::CommSeqConnMgr; libcoll_event_function = void (*)(void*, void*, libcoll_result_t); libcoll_context_t = void*]: Assertion `_scache.getNumSrcRanks(cdata->_phase) > 0' failed.
[cr1cn13:67037] *** Process received signal ***
[cr1cn13:67037] Signal: Aborted (6)
[cr1cn13:67037] Signal code:  (-6)
[cr1cn13:67037] [ 0] [0x3fff8c4a0478]
[cr1cn13:67037] [ 1] /lib64/libc.so.6(abort+0x280)[0x3fff8c140d70]
[cr1cn13:67037] [ 2] /lib64/libc.so.6(+0x348a4)[0x3fff8c1348a4]
[cr1cn13:67037] [ 3] /lib64/libc.so.6(__assert_fail+0x64)[0x3fff8c134994]
[cr1cn13:67037] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libcollectives.so(_ZN4CCMI8Executor9AllreduceINS_17ConnectionManager14CommSeqConnMgrEE10notifyRecvEPvPPN7LibColl13PipeWorkQueueEPPFvS5_S5_16libcoll_result_tEPS5_+0x1c8)[0x3fff88cb32a8]
[cr1cn13:67037] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libcollectives.so(_ZN4CCMI9Protocols9Allreduce22AsyncAllreduceFactoryTINS1_15AsyncAllreduceTINS_17ConnectionManager14CommSeqConnMgrE16libcoll_reduce_tNS_8Executor9AllreduceIS5_EELN7LibColl15topologyIndex_tE0ELm256EEES5_S6_XadL_ZNSA_7Adapter6getKeyEjjjPPvEEE8cb_asyncESE_SE_PKvjjmPPNSA_13PipeWorkQueueEPPFvSE_SE_16libcoll_result_tESF_+0x354)[0x3fff88ce2a94]
[cr1cn13:67037] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libcollectives.so(_ZN7LibColl18NativeInterfaceP2PILb1ELb0EE14dispatch_mcastEPvS2_PKvmS4_mjP11pami_recv_t+0x294)[0x3fff88cc2134]
[cr1cn13:67037] [ 7] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/pami_port/libpami.so(_ZN4PAMI8Protocol4Send9EagerRgetINS_6Device5Shmem11PacketModelINS3_11ShmemDeviceINS_4Fifo10LinearFifoINS7_10FifoPacketILj64ELj4096EEENS_7Counter8IndirectINSB_6NativeEEELj128EEESE_NS4_9CMAShaddrELj256ELj512EEEEENS4_8DmaModelISH_Lb0EEEE17dispatch_envelopeEPvSM_mSM_SM_+0x114)[0x3fff88fb2344]
[cr1cn13:67037] [ 8] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/pami_port/libpami.so(PAMI_Context_advancev+0x4ec)[0x3fff88f5714c]
[cr1cn13:67037] [ 9] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_pml_pami.so(mca_pml_pami_progress+0x2c)[0x3fff8907525c]
[cr1cn13:67037] [10] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-pal.so.2(opal_progress+0x70)[0x3fff8bccb9e0]
[cr1cn13:67037] [11] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_request_default_wait_all+0x2f4)[0x3fff8c3a0204]
[cr1cn13:67037] [12] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_ibm.so(mca_coll_ibm_reduce_scatter+0x998)[0x3fff88e0b2d8]
[cr1cn13:67037] [13] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Reduce_scatter+0x284)[0x3fff8c3d5524]
[cr1cn13:67037] [14] ./redscat3[0x10002588]
[cr1cn13:67037] [15] /lib64/libc.so.6(+0x24700)[0x3fff8c124700]
[cr1cn13:67037] [16] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff8c1248f4]
[cr1cn13:67037] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node cr1cn13 exited on signal 6 (Aborted).
--------------------------------------------------------------------------

Passed Reduce_Scatter test 3 - redscatbkinter

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

Test of reduce scatter block with large data on an intercommunicator (needed in MPICH to trigger the long-data algorithm). Each processor contributes its rank + the index to the reduction, then receives the ith sum. Can be called with any number of processors.

No errors

Passed Reduce_Scatter test 4 - redscatblk3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

Test of reduce scatter with large data (needed in MPICH to trigger the long-data algorithm). Each processor contributes its rank + the index to the reduction, then receives the ith sum. Can be called with any number of processors.

No errors

Passed Reduce_scatter_block test 1 - red_scat_block2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 10

Test Description:

Test of reduce scatter with large data (needed in MPICH to trigger the long-data algorithm). Each processor contributes its rank + the index to the reduction, then receives the ith sum. Can be called with any number of processors.

No errors

Passed Reduce_scatter_block test 2 - red_scat_block

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

Each process contributes its rank plus the index to the reduction, then receives the ith sum. Can be called with any number of processors.

No errors

Passed Reduce_scatter test 1 - redscat

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 6

Test Description:

Each processor contribues its rank plus the index to the reduction, then receives the ith sum. Can be called with any number of processors.

No errors

Passed Reduce_scatter test 2 - redscatinter

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

Test of reduce scatter with large data on an intercommunicator (needed in MPICH to trigger the long-data algorithm). Each processor contributes its rank + the index to the reduction, then receives the ith sum. Can be called with any number of processors.

No errors

Failed Reduce test - reduce

Build: Passed

Execution: Failed

Exit Status: Failed with signal 13

MPI Processes: 10

Test Description:

A simple test of MPI_Reduce() with the rank of the root process shifted through each possible value.

[cr1cn13:66733] *** An error occurred in MPI_Reduce
[cr1cn13:66733] *** reported by process [3332177921,9]
[cr1cn13:66733] *** on communicator MPI COMMUNICATOR 3 SPLIT FROM 0
[cr1cn13:66733] *** MPI_ERR_ARG: invalid argument of some other kind
[cr1cn13:66733] *** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
[cr1cn13:66733] ***    and potentially your MPI job)

Passed Reduce_local test - reduce_local

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

A simple test of MPI_Reduce_local(). Uses MPI_SUM as well as user defined operators.

No errors

Failed Scan test - scantst

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 4

Test Description:

A simple test of MPI_Scan(). The operation is inoutvec[i] = invec[i] op inoutvec[i] (see 4.9.4 of the MPI standard 1.3). The order is important. Note that the computation is in process rank (in the communicator) order, independent of the root.

Found 1 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[55746,1],3]
  Exit code:    1
--------------------------------------------------------------------------

Failed Scatter test 1 - scatter2

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 4

Test Description:

This test sends a vector and receives individual elements, except for the root process that does not receive any data.

Found 1 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[12912,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Passed Scatter test 2 - scatter3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test sends contiguous data and receives a vector on some nodes and contiguous data on others. There is some evidence that some MPI implementations do not check recvcount on the root process. This test checks for that case.

No errors

Passed Scatter test 3 - scattern

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test sends a vector and receives individual elements.

No errors

Passed Scatterv test - scatterv

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is an example of using scatterv to send a matrix from one process to all others, with the matrix stored in Fortran order. Note the use of an explicit upper bound (UB) to enable the sources to overlap. This tests uses scatterv to make sure that it uses the datatype size and extent correctly. It requires the number of processors used in the call to MPI_Dims_create.

No errors

Passed Reduce test - uoplong

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 16

Test Description:

Test user-defined operations with a large number of elements. Added because a talk at EuroMPI'12 claimed that these failed with more than 64k elements.

No errors

Passed Extended collectives test - collectives

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Checks if "extended collectives" are supported. If the test fails to compile, then "extended collectives" are not supported. If the test compiles, then a 4-process MPI job is executed. If the job aborts, then "Extended collectives NOT supported" is reported. If the job executes and the correct value is returned, then "Extended collectives ARE supported" is reported.

No errors

Passed Alltoall thread test - alltoall

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

The LISTENER THREAD waits for communication from any source (including calling thread) messages which it receives that has tag REQ_TAG. Each thread enters an infinite loop that will stop only if every node in the MPI_COMM_WORLD send message containing -1.

No errors

MPI_Info Objects - Score: 100% Passed

The info tests emphasize the MPI Info object functionality.

Passed MPI_Info_delete() test - infodel

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test exercises the MPI_Info_delete().

No errors

Passed MPI_Info_dup() test - infodup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test exercises the MPI_Info_dup().

No errors

Passed MPI_Info_get() test 1 - infoenv

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This is a simple test of MPI_Info_get().

No errors

Passed MPI_Info_get() test 2 - infomany2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Test of info that makes use of the extended handles, including inserts and deletes.

No errors

Passed MPI_Info_get() test 3 - infomany

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Test of info that makes use of the extended handles.

No errors

Passed MPI_Info_get() test 4 - infoorder

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This is a simple test that illustrates how named keys are ordered.

No errors

Passed MPI_Info_get() test 5 - infotest

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Simple info test.

No errors

Passed MPI_Info_{get,send} test - infovallen

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Simple info test.

No errors

Dynamic Process Management - Score: 93% Passed

This group features tests that add processes to a running communicator, joining separately started applications, then handling faults/failures.

Passed Dynamic process management test - dynamic

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks if the dynamic process management routines through MPI-2.2 are defined. If the test passes, then "No errors" is reported.

MPI_Comm_spawn(): verified
MPI_Comm_get_parrent(): verified
MPI_Open_port(): verified
MPI_Comm_accept(): verified
MPI_Comm_connect(): verified
MPI_Publish_name(): verified
MPI_Unpublish_name(): verified
MPI_Lookup_name(): verified
MPI_Comm_disconnect(): verified
MPI_Comm_join(): verified
Dynamic process management routines: verified
No errors

Passed MPI_Comm_disconnect() test - disconnect2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 3

Test Description:

A simple test of Comm_disconnect.

No errors

Passed MPI_Comm_disconnect() test - disconnect3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 3

Test Description:

A simple test of Comm_disconnect.

No errors

Passed MPI_Comm_disconnect() test 1 - disconnect

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 3

Test Description:

A simple test of Comm_disconnect.

No errors

Passed MPI_Comm_disconnect() test 2 - disconnect_reconnect2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 3

Test Description:

In this program, the return codes from the MPI routines are checked. Since the error handlers for the communicators are not set to MPI_ERRORS_RETURN, any error should cause an abort rather than a return. The test on the return value is an extra safety check; note that a return value of other than MPI_SUCCESS in these routines indicates an error in the error handling by the MPI implementation.

No errors
No errors
No errors

Passed MPI_Comm_disconnect() test 3 - disconnect_reconnect3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 3

Test Description:

This test tests the disconnect code for processes that span process groups. This test spawns a group of processes and then merges them into a single communicator. Then the single communicator is split into two communicators, one containing the even ranks and the other the odd ranks. Then the two new communicators do MPI_Comm_accept/connect/disconnect calls in a loop. The even group does the accepting while the odd group does the connecting.

No errors

Passed MPI_Comm_disconnect() test 4 - disconnect_reconnect

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 3

Test Description:

A simple test of Comm_connect/accept/disconnect.

No errors

Passed MPI_Comm_join() test - join

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

A simple test of Comm_join.

No errors

Passed MPI_Comm_connect() test 1 - multiple_ports2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test checks to make sure that two MPI_Comm_connect calls to two different MPI ports match their corresponding MPI_Comm_accept calls.

No errors

Passed MPI_Comm_connect() test 2 - multiple_ports

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 3

Test Description:

This test checks to make sure that two MPI_Comm_connect calls to two different MPI ports match their corresponding MPI_Comm_accept calls.

No errors

Passed MPI_Publish_name() test - namepub

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test confirms the functionality of MPI_Open_port() and MPI_Publish_name().

No errors

Passed PGROUP creation test - pgroup_connect_test

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

James Dinan dinan@mcs.anl.gov
May, 2011

In this test, processes create an intracommunicator, and creation is collective only on the members of the new communicator, not on the parent communicator. This is accomplished by building up and merging intercommunicators using Connect/Accept to merge with a master/controller process.

No errors

Passed Creation group intercomm test - pgroup_intercomm_test

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

James Dinan dinan@mcs.anl.gov
May, 2011

In this test processes create an intracommunicator, and creation is collective only on the members of the new communicator, not on the parent communicator. This is accomplished by building up and merging intercommunicators starting with MPI_COMM_SELF for each process involved.

No errors

Passed MPI_Comm_accept() test - selfconacc

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This tests exercises MPI_Open_port(), MPI_Comm_accept(), and MPI_Comm_disconnect().

No errors

Passed MPI spawn processing test 1 - spaconacc2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

In this program, the return codes from the MPI routines are checked. Since the error handlers for the communicators are not set to MPI_ERRORS_RETURN, any error should cause an abort rather than a return. The test on the return value is an extra safety check; note that a return value of other than MPI_SUCCESS in these routines indicates an error in the error handling by the MPI implementation.

No errors

Passed MPI spawn processing test 2 - spaconacc

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

In this program, the return codes from the MPI routines are checked. Since the error handlers for the communicators are not set to MPI_ERRORS_RETURN, any error should cause an abort rather than a return. The test on the return value is an extra safety check; note that a return value of other than MPI_SUCCESS in these routines indicates an error in the error handling by the MPI implementation.

No errors

Passed MPI_Intercomm_creat() test - spaiccreate

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Use Spawn to create an intercomm, then create a new intercomm that includes processes not in the initial spawn intercomm.This test ensures that spawned processes are able to communicate with processes that were not in the communicator from which they were spawned.

No errors

Passed MPI_Comm_spawn() test 1 - spawn1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

A simple test of Comm_spawn.

No errors

Passed MPI_Comm_spawn() test 2 - spawn2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

A simple test of Comm_spawn, called twice.

No errors

Passed MPI_Comm_spawn() test 3 - spawnargv

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

A simple test of Comm_spawn, with complex arguments.

No errors

Passed MPI_Comm_spawn() test 4 - spawninfo1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

A simple test of Comm_spawn with info.

No errors

Passed MPI_Comm_spawn() test 5 - spawnintra

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

A simple test of Comm_spawn, followed by intercomm merge.

No errors

Passed MPI_Comm_spawn() test 6 - spawnmanyarg

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

A simple test of Comm_spawn, with many arguments.

No errors

Passed MPI_Comm_spawn_multiple() test 1 - spawnminfo1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

A simple test of Comm_spawn_multiple with info.

No errors

Passed MPI_Comm_spawn_multiple() test 2 - spawnmult2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This tests spawn_mult by using the same executable and no command-line options. The attribute MPI_APPNUM is used to determine which executable is running.

No errors

Passed MPI spawn test with pthreads - taskmaster

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Create a thread for each task. Each thread will spawn a child process to perform its task.

No errors
No errors

Failed Multispawn test - multispawn

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 1

Test Description:

This (is a placeholder for a) test that creates 4 threads, each of which does a concurrent spawn of 4 more processes, for a total of 17 MPI processes. The resulting intercomms are tested for consistency (to ensure that the spawns didn't get confused among the threads). As an option, it will time the Spawn calls. If the spawn calls block the calling thread, this may show up in the timing of the calls.

[cr1cn13:46169] *** Process received signal ***
[cr1cn13:46169] Signal: Segmentation fault (11)
[cr1cn13:46169] Signal code: Address not mapped (1)
[cr1cn13:46169] Failing at address: 0x28
[cr1cn13:46169] [ 0] [cr1cn13:46169] *** An error occurred in MPI_Bcast
[cr1cn13:46169] *** reported by process [1985150978,2]
[cr1cn13:46169] *** on communicator MPI_COMM_PARENT
[cr1cn13:46169] *** MPI_ERR_OTHER: known error not in list
[cr1cn13:46169] *** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
[cr1cn13:46169] ***    and potentially your MPI job)
[0x3fff9f6a0478]
[cr1cn13:46169] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff9f5a0c7c]
[cr1cn13:46169] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff9f58a010]
[cr1cn13:46169] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff9f589184]
[cr1cn13:46168] *** Process received signal ***
[cr1cn13:46168] Signal: Segmentation fault (11)
[cr1cn13:46168] Signal code: Address not mapped (1)
[cr1cn13:46168] Failing at address: 0x28
[cr1cn13:46170] *** Process received signal ***
[cr1cn13:46170] Signal: Segmentation fault (11)
[cr1cn13:46170] Signal code: Address not mapped (1)
[cr1cn13:46170] Failing at address: 0x28
[cr1cn13:46170] [ 0] [0x3fff88f20478]
[cr1cn13:46170] [ 1] [cr1cn13:46169] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff9f5b6f80]
[cr1cn13:46169] [ 5] ./multispawn[0x10002754]
[cr1cn13:46169] [ 6] /lib64/libc.so.6(+0x24700)[0x3fff9f324700]
[cr1cn13:46169] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff9f3248f4]
[cr1cn13:46169] *** End of error message ***
/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff88e20c7c]
[cr1cn13:46170] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff88e0a010]
[cr1cn13:46170] [ 3] [cr1cn13:46168] [ 0] [0x3fff84410478]
[cr1cn13:46168] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff84310c7c]
[cr1cn13:46168] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff842fa010]
[cr1cn13:46168] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff842f9184]
[cr1cn13:46168] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff88e09184]
[cr1cn13:46170] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff88e36f80]
[cr1cn13:46170] [ 5] ./multispawn[0x10002754]
[cr1cn13:46170] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff84326f80]
[cr1cn13:46168] [ 5] ./multispawn[0x10002754]
[cr1cn13:46168] [ 6] /lib64/libc.so.6(+0x24700)[0x3fff84094700]
[cr1cn13:46168] [ 7] /lib64/libc.so.6(+0x24700)[0x3fff88ba4700]
[cr1cn13:46170] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff88ba48f4]
[cr1cn13:46170] *** End of error message ***
/lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff840948f4]
[cr1cn13:46168] *** End of error message ***
[cr1cn13:46179] *** Process received signal ***
[cr1cn13:46179] Signal: Segmentation fault (11)
[cr1cn13:46179] Signal code: Address not mapped (1)
[cr1cn13:46179] Failing at address: 0x28
[cr1cn13:46179] [ 0] [0x3fffae330478]
[cr1cn13:46179] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fffae230c7c]
[cr1cn13:46179] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fffae21a010]
[cr1cn13:46179] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fffae219184]
[cr1cn13:46179] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fffae246f80]
[cr1cn13:46179] [ 5] ./multispawn[0x10002754]
[cr1cn13:46179] [ 6] /lib64/libc.so.6(+0x24700)[0x3fffadfb4700]
[cr1cn13:46179] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffadfb48f4]
[cr1cn13:46179] *** End of error message ***
[cr1cn13:46176] *** Process received signal ***
[cr1cn13:46176] Signal: Segmentation fault (11)
[cr1cn13:46176] Signal code: Address not mapped (1)
[cr1cn13:46176] Failing at address: 0x28
[cr1cn13:46176] [ 0] [0x3fffa2190478]
[cr1cn13:46176] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fffa2090c7c]
[cr1cn13:46176] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fffa207a010]
[cr1cn13:46176] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fffa2079184]
[cr1cn13:46176] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fffa20a6f80]
[cr1cn13:46176] [ 5] ./multispawn[0x10002754]
[cr1cn13:46176] [ 6] /lib64/libc.so.6(+0x24700)[0x3fffa1e14700]
[cr1cn13:46176] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffa1e148f4]
[cr1cn13:46176] *** End of error message ***
[cr1cn13:46180] *** Process received signal ***
[cr1cn13:46180] Signal: Segmentation fault (11)
[cr1cn13:46180] Signal code: Address not mapped (1)
[cr1cn13:46180] Failing at address: 0x28
[cr1cn13:46180] [ 0] [0x3fffaeac0478]
[cr1cn13:46180] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fffae9c0c7c]
[cr1cn13:46180] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fffae9aa010]
[cr1cn13:46180] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fffae9a9184]
[cr1cn13:46180] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fffae9d6f80]
[cr1cn13:46180] [ 5] ./multispawn[0x10002754]
[cr1cn13:46180] [ 6] /lib64/libc.so.6(+0x24700)[0x3fffae744700]
[cr1cn13:46180] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffae7448f4]
[cr1cn13:46180] *** End of error message ***
[cr1cn13:46187] *** Process received signal ***
[cr1cn13:46187] Signal: Segmentation fault (11)
[cr1cn13:46187] Signal code: Address not mapped (1)
[cr1cn13:46187] Failing at address: 0x28
[cr1cn13:46187] [ 0] [0x3fffab980478]
[cr1cn13:46187] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fffab880c7c]
[cr1cn13:46187] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fffab86a010]
[cr1cn13:46187] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fffab869184]
[cr1cn13:46187] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fffab896f80]
[cr1cn13:46187] [ 5] ./multispawn[0x10002754]
[cr1cn13:46187] [ 6] /lib64/libc.so.6(+0x24700)[0x3fffab604700]
[cr1cn13:46187] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffab6048f4]
[cr1cn13:46187] *** End of error message ***
[cr1cn13:46186] *** Process received signal ***
[cr1cn13:46186] Signal: Segmentation fault (11)
[cr1cn13:46186] Signal code: Address not mapped (1)
[cr1cn13:46186] Failing at address: 0x28
[cr1cn13:46186] [ 0] [0x3fff905a0478]
[cr1cn13:46186] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff904a0c7c]
[cr1cn13:46186] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff9048a010]
[cr1cn13:46186] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff90489184]
[cr1cn13:46186] [ 4] [cr1cn13:46188] *** Process received signal ***
[cr1cn13:46188] Signal: Segmentation fault (11)
[cr1cn13:46188] Signal code: Address not mapped (1)
[cr1cn13:46188] Failing at address: 0x28
[cr1cn13:46188] [ 0] [0x3fff7e920478]
[cr1cn13:46188] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff7e820c7c]
[cr1cn13:46188] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff7e80a010]
[cr1cn13:46188] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff904b6f80]
[cr1cn13:46186] [ 5] ./multispawn[0x10002754]
[cr1cn13:46186] [ 6] /lib64/libc.so.6(+0x24700)[0x3fff90224700]
[cr1cn13:46186] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff902248f4]
[cr1cn13:46186] *** End of error message ***
/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff7e809184]
[cr1cn13:46188] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff7e836f80]
[cr1cn13:46188] [ 5] ./multispawn[0x10002754]
[cr1cn13:46188] [ 6] /lib64/libc.so.6(+0x24700)[0x3fff7e5a4700]
[cr1cn13:46188] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff7e5a48f4]
[cr1cn13:46188] *** End of error message ***
[cr1cn13:46193] *** Process received signal ***
[cr1cn13:46193] Signal: Segmentation fault (11)
[cr1cn13:46193] Signal code: Address not mapped (1)
[cr1cn13:46193] Failing at address: 0x28
[cr1cn13:46193] [ 0] [0x3fff996f0478]
[cr1cn13:46193] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff995f0c7c]
[cr1cn13:46193] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff995da010]
[cr1cn13:46193] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff995d9184]
[cr1cn13:46193] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff99606f80]
[cr1cn13:46193] [ 5] ./multispawn[0x10002754]
[cr1cn13:46193] [ 6] /lib64/libc.so.6(+0x24700)[0x3fff99374700]
[cr1cn13:46193] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff993748f4]
[cr1cn13:46193] *** End of error message ***
[cr1cn13:46191] *** Process received signal ***
[cr1cn13:46191] Signal: Segmentation fault (11)
[cr1cn13:46191] Signal code: Address not mapped (1)
[cr1cn13:46191] Failing at address: 0x28
[cr1cn13:46191] [ 0] [0x3fff80260478]
[cr1cn13:46191] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff80160c7c]
[cr1cn13:46191] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff8014a010]
[cr1cn13:46191] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff80149184]
[cr1cn13:46191] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff80176f80]
[cr1cn13:46191] [ 5] ./multispawn[0x10002754]
[cr1cn13:46191] [ 6] /lib64/libc.so.6(+0x24700)[0x3fff7fee4700]
[cr1cn13:46191] [ 7] [cr1cn13:46194] *** Process received signal ***
[cr1cn13:46194] Signal: Segmentation fault (11)
[cr1cn13:46194] Signal code: Address not mapped (1)
[cr1cn13:46194] Failing at address: 0x28
/lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff7fee48f4]
[cr1cn13:46191] *** End of error message ***
[cr1cn13:46194] [ 0] [0x3fffad730478]
[cr1cn13:46194] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fffad630c7c]
[cr1cn13:46194] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fffad61a010]
[cr1cn13:46194] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fffad619184]
[cr1cn13:46194] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fffad646f80]
[cr1cn13:46194] [ 5] ./multispawn[0x10002754]
[cr1cn13:46194] [ 6] /lib64/libc.so.6(+0x24700)[0x3fffad3b4700]
[cr1cn13:46194] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffad3b48f4]
[cr1cn13:46194] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 2 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------
[cr1cn13:46144] 11 more processes have sent help message help-mpi-errors.txt / mpi_errors_are_fatal
[cr1cn13:46144] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages

Failed Taskmaster test - th_taskmaster

Build: Passed

Execution: Failed

Exit Status: Application_timed_out

MPI Processes: 1

Test Description:

This is a simple test that creates threads to verifiy compatibility between MPI and the pthread library.

[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193

Threads - Score: 83% Passed

This group features tests that utilize thread compliant MPI implementations. This includes the threaded environment provided by MPI-3.0, as well as POSIX compliant threaded libraries such as PThreads.

Failed Thread/RMA interaction test - multirma

Build: Passed

Execution: Failed

Exit Status: Application_timed_out

MPI Processes: 2

Test Description:

This is a simple test of threads in MPI.

Test Output: None.

Passed Threaded group test - comm_create_group_threads

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

In this test a number of threads are created with a distinct MPI communicator (or comm) group distringuished by its thread-id (used as a tag). Threads on even ranks join an even comm and threads on odd ranks join the odd comm.

No errors

Passed Thread Group creation test - comm_create_threads

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Every thread paticipates in a distinct MPI_Comm_create group, distinguished by its thread-id (used as the tag). Threads on even ranks join an even comm and threads on odd ranks join the odd comm.

No errors

Passed Easy thread test 1 - comm_dup_deadlock

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a simple test of threads in MPI.

No errors

Passed Easy thread test 2 - comm_idup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a simple test of threads in MPI

No Errors

Passed Multiple threads test 1 - ctxdup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test creates communications concurrently in different threads.

No errors

Passed Multiple threads test 2 - ctxidup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test creates communications concurrently in different threads.

No errors

Passed Multiple threads test 3 - dup_leak_test

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test repeatedly duplicates and frees communicators with multiple threads concurrently to stress the multithreaded aspects of the context ID allocation code. Thanks to IBM for providing the original version of this test.

No errors

Failed MPIT multithreaded test - mpit_threading

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 1

Test Description:

This test is adapted from test/mpi/mpi_t/mpit_vars.c. But this is a multithreading version in which multiple threads will call MPI_T routines.

With verbose set, thread 0 will prints out MPI_T control variables, performance variables and their categories.

[cr1cn13:40789:0] Caught signal 11 (Segmentation fault)
==== backtrace ====
 2 0x0000000000073264 mxm_handle_error()  /var/tmp/OFED_topdir/BUILD/mxm-3.5.3093/src/mxm/util/debug/debug.c:641
 3 0x00000000000739a4 mxm_error_signal_handler()  /var/tmp/OFED_topdir/BUILD/mxm-3.5.3093/src/mxm/util/debug/debug.c:616
 4 0x00000000000c2dc4 MPI_T_cvar_read()  ??:0
 5 0x0000000010003068 PrintControlVars()  ??:0
 6 0x0000000010002bec RunTest()  ??:0
 7 0x0000000000008728 start_thread()  pthread_create.c:0
 8 0x000000000011d250 __clone()  ??:0
===================
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Passed Simple thread test 1 - initth2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

The test initializes a thread, then calls MPI_Finalize() and prints "No errors".

No errors

Passed Simple thread test 2 - initth

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

The test here is a simple one that Finalize exits, so the only action is to write no error.

No errors

Passed Alltoall thread test - alltoall

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

The LISTENER THREAD waits for communication from any source (including calling thread) messages which it receives that has tag REQ_TAG. Each thread enters an infinite loop that will stop only if every node in the MPI_COMM_WORLD send message containing -1.

No errors

Passed Threaded request test - greq_test

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Threaded generalized request tests.

No errors

Passed Threaded wait/test test - greq_wait

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Threaded wait/test request tests.

No errors

Passed Threaded ibsend test - ibsend

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This program performs a short test of MPI_BSEND in a multithreaded environment. It starts a single receiver thread that expects NUMSENDS messages and NUMSENDS sender threads, that use MPI_Bsend to send a message of size MSGSIZE to its right neigbour or rank 0 if (my_rank==comm_size-1), i.e. target_rank = (my_rank+1)%size.

After all messages have been received, the receiver thread prints a message, the threads are joined into the main thread and the application terminates.

No Errors

Passed Threaded multi-target test 1 - multisend2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

Run concurrent sends to different target processes. Stresses an implementation that permits concurrent sends to different targets. By turning on verbose output, some simple performance data will be output.

No errors

Passed Threaded multi-target test 2 - multisend3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

Run concurrent sends to different target processes. Stresses an implementation that permits concurrent sends to different targets. By turning on verbose output, some simple performance data will be output. Use non-blocking sends, and have a single thread complete all I/O.

No errors

Passed Threaded multi-target test 3 - multisend4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 5

Test Description:

Run concurrent sends to different target processes. Stresses an implementation that permits concurrent sends to different targets. By turning on verbose output, some simple performance data will be output. Use non-blocking sends, and have a single thread complete all I/O.

No errors

Passed Threaded multi-target test 3 - multisend

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Run concurrent sends to different target processes. Stresses an implementation that permits concurrent sends to different targets. By turning on verbose output, some simple performance data will be output. Use non-blocking sends, and have a single thread complete all I/O.

No errors

Passed Threaded multi-target test 4 - sendselfth

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Send to self in a threaded program.

No errors

Passed Multi-threaded send/receive test - threaded_sr

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

The buffer size needs to be large enough to cause the rndv protocol to be used. If the MPI provider doesn't use a rndv protocol then the size doesn't matter.

No errors

Passed Multi-threaded blocking test - threads

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

The tests blocking and non-blocking capability within MPI.

No errors

Failed Multispawn test - multispawn

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 1

Test Description:

This (is a placeholder for a) test that creates 4 threads, each of which does a concurrent spawn of 4 more processes, for a total of 17 MPI processes. The resulting intercomms are tested for consistency (to ensure that the spawns didn't get confused among the threads). As an option, it will time the Spawn calls. If the spawn calls block the calling thread, this may show up in the timing of the calls.

[cr1cn13:46169] *** Process received signal ***
[cr1cn13:46169] Signal: Segmentation fault (11)
[cr1cn13:46169] Signal code: Address not mapped (1)
[cr1cn13:46169] Failing at address: 0x28
[cr1cn13:46169] [ 0] [cr1cn13:46169] *** An error occurred in MPI_Bcast
[cr1cn13:46169] *** reported by process [1985150978,2]
[cr1cn13:46169] *** on communicator MPI_COMM_PARENT
[cr1cn13:46169] *** MPI_ERR_OTHER: known error not in list
[cr1cn13:46169] *** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
[cr1cn13:46169] ***    and potentially your MPI job)
[0x3fff9f6a0478]
[cr1cn13:46169] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff9f5a0c7c]
[cr1cn13:46169] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff9f58a010]
[cr1cn13:46169] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff9f589184]
[cr1cn13:46168] *** Process received signal ***
[cr1cn13:46168] Signal: Segmentation fault (11)
[cr1cn13:46168] Signal code: Address not mapped (1)
[cr1cn13:46168] Failing at address: 0x28
[cr1cn13:46170] *** Process received signal ***
[cr1cn13:46170] Signal: Segmentation fault (11)
[cr1cn13:46170] Signal code: Address not mapped (1)
[cr1cn13:46170] Failing at address: 0x28
[cr1cn13:46170] [ 0] [0x3fff88f20478]
[cr1cn13:46170] [ 1] [cr1cn13:46169] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff9f5b6f80]
[cr1cn13:46169] [ 5] ./multispawn[0x10002754]
[cr1cn13:46169] [ 6] /lib64/libc.so.6(+0x24700)[0x3fff9f324700]
[cr1cn13:46169] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff9f3248f4]
[cr1cn13:46169] *** End of error message ***
/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff88e20c7c]
[cr1cn13:46170] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff88e0a010]
[cr1cn13:46170] [ 3] [cr1cn13:46168] [ 0] [0x3fff84410478]
[cr1cn13:46168] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff84310c7c]
[cr1cn13:46168] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff842fa010]
[cr1cn13:46168] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff842f9184]
[cr1cn13:46168] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff88e09184]
[cr1cn13:46170] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff88e36f80]
[cr1cn13:46170] [ 5] ./multispawn[0x10002754]
[cr1cn13:46170] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff84326f80]
[cr1cn13:46168] [ 5] ./multispawn[0x10002754]
[cr1cn13:46168] [ 6] /lib64/libc.so.6(+0x24700)[0x3fff84094700]
[cr1cn13:46168] [ 7] /lib64/libc.so.6(+0x24700)[0x3fff88ba4700]
[cr1cn13:46170] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff88ba48f4]
[cr1cn13:46170] *** End of error message ***
/lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff840948f4]
[cr1cn13:46168] *** End of error message ***
[cr1cn13:46179] *** Process received signal ***
[cr1cn13:46179] Signal: Segmentation fault (11)
[cr1cn13:46179] Signal code: Address not mapped (1)
[cr1cn13:46179] Failing at address: 0x28
[cr1cn13:46179] [ 0] [0x3fffae330478]
[cr1cn13:46179] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fffae230c7c]
[cr1cn13:46179] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fffae21a010]
[cr1cn13:46179] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fffae219184]
[cr1cn13:46179] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fffae246f80]
[cr1cn13:46179] [ 5] ./multispawn[0x10002754]
[cr1cn13:46179] [ 6] /lib64/libc.so.6(+0x24700)[0x3fffadfb4700]
[cr1cn13:46179] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffadfb48f4]
[cr1cn13:46179] *** End of error message ***
[cr1cn13:46176] *** Process received signal ***
[cr1cn13:46176] Signal: Segmentation fault (11)
[cr1cn13:46176] Signal code: Address not mapped (1)
[cr1cn13:46176] Failing at address: 0x28
[cr1cn13:46176] [ 0] [0x3fffa2190478]
[cr1cn13:46176] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fffa2090c7c]
[cr1cn13:46176] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fffa207a010]
[cr1cn13:46176] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fffa2079184]
[cr1cn13:46176] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fffa20a6f80]
[cr1cn13:46176] [ 5] ./multispawn[0x10002754]
[cr1cn13:46176] [ 6] /lib64/libc.so.6(+0x24700)[0x3fffa1e14700]
[cr1cn13:46176] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffa1e148f4]
[cr1cn13:46176] *** End of error message ***
[cr1cn13:46180] *** Process received signal ***
[cr1cn13:46180] Signal: Segmentation fault (11)
[cr1cn13:46180] Signal code: Address not mapped (1)
[cr1cn13:46180] Failing at address: 0x28
[cr1cn13:46180] [ 0] [0x3fffaeac0478]
[cr1cn13:46180] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fffae9c0c7c]
[cr1cn13:46180] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fffae9aa010]
[cr1cn13:46180] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fffae9a9184]
[cr1cn13:46180] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fffae9d6f80]
[cr1cn13:46180] [ 5] ./multispawn[0x10002754]
[cr1cn13:46180] [ 6] /lib64/libc.so.6(+0x24700)[0x3fffae744700]
[cr1cn13:46180] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffae7448f4]
[cr1cn13:46180] *** End of error message ***
[cr1cn13:46187] *** Process received signal ***
[cr1cn13:46187] Signal: Segmentation fault (11)
[cr1cn13:46187] Signal code: Address not mapped (1)
[cr1cn13:46187] Failing at address: 0x28
[cr1cn13:46187] [ 0] [0x3fffab980478]
[cr1cn13:46187] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fffab880c7c]
[cr1cn13:46187] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fffab86a010]
[cr1cn13:46187] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fffab869184]
[cr1cn13:46187] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fffab896f80]
[cr1cn13:46187] [ 5] ./multispawn[0x10002754]
[cr1cn13:46187] [ 6] /lib64/libc.so.6(+0x24700)[0x3fffab604700]
[cr1cn13:46187] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffab6048f4]
[cr1cn13:46187] *** End of error message ***
[cr1cn13:46186] *** Process received signal ***
[cr1cn13:46186] Signal: Segmentation fault (11)
[cr1cn13:46186] Signal code: Address not mapped (1)
[cr1cn13:46186] Failing at address: 0x28
[cr1cn13:46186] [ 0] [0x3fff905a0478]
[cr1cn13:46186] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff904a0c7c]
[cr1cn13:46186] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff9048a010]
[cr1cn13:46186] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff90489184]
[cr1cn13:46186] [ 4] [cr1cn13:46188] *** Process received signal ***
[cr1cn13:46188] Signal: Segmentation fault (11)
[cr1cn13:46188] Signal code: Address not mapped (1)
[cr1cn13:46188] Failing at address: 0x28
[cr1cn13:46188] [ 0] [0x3fff7e920478]
[cr1cn13:46188] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff7e820c7c]
[cr1cn13:46188] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff7e80a010]
[cr1cn13:46188] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff904b6f80]
[cr1cn13:46186] [ 5] ./multispawn[0x10002754]
[cr1cn13:46186] [ 6] /lib64/libc.so.6(+0x24700)[0x3fff90224700]
[cr1cn13:46186] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff902248f4]
[cr1cn13:46186] *** End of error message ***
/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff7e809184]
[cr1cn13:46188] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff7e836f80]
[cr1cn13:46188] [ 5] ./multispawn[0x10002754]
[cr1cn13:46188] [ 6] /lib64/libc.so.6(+0x24700)[0x3fff7e5a4700]
[cr1cn13:46188] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff7e5a48f4]
[cr1cn13:46188] *** End of error message ***
[cr1cn13:46193] *** Process received signal ***
[cr1cn13:46193] Signal: Segmentation fault (11)
[cr1cn13:46193] Signal code: Address not mapped (1)
[cr1cn13:46193] Failing at address: 0x28
[cr1cn13:46193] [ 0] [0x3fff996f0478]
[cr1cn13:46193] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff995f0c7c]
[cr1cn13:46193] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff995da010]
[cr1cn13:46193] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff995d9184]
[cr1cn13:46193] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff99606f80]
[cr1cn13:46193] [ 5] ./multispawn[0x10002754]
[cr1cn13:46193] [ 6] /lib64/libc.so.6(+0x24700)[0x3fff99374700]
[cr1cn13:46193] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff993748f4]
[cr1cn13:46193] *** End of error message ***
[cr1cn13:46191] *** Process received signal ***
[cr1cn13:46191] Signal: Segmentation fault (11)
[cr1cn13:46191] Signal code: Address not mapped (1)
[cr1cn13:46191] Failing at address: 0x28
[cr1cn13:46191] [ 0] [0x3fff80260478]
[cr1cn13:46191] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fff80160c7c]
[cr1cn13:46191] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fff8014a010]
[cr1cn13:46191] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fff80149184]
[cr1cn13:46191] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fff80176f80]
[cr1cn13:46191] [ 5] ./multispawn[0x10002754]
[cr1cn13:46191] [ 6] /lib64/libc.so.6(+0x24700)[0x3fff7fee4700]
[cr1cn13:46191] [ 7] [cr1cn13:46194] *** Process received signal ***
[cr1cn13:46194] Signal: Segmentation fault (11)
[cr1cn13:46194] Signal code: Address not mapped (1)
[cr1cn13:46194] Failing at address: 0x28
/lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff7fee48f4]
[cr1cn13:46191] *** End of error message ***
[cr1cn13:46194] [ 0] [0x3fffad730478]
[cr1cn13:46194] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_abort+0x28c)[0x3fffad630c7c]
[cr1cn13:46194] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_errors_are_fatal_comm_handler+0xa0)[0x3fffad61a010]
[cr1cn13:46194] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_errhandler_invoke+0x184)[0x3fffad619184]
[cr1cn13:46194] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Bcast+0x250)[0x3fffad646f80]
[cr1cn13:46194] [ 5] ./multispawn[0x10002754]
[cr1cn13:46194] [ 6] /lib64/libc.so.6(+0x24700)[0x3fffad3b4700]
[cr1cn13:46194] [ 7] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffad3b48f4]
[cr1cn13:46194] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 2 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------
[cr1cn13:46144] 11 more processes have sent help message help-mpi-errors.txt / mpi_errors_are_fatal
[cr1cn13:46144] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages

Failed Taskmaster test - th_taskmaster

Build: Passed

Execution: Failed

Exit Status: Application_timed_out

MPI Processes: 1

Test Description:

This is a simple test that creates threads to verifiy compatibility between MPI and the pthread library.

[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46122] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193
[cr1cn13:46123] OPAL ERROR: Timeout in file ../../../../../opensrc/ompi/opal/mca/pmix/base/pmix_base_fns.c at line 193

MPI-Toolkit Interface - Score: 0% Passed

This group features tests that involve the MPI Tool interface available in MPI-3.0 and higher.

Failed Toolkit varlist test - varlist

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 1

Test Description:

This program, copyrighted (c) 2014, Lawrence Livermore National Security, LLC., accesses the performance and control variables as defined by under MPI-3.0 and newer.

MPI_T Variable List
MPI Thread support: MPI_THREAD_MULTIPLE
MPI_T Thread support: MPI_THREAD_MULTIPLE
===============================
Control Variables
===============================
Found 950 control variables
Found 950 control variables with verbosity <= D/A-9
Variable                                          VRB   Type   Bind     Scope    Value
---------------------------------------------------------------------------------------------
mca_base_param_files                              U/D-2 CHAR   n/a      READONLY /gpfs/home/withheld/.openmpi/mca-params.conf:/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/etc/openmpi-mca-params.conf
mca_param_files                                   U/D-2 CHAR   n/a      READONLY /gpfs/home/withheld/.openmpi/mca-params.conf:/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/etc/openmpi-mca-params.conf
mca_base_override_param_file                      U/D-2 CHAR   n/a      UNKNOWN  /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/etc/openmpi-mca-params-override.conf
mca_base_suppress_override_warning                U/D-2 INT    n/a      LOCAL    false
mca_base_param_file_prefix                        U/A-3 CHAR   n/a      READONLY 
mca_base_envar_file_prefix                        U/A-3 CHAR   n/a      READONLY 
mca_base_param_file_path                          U/A-3 CHAR   n/a      READONLY /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/share/spectrum_mpi/amca-param-sets:/gpfs/pkgs/hpcmp/bct/mpitests/mpi-tools-master/varlist
mca_base_param_file_path_force                    U/A-3 CHAR   n/a      READONLY 
mca_base_env_list                                 U/A-3 CHAR   n/a      READONLY 
mca_base_env_list_delimiter                       U/A-3 CHAR   n/a      READONLY ;
mca_base_env_list_internal                        U/A-3 CHAR   n/a      READONLY 
opal_signal                                       U/A-3 CHAR   n/a      LOCAL    6,7,8,11
opal_net_private_ipv4                             U/A-3 CHAR   n/a      ALL      10.0.0.0/8;172.16.0.0/12;192.168.0.0/16;169.254.0.0/16
opal_set_max_sys_limits                           U/A-3 CHAR   n/a      ALL      
opal_built_with_cuda_support                      T/B-4 INT    n/a      UNKNOWN  false
opal_cuda_support                                 U/A-3 INT    n/a      ALL      false
mpi_leave_pinned                                  D/A-9 INT    n/a      READONLY 0
opal_leave_pinned                                 D/A-9 INT    n/a      READONLY 0
mpi_leave_pinned_pipeline                         D/A-9 INT    n/a      READONLY false
opal_leave_pinned_pipeline                        D/A-9 INT    n/a      READONLY false
mpi_warn_on_fork                                  D/A-9 INT    n/a      READONLY true
opal_abort_delay                                  T/D-5 INT    n/a      READONLY 0
opal_progress_lp_call_ratio                       T/D-5 UINT   n/a      READONLY 8
opal_abort_print_stack                            T/D-5 INT    n/a      READONLY false
dss_buffer_type                                   D/D-8 INT    n/a      ALL      non-describ
dss_buffer_initial_size                           D/D-8 INT    n/a      ALL      128
dss_buffer_threshold_size                         D/D-8 INT    n/a      ALL      1024
mca_base_component_path                           D/A-9 CHAR   n/a      READONLY /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi:/gpfs/home/withheld/.openmpi/components
mca_component_path                                D/A-9 CHAR   n/a      READONLY /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi:/gpfs/home/withheld/.openmpi/components
mca_base_component_show_load_errors               D/A-9 INT    n/a      READONLY false
mca_component_show_load_errors                    D/A-9 INT    n/a      READONLY false
mca_base_component_disable_dlopen                 D/A-9 INT    n/a      READONLY false
mca_component_disable_dlopen                      D/A-9 INT    n/a      READONLY false
mca_base_verbose                                  D/A-9 CHAR   n/a      READONLY stderr
mca_verbose                                       D/A-9 CHAR   n/a      READONLY stderr
dl                                                U/D-2 CHAR   n/a      ALL      
dl_base_verbose                                   D/D-8 INT    n/a      LOCAL    error
dl_dlopen_filename_suffixes                       T/D-5 CHAR   n/a      LOCAL    .so,.dylib,.dll,.sl
dl_dlopen_major_version                           D/A-9 INT    n/a      UNKNOWN  10
dl_dlopen_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
dl_dlopen_release_version                         D/A-9 INT    n/a      UNKNOWN  0
mpi_param_check                                   D/A-9 INT    n/a      READONLY true
mpi_yield_when_idle                               D/A-9 INT    n/a      READONLY false
mpi_event_tick_rate                               D/A-9 INT    n/a      READONLY -1
mpi_show_handle_leaks                             D/A-9 INT    n/a      READONLY false
mpi_no_free_handles                               D/A-9 INT    n/a      READONLY false
mpi_show_mpi_alloc_mem_leaks                      D/A-9 INT    n/a      READONLY 0
mpi_show_mca_params                               D/A-9 CHAR   n/a      READONLY 
mpi_show_mca_params_file                          D/A-9 CHAR   n/a      READONLY 
mpi_preconnect_mpi                                D/A-9 INT    n/a      READONLY false
mpi_preconnect_all                                D/A-9 INT    n/a      READONLY false
mpi_have_sparse_group_storage                     D/A-9 INT    n/a      UNKNOWN  false
mpi_use_sparse_group_storage                      D/A-9 INT    n/a      UNKNOWN  false
mpi_cuda_support                                  U/A-3 INT    n/a      ALL      false
mpi_built_with_cuda_support                       T/B-4 INT    n/a      UNKNOWN  false
mpi_add_procs_cutoff                              U/A-3 UINT   n/a      LOCAL    0
mpi_abort_delay                                   T/D-5 INT    n/a      READONLY 0
mpi_abort_print_stack                             T/D-5 INT    n/a      READONLY false
ompi_timing                                       D/A-9 INT    n/a      READONLY false
ompi_timing_ext                                   D/A-9 INT    n/a      READONLY false
hook                                              U/D-2 CHAR   n/a      ALL      
hook_base_verbose                                 D/D-8 INT    n/a      LOCAL    error
hook_prot_verbose                                 D/A-9 INT    n/a      READONLY 0
hook_prot_enable_mpi_init                         U/A-3 INT    n/a      READONLY false
hook_prot_enable_mpi_finalize                     U/A-3 INT    n/a      READONLY false
platform_prot                                     U/A-3 INT    n/a      READONLY -1482212840
hook_prot_major_version                           D/A-9 INT    n/a      UNKNOWN  10
hook_prot_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
hook_prot_release_version                         D/A-9 INT    n/a      UNKNOWN  0
hook_ibmlicense_verbose                           D/A-9 INT    n/a      READONLY 0
hook_ibmlicense_check                             D/A-9 INT    n/a      READONLY none
hook_ibmlicense_major_version                     D/A-9 INT    n/a      UNKNOWN  10
hook_ibmlicense_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
hook_ibmlicense_release_version                   D/A-9 INT    n/a      UNKNOWN  0
rte                                               U/D-2 CHAR   n/a      ALL      
rte_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
rte_orte_major_version                            D/A-9 INT    n/a      UNKNOWN  10
rte_orte_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
rte_orte_release_version                          D/A-9 INT    n/a      UNKNOWN  0
hwloc                                             U/D-2 CHAR   n/a      ALL      
hwloc_base_verbose                                D/D-8 INT    n/a      LOCAL    error
hwloc_base_mem_alloc_policy                       D/A-9 INT    n/a      READONLY none
hwloc_base_mem_bind_failure_action                D/A-9 INT    n/a      READONLY warn
hwloc_base_binding_policy                         D/A-9 CHAR   n/a      READONLY 
hwloc_base_bind_to_core                           D/A-9 INT    n/a      READONLY false
hwloc_base_bind_to_socket                         D/A-9 INT    n/a      READONLY false
hwloc_base_report_bindings                        D/A-9 INT    n/a      READONLY false
hwloc_base_slot_list                              D/A-9 CHAR   n/a      READONLY 
hwloc_base_cpu_set                                D/A-9 CHAR   n/a      READONLY 
hwloc_base_use_hwthreads_as_cpus                  D/A-9 INT    n/a      READONLY false
hwloc_base_topo_file                              D/A-9 CHAR   n/a      READONLY 
hwloc_external_major_version                      D/A-9 INT    n/a      UNKNOWN  10
hwloc_external_minor_version                      D/A-9 INT    n/a      UNKNOWN  1
hwloc_external_release_version                    D/A-9 INT    n/a      UNKNOWN  0
memcpy                                            U/D-2 CHAR   n/a      ALL      
memcpy_base_verbose                               D/D-8 INT    n/a      LOCAL    error
memory                                            U/D-2 CHAR   n/a      ALL      
memory_base_verbose                               D/D-8 INT    n/a      LOCAL    error
memory_patcher_priority                           T/D-5 INT    n/a      UNKNOWN  80
memory_patcher_major_version                      D/A-9 INT    n/a      UNKNOWN  10
memory_patcher_minor_version                      D/A-9 INT    n/a      UNKNOWN  1
memory_patcher_release_version                    D/A-9 INT    n/a      UNKNOWN  0
patcher                                           U/D-2 CHAR   n/a      ALL      
patcher_base_verbose                              D/D-8 INT    n/a      LOCAL    error
patcher_overwrite_priority                        T/D-5 INT    n/a      UNKNOWN  37
patcher_overwrite_major_version                   D/A-9 INT    n/a      UNKNOWN  10
patcher_overwrite_minor_version                   D/A-9 INT    n/a      UNKNOWN  1
patcher_overwrite_release_version                 D/A-9 INT    n/a      UNKNOWN  0
memchecker                                        U/D-2 CHAR   n/a      ALL      
memchecker_base_verbose                           D/D-8 INT    n/a      LOCAL    error
backtrace                                         U/D-2 CHAR   n/a      ALL      
backtrace_base_verbose                            D/D-8 INT    n/a      LOCAL    error
backtrace_execinfo_major_version                  D/A-9 INT    n/a      UNKNOWN  10
backtrace_execinfo_minor_version                  D/A-9 INT    n/a      UNKNOWN  1
backtrace_execinfo_release_version                D/A-9 INT    n/a      UNKNOWN  0
timer                                             U/D-2 CHAR   n/a      ALL      
timer_base_verbose                                D/D-8 INT    n/a      LOCAL    error
timer_require_monotonic                           T/D-5 INT    n/a      LOCAL    true
timer_linux_major_version                         D/A-9 INT    n/a      UNKNOWN  10
timer_linux_minor_version                         D/A-9 INT    n/a      UNKNOWN  1
timer_linux_release_version                       D/A-9 INT    n/a      UNKNOWN  0
event                                             U/D-2 CHAR   n/a      ALL      
event_base_verbose                                D/D-8 INT    n/a      LOCAL    error
event_external_event_include                      U/A-3 CHAR   n/a      LOCAL    poll
opal_event_include                                U/A-3 CHAR   n/a      LOCAL    poll
event_external_major_version                      D/A-9 INT    n/a      UNKNOWN  10
event_external_minor_version                      D/A-9 INT    n/a      UNKNOWN  1
event_external_release_version                    D/A-9 INT    n/a      UNKNOWN  0
shmem                                             U/D-2 CHAR   n/a      ALL      
shmem_base_verbose                                D/D-8 INT    n/a      LOCAL    error
shmem_base_RUNTIME_QUERY_hint                     D/A-9 CHAR   n/a      ALL-EQ   
shmem_mmap_priority                               U/A-3 INT    n/a      ALL      50
shmem_mmap_enable_nfs_warning                     D/A-9 INT    n/a      LOCAL    true
shmem_mmap_relocate_backing_file                  D/A-9 INT    n/a      ALL      0
shmem_mmap_backing_file_base_dir                  D/A-9 CHAR   n/a      ALL      /dev/shm
shmem_mmap_major_version                          D/A-9 INT    n/a      UNKNOWN  10
shmem_mmap_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
shmem_mmap_release_version                        D/A-9 INT    n/a      UNKNOWN  0
sec                                               U/D-2 CHAR   n/a      ALL      
sec_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
sec_basic_major_version                           D/A-9 INT    n/a      UNKNOWN  10
sec_basic_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
sec_basic_release_version                         D/A-9 INT    n/a      UNKNOWN  0
orte_base_help_aggregate                          D/A-9 INT    n/a      ALL      true
orte_tmpdir_base                                  D/A-9 CHAR   n/a      ALL      /var/tmp/pbs.21874.ir1utl01
orte_local_tmpdir_base                            D/A-9 CHAR   n/a      ALL      
orte_remote_tmpdir_base                           D/A-9 CHAR   n/a      ALL      
orte_no_session_dirs                              D/A-9 CHAR   n/a      ALL-EQ   
orte_create_session_dirs                          D/A-9 INT    n/a      ALL-EQ   true
orte_execute_quiet                                D/A-9 INT    n/a      ALL-EQ   false
orte_report_silent_errors                         D/A-9 INT    n/a      ALL-EQ   false
orte_debug                                        D/A-9 INT    n/a      ALL-EQ   false
orte_debug_verbose                                D/A-9 INT    n/a      ALL-EQ   -1
orte_debug_daemons_file                           D/A-9 INT    n/a      ALL-EQ   false
orte_debug_daemons                                D/A-9 INT    n/a      ALL-EQ   false
orte_progress_thread_debug                        D/A-9 INT    n/a      ALL-EQ   -1
orte_leave_session_attached                       D/A-9 INT    n/a      ALL-EQ   false
orte_in_parallel_debugger                         D/A-9 INT    n/a      READONLY false
orte_output_debugger_proctable                    D/A-9 INT    n/a      ALL-EQ   false
orte_debugger_test_daemon                         D/A-9 CHAR   n/a      READONLY 
orte_debugger_test_attach                         D/A-9 INT    n/a      READONLY false
orte_debugger_check_rate                          D/A-9 INT    n/a      READONLY 0
orte_do_not_launch                                D/A-9 INT    n/a      READONLY false
orte_daemon_spin                                  D/A-9 INT    n/a      READONLY false
orte_daemon_fail                                  D/A-9 INT    n/a      READONLY -1
orte_daemon_fail_delay                            D/A-9 INT    n/a      READONLY 0
orte_startup_timeout                              D/A-9 INT    n/a      READONLY 0
orte_base_user_debugger                           D/A-9 CHAR   n/a      READONLY totalview @mpirun@ -a @mpirun_args@ : ddt -n @np@ -start @executable@ @executable_argv@ @single_app@ : fxp @mpirun@ -a @mpirun_args@
orte_default_hostfile                             D/A-9 CHAR   n/a      READONLY /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/etc/openmpi-default-hostfile
orte_default_dash_host                            D/A-9 CHAR   n/a      READONLY 
orte_node_regex                                   D/A-9 CHAR   n/a      READONLY 
orte_keep_fqdn_hostnames                          D/A-9 INT    n/a      READONLY false
orte_retain_aliases                               D/A-9 INT    n/a      READONLY false
orte_hostname_alias_index                         D/A-9 INT    n/a      READONLY 1
orte_xml_output                                   D/A-9 INT    n/a      READONLY false
orte_tag_output                                   D/A-9 INT    n/a      READONLY false
orte_xml_file                                     D/A-9 CHAR   n/a      READONLY 
orte_timestamp_output                             D/A-9 INT    n/a      READONLY false
orte_output_filename                              D/A-9 CHAR   n/a      READONLY 
orte_show_resolved_nodenames                      D/A-9 INT    n/a      READONLY false
orte_hetero_nodes                                 D/A-9 INT    n/a      READONLY false
orte_launch_agent                                 D/A-9 CHAR   n/a      READONLY orted
orte_fork_agent                                   D/A-9 CHAR   n/a      READONLY 
orte_allocation_required                          D/A-9 INT    n/a      READONLY false
orte_map_stddiag_to_stderr                        D/A-9 INT    n/a      READONLY false
orte_map_stddiag_to_stdout                        D/A-9 INT    n/a      READONLY false
orte_xterm                                        D/A-9 CHAR   n/a      READONLY 
orte_forward_job_control                          D/A-9 INT    n/a      READONLY false
orte_report_launch_progress                       D/A-9 INT    n/a      READONLY false
orte_cpu_type                                     D/A-9 CHAR   n/a      READONLY 
orte_cpu_model                                    D/A-9 CHAR   n/a      READONLY 
orte_report_events                                D/A-9 CHAR   n/a      READONLY 
orte_do_not_barrier                               D/A-9 INT    n/a      READONLY false
orte_enable_recovery                              D/A-9 INT    n/a      READONLY false
orte_max_restarts                                 D/A-9 INT    n/a      READONLY 0
orte_abort_on_non_zero_status                     D/A-9 INT    n/a      READONLY true
orte_allowed_exit_without_sync                    D/A-9 INT    n/a      READONLY false
orte_staged_execution                             D/A-9 INT    n/a      READONLY false
orte_report_child_jobs_separately                 D/A-9 INT    n/a      READONLY false
orte_stat_history_size                            D/A-9 INT    n/a      READONLY 1
orte_max_vm_size                                  D/A-9 INT    n/a      READONLY -1
orte_set_default_slots                            D/A-9 CHAR   n/a      READONLY cores
orte_display_alloc                                D/A-9 INT    n/a      READONLY false
ras_base_display_alloc                            D/A-9 INT    n/a      READONLY false
orte_display_devel_alloc                          D/A-9 INT    n/a      READONLY false
ras_base_display_devel_alloc                      D/A-9 INT    n/a      READONLY false
orte_soft_locations                               D/A-9 INT    n/a      READONLY false
orte_daemon_cores                                 T/D-5 CHAR   n/a      READONLY 
orte_direct_modex_cutoff                          D/A-9 UINT   n/a      READONLY 4294967295
ompi_hostname_cutoff                              D/A-9 UINT   n/a      READONLY 4294967295
orte_timeout_for_stack_trace                      D/A-9 INT    n/a      READONLY 30
orte_hnp_uri                                      D/A-9 CHAR   n/a      READONLY 1254883328.0;usock;tcp://192.168.11.43,192.168.16.43:52155;ud://17072.59.1
orte_local_daemon_uri                             D/A-9 CHAR   n/a      READONLY 1254883328.0;usock;tcp://192.168.11.43,192.168.16.43:52155;ud://17072.59.1
orte_app_num                                      D/A-9 INT    n/a      READONLY 0
orte_strip_prefix                                 D/A-9 CHAR   n/a      READONLY 
orte_num_nodes                                    D/A-9 INT    n/a      READONLY 1
orte_num_restarts                                 D/A-9 INT    n/a      READONLY 0
orte_app_rank                                     D/A-9 INT    n/a      READONLY 0
orte_ess_node_rank                                D/A-9 INT    n/a      UNKNOWN  0
ess                                               U/D-2 CHAR   n/a      ALL      ^lsf
ess_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
ess_base_stream_buffering                         D/A-9 INT    n/a      READONLY default
ess_base_jobid                                    D/A-9 CHAR   n/a      READONLY 1254883329
orte_ess_jobid                                    D/A-9 CHAR   n/a      READONLY 1254883329
ess_base_vpid                                     D/A-9 CHAR   n/a      READONLY 0
orte_ess_vpid                                     D/A-9 CHAR   n/a      READONLY 0
ess_base_num_procs                                D/A-9 INT    n/a      READONLY 1
orte_ess_num_procs                                D/A-9 INT    n/a      READONLY 1
ERROR: CVARREAD: MPI error code 16: MPI_ERR_OTHER: known error not in list
ERROR: CVAR-FREE: MPI error code 16: MPI_ERR_OTHER: known error not in list
orte_server                                       D/A-9 CHAR   n/a      READONLY 0
ess_pmi_major_version                             D/A-9 INT    n/a      UNKNOWN  10
ess_pmi_minor_version                             D/A-9 INT    n/a      UNKNOWN  1
ess_pmi_release_version                           D/A-9 INT    n/a      UNKNOWN  0
pmix                                              U/D-2 CHAR   n/a      ALL      ^s1,s2,cray
pmix_base_verbose                                 D/D-8 INT    n/a      LOCAL    error
pmix_base_async_modex                             D/A-9 INT    n/a      READONLY false
pmix_base_collect_data                            D/A-9 INT    n/a      READONLY true
pmix_external_major_version                       D/A-9 INT    n/a      UNKNOWN  10
pmix_external_minor_version                       D/A-9 INT    n/a      UNKNOWN  1
pmix_external_release_version                     D/A-9 INT    n/a      UNKNOWN  0
state                                             U/D-2 CHAR   n/a      ALL      
state_base_verbose                                D/D-8 INT    n/a      LOCAL    error
state_app_major_version                           D/A-9 INT    n/a      UNKNOWN  10
state_app_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
state_app_release_version                         D/A-9 INT    n/a      UNKNOWN  0
errmgr                                            U/D-2 CHAR   n/a      ALL      
errmgr_base_verbose                               D/D-8 INT    n/a      LOCAL    error
errmgr_default_app_priority                       D/A-9 INT    n/a      READONLY 1000
errmgr_default_app_major_version                  D/A-9 INT    n/a      UNKNOWN  10
errmgr_default_app_minor_version                  D/A-9 INT    n/a      UNKNOWN  1
errmgr_default_app_release_version                D/A-9 INT    n/a      UNKNOWN  0
oob                                               U/D-2 CHAR   n/a      ALL      
oob_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
oob_base_enable_module_progress_threads           D/A-9 INT    n/a      READONLY false
oob_tcp_peer_limit                                T/D-5 INT    n/a      LOCAL    -1
oob_tcp_peer_retries                              T/D-5 INT    n/a      LOCAL    2
oob_tcp_sndbuf                                    T/B-4 INT    n/a      LOCAL    131072
oob_tcp_rcvbuf                                    T/B-4 INT    n/a      LOCAL    131072
oob_tcp_if_include                                U/D-2 CHAR   n/a      LOCAL    
oob_tcp_include                                   U/D-2 CHAR   n/a      LOCAL    
oob_tcp_if_exclude                                U/D-2 CHAR   n/a      LOCAL    
oob_tcp_exclude                                   U/D-2 CHAR   n/a      LOCAL    
oob_tcp_static_ipv4_ports                         U/D-2 CHAR   n/a      READONLY 
oob_tcp_dynamic_ipv4_ports                        T/B-4 CHAR   n/a      READONLY 
oob_tcp_disable_ipv4_family                       T/B-4 INT    n/a      READONLY false
oob_tcp_keepalive_time                            T/D-5 INT    n/a      READONLY 60
oob_tcp_keepalive_intvl                           T/D-5 INT    n/a      READONLY 5
oob_tcp_keepalive_probes                          T/D-5 INT    n/a      READONLY 3
oob_tcp_retry_delay                               T/B-4 INT    n/a      READONLY 0
oob_tcp_max_recon_attempts                        T/B-4 INT    n/a      READONLY 10
oob_tcp_major_version                             D/A-9 INT    n/a      UNKNOWN  10
oob_tcp_minor_version                             D/A-9 INT    n/a      UNKNOWN  1
oob_tcp_release_version                           D/A-9 INT    n/a      UNKNOWN  0
oob_ud_min_qp                                     T/D-5 INT    n/a      LOCAL    8
oob_ud_max_qp                                     T/D-5 INT    n/a      LOCAL    32
oob_ud_recv_buffers                               T/D-5 INT    n/a      LOCAL    512
oob_ud_send_buffers                               T/D-5 INT    n/a      LOCAL    512
oob_ud_peer_retries                               D/A-9 INT    n/a      LOCAL    5
oob_ud_peer_timeout                               D/A-9 INT    n/a      LOCAL    800000
oob_ud_max_send_sge                               D/A-9 INT    n/a      LOCAL    1
oob_ud_max_recv_sge                               D/A-9 INT    n/a      LOCAL    2
oob_ud_max_send_wr                                D/A-9 INT    n/a      LOCAL    4096
oob_ud_max_recv_wr                                D/A-9 INT    n/a      LOCAL    4096
oob_ud_max_inline_data                            D/A-9 INT    n/a      LOCAL    0
oob_ud_major_version                              D/A-9 INT    n/a      UNKNOWN  10
oob_ud_minor_version                              D/A-9 INT    n/a      UNKNOWN  1
oob_ud_release_version                            D/A-9 INT    n/a      UNKNOWN  0
oob_usock_peer_retries                            D/A-9 INT    n/a      LOCAL    2
oob_usock_major_version                           D/A-9 INT    n/a      UNKNOWN  10
oob_usock_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
oob_usock_release_version                         D/A-9 INT    n/a      UNKNOWN  0
if                                                U/D-2 CHAR   n/a      ALL      
if_base_verbose                                   D/D-8 INT    n/a      LOCAL    error
if_base_do_not_resolve                            D/A-9 INT    n/a      ALL      false
if_base_retain_loopback                           D/A-9 INT    n/a      ALL      false
if_linux_ipv6_major_version                       D/A-9 INT    n/a      UNKNOWN  10
if_linux_ipv6_minor_version                       D/A-9 INT    n/a      UNKNOWN  1
if_linux_ipv6_release_version                     D/A-9 INT    n/a      UNKNOWN  0
if_posix_ipv4_major_version                       D/A-9 INT    n/a      UNKNOWN  10
if_posix_ipv4_minor_version                       D/A-9 INT    n/a      UNKNOWN  1
if_posix_ipv4_release_version                     D/A-9 INT    n/a      UNKNOWN  0
rml                                               U/D-2 CHAR   n/a      ALL      
rml_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
rml_base_wrapper                                  D/A-9 CHAR   n/a      READONLY 
rml_wrapper                                       D/A-9 CHAR   n/a      READONLY 
rml_base_max_retries                              D/A-9 INT    n/a      READONLY 3
rml_oob_major_version                             D/A-9 INT    n/a      UNKNOWN  10
rml_oob_minor_version                             D/A-9 INT    n/a      UNKNOWN  1
rml_oob_release_version                           D/A-9 INT    n/a      UNKNOWN  0
routed                                            U/D-2 CHAR   n/a      ALL      
routed_base_verbose                               D/D-8 INT    n/a      LOCAL    error
routed_radix                                      D/A-9 INT    n/a      READONLY 64
routed_radix_max_connections                      D/A-9 INT    n/a      READONLY -1
routed_radix_major_version                        D/A-9 INT    n/a      UNKNOWN  10
routed_radix_minor_version                        D/A-9 INT    n/a      UNKNOWN  1
routed_radix_release_version                      D/A-9 INT    n/a      UNKNOWN  0
grpcomm                                           U/D-2 CHAR   n/a      ALL      
grpcomm_base_verbose                              D/D-8 INT    n/a      LOCAL    error
grpcomm_direct_priority                           D/A-9 INT    n/a      READONLY 85
grpcomm_direct_major_version                      D/A-9 INT    n/a      UNKNOWN  10
grpcomm_direct_minor_version                      D/A-9 INT    n/a      UNKNOWN  1
grpcomm_direct_release_version                    D/A-9 INT    n/a      UNKNOWN  0
dfs                                               U/D-2 CHAR   n/a      ALL      
dfs_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
op                                                U/D-2 CHAR   n/a      ALL      
op_base_verbose                                   D/D-8 INT    n/a      LOCAL    error
allocator                                         U/D-2 CHAR   n/a      ALL      
allocator_base_verbose                            D/D-8 INT    n/a      LOCAL    error
allocator_basic_major_version                     D/A-9 INT    n/a      UNKNOWN  10
allocator_basic_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
allocator_basic_release_version                   D/A-9 INT    n/a      UNKNOWN  0
allocator_bucket_num_buckets                      D/A-9 INT    n/a      LOCAL    30
allocator_bucket_major_version                    D/A-9 INT    n/a      UNKNOWN  10
allocator_bucket_minor_version                    D/A-9 INT    n/a      UNKNOWN  1
allocator_bucket_release_version                  D/A-9 INT    n/a      UNKNOWN  0
rcache                                            U/D-2 CHAR   n/a      ALL      
rcache_base_verbose                               D/D-8 INT    n/a      LOCAL    error
rcache_vma_major_version                          D/A-9 INT    n/a      UNKNOWN  10
rcache_vma_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
rcache_vma_release_version                        D/A-9 INT    n/a      UNKNOWN  0
mpool                                             U/D-2 CHAR   n/a      ALL      
mpool_base_verbose                                D/D-8 INT    n/a      LOCAL    error
mpool_sm_allocator                                D/A-9 CHAR   n/a      READONLY bucket
mpool_sm_min_size                                 D/A-9 ULLONG n/a      READONLY 134217728
mpool_sm_verbose                                  D/A-9 INT    n/a      READONLY 0
mpool_sm_major_version                            D/A-9 INT    n/a      UNKNOWN  10
mpool_sm_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
mpool_sm_release_version                          D/A-9 INT    n/a      UNKNOWN  0
mpool_grdma_rcache_name                           D/A-9 CHAR   n/a      READONLY vma
mpool_grdma_print_stats                           D/A-9 INT    n/a      READONLY false
mpool_grdma_major_version                         D/A-9 INT    n/a      UNKNOWN  10
mpool_grdma_minor_version                         D/A-9 INT    n/a      UNKNOWN  1
mpool_grdma_release_version                       D/A-9 INT    n/a      UNKNOWN  0
bml                                               U/D-2 CHAR   n/a      ALL      
bml_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
bml_r2_show_unreach_errors                        D/A-9 INT    n/a      READONLY true
bml_r2_major_version                              D/A-9 INT    n/a      UNKNOWN  10
bml_r2_minor_version                              D/A-9 INT    n/a      UNKNOWN  1
bml_r2_release_version                            D/A-9 INT    n/a      UNKNOWN  0
btl                                               U/D-2 CHAR   n/a      ALL      self
btl_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
btl_base_thread_multiple_override                 D/A-9 INT    n/a      READONLY false
btl_base_include                                  D/A-9 CHAR   n/a      READONLY 
btl_base_exclude                                  D/A-9 CHAR   n/a      READONLY 
btl_base_warn_component_unused                    D/A-9 INT    n/a      READONLY 1
btl_self_free_list_num                            D/A-9 INT    n/a      READONLY 0
btl_self_free_list_max                            D/A-9 INT    n/a      READONLY -1
btl_self_free_list_inc                            D/A-9 INT    n/a      READONLY 32
btl_self_exclusivity                              D/B-7 UINT   n/a      READONLY 65536
btl_self_flags                                    T/D-5 UINT   n/a      READONLY 11
btl_self_atomic_flags                             T/D-5 UINT   n/a      UNKNOWN  0
btl_self_rndv_eager_limit                         T/B-4 ULONG  n/a      READONLY 131072
btl_self_eager_limit                              T/B-4 ULONG  n/a      READONLY 131072
btl_self_put_limit                                T/B-4 ULONG  n/a      READONLY 18446744073709551615
btl_self_put_alignment                            T/A-6 ULONG  n/a      UNKNOWN  0
btl_self_max_send_size                            T/B-4 ULONG  n/a      READONLY 262144
btl_self_rdma_pipeline_send_length                T/B-4 ULONG  n/a      READONLY 2147483647
btl_self_rdma_pipeline_frag_size                  T/B-4 ULONG  n/a      READONLY 2147483647
btl_self_min_rdma_pipeline_size                   T/B-4 ULONG  n/a      READONLY 2147614719
btl_self_latency                                  T/D-5 UINT   n/a      READONLY 0
btl_self_bandwidth                                T/D-5 UINT   n/a      READONLY 100
btl_self_major_version                            D/A-9 INT    n/a      UNKNOWN  10
btl_self_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
btl_self_release_version                          D/A-9 INT    n/a      UNKNOWN  0
pml                                               U/D-2 CHAR   n/a      ALL      pami
pml_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
pml_base_bsend_allocator                          D/A-9 CHAR   n/a      READONLY basic
pml_base_wrapper                                  D/A-9 CHAR   n/a      READONLY 
pml_wrapper                                       D/A-9 CHAR   n/a      READONLY 
pml_pami_verbose                                  D/A-9 INT    n/a      LOCAL    0
pml_pami_priority                                 U/A-3 INT    n/a      LOCAL    60
pml_pami_unexpected_limit                         D/A-9 UINT   n/a      READONLY 256
pml_pami_local_eager_limit                        T/B-4 ULONG  n/a      READONLY 12288
pml_pami_shm_attach_thresh                        T/B-4 ULONG  n/a      READONLY 12288
pml_pami_remote_eager_limit                       T/B-4 ULONG  n/a      READONLY 65536
pml_pami_use_get                                  D/A-9 UINT   n/a      READONLY 0
pml_pami_enable_cuda                              D/A-9 UINT   n/a      READONLY 0
pml_pami_major_version                            D/A-9 INT    n/a      UNKNOWN  10
pml_pami_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
pml_pami_release_version                          D/A-9 INT    n/a      UNKNOWN  0
coll                                              U/D-2 CHAR   n/a      ALL      
coll_base_verbose                                 D/D-8 INT    n/a      LOCAL    error
coll_self_priority                                D/A-9 INT    n/a      READONLY 75
coll_self_major_version                           D/A-9 INT    n/a      UNKNOWN  10
coll_self_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
coll_self_release_version                         D/A-9 INT    n/a      UNKNOWN  0
coll_libnbc_priority                              D/A-9 INT    n/a      READONLY 10
coll_libnbc_ibcast_skip_dt_decision               D/A-9 INT    n/a      READONLY true
coll_libnbc_major_version                         D/A-9 INT    n/a      UNKNOWN  10
coll_libnbc_minor_version                         D/A-9 INT    n/a      UNKNOWN  1
coll_libnbc_release_version                       D/A-9 INT    n/a      UNKNOWN  0
coll_inter_priority                               D/A-9 INT    n/a      READONLY 40
coll_inter_verbose                                D/A-9 INT    n/a      READONLY 0
coll_inter_major_version                          D/A-9 INT    n/a      UNKNOWN  10
coll_inter_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
coll_inter_release_version                        D/A-9 INT    n/a      UNKNOWN  0
coll_ibm_priority                                 D/A-9 INT    n/a      READONLY 95
coll_ibm_verbose                                  D/A-9 INT    n/a      READONLY 0
coll_ibm_opal_progress_limit                      D/A-9 INT    n/a      READONLY 128
coll_ibm_always_make_progress                     D/A-9 INT    n/a      READONLY false
coll_ibm_comm_lazy_max_wait                       D/A-9 INT    n/a      READONLY 10
coll_ibm_display_table                            D/A-9 INT    n/a      READONLY false
coll_ibm_algorithm                                D/A-9 INT    n/a      READONLY -1
coll_ibm_adapter                                  D/A-9 INT    n/a      READONLY pami
coll_ibm_collselect_mode                          D/A-9 INT    n/a      READONLY static
coll_ibm_collselect_mode_nb                       D/A-9 INT    n/a      READONLY failsafe
coll_ibm_tune_results                             D/A-9 CHAR   n/a      READONLY /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/etc/libcoll_tune_results.xml
coll_ibm_skip_allgather                           D/A-9 INT    n/a      READONLY false
coll_ibm_force_allgather                          D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_allgather                D/A-9 INT    n/a      READONLY static
coll_ibm_skip_iallgather                          D/A-9 INT    n/a      READONLY false
coll_ibm_force_iallgather                         D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_iallgather               D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_allgatherv                          D/A-9 INT    n/a      READONLY false
coll_ibm_force_allgatherv                         D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_allgatherv               D/A-9 INT    n/a      READONLY static
coll_ibm_skip_iallgatherv                         D/A-9 INT    n/a      READONLY false
coll_ibm_force_iallgatherv                        D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_iallgatherv              D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_allreduce                           D/A-9 INT    n/a      READONLY false
coll_ibm_force_allreduce                          D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_allreduce                D/A-9 INT    n/a      READONLY static
coll_ibm_skip_iallreduce                          D/A-9 INT    n/a      READONLY false
coll_ibm_force_iallreduce                         D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_iallreduce               D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_alltoall                            D/A-9 INT    n/a      READONLY false
coll_ibm_force_alltoall                           D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_alltoall                 D/A-9 INT    n/a      READONLY static
coll_ibm_skip_ialltoall                           D/A-9 INT    n/a      READONLY false
coll_ibm_force_ialltoall                          D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_ialltoall                D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_alltoallv                           D/A-9 INT    n/a      READONLY false
coll_ibm_force_alltoallv                          D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_alltoallv                D/A-9 INT    n/a      READONLY static
coll_ibm_skip_ialltoallv                          D/A-9 INT    n/a      READONLY false
coll_ibm_force_ialltoallv                         D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_ialltoallv               D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_barrier                             D/A-9 INT    n/a      READONLY false
coll_ibm_force_barrier                            D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_barrier                  D/A-9 INT    n/a      READONLY static
coll_ibm_skip_ibarrier                            D/A-9 INT    n/a      READONLY false
coll_ibm_force_ibarrier                           D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_ibarrier                 D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_bcast                               D/A-9 INT    n/a      READONLY false
coll_ibm_force_bcast                              D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_bcast                    D/A-9 INT    n/a      READONLY static
coll_ibm_skip_ibcast                              D/A-9 INT    n/a      READONLY false
coll_ibm_force_ibcast                             D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_ibcast                   D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_gather                              D/A-9 INT    n/a      READONLY false
coll_ibm_force_gather                             D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_gather                   D/A-9 INT    n/a      READONLY static
coll_ibm_skip_igather                             D/A-9 INT    n/a      READONLY false
coll_ibm_force_igather                            D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_igather                  D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_gatherv                             D/A-9 INT    n/a      READONLY false
coll_ibm_force_gatherv                            D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_gatherv                  D/A-9 INT    n/a      READONLY static
coll_ibm_skip_igatherv                            D/A-9 INT    n/a      READONLY false
coll_ibm_force_igatherv                           D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_igatherv                 D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_reduce                              D/A-9 INT    n/a      READONLY false
coll_ibm_force_reduce                             D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_reduce                   D/A-9 INT    n/a      READONLY static
coll_ibm_skip_ireduce                             D/A-9 INT    n/a      READONLY false
coll_ibm_force_ireduce                            D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_ireduce                  D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_reduce_scatter                      D/A-9 INT    n/a      READONLY false
coll_ibm_force_reduce_scatter                     D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_reduce_scatter           D/A-9 INT    n/a      READONLY static
coll_ibm_skip_ireduce_scatter                     D/A-9 INT    n/a      READONLY false
coll_ibm_force_ireduce_scatter                    D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_ireduce_scatter          D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_scan                                D/A-9 INT    n/a      READONLY false
coll_ibm_force_scan                               D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_scan                     D/A-9 INT    n/a      READONLY static
coll_ibm_skip_iscan                               D/A-9 INT    n/a      READONLY false
coll_ibm_force_iscan                              D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_iscan                    D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_scatter                             D/A-9 INT    n/a      READONLY false
coll_ibm_force_scatter                            D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_scatter                  D/A-9 INT    n/a      READONLY static
coll_ibm_skip_iscatter                            D/A-9 INT    n/a      READONLY false
coll_ibm_force_iscatter                           D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_iscatter                 D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_scatterv                            D/A-9 INT    n/a      READONLY false
coll_ibm_force_scatterv                           D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_scatterv                 D/A-9 INT    n/a      READONLY static
coll_ibm_skip_iscatterv                           D/A-9 INT    n/a      READONLY false
coll_ibm_force_iscatterv                          D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_iscatterv                D/A-9 INT    n/a      READONLY failsafe
coll_ibm_major_version                            D/A-9 INT    n/a      UNKNOWN  10
coll_ibm_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
coll_ibm_release_version                          D/A-9 INT    n/a      UNKNOWN  0
coll_sync_priority                                D/A-9 INT    n/a      READONLY 50
coll_sync_barrier_before                          D/A-9 INT    n/a      READONLY 0
coll_sync_barrier_after                           D/A-9 INT    n/a      READONLY 0
coll_sync_major_version                           D/A-9 INT    n/a      UNKNOWN  10
coll_sync_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
coll_sync_release_version                         D/A-9 INT    n/a      UNKNOWN  0
coll_tuned_priority                               T/A-6 INT    n/a      READONLY -1
coll_tuned_init_tree_fanout                       T/A-6 INT    n/a      READONLY 4
coll_tuned_init_chain_fanout                      T/A-6 INT    n/a      READONLY 4
coll_tuned_alltoall_small_msg                     T/A-6 INT    n/a      READONLY 200
coll_tuned_alltoall_intermediate_msg              T/A-6 INT    n/a      READONLY 3000
coll_tuned_use_dynamic_rules                      T/A-6 INT    n/a      READONLY false
coll_tuned_dynamic_rules_filename                 T/A-6 CHAR   n/a      READONLY 
coll_tuned_allreduce_algorithm_count              T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_allreduce_algorithm                    T/D-5 INT    n/a      READONLY ignore
coll_tuned_allreduce_algorithm_segmentsize        T/D-5 INT    n/a      READONLY 0
coll_tuned_allreduce_algorithm_tree_fanout        T/D-5 INT    n/a      READONLY 4
coll_tuned_allreduce_algorithm_chain_fanout       T/D-5 INT    n/a      READONLY 4
coll_tuned_alltoall_algorithm_count               T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_alltoall_algorithm                     T/D-5 INT    n/a      READONLY ignore
coll_tuned_alltoall_algorithm_segmentsize         T/D-5 INT    n/a      READONLY 0
coll_tuned_alltoall_algorithm_tree_fanout         T/D-5 INT    n/a      READONLY 4
coll_tuned_alltoall_algorithm_chain_fanout        T/D-5 INT    n/a      READONLY 4
coll_tuned_alltoall_algorithm_max_requests        T/D-5 INT    n/a      READONLY 0
coll_tuned_allgather_algorithm_count              T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_allgather_algorithm                    T/D-5 INT    n/a      READONLY ignore
coll_tuned_allgather_algorithm_segmentsize        T/D-5 INT    n/a      READONLY 0
coll_tuned_allgather_algorithm_tree_fanout        T/D-5 INT    n/a      READONLY 4
coll_tuned_allgather_algorithm_chain_fanout       T/D-5 INT    n/a      READONLY 4
coll_tuned_allgatherv_algorithm_count             T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_allgatherv_algorithm                   T/D-5 INT    n/a      READONLY ignore
coll_tuned_allgatherv_algorithm_segmentsize       T/D-5 INT    n/a      READONLY 0
coll_tuned_allgatherv_algorithm_tree_fanout       T/D-5 INT    n/a      READONLY 4
coll_tuned_allgatherv_algorithm_chain_fanout      T/D-5 INT    n/a      READONLY 4
coll_tuned_alltoallv_algorithm_count              T/D-5 INT    n/a      UNKNOWN  -1667791020
coll_tuned_alltoallv_algorithm                    T/D-5 INT    n/a      READONLY ignore
coll_tuned_barrier_algorithm_count                T/D-5 INT    n/a      UNKNOWN  -1667791020
coll_tuned_barrier_algorithm                      T/D-5 INT    n/a      READONLY ignore
coll_tuned_bcast_algorithm_count                  T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_bcast_algorithm                        T/D-5 INT    n/a      READONLY ignore
coll_tuned_bcast_algorithm_segmentsize            T/D-5 INT    n/a      READONLY 0
coll_tuned_bcast_algorithm_tree_fanout            T/D-5 INT    n/a      READONLY 4
coll_tuned_bcast_algorithm_chain_fanout           T/D-5 INT    n/a      READONLY 4
coll_tuned_reduce_algorithm_count                 T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_reduce_algorithm                       T/D-5 INT    n/a      READONLY ignore
coll_tuned_reduce_algorithm_segmentsize           T/D-5 INT    n/a      READONLY 0
coll_tuned_reduce_algorithm_tree_fanout           T/D-5 INT    n/a      READONLY 4
coll_tuned_reduce_algorithm_chain_fanout          T/D-5 INT    n/a      READONLY 4
coll_tuned_reduce_algorithm_max_requests          T/D-5 INT    n/a      READONLY 0
coll_tuned_reduce_scatter_algorithm_count         T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_reduce_scatter_algorithm               T/D-5 INT    n/a      READONLY ignore
coll_tuned_reduce_scatter_algorithm_segmentsize   T/D-5 INT    n/a      READONLY 0
coll_tuned_reduce_scatter_algorithm_tree_fanout   T/D-5 INT    n/a      READONLY 4
coll_tuned_reduce_scatter_algorithm_chain_fanout  T/D-5 INT    n/a      READONLY 4
coll_tuned_gather_algorithm_count                 T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_gather_algorithm                       T/D-5 INT    n/a      READONLY ignore
coll_tuned_gather_algorithm_segmentsize           T/D-5 INT    n/a      READONLY 0
coll_tuned_gather_algorithm_tree_fanout           T/D-5 INT    n/a      READONLY 4
coll_tuned_gather_algorithm_chain_fanout          T/D-5 INT    n/a      READONLY 4
coll_tuned_scatter_algorithm_count                T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_scatter_algorithm                      T/D-5 INT    n/a      READONLY ignore
coll_tuned_scatter_algorithm_segmentsize          T/D-5 INT    n/a      READONLY 0
coll_tuned_scatter_algorithm_tree_fanout          T/D-5 INT    n/a      READONLY 4
coll_tuned_scatter_algorithm_chain_fanout         T/D-5 INT    n/a      READONLY 4
coll_tuned_major_version                          D/A-9 INT    n/a      UNKNOWN  10
coll_tuned_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
coll_tuned_release_version                        D/A-9 INT    n/a      UNKNOWN  0
coll_basic_priority                               D/A-9 INT    n/a      READONLY 10
coll_basic_crossover                              D/A-9 INT    n/a      READONLY 4
coll_basic_major_version                          D/A-9 INT    n/a      UNKNOWN  10
coll_basic_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
coll_basic_release_version                        D/A-9 INT    n/a      UNKNOWN  0
coll_sm_priority                                  D/A-9 INT    n/a      READONLY 0
coll_sm_control_size                              D/A-9 INT    n/a      READONLY 4096
coll_sm_fragment_size                             D/A-9 INT    n/a      READONLY 8192
coll_sm_comm_in_use_flags                         D/A-9 INT    n/a      READONLY 2
coll_sm_comm_num_segments                         D/A-9 INT    n/a      READONLY 8
coll_sm_tree_degree                               D/A-9 INT    n/a      READONLY 4
coll_sm_info_num_procs                            D/A-9 INT    n/a      READONLY 4
coll_sm_shared_mem_used_data                      D/A-9 INT    n/a      READONLY 548864
coll_sm_major_version                             D/A-9 INT    n/a      UNKNOWN  10
coll_sm_minor_version                             D/A-9 INT    n/a      UNKNOWN  1
coll_sm_release_version                           D/A-9 INT    n/a      UNKNOWN  0
osc                                               U/D-2 CHAR   n/a      ALL      pami
osc_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
osc_pami_no_locks                                 D/A-9 INT    n/a      READONLY unknown
osc_pami_max_ctrl_sends                           U/A-3 UINT   n/a      READONLY 1024
osc_pami_rma_pending                              U/A-3 UINT   n/a      READONLY 1024
osc_pami_use_get                                  D/A-9 UINT   n/a      READONLY 0
osc_pami_priority                                 U/A-3 INT    n/a      GROUP    95
osc_pami_major_version                            D/A-9 INT    n/a      UNKNOWN  10
osc_pami_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
osc_pami_release_version                          D/A-9 INT    n/a      UNKNOWN  0
common_pami_verbose                               D/A-9 INT    n/a      READONLY -1
common_pami_ncontexts                             D/A-9 INT    n/a      READONLY 1
pstat                                             U/D-2 CHAR   n/a      ALL      
pstat_base_verbose                                D/D-8 INT    n/a      LOCAL    error
pstat_linux_major_version                         D/A-9 INT    n/a      UNKNOWN  10
pstat_linux_minor_version                         D/A-9 INT    n/a      UNKNOWN  1
pstat_linux_release_version                       D/A-9 INT    n/a      UNKNOWN  0
filem                                             U/D-2 CHAR   n/a      ALL      
filem_base_verbose                                D/D-8 INT    n/a      LOCAL    error
filem_raw_flatten_directory_trees                 D/A-9 INT    n/a      READONLY false
filem_raw_major_version                           D/A-9 INT    n/a      UNKNOWN  10
filem_raw_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
filem_raw_release_version                         D/A-9 INT    n/a      UNKNOWN  0
iof                                               U/D-2 CHAR   n/a      ALL      
iof_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
iof_base_output_limit                             D/A-9 ULONG  n/a      READONLY 2147483647
iof_base_input_files                              D/A-9 CHAR   n/a      READONLY 
iof_base_redirect_app_stderr_to_stdout            D/A-9 INT    n/a      READONLY false
iof_mr_orted_major_version                        D/A-9 INT    n/a      UNKNOWN  10
iof_mr_orted_minor_version                        D/A-9 INT    n/a      UNKNOWN  1
iof_mr_orted_release_version                      D/A-9 INT    n/a      UNKNOWN  0
iof_tool_major_version                            D/A-9 INT    n/a      UNKNOWN  10
iof_tool_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
iof_tool_release_version                          D/A-9 INT    n/a      UNKNOWN  0
iof_mr_hnp_major_version                          D/A-9 INT    n/a      UNKNOWN  10
iof_mr_hnp_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
iof_mr_hnp_release_version                        D/A-9 INT    n/a      UNKNOWN  0
iof_orted_major_version                           D/A-9 INT    n/a      UNKNOWN  10
iof_orted_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
iof_orted_release_version                         D/A-9 INT    n/a      UNKNOWN  0
iof_hnp_major_version                             D/A-9 INT    n/a      UNKNOWN  10
iof_hnp_minor_version                             D/A-9 INT    n/a      UNKNOWN  1
iof_hnp_release_version                           D/A-9 INT    n/a      UNKNOWN  0
notifier                                          U/D-2 CHAR   n/a      ALL      
notifier_base_verbose                             D/D-8 INT    n/a      LOCAL    error
notifier_base_use_progress_thread                 D/A-9 INT    n/a      READONLY false
notifier_base_severity_level                      D/A-9 CHAR   n/a      READONLY 
notifier_base_default_actions                     D/A-9 CHAR   n/a      READONLY syslog
notifier_base_emerg_event_actions                 D/A-9 CHAR   n/a      READONLY 
notifier_base_alert_event_actions                 D/A-9 CHAR   n/a      READONLY 
notifier_base_crit_event_actions                  D/A-9 CHAR   n/a      READONLY 
notifier_base_warn_event_actions                  D/A-9 CHAR   n/a      READONLY 
notifier_base_notice_event_actions                D/A-9 CHAR   n/a      READONLY 
notifier_base_info_event_actions                  D/A-9 CHAR   n/a      READONLY 
notifier_base_debug_event_actions                 D/A-9 CHAR   n/a      READONLY 
notifier_base_error_event_actions                 D/A-9 CHAR   n/a      READONLY 
notifier_syslog_major_version                     D/A-9 INT    n/a      UNKNOWN  10
notifier_syslog_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
notifier_syslog_release_version                   D/A-9 INT    n/a      UNKNOWN  0
odls                                              U/D-2 CHAR   n/a      ALL      
odls_base_verbose                                 D/D-8 INT    n/a      LOCAL    error
odls_base_sigkill_timeout                         D/A-9 INT    n/a      READONLY 1
odls_default_major_version                        D/A-9 INT    n/a      UNKNOWN  10
odls_default_minor_version                        D/A-9 INT    n/a      UNKNOWN  1
odls_default_release_version                      D/A-9 INT    n/a      UNKNOWN  0
plm                                               U/D-2 CHAR   n/a      ALL      ^lsf
plm_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
plm_jsexec_verbose                                D/A-9 INT    n/a      READONLY 0
plm_jsexec_priority                               D/A-9 INT    n/a      READONLY 1
plm_jsexec_major_version                          D/A-9 INT    n/a      UNKNOWN  10
plm_jsexec_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
plm_jsexec_release_version                        D/A-9 INT    n/a      UNKNOWN  0
plm_isolated_major_version                        D/A-9 INT    n/a      UNKNOWN  10
plm_isolated_minor_version                        D/A-9 INT    n/a      UNKNOWN  1
plm_isolated_release_version                      D/A-9 INT    n/a      UNKNOWN  0
plm_rsh_num_concurrent                            T/D-5 INT    n/a      READONLY 128
plm_rsh_force_rsh                                 U/D-2 INT    n/a      READONLY false
plm_rsh_disable_qrsh                              U/D-2 INT    n/a      READONLY false
plm_rsh_daemonize_qrsh                            U/D-2 INT    n/a      READONLY false
plm_rsh_disable_llspawn                           U/D-2 INT    n/a      READONLY false
plm_rsh_daemonize_llspawn                         U/D-2 INT    n/a      READONLY false
plm_rsh_priority                                  D/A-9 INT    n/a      READONLY 10
plm_rsh_delay                                     T/B-4 CHAR   n/a      READONLY 
plm_rsh_no_tree_spawn                             T/D-5 INT    n/a      READONLY false
plm_rsh_agent                                     U/D-2 CHAR   n/a      READONLY ssh : rsh
pls_rsh_agent                                     U/D-2 CHAR   n/a      READONLY ssh : rsh
orte_rsh_agent                                    U/D-2 CHAR   n/a      READONLY ssh : rsh
plm_rsh_assume_same_shell                         U/D-2 INT    n/a      READONLY true
orte_assume_same_shell                            U/D-2 INT    n/a      READONLY true
plm_rsh_pass_environ_mca_params                   U/D-2 INT    n/a      READONLY true
plm_rsh_args                                      U/D-2 CHAR   n/a      READONLY 
plm_rsh_pass_libpath                              U/D-2 CHAR   n/a      READONLY 
plm_rsh_use_cat                                   U/D-2 INT    n/a      READONLY true
plm_rsh_major_version                             D/A-9 INT    n/a      UNKNOWN  10
plm_rsh_minor_version                             D/A-9 INT    n/a      UNKNOWN  1
plm_rsh_release_version                           D/A-9 INT    n/a      UNKNOWN  0
ras                                               U/D-2 CHAR   n/a      ALL      ^lsf
ras_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
ras_simulator_slots                               D/A-9 CHAR   n/a      READONLY 1
ras_simulator_max_slots                           D/A-9 CHAR   n/a      READONLY 0
ras_simulator_num_nodes                           D/A-9 CHAR   n/a      READONLY 
ras_simulator_topo_files                          D/A-9 CHAR   n/a      READONLY 
ras_simulator_topologies                          D/A-9 CHAR   n/a      READONLY 
ras_simulator_have_cpubind                        D/A-9 INT    n/a      READONLY true
ras_simulator_have_membind                        D/A-9 INT    n/a      READONLY true
ras_simulator_major_version                       D/A-9 INT    n/a      UNKNOWN  10
ras_simulator_minor_version                       D/A-9 INT    n/a      UNKNOWN  1
ras_simulator_release_version                     D/A-9 INT    n/a      UNKNOWN  0
ras_gridengine_priority                           D/A-9 INT    n/a      READONLY 100
ras_gridengine_verbose                            D/A-9 INT    n/a      LOCAL    0
ras_gridengine_show_jobid                         D/A-9 INT    n/a      READONLY false
ras_gridengine_major_version                      D/A-9 INT    n/a      UNKNOWN  10
ras_gridengine_minor_version                      D/A-9 INT    n/a      UNKNOWN  1
ras_gridengine_release_version                    D/A-9 INT    n/a      UNKNOWN  0
ras_loadleveler_priority                          D/A-9 INT    n/a      READONLY 90
ras_loadleveler_major_version                     D/A-9 INT    n/a      UNKNOWN  10
ras_loadleveler_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
ras_loadleveler_release_version                   D/A-9 INT    n/a      UNKNOWN  0
rmaps                                             U/D-2 CHAR   n/a      ALL      
rmaps_base_verbose                                D/D-8 INT    n/a      LOCAL    error
rmaps_base_pernode                                D/A-9 INT    n/a      READONLY false
rmaps_ppr_pernode                                 D/A-9 INT    n/a      READONLY false
rmaps_base_n_pernode                              D/A-9 INT    n/a      READONLY 0
rmaps_ppr_n_pernode                               D/A-9 INT    n/a      READONLY 0
rmaps_base_n_persocket                            D/A-9 INT    n/a      READONLY 0
rmaps_ppr_n_persocket                             D/A-9 INT    n/a      READONLY 0
rmaps_base_pattern                                D/A-9 CHAR   n/a      READONLY 
rmaps_ppr_pattern                                 D/A-9 CHAR   n/a      READONLY 
rmaps_base_mapping_policy                         D/A-9 CHAR   n/a      READONLY 
rmaps_base_schedule_policy                        D/A-9 CHAR   n/a      READONLY 
rmaps_base_ranking_policy                         D/A-9 CHAR   n/a      READONLY 
rmaps_base_bycore                                 D/A-9 INT    n/a      READONLY false
rmaps_base_byslot                                 D/A-9 INT    n/a      READONLY false
rmaps_base_bynode                                 D/A-9 INT    n/a      READONLY false
rmaps_base_cpus_per_proc                          D/A-9 INT    n/a      READONLY 1
rmaps_base_cpus_per_rank                          D/A-9 INT    n/a      READONLY 1
rmaps_dist_device                                 D/A-9 CHAR   n/a      READONLY 
rmaps_base_no_schedule_local                      D/A-9 INT    n/a      READONLY false
rmaps_base_no_oversubscribe                       D/A-9 INT    n/a      READONLY false
rmaps_base_oversubscribe                          D/A-9 INT    n/a      READONLY false
rmaps_base_display_map                            D/A-9 INT    n/a      READONLY false
rmaps_base_display_devel_map                      D/A-9 INT    n/a      READONLY false
rmaps_base_display_topo_with_map                  D/A-9 INT    n/a      READONLY false
rmaps_base_display_diffable_map                   D/A-9 INT    n/a      READONLY false
rmaps_base_topology                               D/A-9 CHAR   n/a      READONLY 
rmaps_seq_priority                                D/A-9 INT    n/a      READONLY 60
rmaps_seq_major_version                           D/A-9 INT    n/a      UNKNOWN  10
rmaps_seq_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
rmaps_seq_release_version                         D/A-9 INT    n/a      UNKNOWN  0
rmaps_rank_file_priority                          D/A-9 INT    n/a      READONLY 0
rmaps_rank_file_path                              T/D-5 CHAR   n/a      READONLY 
orte_rankfile                                     T/D-5 CHAR   n/a      READONLY 
rmaps_rank_file_physical                          T/D-5 INT    n/a      READONLY false
rmaps_rank_file_major_version                     D/A-9 INT    n/a      UNKNOWN  10
rmaps_rank_file_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
rmaps_rank_file_release_version                   D/A-9 INT    n/a      UNKNOWN  0
rmaps_resilient_priority                          D/A-9 INT    n/a      READONLY 40
rmaps_resilient_fault_grp_file                    D/A-9 CHAR   n/a      READONLY 
rmaps_resilient_major_version                     D/A-9 INT    n/a      UNKNOWN  10
rmaps_resilient_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
rmaps_resilient_release_version                   D/A-9 INT    n/a      UNKNOWN  0
rmaps_staged_major_version                        D/A-9 INT    n/a      UNKNOWN  10
rmaps_staged_minor_version                        D/A-9 INT    n/a      UNKNOWN  1
rmaps_staged_release_version                      D/A-9 INT    n/a      UNKNOWN  0
rmaps_mindist_priority                            D/A-9 INT    n/a      READONLY 20
rmaps_mindist_major_version                       D/A-9 INT    n/a      UNKNOWN  10
rmaps_mindist_minor_version                       D/A-9 INT    n/a      UNKNOWN  1
rmaps_mindist_release_version                     D/A-9 INT    n/a      UNKNOWN  0
rmaps_round_robin_priority                        D/A-9 INT    n/a      READONLY 10
rmaps_round_robin_major_version                   D/A-9 INT    n/a      UNKNOWN  10
rmaps_round_robin_minor_version                   D/A-9 INT    n/a      UNKNOWN  1
rmaps_round_robin_release_version                 D/A-9 INT    n/a      UNKNOWN  0
rmaps_ppr_priority                                D/A-9 INT    n/a      READONLY 90
rmaps_ppr_major_version                           D/A-9 INT    n/a      UNKNOWN  10
rmaps_ppr_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
rmaps_ppr_release_version                         D/A-9 INT    n/a      UNKNOWN  0
rtc                                               U/D-2 CHAR   n/a      ALL      
rtc_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
rtc_freq_priority                                 D/A-9 INT    n/a      READONLY 50
rtc_freq_governor                                 D/A-9 CHAR   n/a      READONLY 
rtc_freq_max                                      D/A-9 CHAR   n/a      READONLY 
rtc_freq_min                                      D/A-9 CHAR   n/a      READONLY 
rtc_freq                                          D/A-9 CHAR   n/a      READONLY 
rtc_freq_major_version                            D/A-9 INT    n/a      UNKNOWN  10
rtc_freq_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
rtc_freq_release_version                          D/A-9 INT    n/a      UNKNOWN  0
rtc_hwloc_priority                                D/A-9 INT    n/a      READONLY 70
rtc_hwloc_major_version                           D/A-9 INT    n/a      UNKNOWN  10
rtc_hwloc_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
rtc_hwloc_release_version                         D/A-9 INT    n/a      UNKNOWN  0
schizo                                            U/D-2 CHAR   n/a      ALL      
schizo_base_verbose                               D/D-8 INT    n/a      LOCAL    error
schizo_ompi_major_version                         D/A-9 INT    n/a      UNKNOWN  10
schizo_ompi_minor_version                         D/A-9 INT    n/a      UNKNOWN  1
schizo_ompi_release_version                       D/A-9 INT    n/a      UNKNOWN  0
fbtl                                              U/D-2 CHAR   n/a      ALL      
fbtl_base_verbose                                 D/D-8 INT    n/a      LOCAL    error
fbtl_posix_major_version                          D/A-9 INT    n/a      UNKNOWN  10
fbtl_posix_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
fbtl_posix_release_version                        D/A-9 INT    n/a      UNKNOWN  0
fcoll                                             U/D-2 CHAR   n/a      ALL      
fcoll_base_verbose                                D/D-8 INT    n/a      LOCAL    error
fcoll_static_priority                             D/A-9 INT    n/a      READONLY 10
fcoll_static_major_version                        D/A-9 INT    n/a      UNKNOWN  10
fcoll_static_minor_version                        D/A-9 INT    n/a      UNKNOWN  1
fcoll_static_release_version                      D/A-9 INT    n/a      UNKNOWN  0
fcoll_two_phase_priority                          D/A-9 INT    n/a      READONLY 10
fcoll_two_phase_major_version                     D/A-9 INT    n/a      UNKNOWN  10
fcoll_two_phase_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
fcoll_two_phase_release_version                   D/A-9 INT    n/a      UNKNOWN  0
fcoll_dynamic_priority                            D/A-9 INT    n/a      READONLY 10
fcoll_dynamic_major_version                       D/A-9 INT    n/a      UNKNOWN  10
fcoll_dynamic_minor_version                       D/A-9 INT    n/a      UNKNOWN  1
fcoll_dynamic_release_version                     D/A-9 INT    n/a      UNKNOWN  0
fcoll_individual_priority                         D/A-9 INT    n/a      READONLY 10
fcoll_individual_major_version                    D/A-9 INT    n/a      UNKNOWN  10
fcoll_individual_minor_version                    D/A-9 INT    n/a      UNKNOWN  1
fcoll_individual_release_version                  D/A-9 INT    n/a      UNKNOWN  0
fs                                                U/D-2 CHAR   n/a      ALL      
fs_base_verbose                                   D/D-8 INT    n/a      LOCAL    error
fs_ufs_major_version                              D/A-9 INT    n/a      UNKNOWN  10
fs_ufs_minor_version                              D/A-9 INT    n/a      UNKNOWN  1
fs_ufs_release_version                            D/A-9 INT    n/a      UNKNOWN  0
io                                                U/D-2 CHAR   n/a      ALL      
io_base_verbose                                   D/D-8 INT    n/a      LOCAL    error
io_romio314_priority                              D/A-9 INT    n/a      READONLY 40
io_romio314_delete_priority                       D/A-9 INT    n/a      READONLY 40
io_romio314_version                               D/A-9 CHAR   n/a      READONLY from MPICH v3.1.4
io_romio314_user_configure_params                 D/A-9 CHAR   n/a      READONLY CFLAGS=-I/__unresolved_path_____________/dependencies/include/cuda -DROMIO_CUDA_AWARE_SUPPORT=1
[cr1cn13:35212:0] Caught signal 11 (Segmentation fault)
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Failed MPI_T calls test 1 - cvarwrite

Build: Failed

Execution: NA

Exit Status: Build_errors

MPI Processes: 1

Test Description:

This test writes to control variables exposed by MPI_T functionality of MPI_3.0.

Test Output: None.

Failed MPI_T calls test 2 - mpi_t_str

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 1

Test Description:

A test that MPI_T string handling is working as expected.

check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
found 848 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[23192,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Failed MPI_T calls test 3 - mpit_vars

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 1

Test Description:

To print out all MPI_T control variables, performance variables and their categories in the MPI implementation.

[cr1cn13:39136:0] Caught signal 11 (Segmentation fault)
==== backtrace ====
 2 0x0000000000073264 mxm_handle_error()  /var/tmp/OFED_topdir/BUILD/mxm-3.5.3093/src/mxm/util/debug/debug.c:641
 3 0x00000000000739a4 mxm_error_signal_handler()  /var/tmp/OFED_topdir/BUILD/mxm-3.5.3093/src/mxm/util/debug/debug.c:616
 4 0x00000000000c2dc4 MPI_T_cvar_read()  ??:0
 5 0x0000000010002eec PrintControlVars()  ??:0
 6 0x0000000010002c5c main()  ??:0
 7 0x0000000000024700 generic_start_main.isra.0()  libc-start.c:0
 8 0x00000000000248f4 __libc_start_main()  ??:0
===================
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Failed MPIT multithreaded test - mpit_threading

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 1

Test Description:

This test is adapted from test/mpi/mpi_t/mpit_vars.c. But this is a multithreading version in which multiple threads will call MPI_T routines.

With verbose set, thread 0 will prints out MPI_T control variables, performance variables and their categories.

[cr1cn13:40789:0] Caught signal 11 (Segmentation fault)
==== backtrace ====
 2 0x0000000000073264 mxm_handle_error()  /var/tmp/OFED_topdir/BUILD/mxm-3.5.3093/src/mxm/util/debug/debug.c:641
 3 0x00000000000739a4 mxm_error_signal_handler()  /var/tmp/OFED_topdir/BUILD/mxm-3.5.3093/src/mxm/util/debug/debug.c:616
 4 0x00000000000c2dc4 MPI_T_cvar_read()  ??:0
 5 0x0000000010003068 PrintControlVars()  ??:0
 6 0x0000000010002bec RunTest()  ??:0
 7 0x0000000000008728 start_thread()  pthread_create.c:0
 8 0x000000000011d250 __clone()  ??:0
===================
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

MPI-3.0 - Score: 83% Passed

This group features tests that exercises MPI-3.0 and higher functionality. Note that the test suite was designed to be compiled and executed under all versions of MPI. If the current version of MPI the test suite is less that MPI-3.0, the executed code will report "MPI-3.0 or higher required" and will exit.

Failed Iallreduce test - iallred

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 2

Test Description:

This test illustrates the use of MPI_Iallreduce() and MPI_Allreduce().

-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[55608,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Passed Ibarrier test - ibarrier

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test calls MPI_Ibarrier() followed by an conditional loop containing usleep(1000) and MPI_Test(). This test hung indefinitely under some MPI implementations. Successfully completing this test indicates the error has been corrected.

No errors

Failed Ibcast,Wait,Ibarrier test 1 - nonblocking2

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 5

Test Description:

This is a basic test of all 17 non-blocking collective operations specified by the MPI-3 standard. It only exercises the intracommunicator functionality, does not use MPI_IN_PLACE, and only transmits/receives simple integer types with relatively small counts. It does check a few fancier issues, such as ensuring that "premature user releases" of MPI_Op and MPI_Datatype objects does not result in a segfault.

[cr1cn13:52750] *** Process received signal ***
[cr1cn13:52750] Signal: Segmentation fault (11)
[cr1cn13:52750] Signal code: Address not mapped (1)
[cr1cn13:52750] Failing at address: (nil)
[cr1cn13:52750] [ 0] [0x3fff7a8c0478]
[cr1cn13:52750] [ 1] [cr1cn13:52752] *** Process received signal ***
[cr1cn13:52752] Signal: Segmentation fault (11)
[cr1cn13:52752] Signal code: Address not mapped (1)
[cr1cn13:52752] Failing at address: (nil)
[cr1cn13:52752] [ 0] [0x3fff93060478]
[cr1cn13:52752] [ 1] [0x0]
[cr1cn13:52752] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_libnbc.so(NBC_Progress+0x348)[0x3fff8ba07fd8]
[0x0]
[cr1cn13:52750] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_libnbc.so(NBC_Progress+0x348)[0x3fff781f7fd8]
[cr1cn13:52750] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_libnbc.so(ompi_coll_libnbc_progress+0xc8)[0x3fff781f6568]
[cr1cn13:52750] [ 4] [cr1cn13:52752] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_libnbc.so(ompi_coll_libnbc_progress+0xc8)[0x3fff8ba06568]
[cr1cn13:52752] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-pal.so.2(opal_progress+0x70)[0x3fff9288b9e0]
[cr1cn13:52752] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_request_default_wait+0x184)[0x3fff92f5f9a4]
[cr1cn13:52752] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Wait+0xa0)[0x3fff92fa32d0]
[cr1cn13:52752] [ 7] ./nonblocking2[0x10002fa4]
[cr1cn13:52752] [ 8] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-pal.so.2(opal_progress+0x70)[0x3fff7a0eb9e0]
[cr1cn13:52750] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_request_default_wait+0x184)[0x3fff7a7bf9a4]
[cr1cn13:52750] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Wait+0xa0)[0x3fff7a8032d0]
[cr1cn13:52750] [ 7] ./nonblocking2[0x10002fa4]
[cr1cn13:52750] [ 8] /lib64/libc.so.6(+0x24700)[0x3fff7a544700]
[cr1cn13:52750] [ 9] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff7a5448f4]
[cr1cn13:52750] *** End of error message ***
/lib64/libc.so.6(+0x24700)[0x3fff92ce4700]
[cr1cn13:52752] [ 9] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff92ce48f4]
[cr1cn13:52752] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 2 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Failed Ibcast,Wait,Ibarrier test 2 - nonblocking3

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 5

Test Description:

This test attempts to execute multiple simultaneous non-blocking collective (NBC) MPI routines at the same time, and manages their completion with a variety of routines (MPI_{Wait,Test}{,_all,_any,_some}). The test also exercises a few point-to-point operations.

[cr1cn13:61461] *** Process received signal ***
[cr1cn13:61462] *** Process received signal ***
[cr1cn13:61462] Signal: Segmentation fault (11)
[cr1cn13:61462] Signal code: Address not mapped (1)
[cr1cn13:61462] Failing at address: 0x98cce8c098cce8d0
[cr1cn13:61464] *** Process received signal ***
[cr1cn13:61464] Signal: Segmentation fault (11)
[cr1cn13:61464] Signal code: Address not mapped (1)
[cr1cn13:61464] Failing at address: 0x8722e8c08722e8d0
[cr1cn13:61461] Signal: Segmentation fault (11)
[cr1cn13:61461] Signal code: Address not mapped (1)
[cr1cn13:61461] Failing at address: 0x7c4ae8c07c4ae8d0
[cr1cn13:61461] [ 0] [cr1cn13:61462] [ 0] [0x3fff98d20478]
[cr1cn13:61464] [ 0] [0x3fff87280478]
[cr1cn13:61464] [ 1] [0x0]
[cr1cn13:61464] [ 2] ./nonblocking3[0x100043e0]
[cr1cn13:61464] [ 3] ./nonblocking3[0x10006eec]
[cr1cn13:61464] [ 4] /lib64/libc.so.6(+0x24700)[0x3fff86f04700]
[cr1cn13:61464] [ 5] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff86f048f4]
[cr1cn13:61464] *** End of error message ***
[cr1cn13:61462] [ 1] [0x0]
[cr1cn13:61462] [ 2] ./nonblocking3[0x100043e0]
[cr1cn13:61462] [ 3] ./nonblocking3[0x10006eec]
[cr1cn13:61462] [ 4] /lib64/libc.so.6(+0x24700)[0x3fff989a4700]
[cr1cn13:61462] [ 5] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff989a48f4]
[cr1cn13:61462] *** End of error message ***
[0x3fff7c500478]
[cr1cn13:61461] [ 1] [0x0]
[cr1cn13:61461] [ 2] ./nonblocking3[0x100043e0]
[cr1cn13:61461] [ 3] ./nonblocking3[0x10006eec]
[cr1cn13:61461] [ 4] /lib64/libc.so.6(+0x24700)[0x3fff7c184700]
[cr1cn13:61461] [ 5] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff7c1848f4]
[cr1cn13:61461] *** End of error message ***
[cr1cn13:61465] *** Process received signal ***
[cr1cn13:61463] *** Process received signal ***
[cr1cn13:61463] Signal: Segmentation fault (11)
[cr1cn13:61463] Signal code: Address not mapped (1)
[cr1cn13:61463] Failing at address: 0x7d2de8c07d2de8d0
[cr1cn13:61463] [ 0] [0x3fff7d330478]
[cr1cn13:61463] [ 1] [0x0]
[cr1cn13:61463] [ 2] ./nonblocking3[0x100043e0]
[cr1cn13:61463] [ 3] ./nonblocking3[0x10006eec]
[cr1cn13:61463] [ 4] [cr1cn13:61465] Signal: Segmentation fault (11)
[cr1cn13:61465] Signal code: Address not mapped (1)
[cr1cn13:61465] Failing at address: 0x935be8c0935be8d0
[cr1cn13:61465] [ 0] [0x3fff93610478]
[cr1cn13:61465] [ 1] [0x0]
[cr1cn13:61465] [ 2] ./nonblocking3[0x100043e0]
[cr1cn13:61465] [ 3] ./nonblocking3[0x10006eec]
[cr1cn13:61465] [ 4] /lib64/libc.so.6(+0x24700)[0x3fff93294700]
[cr1cn13:61465] [ 5] /lib64/libc.so.6(+0x24700)[0x3fff7cfb4700]
[cr1cn13:61463] [ 5] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff932948f4]
[cr1cn13:61465] *** End of error message ***
/lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff7cfb48f4]
[cr1cn13:61463] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Failed Non-blocking collectives test - nonblocking4

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 4

Test Description:

This is a weak sanity test that all non-blocking collectives specified by MPI-3 are present in the library and accept arguments as expected. This test does not check for progress, matching issues, or sensible output buffer values.

[cr1cn13:71082] *** Process received signal ***
[cr1cn13:71082] Signal: Segmentation fault (11)
[cr1cn13:71082] Signal code: Address not mapped (1)
[cr1cn13:71082] Failing at address: 0x80d2e8c080d2e8d0
[cr1cn13:71082] [ 0] [0x3fff80d80478]
[cr1cn13:71082] [ 1] [0x0]
[cr1cn13:71082] [ 2] ./nonblocking4[0x10002c24]
[cr1cn13:71082] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff80a04700]
[cr1cn13:71082] [ 4] [cr1cn13:71081] *** Process received signal ***
[cr1cn13:71081] Signal: Segmentation fault (11)
[cr1cn13:71081] Signal code: Address not mapped (1)
[cr1cn13:71081] Failing at address: 0xaeb9e8c0aeb9e8d0
[cr1cn13:71081] [ 0] [0x3fffaebf0478]
[cr1cn13:71081] [ 1] [0x0]
[cr1cn13:71081] [ 2] ./nonblocking4[0x10002c24]
[cr1cn13:71081] [ 3] [cr1cn13:71083] *** Process received signal ***
[cr1cn13:71083] Signal: Segmentation fault (11)
[cr1cn13:71083] Signal code: Address not mapped (1)
[cr1cn13:71083] Failing at address: 0xace7e8c0ace7e8d0
[cr1cn13:71083] [ 0] [0x3fffaced0478]
[cr1cn13:71083] [ 1] [0x0]
[cr1cn13:71083] [ 2] ./nonblocking4[0x10002c24]
[cr1cn13:71083] [ 3] /lib64/libc.so.6(+0x24700)[0x3fffae874700]
[cr1cn13:71081] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffae8748f4]
[cr1cn13:71081] *** End of error message ***
/lib64/libc.so.6(+0x24700)[0x3fffacb54700]
[cr1cn13:71083] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffacb548f4]
[cr1cn13:71083] *** End of error message ***
/lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff80a048f4]
[cr1cn13:71082] *** End of error message ***
[cr1cn13:71069] *** Process received signal ***
[cr1cn13:71069] Signal: Segmentation fault (11)
[cr1cn13:71069] Signal code: Address not mapped (1)
[cr1cn13:71069] Failing at address: 0xa80ee8c0a80ee8d0
[cr1cn13:71069] [ 0] [0x3fffa8140478]
[cr1cn13:71069] [ 1] [0x0]
[cr1cn13:71069] [ 2] ./nonblocking4[0x10002c24]
[cr1cn13:71069] [ 3] /lib64/libc.so.6(+0x24700)[0x3fffa7dc4700]
[cr1cn13:71069] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffa7dc48f4]
[cr1cn13:71069] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 2 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Failed Wait test - nonblocking

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 10

Test Description:

This is a very weak sanity test that all non-blocking collectives specified by MPI-3 are present in the library and take arguments as expected. This test does not check for progress, matching issues, or sensible output buffer values.

[cr1cn13:52144] *** Process received signal ***
[cr1cn13:52144] Signal: Segmentation fault (11)
[cr1cn13:52144] Signal code: Address not mapped (1)
[cr1cn13:52144] Failing at address: 0x86fae8c086fae8d0
[cr1cn13:52147] *** Process received signal ***
[cr1cn13:52147] Signal: Segmentation fault (11)
[cr1cn13:52147] Signal code: Address not mapped (1)
[cr1cn13:52147] Failing at address: 0x833be8c0833be8d0
[cr1cn13:52147] [cr1cn13:52129] *** Process received signal ***
[cr1cn13:52129] Signal: Segmentation fault (11)
[cr1cn13:52129] Signal code: Address not mapped (1)
[cr1cn13:52129] Failing at address: 0xa434e8c0a434e8d0
[cr1cn13:52129] [ 0] [cr1cn13:52130] *** Process received signal ***
[cr1cn13:52130] Signal: Segmentation fault (11)
[cr1cn13:52130] Signal code: Address not mapped (1)
[cr1cn13:52130] Failing at address: 0x93e9e8c093e9e8d0
[cr1cn13:52130] [ 0] [cr1cn13:52131] *** Process received signal ***
[cr1cn13:52131] Signal: Segmentation fault (11)
[cr1cn13:52131] Signal code: Address not mapped (1)
[cr1cn13:52131] Failing at address: 0x82d7e8c082d7e8d0
[cr1cn13:52131] [ 0] [0x3fff82dd0478]
[cr1cn13:52131] [cr1cn13:52133] *** Process received signal ***
[cr1cn13:52133] Signal: Segmentation fault (11)
[cr1cn13:52133] Signal code: Address not mapped (1)
[cr1cn13:52133] Failing at address: 0x996ce8c0996ce8d0
[cr1cn13:52133] [ 0] [0x3fff99720478]
[cr1cn13:52134] *** Process received signal ***
[cr1cn13:52134] Signal: Segmentation fault (11)
[cr1cn13:52134] Signal code: Address not mapped (1)
[cr1cn13:52134] Failing at address: 0xa4b3e8c0a4b3e8d0
[cr1cn13:52134] [ 0] [0x3fffa4b90478]
[cr1cn13:52134] [ 1] [cr1cn13:52137] *** Process received signal ***
[cr1cn13:52137] Signal: Segmentation fault (11)
[cr1cn13:52137] Signal code: Address not mapped (1)
[cr1cn13:52137] Failing at address: 0x93cfe8c093cfe8d0
[cr1cn13:52137] [ 0] [0x3fff93d50478]
[cr1cn13:52137] [ 1] [0x0]
[cr1cn13:52139] *** Process received signal ***
[cr1cn13:52139] Signal: Segmentation fault (11)
[cr1cn13:52139] Signal code: Address not mapped (1)
[cr1cn13:52139] Failing at address: 0x93eae8c093eae8d0
[cr1cn13:52139] [ 0] [0x3fff93f00478]
[cr1cn13:52139] [ 1] [0x0]
[cr1cn13:52139] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52141] *** Process received signal ***
[cr1cn13:52141] Signal: Segmentation fault (11)
[cr1cn13:52141] Signal code: Address not mapped (1)
[cr1cn13:52141] Failing at address: 0xacf2e8c0acf2e8d0
[cr1cn13:52141] [ 0] [0x3fffacf80478]
[cr1cn13:52141] [ 1] [0x0]
[cr1cn13:52141] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52144] [ 0] [0x3fff87000478]
[cr1cn13:52144] [ 1] [0x0]
[cr1cn13:52144] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52144] [ 3] [cr1cn13:52141] [ 3] /lib64/libc.so.6(+0x24700)[0x3fffacc04700]
[cr1cn13:52141] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffacc048f4]
[cr1cn13:52141] *** End of error message ***
[ 0] [0x3fff83410478]
[cr1cn13:52147] [ 1] [0x0]
[cr1cn13:52147] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52147] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff83094700]
[cr1cn13:52147] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff830948f4]
[cr1cn13:52147] *** End of error message ***
[0x3fffa43a0478]
[cr1cn13:52129] [ 1] [0x0]
[cr1cn13:52129] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52129] [ 3] /lib64/libc.so.6(+0x24700)[0x3fffa4024700]
[cr1cn13:52129] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffa40248f4]
[cr1cn13:52129] *** End of error message ***
[0x3fff93ef0478]
[cr1cn13:52130] [ 1] [0x0]
[cr1cn13:52130] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52130] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff93b74700]
[cr1cn13:52130] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff93b748f4]
[cr1cn13:52130] *** End of error message ***
[ 1] [0x0]
[cr1cn13:52131] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52131] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff82a54700]
[cr1cn13:52131] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff82a548f4]
[cr1cn13:52131] *** End of error message ***
[cr1cn13:52133] [ 1] [0x0]
[cr1cn13:52133] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52133] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff993a4700]
[cr1cn13:52133] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff993a48f4]
[cr1cn13:52133] *** End of error message ***
[0x0]
[cr1cn13:52134] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52134] [ 3] /lib64/libc.so.6(+0x24700)[0x3fffa4814700]
[cr1cn13:52134] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffa48148f4]
[cr1cn13:52134] *** End of error message ***
[cr1cn13:52137] [ 2] ./nonblocking[0x10002be8]
[cr1cn13:52137] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff939d4700]
[cr1cn13:52137] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff939d48f4]
[cr1cn13:52137] *** End of error message ***
[cr1cn13:52139] [ 3] /lib64/libc.so.6(+0x24700)[0x3fff93b84700]
[cr1cn13:52139] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff93b848f4]
[cr1cn13:52139] *** End of error message ***
/lib64/libc.so.6(+0x24700)[0x3fff86c84700]
[cr1cn13:52144] [ 4] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff86c848f4]
[cr1cn13:52144] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 8 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Failed Toolkit varlist test - varlist

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 1

Test Description:

This program, copyrighted (c) 2014, Lawrence Livermore National Security, LLC., accesses the performance and control variables as defined by under MPI-3.0 and newer.

MPI_T Variable List
MPI Thread support: MPI_THREAD_MULTIPLE
MPI_T Thread support: MPI_THREAD_MULTIPLE
===============================
Control Variables
===============================
Found 950 control variables
Found 950 control variables with verbosity <= D/A-9
Variable                                          VRB   Type   Bind     Scope    Value
---------------------------------------------------------------------------------------------
mca_base_param_files                              U/D-2 CHAR   n/a      READONLY /gpfs/home/withheld/.openmpi/mca-params.conf:/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/etc/openmpi-mca-params.conf
mca_param_files                                   U/D-2 CHAR   n/a      READONLY /gpfs/home/withheld/.openmpi/mca-params.conf:/gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/etc/openmpi-mca-params.conf
mca_base_override_param_file                      U/D-2 CHAR   n/a      UNKNOWN  /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/etc/openmpi-mca-params-override.conf
mca_base_suppress_override_warning                U/D-2 INT    n/a      LOCAL    false
mca_base_param_file_prefix                        U/A-3 CHAR   n/a      READONLY 
mca_base_envar_file_prefix                        U/A-3 CHAR   n/a      READONLY 
mca_base_param_file_path                          U/A-3 CHAR   n/a      READONLY /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/share/spectrum_mpi/amca-param-sets:/gpfs/pkgs/hpcmp/bct/mpitests/mpi-tools-master/varlist
mca_base_param_file_path_force                    U/A-3 CHAR   n/a      READONLY 
mca_base_env_list                                 U/A-3 CHAR   n/a      READONLY 
mca_base_env_list_delimiter                       U/A-3 CHAR   n/a      READONLY ;
mca_base_env_list_internal                        U/A-3 CHAR   n/a      READONLY 
opal_signal                                       U/A-3 CHAR   n/a      LOCAL    6,7,8,11
opal_net_private_ipv4                             U/A-3 CHAR   n/a      ALL      10.0.0.0/8;172.16.0.0/12;192.168.0.0/16;169.254.0.0/16
opal_set_max_sys_limits                           U/A-3 CHAR   n/a      ALL      
opal_built_with_cuda_support                      T/B-4 INT    n/a      UNKNOWN  false
opal_cuda_support                                 U/A-3 INT    n/a      ALL      false
mpi_leave_pinned                                  D/A-9 INT    n/a      READONLY 0
opal_leave_pinned                                 D/A-9 INT    n/a      READONLY 0
mpi_leave_pinned_pipeline                         D/A-9 INT    n/a      READONLY false
opal_leave_pinned_pipeline                        D/A-9 INT    n/a      READONLY false
mpi_warn_on_fork                                  D/A-9 INT    n/a      READONLY true
opal_abort_delay                                  T/D-5 INT    n/a      READONLY 0
opal_progress_lp_call_ratio                       T/D-5 UINT   n/a      READONLY 8
opal_abort_print_stack                            T/D-5 INT    n/a      READONLY false
dss_buffer_type                                   D/D-8 INT    n/a      ALL      non-describ
dss_buffer_initial_size                           D/D-8 INT    n/a      ALL      128
dss_buffer_threshold_size                         D/D-8 INT    n/a      ALL      1024
mca_base_component_path                           D/A-9 CHAR   n/a      READONLY /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi:/gpfs/home/withheld/.openmpi/components
mca_component_path                                D/A-9 CHAR   n/a      READONLY /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi:/gpfs/home/withheld/.openmpi/components
mca_base_component_show_load_errors               D/A-9 INT    n/a      READONLY false
mca_component_show_load_errors                    D/A-9 INT    n/a      READONLY false
mca_base_component_disable_dlopen                 D/A-9 INT    n/a      READONLY false
mca_component_disable_dlopen                      D/A-9 INT    n/a      READONLY false
mca_base_verbose                                  D/A-9 CHAR   n/a      READONLY stderr
mca_verbose                                       D/A-9 CHAR   n/a      READONLY stderr
dl                                                U/D-2 CHAR   n/a      ALL      
dl_base_verbose                                   D/D-8 INT    n/a      LOCAL    error
dl_dlopen_filename_suffixes                       T/D-5 CHAR   n/a      LOCAL    .so,.dylib,.dll,.sl
dl_dlopen_major_version                           D/A-9 INT    n/a      UNKNOWN  10
dl_dlopen_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
dl_dlopen_release_version                         D/A-9 INT    n/a      UNKNOWN  0
mpi_param_check                                   D/A-9 INT    n/a      READONLY true
mpi_yield_when_idle                               D/A-9 INT    n/a      READONLY false
mpi_event_tick_rate                               D/A-9 INT    n/a      READONLY -1
mpi_show_handle_leaks                             D/A-9 INT    n/a      READONLY false
mpi_no_free_handles                               D/A-9 INT    n/a      READONLY false
mpi_show_mpi_alloc_mem_leaks                      D/A-9 INT    n/a      READONLY 0
mpi_show_mca_params                               D/A-9 CHAR   n/a      READONLY 
mpi_show_mca_params_file                          D/A-9 CHAR   n/a      READONLY 
mpi_preconnect_mpi                                D/A-9 INT    n/a      READONLY false
mpi_preconnect_all                                D/A-9 INT    n/a      READONLY false
mpi_have_sparse_group_storage                     D/A-9 INT    n/a      UNKNOWN  false
mpi_use_sparse_group_storage                      D/A-9 INT    n/a      UNKNOWN  false
mpi_cuda_support                                  U/A-3 INT    n/a      ALL      false
mpi_built_with_cuda_support                       T/B-4 INT    n/a      UNKNOWN  false
mpi_add_procs_cutoff                              U/A-3 UINT   n/a      LOCAL    0
mpi_abort_delay                                   T/D-5 INT    n/a      READONLY 0
mpi_abort_print_stack                             T/D-5 INT    n/a      READONLY false
ompi_timing                                       D/A-9 INT    n/a      READONLY false
ompi_timing_ext                                   D/A-9 INT    n/a      READONLY false
hook                                              U/D-2 CHAR   n/a      ALL      
hook_base_verbose                                 D/D-8 INT    n/a      LOCAL    error
hook_prot_verbose                                 D/A-9 INT    n/a      READONLY 0
hook_prot_enable_mpi_init                         U/A-3 INT    n/a      READONLY false
hook_prot_enable_mpi_finalize                     U/A-3 INT    n/a      READONLY false
platform_prot                                     U/A-3 INT    n/a      READONLY -1482212840
hook_prot_major_version                           D/A-9 INT    n/a      UNKNOWN  10
hook_prot_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
hook_prot_release_version                         D/A-9 INT    n/a      UNKNOWN  0
hook_ibmlicense_verbose                           D/A-9 INT    n/a      READONLY 0
hook_ibmlicense_check                             D/A-9 INT    n/a      READONLY none
hook_ibmlicense_major_version                     D/A-9 INT    n/a      UNKNOWN  10
hook_ibmlicense_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
hook_ibmlicense_release_version                   D/A-9 INT    n/a      UNKNOWN  0
rte                                               U/D-2 CHAR   n/a      ALL      
rte_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
rte_orte_major_version                            D/A-9 INT    n/a      UNKNOWN  10
rte_orte_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
rte_orte_release_version                          D/A-9 INT    n/a      UNKNOWN  0
hwloc                                             U/D-2 CHAR   n/a      ALL      
hwloc_base_verbose                                D/D-8 INT    n/a      LOCAL    error
hwloc_base_mem_alloc_policy                       D/A-9 INT    n/a      READONLY none
hwloc_base_mem_bind_failure_action                D/A-9 INT    n/a      READONLY warn
hwloc_base_binding_policy                         D/A-9 CHAR   n/a      READONLY 
hwloc_base_bind_to_core                           D/A-9 INT    n/a      READONLY false
hwloc_base_bind_to_socket                         D/A-9 INT    n/a      READONLY false
hwloc_base_report_bindings                        D/A-9 INT    n/a      READONLY false
hwloc_base_slot_list                              D/A-9 CHAR   n/a      READONLY 
hwloc_base_cpu_set                                D/A-9 CHAR   n/a      READONLY 
hwloc_base_use_hwthreads_as_cpus                  D/A-9 INT    n/a      READONLY false
hwloc_base_topo_file                              D/A-9 CHAR   n/a      READONLY 
hwloc_external_major_version                      D/A-9 INT    n/a      UNKNOWN  10
hwloc_external_minor_version                      D/A-9 INT    n/a      UNKNOWN  1
hwloc_external_release_version                    D/A-9 INT    n/a      UNKNOWN  0
memcpy                                            U/D-2 CHAR   n/a      ALL      
memcpy_base_verbose                               D/D-8 INT    n/a      LOCAL    error
memory                                            U/D-2 CHAR   n/a      ALL      
memory_base_verbose                               D/D-8 INT    n/a      LOCAL    error
memory_patcher_priority                           T/D-5 INT    n/a      UNKNOWN  80
memory_patcher_major_version                      D/A-9 INT    n/a      UNKNOWN  10
memory_patcher_minor_version                      D/A-9 INT    n/a      UNKNOWN  1
memory_patcher_release_version                    D/A-9 INT    n/a      UNKNOWN  0
patcher                                           U/D-2 CHAR   n/a      ALL      
patcher_base_verbose                              D/D-8 INT    n/a      LOCAL    error
patcher_overwrite_priority                        T/D-5 INT    n/a      UNKNOWN  37
patcher_overwrite_major_version                   D/A-9 INT    n/a      UNKNOWN  10
patcher_overwrite_minor_version                   D/A-9 INT    n/a      UNKNOWN  1
patcher_overwrite_release_version                 D/A-9 INT    n/a      UNKNOWN  0
memchecker                                        U/D-2 CHAR   n/a      ALL      
memchecker_base_verbose                           D/D-8 INT    n/a      LOCAL    error
backtrace                                         U/D-2 CHAR   n/a      ALL      
backtrace_base_verbose                            D/D-8 INT    n/a      LOCAL    error
backtrace_execinfo_major_version                  D/A-9 INT    n/a      UNKNOWN  10
backtrace_execinfo_minor_version                  D/A-9 INT    n/a      UNKNOWN  1
backtrace_execinfo_release_version                D/A-9 INT    n/a      UNKNOWN  0
timer                                             U/D-2 CHAR   n/a      ALL      
timer_base_verbose                                D/D-8 INT    n/a      LOCAL    error
timer_require_monotonic                           T/D-5 INT    n/a      LOCAL    true
timer_linux_major_version                         D/A-9 INT    n/a      UNKNOWN  10
timer_linux_minor_version                         D/A-9 INT    n/a      UNKNOWN  1
timer_linux_release_version                       D/A-9 INT    n/a      UNKNOWN  0
event                                             U/D-2 CHAR   n/a      ALL      
event_base_verbose                                D/D-8 INT    n/a      LOCAL    error
event_external_event_include                      U/A-3 CHAR   n/a      LOCAL    poll
opal_event_include                                U/A-3 CHAR   n/a      LOCAL    poll
event_external_major_version                      D/A-9 INT    n/a      UNKNOWN  10
event_external_minor_version                      D/A-9 INT    n/a      UNKNOWN  1
event_external_release_version                    D/A-9 INT    n/a      UNKNOWN  0
shmem                                             U/D-2 CHAR   n/a      ALL      
shmem_base_verbose                                D/D-8 INT    n/a      LOCAL    error
shmem_base_RUNTIME_QUERY_hint                     D/A-9 CHAR   n/a      ALL-EQ   
shmem_mmap_priority                               U/A-3 INT    n/a      ALL      50
shmem_mmap_enable_nfs_warning                     D/A-9 INT    n/a      LOCAL    true
shmem_mmap_relocate_backing_file                  D/A-9 INT    n/a      ALL      0
shmem_mmap_backing_file_base_dir                  D/A-9 CHAR   n/a      ALL      /dev/shm
shmem_mmap_major_version                          D/A-9 INT    n/a      UNKNOWN  10
shmem_mmap_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
shmem_mmap_release_version                        D/A-9 INT    n/a      UNKNOWN  0
sec                                               U/D-2 CHAR   n/a      ALL      
sec_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
sec_basic_major_version                           D/A-9 INT    n/a      UNKNOWN  10
sec_basic_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
sec_basic_release_version                         D/A-9 INT    n/a      UNKNOWN  0
orte_base_help_aggregate                          D/A-9 INT    n/a      ALL      true
orte_tmpdir_base                                  D/A-9 CHAR   n/a      ALL      /var/tmp/pbs.21874.ir1utl01
orte_local_tmpdir_base                            D/A-9 CHAR   n/a      ALL      
orte_remote_tmpdir_base                           D/A-9 CHAR   n/a      ALL      
orte_no_session_dirs                              D/A-9 CHAR   n/a      ALL-EQ   
orte_create_session_dirs                          D/A-9 INT    n/a      ALL-EQ   true
orte_execute_quiet                                D/A-9 INT    n/a      ALL-EQ   false
orte_report_silent_errors                         D/A-9 INT    n/a      ALL-EQ   false
orte_debug                                        D/A-9 INT    n/a      ALL-EQ   false
orte_debug_verbose                                D/A-9 INT    n/a      ALL-EQ   -1
orte_debug_daemons_file                           D/A-9 INT    n/a      ALL-EQ   false
orte_debug_daemons                                D/A-9 INT    n/a      ALL-EQ   false
orte_progress_thread_debug                        D/A-9 INT    n/a      ALL-EQ   -1
orte_leave_session_attached                       D/A-9 INT    n/a      ALL-EQ   false
orte_in_parallel_debugger                         D/A-9 INT    n/a      READONLY false
orte_output_debugger_proctable                    D/A-9 INT    n/a      ALL-EQ   false
orte_debugger_test_daemon                         D/A-9 CHAR   n/a      READONLY 
orte_debugger_test_attach                         D/A-9 INT    n/a      READONLY false
orte_debugger_check_rate                          D/A-9 INT    n/a      READONLY 0
orte_do_not_launch                                D/A-9 INT    n/a      READONLY false
orte_daemon_spin                                  D/A-9 INT    n/a      READONLY false
orte_daemon_fail                                  D/A-9 INT    n/a      READONLY -1
orte_daemon_fail_delay                            D/A-9 INT    n/a      READONLY 0
orte_startup_timeout                              D/A-9 INT    n/a      READONLY 0
orte_base_user_debugger                           D/A-9 CHAR   n/a      READONLY totalview @mpirun@ -a @mpirun_args@ : ddt -n @np@ -start @executable@ @executable_argv@ @single_app@ : fxp @mpirun@ -a @mpirun_args@
orte_default_hostfile                             D/A-9 CHAR   n/a      READONLY /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/etc/openmpi-default-hostfile
orte_default_dash_host                            D/A-9 CHAR   n/a      READONLY 
orte_node_regex                                   D/A-9 CHAR   n/a      READONLY 
orte_keep_fqdn_hostnames                          D/A-9 INT    n/a      READONLY false
orte_retain_aliases                               D/A-9 INT    n/a      READONLY false
orte_hostname_alias_index                         D/A-9 INT    n/a      READONLY 1
orte_xml_output                                   D/A-9 INT    n/a      READONLY false
orte_tag_output                                   D/A-9 INT    n/a      READONLY false
orte_xml_file                                     D/A-9 CHAR   n/a      READONLY 
orte_timestamp_output                             D/A-9 INT    n/a      READONLY false
orte_output_filename                              D/A-9 CHAR   n/a      READONLY 
orte_show_resolved_nodenames                      D/A-9 INT    n/a      READONLY false
orte_hetero_nodes                                 D/A-9 INT    n/a      READONLY false
orte_launch_agent                                 D/A-9 CHAR   n/a      READONLY orted
orte_fork_agent                                   D/A-9 CHAR   n/a      READONLY 
orte_allocation_required                          D/A-9 INT    n/a      READONLY false
orte_map_stddiag_to_stderr                        D/A-9 INT    n/a      READONLY false
orte_map_stddiag_to_stdout                        D/A-9 INT    n/a      READONLY false
orte_xterm                                        D/A-9 CHAR   n/a      READONLY 
orte_forward_job_control                          D/A-9 INT    n/a      READONLY false
orte_report_launch_progress                       D/A-9 INT    n/a      READONLY false
orte_cpu_type                                     D/A-9 CHAR   n/a      READONLY 
orte_cpu_model                                    D/A-9 CHAR   n/a      READONLY 
orte_report_events                                D/A-9 CHAR   n/a      READONLY 
orte_do_not_barrier                               D/A-9 INT    n/a      READONLY false
orte_enable_recovery                              D/A-9 INT    n/a      READONLY false
orte_max_restarts                                 D/A-9 INT    n/a      READONLY 0
orte_abort_on_non_zero_status                     D/A-9 INT    n/a      READONLY true
orte_allowed_exit_without_sync                    D/A-9 INT    n/a      READONLY false
orte_staged_execution                             D/A-9 INT    n/a      READONLY false
orte_report_child_jobs_separately                 D/A-9 INT    n/a      READONLY false
orte_stat_history_size                            D/A-9 INT    n/a      READONLY 1
orte_max_vm_size                                  D/A-9 INT    n/a      READONLY -1
orte_set_default_slots                            D/A-9 CHAR   n/a      READONLY cores
orte_display_alloc                                D/A-9 INT    n/a      READONLY false
ras_base_display_alloc                            D/A-9 INT    n/a      READONLY false
orte_display_devel_alloc                          D/A-9 INT    n/a      READONLY false
ras_base_display_devel_alloc                      D/A-9 INT    n/a      READONLY false
orte_soft_locations                               D/A-9 INT    n/a      READONLY false
orte_daemon_cores                                 T/D-5 CHAR   n/a      READONLY 
orte_direct_modex_cutoff                          D/A-9 UINT   n/a      READONLY 4294967295
ompi_hostname_cutoff                              D/A-9 UINT   n/a      READONLY 4294967295
orte_timeout_for_stack_trace                      D/A-9 INT    n/a      READONLY 30
orte_hnp_uri                                      D/A-9 CHAR   n/a      READONLY 1254883328.0;usock;tcp://192.168.11.43,192.168.16.43:52155;ud://17072.59.1
orte_local_daemon_uri                             D/A-9 CHAR   n/a      READONLY 1254883328.0;usock;tcp://192.168.11.43,192.168.16.43:52155;ud://17072.59.1
orte_app_num                                      D/A-9 INT    n/a      READONLY 0
orte_strip_prefix                                 D/A-9 CHAR   n/a      READONLY 
orte_num_nodes                                    D/A-9 INT    n/a      READONLY 1
orte_num_restarts                                 D/A-9 INT    n/a      READONLY 0
orte_app_rank                                     D/A-9 INT    n/a      READONLY 0
orte_ess_node_rank                                D/A-9 INT    n/a      UNKNOWN  0
ess                                               U/D-2 CHAR   n/a      ALL      ^lsf
ess_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
ess_base_stream_buffering                         D/A-9 INT    n/a      READONLY default
ess_base_jobid                                    D/A-9 CHAR   n/a      READONLY 1254883329
orte_ess_jobid                                    D/A-9 CHAR   n/a      READONLY 1254883329
ess_base_vpid                                     D/A-9 CHAR   n/a      READONLY 0
orte_ess_vpid                                     D/A-9 CHAR   n/a      READONLY 0
ess_base_num_procs                                D/A-9 INT    n/a      READONLY 1
orte_ess_num_procs                                D/A-9 INT    n/a      READONLY 1
ERROR: CVARREAD: MPI error code 16: MPI_ERR_OTHER: known error not in list
ERROR: CVAR-FREE: MPI error code 16: MPI_ERR_OTHER: known error not in list
orte_server                                       D/A-9 CHAR   n/a      READONLY 0
ess_pmi_major_version                             D/A-9 INT    n/a      UNKNOWN  10
ess_pmi_minor_version                             D/A-9 INT    n/a      UNKNOWN  1
ess_pmi_release_version                           D/A-9 INT    n/a      UNKNOWN  0
pmix                                              U/D-2 CHAR   n/a      ALL      ^s1,s2,cray
pmix_base_verbose                                 D/D-8 INT    n/a      LOCAL    error
pmix_base_async_modex                             D/A-9 INT    n/a      READONLY false
pmix_base_collect_data                            D/A-9 INT    n/a      READONLY true
pmix_external_major_version                       D/A-9 INT    n/a      UNKNOWN  10
pmix_external_minor_version                       D/A-9 INT    n/a      UNKNOWN  1
pmix_external_release_version                     D/A-9 INT    n/a      UNKNOWN  0
state                                             U/D-2 CHAR   n/a      ALL      
state_base_verbose                                D/D-8 INT    n/a      LOCAL    error
state_app_major_version                           D/A-9 INT    n/a      UNKNOWN  10
state_app_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
state_app_release_version                         D/A-9 INT    n/a      UNKNOWN  0
errmgr                                            U/D-2 CHAR   n/a      ALL      
errmgr_base_verbose                               D/D-8 INT    n/a      LOCAL    error
errmgr_default_app_priority                       D/A-9 INT    n/a      READONLY 1000
errmgr_default_app_major_version                  D/A-9 INT    n/a      UNKNOWN  10
errmgr_default_app_minor_version                  D/A-9 INT    n/a      UNKNOWN  1
errmgr_default_app_release_version                D/A-9 INT    n/a      UNKNOWN  0
oob                                               U/D-2 CHAR   n/a      ALL      
oob_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
oob_base_enable_module_progress_threads           D/A-9 INT    n/a      READONLY false
oob_tcp_peer_limit                                T/D-5 INT    n/a      LOCAL    -1
oob_tcp_peer_retries                              T/D-5 INT    n/a      LOCAL    2
oob_tcp_sndbuf                                    T/B-4 INT    n/a      LOCAL    131072
oob_tcp_rcvbuf                                    T/B-4 INT    n/a      LOCAL    131072
oob_tcp_if_include                                U/D-2 CHAR   n/a      LOCAL    
oob_tcp_include                                   U/D-2 CHAR   n/a      LOCAL    
oob_tcp_if_exclude                                U/D-2 CHAR   n/a      LOCAL    
oob_tcp_exclude                                   U/D-2 CHAR   n/a      LOCAL    
oob_tcp_static_ipv4_ports                         U/D-2 CHAR   n/a      READONLY 
oob_tcp_dynamic_ipv4_ports                        T/B-4 CHAR   n/a      READONLY 
oob_tcp_disable_ipv4_family                       T/B-4 INT    n/a      READONLY false
oob_tcp_keepalive_time                            T/D-5 INT    n/a      READONLY 60
oob_tcp_keepalive_intvl                           T/D-5 INT    n/a      READONLY 5
oob_tcp_keepalive_probes                          T/D-5 INT    n/a      READONLY 3
oob_tcp_retry_delay                               T/B-4 INT    n/a      READONLY 0
oob_tcp_max_recon_attempts                        T/B-4 INT    n/a      READONLY 10
oob_tcp_major_version                             D/A-9 INT    n/a      UNKNOWN  10
oob_tcp_minor_version                             D/A-9 INT    n/a      UNKNOWN  1
oob_tcp_release_version                           D/A-9 INT    n/a      UNKNOWN  0
oob_ud_min_qp                                     T/D-5 INT    n/a      LOCAL    8
oob_ud_max_qp                                     T/D-5 INT    n/a      LOCAL    32
oob_ud_recv_buffers                               T/D-5 INT    n/a      LOCAL    512
oob_ud_send_buffers                               T/D-5 INT    n/a      LOCAL    512
oob_ud_peer_retries                               D/A-9 INT    n/a      LOCAL    5
oob_ud_peer_timeout                               D/A-9 INT    n/a      LOCAL    800000
oob_ud_max_send_sge                               D/A-9 INT    n/a      LOCAL    1
oob_ud_max_recv_sge                               D/A-9 INT    n/a      LOCAL    2
oob_ud_max_send_wr                                D/A-9 INT    n/a      LOCAL    4096
oob_ud_max_recv_wr                                D/A-9 INT    n/a      LOCAL    4096
oob_ud_max_inline_data                            D/A-9 INT    n/a      LOCAL    0
oob_ud_major_version                              D/A-9 INT    n/a      UNKNOWN  10
oob_ud_minor_version                              D/A-9 INT    n/a      UNKNOWN  1
oob_ud_release_version                            D/A-9 INT    n/a      UNKNOWN  0
oob_usock_peer_retries                            D/A-9 INT    n/a      LOCAL    2
oob_usock_major_version                           D/A-9 INT    n/a      UNKNOWN  10
oob_usock_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
oob_usock_release_version                         D/A-9 INT    n/a      UNKNOWN  0
if                                                U/D-2 CHAR   n/a      ALL      
if_base_verbose                                   D/D-8 INT    n/a      LOCAL    error
if_base_do_not_resolve                            D/A-9 INT    n/a      ALL      false
if_base_retain_loopback                           D/A-9 INT    n/a      ALL      false
if_linux_ipv6_major_version                       D/A-9 INT    n/a      UNKNOWN  10
if_linux_ipv6_minor_version                       D/A-9 INT    n/a      UNKNOWN  1
if_linux_ipv6_release_version                     D/A-9 INT    n/a      UNKNOWN  0
if_posix_ipv4_major_version                       D/A-9 INT    n/a      UNKNOWN  10
if_posix_ipv4_minor_version                       D/A-9 INT    n/a      UNKNOWN  1
if_posix_ipv4_release_version                     D/A-9 INT    n/a      UNKNOWN  0
rml                                               U/D-2 CHAR   n/a      ALL      
rml_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
rml_base_wrapper                                  D/A-9 CHAR   n/a      READONLY 
rml_wrapper                                       D/A-9 CHAR   n/a      READONLY 
rml_base_max_retries                              D/A-9 INT    n/a      READONLY 3
rml_oob_major_version                             D/A-9 INT    n/a      UNKNOWN  10
rml_oob_minor_version                             D/A-9 INT    n/a      UNKNOWN  1
rml_oob_release_version                           D/A-9 INT    n/a      UNKNOWN  0
routed                                            U/D-2 CHAR   n/a      ALL      
routed_base_verbose                               D/D-8 INT    n/a      LOCAL    error
routed_radix                                      D/A-9 INT    n/a      READONLY 64
routed_radix_max_connections                      D/A-9 INT    n/a      READONLY -1
routed_radix_major_version                        D/A-9 INT    n/a      UNKNOWN  10
routed_radix_minor_version                        D/A-9 INT    n/a      UNKNOWN  1
routed_radix_release_version                      D/A-9 INT    n/a      UNKNOWN  0
grpcomm                                           U/D-2 CHAR   n/a      ALL      
grpcomm_base_verbose                              D/D-8 INT    n/a      LOCAL    error
grpcomm_direct_priority                           D/A-9 INT    n/a      READONLY 85
grpcomm_direct_major_version                      D/A-9 INT    n/a      UNKNOWN  10
grpcomm_direct_minor_version                      D/A-9 INT    n/a      UNKNOWN  1
grpcomm_direct_release_version                    D/A-9 INT    n/a      UNKNOWN  0
dfs                                               U/D-2 CHAR   n/a      ALL      
dfs_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
op                                                U/D-2 CHAR   n/a      ALL      
op_base_verbose                                   D/D-8 INT    n/a      LOCAL    error
allocator                                         U/D-2 CHAR   n/a      ALL      
allocator_base_verbose                            D/D-8 INT    n/a      LOCAL    error
allocator_basic_major_version                     D/A-9 INT    n/a      UNKNOWN  10
allocator_basic_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
allocator_basic_release_version                   D/A-9 INT    n/a      UNKNOWN  0
allocator_bucket_num_buckets                      D/A-9 INT    n/a      LOCAL    30
allocator_bucket_major_version                    D/A-9 INT    n/a      UNKNOWN  10
allocator_bucket_minor_version                    D/A-9 INT    n/a      UNKNOWN  1
allocator_bucket_release_version                  D/A-9 INT    n/a      UNKNOWN  0
rcache                                            U/D-2 CHAR   n/a      ALL      
rcache_base_verbose                               D/D-8 INT    n/a      LOCAL    error
rcache_vma_major_version                          D/A-9 INT    n/a      UNKNOWN  10
rcache_vma_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
rcache_vma_release_version                        D/A-9 INT    n/a      UNKNOWN  0
mpool                                             U/D-2 CHAR   n/a      ALL      
mpool_base_verbose                                D/D-8 INT    n/a      LOCAL    error
mpool_sm_allocator                                D/A-9 CHAR   n/a      READONLY bucket
mpool_sm_min_size                                 D/A-9 ULLONG n/a      READONLY 134217728
mpool_sm_verbose                                  D/A-9 INT    n/a      READONLY 0
mpool_sm_major_version                            D/A-9 INT    n/a      UNKNOWN  10
mpool_sm_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
mpool_sm_release_version                          D/A-9 INT    n/a      UNKNOWN  0
mpool_grdma_rcache_name                           D/A-9 CHAR   n/a      READONLY vma
mpool_grdma_print_stats                           D/A-9 INT    n/a      READONLY false
mpool_grdma_major_version                         D/A-9 INT    n/a      UNKNOWN  10
mpool_grdma_minor_version                         D/A-9 INT    n/a      UNKNOWN  1
mpool_grdma_release_version                       D/A-9 INT    n/a      UNKNOWN  0
bml                                               U/D-2 CHAR   n/a      ALL      
bml_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
bml_r2_show_unreach_errors                        D/A-9 INT    n/a      READONLY true
bml_r2_major_version                              D/A-9 INT    n/a      UNKNOWN  10
bml_r2_minor_version                              D/A-9 INT    n/a      UNKNOWN  1
bml_r2_release_version                            D/A-9 INT    n/a      UNKNOWN  0
btl                                               U/D-2 CHAR   n/a      ALL      self
btl_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
btl_base_thread_multiple_override                 D/A-9 INT    n/a      READONLY false
btl_base_include                                  D/A-9 CHAR   n/a      READONLY 
btl_base_exclude                                  D/A-9 CHAR   n/a      READONLY 
btl_base_warn_component_unused                    D/A-9 INT    n/a      READONLY 1
btl_self_free_list_num                            D/A-9 INT    n/a      READONLY 0
btl_self_free_list_max                            D/A-9 INT    n/a      READONLY -1
btl_self_free_list_inc                            D/A-9 INT    n/a      READONLY 32
btl_self_exclusivity                              D/B-7 UINT   n/a      READONLY 65536
btl_self_flags                                    T/D-5 UINT   n/a      READONLY 11
btl_self_atomic_flags                             T/D-5 UINT   n/a      UNKNOWN  0
btl_self_rndv_eager_limit                         T/B-4 ULONG  n/a      READONLY 131072
btl_self_eager_limit                              T/B-4 ULONG  n/a      READONLY 131072
btl_self_put_limit                                T/B-4 ULONG  n/a      READONLY 18446744073709551615
btl_self_put_alignment                            T/A-6 ULONG  n/a      UNKNOWN  0
btl_self_max_send_size                            T/B-4 ULONG  n/a      READONLY 262144
btl_self_rdma_pipeline_send_length                T/B-4 ULONG  n/a      READONLY 2147483647
btl_self_rdma_pipeline_frag_size                  T/B-4 ULONG  n/a      READONLY 2147483647
btl_self_min_rdma_pipeline_size                   T/B-4 ULONG  n/a      READONLY 2147614719
btl_self_latency                                  T/D-5 UINT   n/a      READONLY 0
btl_self_bandwidth                                T/D-5 UINT   n/a      READONLY 100
btl_self_major_version                            D/A-9 INT    n/a      UNKNOWN  10
btl_self_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
btl_self_release_version                          D/A-9 INT    n/a      UNKNOWN  0
pml                                               U/D-2 CHAR   n/a      ALL      pami
pml_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
pml_base_bsend_allocator                          D/A-9 CHAR   n/a      READONLY basic
pml_base_wrapper                                  D/A-9 CHAR   n/a      READONLY 
pml_wrapper                                       D/A-9 CHAR   n/a      READONLY 
pml_pami_verbose                                  D/A-9 INT    n/a      LOCAL    0
pml_pami_priority                                 U/A-3 INT    n/a      LOCAL    60
pml_pami_unexpected_limit                         D/A-9 UINT   n/a      READONLY 256
pml_pami_local_eager_limit                        T/B-4 ULONG  n/a      READONLY 12288
pml_pami_shm_attach_thresh                        T/B-4 ULONG  n/a      READONLY 12288
pml_pami_remote_eager_limit                       T/B-4 ULONG  n/a      READONLY 65536
pml_pami_use_get                                  D/A-9 UINT   n/a      READONLY 0
pml_pami_enable_cuda                              D/A-9 UINT   n/a      READONLY 0
pml_pami_major_version                            D/A-9 INT    n/a      UNKNOWN  10
pml_pami_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
pml_pami_release_version                          D/A-9 INT    n/a      UNKNOWN  0
coll                                              U/D-2 CHAR   n/a      ALL      
coll_base_verbose                                 D/D-8 INT    n/a      LOCAL    error
coll_self_priority                                D/A-9 INT    n/a      READONLY 75
coll_self_major_version                           D/A-9 INT    n/a      UNKNOWN  10
coll_self_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
coll_self_release_version                         D/A-9 INT    n/a      UNKNOWN  0
coll_libnbc_priority                              D/A-9 INT    n/a      READONLY 10
coll_libnbc_ibcast_skip_dt_decision               D/A-9 INT    n/a      READONLY true
coll_libnbc_major_version                         D/A-9 INT    n/a      UNKNOWN  10
coll_libnbc_minor_version                         D/A-9 INT    n/a      UNKNOWN  1
coll_libnbc_release_version                       D/A-9 INT    n/a      UNKNOWN  0
coll_inter_priority                               D/A-9 INT    n/a      READONLY 40
coll_inter_verbose                                D/A-9 INT    n/a      READONLY 0
coll_inter_major_version                          D/A-9 INT    n/a      UNKNOWN  10
coll_inter_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
coll_inter_release_version                        D/A-9 INT    n/a      UNKNOWN  0
coll_ibm_priority                                 D/A-9 INT    n/a      READONLY 95
coll_ibm_verbose                                  D/A-9 INT    n/a      READONLY 0
coll_ibm_opal_progress_limit                      D/A-9 INT    n/a      READONLY 128
coll_ibm_always_make_progress                     D/A-9 INT    n/a      READONLY false
coll_ibm_comm_lazy_max_wait                       D/A-9 INT    n/a      READONLY 10
coll_ibm_display_table                            D/A-9 INT    n/a      READONLY false
coll_ibm_algorithm                                D/A-9 INT    n/a      READONLY -1
coll_ibm_adapter                                  D/A-9 INT    n/a      READONLY pami
coll_ibm_collselect_mode                          D/A-9 INT    n/a      READONLY static
coll_ibm_collselect_mode_nb                       D/A-9 INT    n/a      READONLY failsafe
coll_ibm_tune_results                             D/A-9 CHAR   n/a      READONLY /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/etc/libcoll_tune_results.xml
coll_ibm_skip_allgather                           D/A-9 INT    n/a      READONLY false
coll_ibm_force_allgather                          D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_allgather                D/A-9 INT    n/a      READONLY static
coll_ibm_skip_iallgather                          D/A-9 INT    n/a      READONLY false
coll_ibm_force_iallgather                         D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_iallgather               D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_allgatherv                          D/A-9 INT    n/a      READONLY false
coll_ibm_force_allgatherv                         D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_allgatherv               D/A-9 INT    n/a      READONLY static
coll_ibm_skip_iallgatherv                         D/A-9 INT    n/a      READONLY false
coll_ibm_force_iallgatherv                        D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_iallgatherv              D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_allreduce                           D/A-9 INT    n/a      READONLY false
coll_ibm_force_allreduce                          D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_allreduce                D/A-9 INT    n/a      READONLY static
coll_ibm_skip_iallreduce                          D/A-9 INT    n/a      READONLY false
coll_ibm_force_iallreduce                         D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_iallreduce               D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_alltoall                            D/A-9 INT    n/a      READONLY false
coll_ibm_force_alltoall                           D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_alltoall                 D/A-9 INT    n/a      READONLY static
coll_ibm_skip_ialltoall                           D/A-9 INT    n/a      READONLY false
coll_ibm_force_ialltoall                          D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_ialltoall                D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_alltoallv                           D/A-9 INT    n/a      READONLY false
coll_ibm_force_alltoallv                          D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_alltoallv                D/A-9 INT    n/a      READONLY static
coll_ibm_skip_ialltoallv                          D/A-9 INT    n/a      READONLY false
coll_ibm_force_ialltoallv                         D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_ialltoallv               D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_barrier                             D/A-9 INT    n/a      READONLY false
coll_ibm_force_barrier                            D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_barrier                  D/A-9 INT    n/a      READONLY static
coll_ibm_skip_ibarrier                            D/A-9 INT    n/a      READONLY false
coll_ibm_force_ibarrier                           D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_ibarrier                 D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_bcast                               D/A-9 INT    n/a      READONLY false
coll_ibm_force_bcast                              D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_bcast                    D/A-9 INT    n/a      READONLY static
coll_ibm_skip_ibcast                              D/A-9 INT    n/a      READONLY false
coll_ibm_force_ibcast                             D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_ibcast                   D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_gather                              D/A-9 INT    n/a      READONLY false
coll_ibm_force_gather                             D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_gather                   D/A-9 INT    n/a      READONLY static
coll_ibm_skip_igather                             D/A-9 INT    n/a      READONLY false
coll_ibm_force_igather                            D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_igather                  D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_gatherv                             D/A-9 INT    n/a      READONLY false
coll_ibm_force_gatherv                            D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_gatherv                  D/A-9 INT    n/a      READONLY static
coll_ibm_skip_igatherv                            D/A-9 INT    n/a      READONLY false
coll_ibm_force_igatherv                           D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_igatherv                 D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_reduce                              D/A-9 INT    n/a      READONLY false
coll_ibm_force_reduce                             D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_reduce                   D/A-9 INT    n/a      READONLY static
coll_ibm_skip_ireduce                             D/A-9 INT    n/a      READONLY false
coll_ibm_force_ireduce                            D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_ireduce                  D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_reduce_scatter                      D/A-9 INT    n/a      READONLY false
coll_ibm_force_reduce_scatter                     D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_reduce_scatter           D/A-9 INT    n/a      READONLY static
coll_ibm_skip_ireduce_scatter                     D/A-9 INT    n/a      READONLY false
coll_ibm_force_ireduce_scatter                    D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_ireduce_scatter          D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_scan                                D/A-9 INT    n/a      READONLY false
coll_ibm_force_scan                               D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_scan                     D/A-9 INT    n/a      READONLY static
coll_ibm_skip_iscan                               D/A-9 INT    n/a      READONLY false
coll_ibm_force_iscan                              D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_iscan                    D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_scatter                             D/A-9 INT    n/a      READONLY false
coll_ibm_force_scatter                            D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_scatter                  D/A-9 INT    n/a      READONLY static
coll_ibm_skip_iscatter                            D/A-9 INT    n/a      READONLY false
coll_ibm_force_iscatter                           D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_iscatter                 D/A-9 INT    n/a      READONLY failsafe
coll_ibm_skip_scatterv                            D/A-9 INT    n/a      READONLY false
coll_ibm_force_scatterv                           D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_scatterv                 D/A-9 INT    n/a      READONLY static
coll_ibm_skip_iscatterv                           D/A-9 INT    n/a      READONLY false
coll_ibm_force_iscatterv                          D/A-9 INT    n/a      READONLY -1
coll_ibm_collselect_mode_iscatterv                D/A-9 INT    n/a      READONLY failsafe
coll_ibm_major_version                            D/A-9 INT    n/a      UNKNOWN  10
coll_ibm_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
coll_ibm_release_version                          D/A-9 INT    n/a      UNKNOWN  0
coll_sync_priority                                D/A-9 INT    n/a      READONLY 50
coll_sync_barrier_before                          D/A-9 INT    n/a      READONLY 0
coll_sync_barrier_after                           D/A-9 INT    n/a      READONLY 0
coll_sync_major_version                           D/A-9 INT    n/a      UNKNOWN  10
coll_sync_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
coll_sync_release_version                         D/A-9 INT    n/a      UNKNOWN  0
coll_tuned_priority                               T/A-6 INT    n/a      READONLY -1
coll_tuned_init_tree_fanout                       T/A-6 INT    n/a      READONLY 4
coll_tuned_init_chain_fanout                      T/A-6 INT    n/a      READONLY 4
coll_tuned_alltoall_small_msg                     T/A-6 INT    n/a      READONLY 200
coll_tuned_alltoall_intermediate_msg              T/A-6 INT    n/a      READONLY 3000
coll_tuned_use_dynamic_rules                      T/A-6 INT    n/a      READONLY false
coll_tuned_dynamic_rules_filename                 T/A-6 CHAR   n/a      READONLY 
coll_tuned_allreduce_algorithm_count              T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_allreduce_algorithm                    T/D-5 INT    n/a      READONLY ignore
coll_tuned_allreduce_algorithm_segmentsize        T/D-5 INT    n/a      READONLY 0
coll_tuned_allreduce_algorithm_tree_fanout        T/D-5 INT    n/a      READONLY 4
coll_tuned_allreduce_algorithm_chain_fanout       T/D-5 INT    n/a      READONLY 4
coll_tuned_alltoall_algorithm_count               T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_alltoall_algorithm                     T/D-5 INT    n/a      READONLY ignore
coll_tuned_alltoall_algorithm_segmentsize         T/D-5 INT    n/a      READONLY 0
coll_tuned_alltoall_algorithm_tree_fanout         T/D-5 INT    n/a      READONLY 4
coll_tuned_alltoall_algorithm_chain_fanout        T/D-5 INT    n/a      READONLY 4
coll_tuned_alltoall_algorithm_max_requests        T/D-5 INT    n/a      READONLY 0
coll_tuned_allgather_algorithm_count              T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_allgather_algorithm                    T/D-5 INT    n/a      READONLY ignore
coll_tuned_allgather_algorithm_segmentsize        T/D-5 INT    n/a      READONLY 0
coll_tuned_allgather_algorithm_tree_fanout        T/D-5 INT    n/a      READONLY 4
coll_tuned_allgather_algorithm_chain_fanout       T/D-5 INT    n/a      READONLY 4
coll_tuned_allgatherv_algorithm_count             T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_allgatherv_algorithm                   T/D-5 INT    n/a      READONLY ignore
coll_tuned_allgatherv_algorithm_segmentsize       T/D-5 INT    n/a      READONLY 0
coll_tuned_allgatherv_algorithm_tree_fanout       T/D-5 INT    n/a      READONLY 4
coll_tuned_allgatherv_algorithm_chain_fanout      T/D-5 INT    n/a      READONLY 4
coll_tuned_alltoallv_algorithm_count              T/D-5 INT    n/a      UNKNOWN  -1667791020
coll_tuned_alltoallv_algorithm                    T/D-5 INT    n/a      READONLY ignore
coll_tuned_barrier_algorithm_count                T/D-5 INT    n/a      UNKNOWN  -1667791020
coll_tuned_barrier_algorithm                      T/D-5 INT    n/a      READONLY ignore
coll_tuned_bcast_algorithm_count                  T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_bcast_algorithm                        T/D-5 INT    n/a      READONLY ignore
coll_tuned_bcast_algorithm_segmentsize            T/D-5 INT    n/a      READONLY 0
coll_tuned_bcast_algorithm_tree_fanout            T/D-5 INT    n/a      READONLY 4
coll_tuned_bcast_algorithm_chain_fanout           T/D-5 INT    n/a      READONLY 4
coll_tuned_reduce_algorithm_count                 T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_reduce_algorithm                       T/D-5 INT    n/a      READONLY ignore
coll_tuned_reduce_algorithm_segmentsize           T/D-5 INT    n/a      READONLY 0
coll_tuned_reduce_algorithm_tree_fanout           T/D-5 INT    n/a      READONLY 4
coll_tuned_reduce_algorithm_chain_fanout          T/D-5 INT    n/a      READONLY 4
coll_tuned_reduce_algorithm_max_requests          T/D-5 INT    n/a      READONLY 0
coll_tuned_reduce_scatter_algorithm_count         T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_reduce_scatter_algorithm               T/D-5 INT    n/a      READONLY ignore
coll_tuned_reduce_scatter_algorithm_segmentsize   T/D-5 INT    n/a      READONLY 0
coll_tuned_reduce_scatter_algorithm_tree_fanout   T/D-5 INT    n/a      READONLY 4
coll_tuned_reduce_scatter_algorithm_chain_fanout  T/D-5 INT    n/a      READONLY 4
coll_tuned_gather_algorithm_count                 T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_gather_algorithm                       T/D-5 INT    n/a      READONLY ignore
coll_tuned_gather_algorithm_segmentsize           T/D-5 INT    n/a      READONLY 0
coll_tuned_gather_algorithm_tree_fanout           T/D-5 INT    n/a      READONLY 4
coll_tuned_gather_algorithm_chain_fanout          T/D-5 INT    n/a      READONLY 4
coll_tuned_scatter_algorithm_count                T/D-5 INT    n/a      UNKNOWN  452563216
coll_tuned_scatter_algorithm                      T/D-5 INT    n/a      READONLY ignore
coll_tuned_scatter_algorithm_segmentsize          T/D-5 INT    n/a      READONLY 0
coll_tuned_scatter_algorithm_tree_fanout          T/D-5 INT    n/a      READONLY 4
coll_tuned_scatter_algorithm_chain_fanout         T/D-5 INT    n/a      READONLY 4
coll_tuned_major_version                          D/A-9 INT    n/a      UNKNOWN  10
coll_tuned_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
coll_tuned_release_version                        D/A-9 INT    n/a      UNKNOWN  0
coll_basic_priority                               D/A-9 INT    n/a      READONLY 10
coll_basic_crossover                              D/A-9 INT    n/a      READONLY 4
coll_basic_major_version                          D/A-9 INT    n/a      UNKNOWN  10
coll_basic_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
coll_basic_release_version                        D/A-9 INT    n/a      UNKNOWN  0
coll_sm_priority                                  D/A-9 INT    n/a      READONLY 0
coll_sm_control_size                              D/A-9 INT    n/a      READONLY 4096
coll_sm_fragment_size                             D/A-9 INT    n/a      READONLY 8192
coll_sm_comm_in_use_flags                         D/A-9 INT    n/a      READONLY 2
coll_sm_comm_num_segments                         D/A-9 INT    n/a      READONLY 8
coll_sm_tree_degree                               D/A-9 INT    n/a      READONLY 4
coll_sm_info_num_procs                            D/A-9 INT    n/a      READONLY 4
coll_sm_shared_mem_used_data                      D/A-9 INT    n/a      READONLY 548864
coll_sm_major_version                             D/A-9 INT    n/a      UNKNOWN  10
coll_sm_minor_version                             D/A-9 INT    n/a      UNKNOWN  1
coll_sm_release_version                           D/A-9 INT    n/a      UNKNOWN  0
osc                                               U/D-2 CHAR   n/a      ALL      pami
osc_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
osc_pami_no_locks                                 D/A-9 INT    n/a      READONLY unknown
osc_pami_max_ctrl_sends                           U/A-3 UINT   n/a      READONLY 1024
osc_pami_rma_pending                              U/A-3 UINT   n/a      READONLY 1024
osc_pami_use_get                                  D/A-9 UINT   n/a      READONLY 0
osc_pami_priority                                 U/A-3 INT    n/a      GROUP    95
osc_pami_major_version                            D/A-9 INT    n/a      UNKNOWN  10
osc_pami_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
osc_pami_release_version                          D/A-9 INT    n/a      UNKNOWN  0
common_pami_verbose                               D/A-9 INT    n/a      READONLY -1
common_pami_ncontexts                             D/A-9 INT    n/a      READONLY 1
pstat                                             U/D-2 CHAR   n/a      ALL      
pstat_base_verbose                                D/D-8 INT    n/a      LOCAL    error
pstat_linux_major_version                         D/A-9 INT    n/a      UNKNOWN  10
pstat_linux_minor_version                         D/A-9 INT    n/a      UNKNOWN  1
pstat_linux_release_version                       D/A-9 INT    n/a      UNKNOWN  0
filem                                             U/D-2 CHAR   n/a      ALL      
filem_base_verbose                                D/D-8 INT    n/a      LOCAL    error
filem_raw_flatten_directory_trees                 D/A-9 INT    n/a      READONLY false
filem_raw_major_version                           D/A-9 INT    n/a      UNKNOWN  10
filem_raw_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
filem_raw_release_version                         D/A-9 INT    n/a      UNKNOWN  0
iof                                               U/D-2 CHAR   n/a      ALL      
iof_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
iof_base_output_limit                             D/A-9 ULONG  n/a      READONLY 2147483647
iof_base_input_files                              D/A-9 CHAR   n/a      READONLY 
iof_base_redirect_app_stderr_to_stdout            D/A-9 INT    n/a      READONLY false
iof_mr_orted_major_version                        D/A-9 INT    n/a      UNKNOWN  10
iof_mr_orted_minor_version                        D/A-9 INT    n/a      UNKNOWN  1
iof_mr_orted_release_version                      D/A-9 INT    n/a      UNKNOWN  0
iof_tool_major_version                            D/A-9 INT    n/a      UNKNOWN  10
iof_tool_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
iof_tool_release_version                          D/A-9 INT    n/a      UNKNOWN  0
iof_mr_hnp_major_version                          D/A-9 INT    n/a      UNKNOWN  10
iof_mr_hnp_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
iof_mr_hnp_release_version                        D/A-9 INT    n/a      UNKNOWN  0
iof_orted_major_version                           D/A-9 INT    n/a      UNKNOWN  10
iof_orted_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
iof_orted_release_version                         D/A-9 INT    n/a      UNKNOWN  0
iof_hnp_major_version                             D/A-9 INT    n/a      UNKNOWN  10
iof_hnp_minor_version                             D/A-9 INT    n/a      UNKNOWN  1
iof_hnp_release_version                           D/A-9 INT    n/a      UNKNOWN  0
notifier                                          U/D-2 CHAR   n/a      ALL      
notifier_base_verbose                             D/D-8 INT    n/a      LOCAL    error
notifier_base_use_progress_thread                 D/A-9 INT    n/a      READONLY false
notifier_base_severity_level                      D/A-9 CHAR   n/a      READONLY 
notifier_base_default_actions                     D/A-9 CHAR   n/a      READONLY syslog
notifier_base_emerg_event_actions                 D/A-9 CHAR   n/a      READONLY 
notifier_base_alert_event_actions                 D/A-9 CHAR   n/a      READONLY 
notifier_base_crit_event_actions                  D/A-9 CHAR   n/a      READONLY 
notifier_base_warn_event_actions                  D/A-9 CHAR   n/a      READONLY 
notifier_base_notice_event_actions                D/A-9 CHAR   n/a      READONLY 
notifier_base_info_event_actions                  D/A-9 CHAR   n/a      READONLY 
notifier_base_debug_event_actions                 D/A-9 CHAR   n/a      READONLY 
notifier_base_error_event_actions                 D/A-9 CHAR   n/a      READONLY 
notifier_syslog_major_version                     D/A-9 INT    n/a      UNKNOWN  10
notifier_syslog_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
notifier_syslog_release_version                   D/A-9 INT    n/a      UNKNOWN  0
odls                                              U/D-2 CHAR   n/a      ALL      
odls_base_verbose                                 D/D-8 INT    n/a      LOCAL    error
odls_base_sigkill_timeout                         D/A-9 INT    n/a      READONLY 1
odls_default_major_version                        D/A-9 INT    n/a      UNKNOWN  10
odls_default_minor_version                        D/A-9 INT    n/a      UNKNOWN  1
odls_default_release_version                      D/A-9 INT    n/a      UNKNOWN  0
plm                                               U/D-2 CHAR   n/a      ALL      ^lsf
plm_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
plm_jsexec_verbose                                D/A-9 INT    n/a      READONLY 0
plm_jsexec_priority                               D/A-9 INT    n/a      READONLY 1
plm_jsexec_major_version                          D/A-9 INT    n/a      UNKNOWN  10
plm_jsexec_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
plm_jsexec_release_version                        D/A-9 INT    n/a      UNKNOWN  0
plm_isolated_major_version                        D/A-9 INT    n/a      UNKNOWN  10
plm_isolated_minor_version                        D/A-9 INT    n/a      UNKNOWN  1
plm_isolated_release_version                      D/A-9 INT    n/a      UNKNOWN  0
plm_rsh_num_concurrent                            T/D-5 INT    n/a      READONLY 128
plm_rsh_force_rsh                                 U/D-2 INT    n/a      READONLY false
plm_rsh_disable_qrsh                              U/D-2 INT    n/a      READONLY false
plm_rsh_daemonize_qrsh                            U/D-2 INT    n/a      READONLY false
plm_rsh_disable_llspawn                           U/D-2 INT    n/a      READONLY false
plm_rsh_daemonize_llspawn                         U/D-2 INT    n/a      READONLY false
plm_rsh_priority                                  D/A-9 INT    n/a      READONLY 10
plm_rsh_delay                                     T/B-4 CHAR   n/a      READONLY 
plm_rsh_no_tree_spawn                             T/D-5 INT    n/a      READONLY false
plm_rsh_agent                                     U/D-2 CHAR   n/a      READONLY ssh : rsh
pls_rsh_agent                                     U/D-2 CHAR   n/a      READONLY ssh : rsh
orte_rsh_agent                                    U/D-2 CHAR   n/a      READONLY ssh : rsh
plm_rsh_assume_same_shell                         U/D-2 INT    n/a      READONLY true
orte_assume_same_shell                            U/D-2 INT    n/a      READONLY true
plm_rsh_pass_environ_mca_params                   U/D-2 INT    n/a      READONLY true
plm_rsh_args                                      U/D-2 CHAR   n/a      READONLY 
plm_rsh_pass_libpath                              U/D-2 CHAR   n/a      READONLY 
plm_rsh_use_cat                                   U/D-2 INT    n/a      READONLY true
plm_rsh_major_version                             D/A-9 INT    n/a      UNKNOWN  10
plm_rsh_minor_version                             D/A-9 INT    n/a      UNKNOWN  1
plm_rsh_release_version                           D/A-9 INT    n/a      UNKNOWN  0
ras                                               U/D-2 CHAR   n/a      ALL      ^lsf
ras_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
ras_simulator_slots                               D/A-9 CHAR   n/a      READONLY 1
ras_simulator_max_slots                           D/A-9 CHAR   n/a      READONLY 0
ras_simulator_num_nodes                           D/A-9 CHAR   n/a      READONLY 
ras_simulator_topo_files                          D/A-9 CHAR   n/a      READONLY 
ras_simulator_topologies                          D/A-9 CHAR   n/a      READONLY 
ras_simulator_have_cpubind                        D/A-9 INT    n/a      READONLY true
ras_simulator_have_membind                        D/A-9 INT    n/a      READONLY true
ras_simulator_major_version                       D/A-9 INT    n/a      UNKNOWN  10
ras_simulator_minor_version                       D/A-9 INT    n/a      UNKNOWN  1
ras_simulator_release_version                     D/A-9 INT    n/a      UNKNOWN  0
ras_gridengine_priority                           D/A-9 INT    n/a      READONLY 100
ras_gridengine_verbose                            D/A-9 INT    n/a      LOCAL    0
ras_gridengine_show_jobid                         D/A-9 INT    n/a      READONLY false
ras_gridengine_major_version                      D/A-9 INT    n/a      UNKNOWN  10
ras_gridengine_minor_version                      D/A-9 INT    n/a      UNKNOWN  1
ras_gridengine_release_version                    D/A-9 INT    n/a      UNKNOWN  0
ras_loadleveler_priority                          D/A-9 INT    n/a      READONLY 90
ras_loadleveler_major_version                     D/A-9 INT    n/a      UNKNOWN  10
ras_loadleveler_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
ras_loadleveler_release_version                   D/A-9 INT    n/a      UNKNOWN  0
rmaps                                             U/D-2 CHAR   n/a      ALL      
rmaps_base_verbose                                D/D-8 INT    n/a      LOCAL    error
rmaps_base_pernode                                D/A-9 INT    n/a      READONLY false
rmaps_ppr_pernode                                 D/A-9 INT    n/a      READONLY false
rmaps_base_n_pernode                              D/A-9 INT    n/a      READONLY 0
rmaps_ppr_n_pernode                               D/A-9 INT    n/a      READONLY 0
rmaps_base_n_persocket                            D/A-9 INT    n/a      READONLY 0
rmaps_ppr_n_persocket                             D/A-9 INT    n/a      READONLY 0
rmaps_base_pattern                                D/A-9 CHAR   n/a      READONLY 
rmaps_ppr_pattern                                 D/A-9 CHAR   n/a      READONLY 
rmaps_base_mapping_policy                         D/A-9 CHAR   n/a      READONLY 
rmaps_base_schedule_policy                        D/A-9 CHAR   n/a      READONLY 
rmaps_base_ranking_policy                         D/A-9 CHAR   n/a      READONLY 
rmaps_base_bycore                                 D/A-9 INT    n/a      READONLY false
rmaps_base_byslot                                 D/A-9 INT    n/a      READONLY false
rmaps_base_bynode                                 D/A-9 INT    n/a      READONLY false
rmaps_base_cpus_per_proc                          D/A-9 INT    n/a      READONLY 1
rmaps_base_cpus_per_rank                          D/A-9 INT    n/a      READONLY 1
rmaps_dist_device                                 D/A-9 CHAR   n/a      READONLY 
rmaps_base_no_schedule_local                      D/A-9 INT    n/a      READONLY false
rmaps_base_no_oversubscribe                       D/A-9 INT    n/a      READONLY false
rmaps_base_oversubscribe                          D/A-9 INT    n/a      READONLY false
rmaps_base_display_map                            D/A-9 INT    n/a      READONLY false
rmaps_base_display_devel_map                      D/A-9 INT    n/a      READONLY false
rmaps_base_display_topo_with_map                  D/A-9 INT    n/a      READONLY false
rmaps_base_display_diffable_map                   D/A-9 INT    n/a      READONLY false
rmaps_base_topology                               D/A-9 CHAR   n/a      READONLY 
rmaps_seq_priority                                D/A-9 INT    n/a      READONLY 60
rmaps_seq_major_version                           D/A-9 INT    n/a      UNKNOWN  10
rmaps_seq_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
rmaps_seq_release_version                         D/A-9 INT    n/a      UNKNOWN  0
rmaps_rank_file_priority                          D/A-9 INT    n/a      READONLY 0
rmaps_rank_file_path                              T/D-5 CHAR   n/a      READONLY 
orte_rankfile                                     T/D-5 CHAR   n/a      READONLY 
rmaps_rank_file_physical                          T/D-5 INT    n/a      READONLY false
rmaps_rank_file_major_version                     D/A-9 INT    n/a      UNKNOWN  10
rmaps_rank_file_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
rmaps_rank_file_release_version                   D/A-9 INT    n/a      UNKNOWN  0
rmaps_resilient_priority                          D/A-9 INT    n/a      READONLY 40
rmaps_resilient_fault_grp_file                    D/A-9 CHAR   n/a      READONLY 
rmaps_resilient_major_version                     D/A-9 INT    n/a      UNKNOWN  10
rmaps_resilient_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
rmaps_resilient_release_version                   D/A-9 INT    n/a      UNKNOWN  0
rmaps_staged_major_version                        D/A-9 INT    n/a      UNKNOWN  10
rmaps_staged_minor_version                        D/A-9 INT    n/a      UNKNOWN  1
rmaps_staged_release_version                      D/A-9 INT    n/a      UNKNOWN  0
rmaps_mindist_priority                            D/A-9 INT    n/a      READONLY 20
rmaps_mindist_major_version                       D/A-9 INT    n/a      UNKNOWN  10
rmaps_mindist_minor_version                       D/A-9 INT    n/a      UNKNOWN  1
rmaps_mindist_release_version                     D/A-9 INT    n/a      UNKNOWN  0
rmaps_round_robin_priority                        D/A-9 INT    n/a      READONLY 10
rmaps_round_robin_major_version                   D/A-9 INT    n/a      UNKNOWN  10
rmaps_round_robin_minor_version                   D/A-9 INT    n/a      UNKNOWN  1
rmaps_round_robin_release_version                 D/A-9 INT    n/a      UNKNOWN  0
rmaps_ppr_priority                                D/A-9 INT    n/a      READONLY 90
rmaps_ppr_major_version                           D/A-9 INT    n/a      UNKNOWN  10
rmaps_ppr_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
rmaps_ppr_release_version                         D/A-9 INT    n/a      UNKNOWN  0
rtc                                               U/D-2 CHAR   n/a      ALL      
rtc_base_verbose                                  D/D-8 INT    n/a      LOCAL    error
rtc_freq_priority                                 D/A-9 INT    n/a      READONLY 50
rtc_freq_governor                                 D/A-9 CHAR   n/a      READONLY 
rtc_freq_max                                      D/A-9 CHAR   n/a      READONLY 
rtc_freq_min                                      D/A-9 CHAR   n/a      READONLY 
rtc_freq                                          D/A-9 CHAR   n/a      READONLY 
rtc_freq_major_version                            D/A-9 INT    n/a      UNKNOWN  10
rtc_freq_minor_version                            D/A-9 INT    n/a      UNKNOWN  1
rtc_freq_release_version                          D/A-9 INT    n/a      UNKNOWN  0
rtc_hwloc_priority                                D/A-9 INT    n/a      READONLY 70
rtc_hwloc_major_version                           D/A-9 INT    n/a      UNKNOWN  10
rtc_hwloc_minor_version                           D/A-9 INT    n/a      UNKNOWN  1
rtc_hwloc_release_version                         D/A-9 INT    n/a      UNKNOWN  0
schizo                                            U/D-2 CHAR   n/a      ALL      
schizo_base_verbose                               D/D-8 INT    n/a      LOCAL    error
schizo_ompi_major_version                         D/A-9 INT    n/a      UNKNOWN  10
schizo_ompi_minor_version                         D/A-9 INT    n/a      UNKNOWN  1
schizo_ompi_release_version                       D/A-9 INT    n/a      UNKNOWN  0
fbtl                                              U/D-2 CHAR   n/a      ALL      
fbtl_base_verbose                                 D/D-8 INT    n/a      LOCAL    error
fbtl_posix_major_version                          D/A-9 INT    n/a      UNKNOWN  10
fbtl_posix_minor_version                          D/A-9 INT    n/a      UNKNOWN  1
fbtl_posix_release_version                        D/A-9 INT    n/a      UNKNOWN  0
fcoll                                             U/D-2 CHAR   n/a      ALL      
fcoll_base_verbose                                D/D-8 INT    n/a      LOCAL    error
fcoll_static_priority                             D/A-9 INT    n/a      READONLY 10
fcoll_static_major_version                        D/A-9 INT    n/a      UNKNOWN  10
fcoll_static_minor_version                        D/A-9 INT    n/a      UNKNOWN  1
fcoll_static_release_version                      D/A-9 INT    n/a      UNKNOWN  0
fcoll_two_phase_priority                          D/A-9 INT    n/a      READONLY 10
fcoll_two_phase_major_version                     D/A-9 INT    n/a      UNKNOWN  10
fcoll_two_phase_minor_version                     D/A-9 INT    n/a      UNKNOWN  1
fcoll_two_phase_release_version                   D/A-9 INT    n/a      UNKNOWN  0
fcoll_dynamic_priority                            D/A-9 INT    n/a      READONLY 10
fcoll_dynamic_major_version                       D/A-9 INT    n/a      UNKNOWN  10
fcoll_dynamic_minor_version                       D/A-9 INT    n/a      UNKNOWN  1
fcoll_dynamic_release_version                     D/A-9 INT    n/a      UNKNOWN  0
fcoll_individual_priority                         D/A-9 INT    n/a      READONLY 10
fcoll_individual_major_version                    D/A-9 INT    n/a      UNKNOWN  10
fcoll_individual_minor_version                    D/A-9 INT    n/a      UNKNOWN  1
fcoll_individual_release_version                  D/A-9 INT    n/a      UNKNOWN  0
fs                                                U/D-2 CHAR   n/a      ALL      
fs_base_verbose                                   D/D-8 INT    n/a      LOCAL    error
fs_ufs_major_version                              D/A-9 INT    n/a      UNKNOWN  10
fs_ufs_minor_version                              D/A-9 INT    n/a      UNKNOWN  1
fs_ufs_release_version                            D/A-9 INT    n/a      UNKNOWN  0
io                                                U/D-2 CHAR   n/a      ALL      
io_base_verbose                                   D/D-8 INT    n/a      LOCAL    error
io_romio314_priority                              D/A-9 INT    n/a      READONLY 40
io_romio314_delete_priority                       D/A-9 INT    n/a      READONLY 40
io_romio314_version                               D/A-9 CHAR   n/a      READONLY from MPICH v3.1.4
io_romio314_user_configure_params                 D/A-9 CHAR   n/a      READONLY CFLAGS=-I/__unresolved_path_____________/dependencies/include/cuda -DROMIO_CUDA_AWARE_SUPPORT=1
[cr1cn13:35212:0] Caught signal 11 (Segmentation fault)
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Failed Matched Probe test - mprobe

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 2

Test Description:

written Dr. Michael L. Stokes, Michael.Stokes@UAH.edu

This routine is designed to test the MPI-3.0 matched probe support. The support provided in MPI-2.2 was not thread safe allowing other threads to usurp messages probed in other threads.

The rank=0 process generates a random array of floats that is sent to mpi rank 1. Rank 1 send a message back to rank 0 with the message length of the received array. Rank 1 spawns 2 or more threads that each attempt to read the message sent by rank 0. In general, all of the threads have equal access to the data, but the first one to probe the data will eventually end of processing the data, and all the others will relent. The threads use MPI_Improbe(), so if there is nothing to read, the thread will rest for 0.1 secs before reprobing. If nothing is probed within a fixed number of cycles, the thread exists and sets it thread exit status to 1. If a thread is able to read the message, it returns an exit status of 0.

mpi_rank:1 thread 0 MPI_rank:1
mpi_rank:1 thread 2 MPI_rank:1
mpi_rank:1 thread 3 MPI_rank:1
mpi_rank:1 thread 1 MPI_rank:1
mpi_rank:1 thread 0 used 1 read cycle.
mpi_rank:1 thread 0 local memory request (bytes):400 of local allocation:800
mpi_rank:1 thread 2 used 1 read cycle.
mpi_rank:1 thread 2 local memory request (bytes):400 of local allocation:800
mpi_rank:1 thread 2 recv'd 50 MPI_FLOATs from rank:0.
mpi_rank:1 thread 2 sending rank:0 the number of MPI_FLOATs received:50
mpi_rank:1 thread 0 recv'd 50 MPI_FLOATs from rank:0.
mpi_rank:1 thread 0 sending rank:0 the number of MPI_FLOATs received:50
mpi_rank:0 main() received message from rank:1 that the received message length was 400 bytes long.
mpi_rank:1 main() thread 0 exit status:0
mpi_rank:1 thread 1 giving up reading data.
mpi_rank:1 thread 3 giving up reading data.
mpi_rank:1 main() thread 1 exit status:1
mpi_rank:1 main() thread 2 exit status:0
mpi_rank:1 main() thread 3 exit status:1
[cr1cn13:35257] *** Process received signal ***
[cr1cn13:35257] Signal: Segmentation fault (11)
[cr1cn13:35257] Signal code: Address not mapped (1)
[cr1cn13:35257] Failing at address: 0x10
[cr1cn13:35257] [ 0] [0x3fffa6a80478]
[cr1cn13:35257] [ 1] /lib64/ld64.so.2(+0x1f238)[0x3fffa6abf238]
[cr1cn13:35257] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_pml_pami.so(pml_pami_finalize+0x104)[0x3fffa4655b14]
[cr1cn13:35257] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_pml_pami.so(+0xa518)[0x3fffa465a518]
[cr1cn13:35257] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(mca_pml_base_finalize+0x3c)[0x3fffa6a01f5c]
[cr1cn13:35257] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_finalize+0x5a0)[0x3fffa69829a0]
[cr1cn13:35257] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(PMPI_Finalize+0x54)[0x3fffa69a3354]
[cr1cn13:35257] [ 7] ./mprobe[0x100030b4]
[cr1cn13:35257] [ 8] /lib64/libc.so.6(+0x24700)[0x3fffa6704700]
[cr1cn13:35257] [ 9] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffa67048f4]
[cr1cn13:35257] *** End of error message ***
No errors.
--------------------------------------------------------------------------
mpirun noticed that process rank 1 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Passed RMA compliance test - badrma

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

The test uses various combinations of either zero size datatypes or zero size counts. All tests should pass to be compliant with the MPI-3.0 specification.

No errors

Passed Compare_and_swap test - compare_and_swap

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This function compares one element of type datatype in the compare buffer compare_addr with the buffer at offset target_disp in the target window specified by target_rank and window. It replaces the value at the target with the value in the origin buffer if both buffers are identical. The original value at the target is returned in the result buffer.

No errors

Passed RMA Shared Memory test - fence_shm

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This simple test uses MPI_Win_allocate_shared() with MPI_Win_fence(), MPI_Put() calls with assertions.

No errors

Passed Fetch_and_op test - fetch_and_op

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a simple test that executes the MPI_Fetch_and op() calls on RMA windows.

No errors

Passed Win_flush() test - flush

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Window Flush. This simple test flushes a shared window.

No errors

Passed Get_acculumate test 1 - get_acc_local

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Get Accumalated Test. This is a simple test of MPI_Get_accumulate().

No errors

Passed Get_accumulate test 2 - get_accumulate

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Get Accumulate Test. This is a simple test of MPI_Get_accumulate().

No errors

Passed Linked_list construction test 1 - linked_list_bench_lock_all

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Construct a distributed shared linked list using MPI-3 dynamic windows. Initially process 0 creates the head of the list, attaches it to the window, and broadcasts the pointer to all processes. Each process p then appends N new elements to the list when the tail reaches process p-1.

No errors

Passed Linked_list construction test 2 - linked_list_bench_lock_excl

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

MPI-3 distributed linked list construction example. Construct a distributed shared linked list using proposed MPI-3 dynamic windows. Initially process 0 creates the head of the list, attaches it to the window, and broadcasts the pointer to all processes. Each process "p" then appends N new elements to the list when the tail reaches process "p-1". The test uses the MPI_LOCK_EXCLUSIVE argument with MPI_Win_lock().

No errors

Passed Linked-list construction test 3 - linked_list_bench_lock_shr

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test constructs a distributed shared linked list using MPI-3 dynamic windows. Initially process 0 creates the head of the list, attaches it to the window, and broadcasts the pointer to all processes. Each process "p" then appends N new elements to the list when the tail reaches process "p-1". This test is similar to "rma/linked_list_bench_lock_excl" but uses an MPI_LOCK_SHARED parameter to MPI_Win_Lock().

No errors

Passed Linked_list construction test 4 - linked_list

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test constructs a distributed shared linked list using MPI-3 dynamic windows. Initially process 0 creates the head of the list, attaches it to an RMA window, and broadcasts the pointer to all processes. All processes then concurrently append N new elements to the list. When a process attempts to attach its element to the tail of list it may discover that its tail pointer is stale and it must chase ahead to the new tail before the element can be attached.

No errors

Passed Linked list construction test 5 - linked_list_fop

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test constructs a distributed shared linked list using MPI-3 dynamic windows. Initially process 0 creates the head of the list, attaches it to the window, and broadcasts the pointer to all processes. All processes then concurrently append N new elements to the list. When a process attempts to attach its element to the tail of list it may discover that its tail pointer is stale and it must chase ahead to the new tail before the element can be attached.

No errors

Passed Linked list construction test 6 - linked_list_lockall

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Construct a distributed shared linked list using MPI-3 dynamic RMA windows. Initially process 0 creates the head of the list, attaches it to the window, and broadcasts the pointer to all processes. All processes then concurrently append N new elements to the list. When a process attempts to attach its element to the tail of list it may discover that its tail pointer is stale and it must chase ahead to the new tail before the element can be attached. This version of the test suite uses MPI_Win_lock_all() instead of MPI_Win_lock(MPI_LOCK_EXCLUSIVE, ...).

No errors

Passed Request-based ops test - req_example

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Example 11.21 from the MPI 3.0 spec. The following example shows how request-based operations can be used to overlap communication with computation. Each process fetches, processes, and writes the result for NSTEPS chunks of data. Instead of a single buffer, M local buffers are used to allow up to M communication operations to overlap with computation.

No errors

Passed MPI RMA read-and-ops test - reqops

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test exercises atomic, one-sided read-and-operation calls.

No errors

Passed MPI_PROC_NULL test - rmanull

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test the MPI_PROC_NULL as a valid target.

No errors

Passed RMA zero-byte transfers test - rmazero

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test loops are used to run through a series of communicators that are subsets of MPI_COMM_WORLD.

No errors

Passed One-Sided accumulate test 4 - strided_getacc_indexed

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Author: James Dinan dinan@mcs.anl.gov
Date: December, 201

This code performs N strided put operations followed by get operations into a 2d patch of a shared array. The array has dimensions [X, Y] and the subarray has dimensions [SUB_X, SUB_Y] and begins at index [0, 0]. The input and output buffers are specified using an MPI indexed type.

No errors

Passed One-sided accumulate test 5 - strided_getacc_indexed_shared

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Author: James Dinan dinan@mcs.anl.gov
Date: November, 2012

This code performs N strided put operations followed by get operations into a 2d patch of a shared array. The array has dimensions [X, Y] and the subarray has dimensions [SUB_X, SUB_Y] and begins at index [0, 0]. The input and output buffers are specified using an MPI indexed type.

No errors

Passed One-Sided accumulate test 8 - strided_putget_indexed_shared

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Author: James Dinan dinan@mcs.anl.gov
Date: November, 2012

This code performs N strided put operations followed by get operations into a 2-D patch of a shared array. The array has dimensions [X, Y] and the subarray has dimensions [SUB_X, SUB_Y] and begins at index [0, 0]. The input and output buffers are specified using an MPI indexed type.

No errors

Passed Win_create_dynamic test - win_dynamic_acc

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test exercises dynamic RMA windows using the MPI_Win_create_dynamic() and MPI_Accumulate() operations.

No errors

Passed Win_get_attr test - win_flavors

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test determines which "flavor" of RMA is created.

No errors

Passed Win_info test - win_info

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test creates an RMA info object, sets key/value pairs on the object, then duplicates the info object and confirms that the key/value pairs are in the same order as the original.

No errors

Passed MPI_Win_allocate_shared test - win_large_shm

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test MPI_WIN_ALLOCATE and MPI_WIN_ALLOCATE_SHARED when allocating SHM memory with size of 1GB per process.

No errors

Passed Win_shared_query test 1 - win_shared

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This simple test exercises the MPI_Win_shared_query().

2 -- size = 40000 baseptr = 0x3fffa81e0008 my_baseptr = 0x3fffa81f3888
3 -- size = 40000 baseptr = 0x3fff980f0008 my_baseptr = 0x3fff9810d4c8
0 -- size = 40000 baseptr = 0x3fff9c180008 my_baseptr = 0x3fff9c180008
1 -- size = 40000 baseptr = 0x3fffa8260008 my_baseptr = 0x3fffa8269c48
No errors

Passed Win_shared_query test 2 - win_shared_noncontig

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test exercises MPI_Win_shared_query().

No errors

Passed Win_shared_query test 3 - win_shared_noncontig_put

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

MPI_Put test with noncontiguous datatyes.

No errors

Passed Win_allocate_shared test - win_zero

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test MPI_WIN_ALLOCATE_SHARED when size of total shared memory region is 0.

No errors

Passed MCS_Mutex_trylock test - mutex_bench

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test exercises the MCS_Mutex_lock calls.

No errors

Passed MPI_Get_library_version test - library_version

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

MPI-3.0 Test returns MPI library version.

Open MPI v10.1.0, package: IBM Spectrum MPI, ident: IBM Spectrum MPI, repo rev: IBM_SPECTRUM_MPI_10.01.00.03_2017.02.16, Feb 27, 2017
No errors

Passed Comm_split test 4 - cmsplit_type

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test only checks that the MPI_Comm_split_type routine doesn't fail. It does not check for correct behavior.

No errors

Passed Comm_create_group test 2 - comm_create_group4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This routine creates/frees groups using different schemes.

No errors

Passed Comm_create_group test 3 - comm_create_group8

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

This routine creates/frees groups using different schemes.

No errors

Passed Comm_create_group test 4 - comm_group_half2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This routine creates/frees groups using different schemes.

No errors

Passed Comm_create_group test 5 - comm_group_half4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This routine creates/frees groups using different schemes.

No errors

Passed Comm_creation_group test 6 - comm_group_half8

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

This routine creates/frees groups using different schemes.

No errors

Passed Comm_create_group test 7 - comm_group_rand2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This routine creates/frees groups using even-odd pairs.

No errors

Passed Comm_create_group test 8 - comm_group_rand4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This routine create/frees groups using modulus 4 random numbers.

No errors

Passed Comm_create_group test 1 - comm_group_rand8

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

This test is create/frees groups using different schemes.

No errors

Passed Comm_idup test 1 - comm_idup2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test exercises MPI_Comm_idup().

No errors

Passed Comm_idup test 2 - comm_idup4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Test plan: Make rank 0 wait in a blocking recv until all other processes have posted their MPI_Comm_idup ops, then post last. Should ensure that idup doesn't block on the non-zero ranks, otherwise we'll get a deadlock.

No errors

Passed Comm_idup test 3 - comm_idup9

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 9

Test Description:

Test plan: Make rank 0 wait in a blocking recv until all other processes have posted their MPI_Comm_idup ops, then post last. Should ensure that idup doesn't block on the non-zero ranks, otherwise we'll get a deadlock.

No errors

Passed Comm_idup test 4 - comm_idup_mul

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test creating multiple communicators with MPI_Comm_idup.

No errors

Passed Comm_idup test 5 - comm_idup_overlap

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Each pair dups the communicator such that the dups are overlapping. If this were done with MPI_Comm_dup, this should deadlock.

No errors

Passed MPI_Info_create() test - comm_info

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 6

Test Description:

Comm_{set,get}_info test

No errors

Passed Comm_with_info() test 1 - dup_with_info2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test exercises MPI_Comm_dup_with_info().

No errors

Passed Comm_with_info test 2 - dup_with_info4

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test exercises MPI_Comm_dup_with_info().

No errors

Passed Comm_with_info test 3 - dup_with_info9

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 9

Test Description:

This test exercises MPI_Comm_dup_with_info().

No errors

Passed C++ datatype test - cxx-types

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test checks for the existence of four new C++ named predefined datatypes that should be accessible from C and Fortran.

No errors

Passed Datatype structs test - get-struct

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test was motivated by the failure of an example program for RMA involving simple operations on a struct that included a struct. The observed failure was a SEGV in the MPI_Get.

No errors

Passed Type_create_hindexed_block test 1 - hindexed_block

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Tests behavior with a hindexed_block that can be converted to a contig easily. This is specifically for coverage. Returns the number of errors encountered.

No errors

Passed Type_create_hindexed_block test 2 - hindexed_block_contents

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test is a simple check of MPI_Type_create_hindexed_block() using MPI_Type_get_envelope() and MPI_Type_get_contents().

No errors

Failed Large count test - large-count

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 1

Test Description:

This test checks for large count functionality ("MPI_Count") mandated by MPI-3, as well as behavior of corresponding pre-MPI-3 interfaces that have better defined behavior when an "int" quantity would overflow.

check failed: (elements == (2147483647)), line 227
check failed: (elements_x == (2147483647)), line 227
check failed: (count == 1), line 227
check failed: (elements == (2147483647)), line 227
check failed: (elements_x == (2147483647)), line 227
check failed: (count == 1), line 227
check failed: (elements == (4)), line 228
check failed: (elements_x == (4)), line 228
check failed: (count == 1), line 228
found 18 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[56053,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Passed Type_contiguous test - large_type

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test checks that MPI can handle large datatypes.

No errors

Passed MPI_Dist_graph_create test - distgraph1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test excercises MPI_Dist_graph_create() and MPI_Dist_graph_adjacent().

No errors

Passed MPI_Info_get() test 1 - infoenv

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This is a simple test of MPI_Info_get().

No errors

Passed MPI_Status large count test - big_count_status

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test manipulates an MPI status object using MPI_Status_set_elements_x() with a large count value.

No errors

Passed MPI_Mprobe() test - mprobe1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test MPI_Mprobe() to get the status of a pending receive, then calls MPI_Mrecv() with that status value.

No errors

Failed MPI_T calls test 1 - cvarwrite

Build: Failed

Execution: NA

Exit Status: Build_errors

MPI Processes: 1

Test Description:

This test writes to control variables exposed by MPI_T functionality of MPI_3.0.

Test Output: None.

Failed MPI_T calls test 2 - mpi_t_str

Build: Passed

Execution: Failed

Exit Status: Application_ended_with_error(s)

MPI Processes: 1

Test Description:

A test that MPI_T string handling is working as expected.

check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
check failed: ((strlen(desc) + 1) == min(desc_len, STR_SZ)), line 94
found 848 errors
-------------------------------------------------------
Primary job  terminated normally, but 1 process returned
a non-zero exit code.. Per user-direction, the job has been aborted.
-------------------------------------------------------
--------------------------------------------------------------------------
mpirun detected that one or more processes exited with non-zero status, thus causing
the job to be terminated. The first process to do so was:
  Process name: [[23192,1],0]
  Exit code:    1
--------------------------------------------------------------------------

Failed MPI_T calls test 3 - mpit_vars

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 1

Test Description:

To print out all MPI_T control variables, performance variables and their categories in the MPI implementation.

[cr1cn13:39136:0] Caught signal 11 (Segmentation fault)
==== backtrace ====
 2 0x0000000000073264 mxm_handle_error()  /var/tmp/OFED_topdir/BUILD/mxm-3.5.3093/src/mxm/util/debug/debug.c:641
 3 0x00000000000739a4 mxm_error_signal_handler()  /var/tmp/OFED_topdir/BUILD/mxm-3.5.3093/src/mxm/util/debug/debug.c:616
 4 0x00000000000c2dc4 MPI_T_cvar_read()  ??:0
 5 0x0000000010002eec PrintControlVars()  ??:0
 6 0x0000000010002c5c main()  ??:0
 7 0x0000000000024700 generic_start_main.isra.0()  libc-start.c:0
 8 0x00000000000248f4 __libc_start_main()  ??:0
===================
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Failed Thread/RMA interaction test - multirma

Build: Passed

Execution: Failed

Exit Status: Application_timed_out

MPI Processes: 2

Test Description:

This is a simple test of threads in MPI.

Test Output: None.

Passed Threaded group test - comm_create_group_threads

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

In this test a number of threads are created with a distinct MPI communicator (or comm) group distringuished by its thread-id (used as a tag). Threads on even ranks join an even comm and threads on odd ranks join the odd comm.

No errors

Passed Easy thread test 2 - comm_idup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a simple test of threads in MPI

No Errors

Passed Multiple threads test 1 - ctxdup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test creates communications concurrently in different threads.

No errors

Passed Multiple threads test 2 - ctxidup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test creates communications concurrently in different threads.

No errors

Failed MPIT multithreaded test - mpit_threading

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 1

Test Description:

This test is adapted from test/mpi/mpi_t/mpit_vars.c. But this is a multithreading version in which multiple threads will call MPI_T routines.

With verbose set, thread 0 will prints out MPI_T control variables, performance variables and their categories.

[cr1cn13:40789:0] Caught signal 11 (Segmentation fault)
==== backtrace ====
 2 0x0000000000073264 mxm_handle_error()  /var/tmp/OFED_topdir/BUILD/mxm-3.5.3093/src/mxm/util/debug/debug.c:641
 3 0x00000000000739a4 mxm_error_signal_handler()  /var/tmp/OFED_topdir/BUILD/mxm-3.5.3093/src/mxm/util/debug/debug.c:616
 4 0x00000000000c2dc4 MPI_T_cvar_read()  ??:0
 5 0x0000000010003068 PrintControlVars()  ??:0
 6 0x0000000010002bec RunTest()  ??:0
 7 0x0000000000008728 start_thread()  pthread_create.c:0
 8 0x000000000011d250 __clone()  ??:0
===================
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

MPI-2.2 - Score: 96% Passed

This group features tests that exercises MPI functionality of MPI-2.2 and earlier.

Passed Reduce_local test - reduce_local

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

A simple test of MPI_Reduce_local(). Uses MPI_SUM as well as user defined operators.

No errors

Passed Alloc_mem test - alloc

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks if MPI_Alloc_mem() is supported. If test passes, then the following is reported "MPI_Alloc_mem is supported." else, "MPI_Alloc_mem NOT supported" is reported.

No errors

Passed Communicator attributes test - attributes

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Returns all communicator attributes that are not supported. The test is run as a single process MPI job.

No errors

Passed Extended collectives test - collectives

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Checks if "extended collectives" are supported. If the test fails to compile, then "extended collectives" are not supported. If the test compiles, then a 4-process MPI job is executed. If the job aborts, then "Extended collectives NOT supported" is reported. If the job executes and the correct value is returned, then "Extended collectives ARE supported" is reported.

No errors

Passed Deprecated routines test - deprecated

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks all MPI deprecated routines as of MPI-2.2.

MPI_Address(): is functional.
MPI_Attr_delete(): is functional.
MPI_Attr_get(): is functional.
MPI_Attr_put(): is functional.
MPI_Errhandler_create(): is functional.
MPI_Errhandler_get(): is functional.
MPI_Errhandler_set(): is functional.
MPI_Keyval_create(): is functional.
MPI_Keyval_free(): is functional.
MPI_Type_extent(): is functional.
MPI_Type_hindexed(): is functional.
MPI_Type_hvector(): is functional.
MPI_Type_lb(): is functional.
MPI_Type_struct(): is functional.
MPI_Type_ub(): is functional.
No errors

Passed Dynamic process management test - dynamic

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks if the dynamic process management routines through MPI-2.2 are defined. If the test passes, then "No errors" is reported.

MPI_Comm_spawn(): verified
MPI_Comm_get_parrent(): verified
MPI_Open_port(): verified
MPI_Comm_accept(): verified
MPI_Comm_connect(): verified
MPI_Publish_name(): verified
MPI_Unpublish_name(): verified
MPI_Lookup_name(): verified
MPI_Comm_disconnect(): verified
MPI_Comm_join(): verified
Dynamic process management routines: verified
No errors

Passed Error Handling test - errors

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Reports the default action taken on an error. It also reports if error handling can be changed to "returns", and if so, if this functions properly.

MPI errors are fatal by default.
MPI errors can be changed to MPI_ERRORS_RETURN.
Call MPI_Send() with a bad destination rank.
Error code: 4
Error string: MPI_ERR_TAG: invalid tag
No errors

Passed Init argument test - init_args

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

In MPI-1.1, it is explicitly stated that an implementation is allowed to require that the arguments argc and argv passed by an application to MPI_Init in C be the same arguments passed into the application as the arguments to main. In MPI-2 implementations are not allowed to impose this requirement. Conforming implementations of MPI allow applications to pass NULL for both the argc and argv arguments of MPI_Init(). This test prints the result of the error status of MPI_Init(). If the test completes without error, it reports 'No errors.'

MPI_INIT accepts Null arguments for MPI_init().
No errors

Passed C/Fortran interoperability test - interoperability

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks if the C-Fortran (F77) interoperability functions are supported using MPI-2.2 specification.

No errors

Passed I/O modes test - io_modes

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks if all MPI predefined I/O modes are supported. If test passes, "No errors" is reported. Any modes not supported are indicated individually as not being supported.

MPI_MODE_APPEND:128
MPI_MODE_CREATE:1
MPI_MODE_DELETE_ON_CLOSE:16
MPI_MODE_EXCL:64
MPI_MODE_RDONLY:2
MPI_MODE_RDWR:8
MPI_MODE_SEQUENTIAL:256
MPI_MODE_UNIQUE_OPEN:32
MPI_MODE_WRONLY:4
No errors

Passed I/O verification test 1 - io_test

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Reports if MPI I/O is supported. If the MPI-I/O routines terminate normally and provide correct results, MPI-I/O reportes "No errors", otherwise error messages are generated.

rank:1/4 MPI-I/O is supported.
rank:3/4 MPI-I/O is supported.
rank:2/4 MPI-I/O is supported.
rank:0/4 MPI-I/O is supported.
No errors

Passed I/O verification test 2 - io_verify

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test is used to verify that the file created by io_test,c holds the correct values. If the test fails, the problem is reported. If all tests pass successfully it is reported that MPI-I/O is supported.

MPI-I/O: MPI_File_open() is verified.
MPI-I/O: MPI_File_read() is verified.
MPI-I/O: MPI_FILE_close() is verified.
No errors

Failed Master/slave test - master

Build: Passed

Execution: Failed

Exit Status: Failed with signal 11

MPI Processes: 1

Test Description:

This test running as a single MPI process spawns four slave processes using MPI_Comm_spawn(). The master process sends and receives a message from each slave. If the test completes, it will report 'No errors.', otherwise specific error messages are listed.

[cr1cn13:57691] *** Process received signal ***
[cr1cn13:57691] Signal: Segmentation fault (11)
[cr1cn13:57691] Signal code: Invalid permissions (2)
[cr1cn13:57691] Failing at address: 0x100020b4
[cr1cn13:57691] [ 0] [0x3fff8fc20478]
[cr1cn13:57691] [ 1] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_errmgr_default_app.so(+0x14a0)[0x3fff8f1e14a0]
[cr1cn13:57691] [ 2] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-rte.so.2(orte_errmgr_base_select+0x84)[0x3fff8f53a004]
[cr1cn13:57691] [ 3] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-rte.so.2(orte_ess_base_app_setup+0x854)[0x3fff8f53c2b4]
[cr1cn13:57691] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_ess_pmi.so(+0x3138)[0x3fff8f163138]
[cr1cn13:57691] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libopen-rte.so.2(orte_init+0x324)[0x3fff8f4fab34]
[cr1cn13:57691] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(ompi_mpi_init+0x47c)[0x3fff8fb2174c]
[cr1cn13:57691] [ 7] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Init+0x94)[0x3fff8fb4b454]
[cr1cn13:57691] [ 8] ./master[0x1000221c]
[cr1cn13:57691] [ 9] /lib64/libc.so.6(+0x24700)[0x3fff8f8a4700]
[cr1cn13:57691] [10] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff8f8a48f4]
[cr1cn13:57691] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node cr1cn13 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------

Passed MPI-2 Routines test 2 - mpi_2_functions_bcast

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test simply checks all MPI-2 routines that replaced some MPI-1 routines. Since these routines were added to avoid ambiquity with MPI-2 functionality, they do not add functionality to the test suite.

No errors

Passed MPI-2 routines test 1 - mpi_2_functions

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks all MPI-2.2 routines that replaced deprecated routines. If the test passes, then "No errors" is reported, otherwise, specific errors are reported."

errHandler() MPI_ERR_Other returned.
errHandler() MPI_ERR_Other returned.
errHandler() MPI_ERR_Other returned.
No errors

Passed One-sided fences test - one_sided_fences

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test Verifies that one-sided communication with active target synchronization with fences functions properly. If all operations succeed, one-sided communication with active target synchronization with fences is reported as supported. If one or more operations fail, the failures are reported and one-sided-communication with active target synchronization with fences is reported as NOT supported.

No errors

Passed One-sided communication test - one_sided_modes

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks MPI-2.2 one-sided communication modes reporting those that are not defined. If the test compiles, then "No errors" is reported, else, all undefined modes are reported as "not defined."

No errors

Passed One-sided passive test - one_sided_passive

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Verifies one-sided-communication with passive target synchronization functions properly. If all operations succeed, one-sided-communication with passive target synchronization is reported as supported. If one or more operations fail, the failures are reported and one-sided-communication with passive target synchronization with fences is reported as NOT supported.

No errors

Passed One-sided post test - one_sided_post

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Verifies one-sided-communication with active target synchronization with post/start/complete/wait functions properly. If all operations succeed, one-sided communication with active target synchronization with post/start/complete/wait is reported as supported. If one or more operations fail, the failures are reported and one-sided-communication with active target synchronization with post/start/complete/wait is reported as NOT supported.

No errors

Passed One-sided routines test - one_sided_routines

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Reports if one-sided communication routines are defined. If this test compiles, one-sided communication is reported as defined, otherwise "not supported".

No errors

Passed Thread support test - thread_safety

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Reports the level of thread support provided. This is either MPI_THREAD_SINGLE, MPI_THREAD_FUNNELED, MPI_THREAD_SERIALIZED, or MPI_THREAD_MULTIPLE.

MPI_THREAD_MULTIPLE requested.
MPI_THREAD_MULTIPLE is supported.
No errors

Passed Comm_create() test - iccreate

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

This program tests that MPI_Comm_create applies to intercommunicators. This is an extension added in MPI-2.

No errors

Passed Comm_split Test 1 - icsplit

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

This tests whether MPI_Comm_split() applies to intercommunicators which is an extension of MPI-2.

No errors

Passed MPI_Topo_test() test - dgraph_unwgt

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Specify a distributed graph of a bidirectional ring of the MPI_COMM_WORLD communicator. Thus each node in the graph has a left and right neighbor.

No errors

RMA - Score: 94% Passed

This group features tests that involve Remote Memory Access, sometimes called one-sided communication. Remote Memory Access is similar in fuctionality to shared memory access.

Passed Alloc_mem test - alloc

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks if MPI_Alloc_mem() is supported. If test passes, then the following is reported "MPI_Alloc_mem is supported." else, "MPI_Alloc_mem NOT supported" is reported.

No errors

Passed One-sided fences test - one_sided_fences

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test Verifies that one-sided communication with active target synchronization with fences functions properly. If all operations succeed, one-sided communication with active target synchronization with fences is reported as supported. If one or more operations fail, the failures are reported and one-sided-communication with active target synchronization with fences is reported as NOT supported.

No errors

Passed One-sided communication test - one_sided_modes

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Checks MPI-2.2 one-sided communication modes reporting those that are not defined. If the test compiles, then "No errors" is reported, else, all undefined modes are reported as "not defined."

No errors

Passed One-sided passive test - one_sided_passive

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Verifies one-sided-communication with passive target synchronization functions properly. If all operations succeed, one-sided-communication with passive target synchronization is reported as supported. If one or more operations fail, the failures are reported and one-sided-communication with passive target synchronization with fences is reported as NOT supported.

No errors

Passed One-sided post test - one_sided_post

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Verifies one-sided-communication with active target synchronization with post/start/complete/wait functions properly. If all operations succeed, one-sided communication with active target synchronization with post/start/complete/wait is reported as supported. If one or more operations fail, the failures are reported and one-sided-communication with active target synchronization with post/start/complete/wait is reported as NOT supported.

No errors

Passed One-sided routines test - one_sided_routines

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Reports if one-sided communication routines are defined. If this test compiles, one-sided communication is reported as defined, otherwise "not supported".

No errors

Failed Accumulate with fence test 1 - accfence1

Build: Passed

Execution: Failed

Exit Status: Failed with signal 6

MPI Processes: 4

Test Description:

This simple test of Accumulate/Replace with fence.

[cr1cn13:65531] *** Process received signal ***
[cr1cn13:65531] Signal: Aborted (6)
[cr1cn13:65531] Signal code:  (-6)
[cr1cn13:65531] [ 0] [0x3fff87160478]
[cr1cn13:65531] [ 1] /lib64/libc.so.6(abort+0x280)[0x3fff86e00d70]
[cr1cn13:65531] [ 2] /lib64/libc.so.6(+0x85784)[0x3fff86e45784]
[cr1cn13:65531] [ 3] /lib64/libc.so.6(cfree+0x44c)[0x3fff86e54dec]
[cr1cn13:65531] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_osc_pami.so(osc_pami_process_accumulate+0x28c)[0x3fff7f7f642c]
[cr1cn13:65531] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_osc_pami.so(pami_win_accum_cb+0x2d4)[0x3fff7f7f6af4]
[cr1cn13:65531] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/pami_port/libpami.so(_ZN4PAMI8Protocol4Send11EagerSimpleINS_6Device5Shmem11PacketModelINS3_11ShmemDeviceINS_4Fifo10LinearFifoINS7_10FifoPacketILj64ELj4096EEENS_7Counter8IndirectINSB_6NativeEEELj128EEESE_NS4_9CMAShaddrELj256ELj512EEEEELNS1_15configuration_tE1EE15dispatch_packedEPvSL_mSL_SL_+0x4c)[0x3fff7faeaebc]
[cr1cn13:65531] [ 7] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/pami_port/libpami.so(PAMI_Context_advancev+0x4ec)[0x3fff7fae714c]
[cr1cn13:65531] [ 8] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libcollectives.so(LIBCOLL_Advance+0x34)[0x3fff7f8cb3a4]
[cr1cn13:65531] [ 9] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_coll_ibm.so(mca_coll_ibm_barrier+0xe8)[0x3fff840968a8]
[cr1cn13:65531] [10] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_osc_pami.so(mca_osc_pami_fence+0x32c)[0x3fff7f7fc7fc]
[cr1cn13:65531] [11] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Win_fence+0x134)[0x3fff870a6344]
[cr1cn13:65531] [12] ./accfence1[0x10002270]
[cr1cn13:65531] [13] /lib64/libc.so.6(+0x24700)[0x3fff86de4700]
[cr1cn13:65531] [14] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fff86de48f4]
[cr1cn13:65531] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 3 with PID 0 on node cr1cn13 exited on signal 6 (Aborted).
--------------------------------------------------------------------------

Passed Accumulate with fence test 2 - accfence2_am

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Accumulate Fence. Test MPI_Accumulate with fence. This test is the same as accfence2 except that it uses alloc_mem() to allocate memory.

No errors

Passed Accumulate() with fence test 3 - accfence2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Accumulate Fence. Test MPI_Accumulate with fence. The test illustrates the use of the routines to run through a selection of communicators and datatypes. Use subsets of these for tests that do not involve combinations of communicators, datatypes, and counts of datatypes.

No errors

Passed Accumulate with Lock test - acc-loc

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Accumulate Lock. This test uses MAXLOC and MINLOC with MPI_Accumulate

No errors

Failed RMA post/start/complete/wait test - accpscw1

Build: Passed

Execution: Failed

Exit Status: Failed with signal 6

MPI Processes: 4

Test Description:

Accumulate Post-Start-Complete-Wait. This test uses accumulate/replace with post/start/complete/wait.

[cr1cn13:80183] *** Process received signal ***
[cr1cn13:80183] Signal: Aborted (6)
[cr1cn13:80183] Signal code:  (-6)
[cr1cn13:80183] [ 0] [0x3fffa1070478]
[cr1cn13:80183] [ 1] /lib64/libc.so.6(abort+0x280)[0x3fffa0d10d70]
[cr1cn13:80183] [ 2] /lib64/libc.so.6(+0x85784)[0x3fffa0d55784]
[cr1cn13:80183] [ 3] /lib64/libc.so.6(cfree+0x44c)[0x3fffa0d64dec]
[cr1cn13:80183] [ 4] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_osc_pami.so(osc_pami_process_accumulate+0x28c)[0x3fff9d70642c]
[cr1cn13:80183] [ 5] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_osc_pami.so(pami_win_accum_cb+0x2d4)[0x3fff9d706af4]
[cr1cn13:80183] [ 6] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/pami_port/libpami.so(_ZN4PAMI8Protocol4Send11EagerSimpleINS_6Device5Shmem11PacketModelINS3_11ShmemDeviceINS_4Fifo10LinearFifoINS7_10FifoPacketILj64ELj4096EEENS_7Counter8IndirectINSB_6NativeEEELj128EEESE_NS4_9CMAShaddrELj256ELj512EEEEELNS1_15configuration_tE1EE15dispatch_packedEPvSL_mSL_SL_+0x4c)[0x3fff9db2aebc]
[cr1cn13:80183] [ 7] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/pami_port/libpami.so(PAMI_Context_advance+0x49c)[0x3fff9db26b7c]
[cr1cn13:80183] [ 8] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/spectrum_mpi/mca_osc_pami.so(mca_osc_pami_wait+0x1b8)[0x3fff9d714f68]
[cr1cn13:80183] [ 9] /gpfs/pkgs/ibm/spectrum_mpi/10.1.0.3/lib/libmpi_ibm.so.2(MPI_Win_wait+0xb0)[0x3fffa0fba240]
[cr1cn13:80183] [10] ./accpscw1[0x10002498]
[cr1cn13:80183] [11] /lib64/libc.so.6(+0x24700)[0x3fffa0cf4700]
[cr1cn13:80183] [12] /lib64/libc.so.6(__libc_start_main+0xc4)[0x3fffa0cf48f4]
[cr1cn13:80183] *** End of error message ***
--------------------------------------------------------------------------
mpirun noticed that process rank 3 with PID 0 on node cr1cn13 exited on signal 6 (Aborted).
--------------------------------------------------------------------------

Passed ADLB mimic test - adlb_mimic1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 3

Test Description:

This test uses one server process (S), one target process (T) and a bunch of origin processes (O). 'O' PUTs (LOCK/PUT/UNLOCK) data to a distinct part of the window, and sends a message to 'S' once the UNLOCK has completed. The server forwards this message to 'T'. 'T' GETS the data from this buffer after it receives the message from 'S', to see if it contains the correct contents.

diagram showing communication steps between the S, O, and T processes
No errors

Passed Alloc_mem test - allocmem

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Allocate Memory. Simple test where MPI_Alloc_mem() and MPI_Free_mem() work together.

No errors

Passed Attributes order test - attrorderwin

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Test creating and inserting attributes in different orders to ensure the list management code handles all cases.

No errors

Passed RMA compliance test - badrma

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

The test uses various combinations of either zero size datatypes or zero size counts. All tests should pass to be compliant with the MPI-3.0 specification.

No errors

Passed RMA attributes test - baseattrwin

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This test creates a window, then extracts its attributes through a series of MPI calls.

No errors

Passed Compare_and_swap test - compare_and_swap

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This function compares one element of type datatype in the compare buffer compare_addr with the buffer at offset target_disp in the target window specified by target_rank and window. It replaces the value at the target with the value in the origin buffer if both buffers are identical. The original value at the target is returned in the result buffer.

No errors

Passed Contented Put test 2 - contention_put

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Contented RMA put test by James Dinan dinan@mcs.anl.gov. Each process issues COUNT put operations to non-overlapping locations on every other process.

No errors

Passed Contented Put test 1 - contention_putget

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Contented RMA put test by James Dinan dinan@mcs.anl.gov. Each process issues COUNT put and get operations to non-overlapping locations on every other process.

No errors

Passed Contiguous Get test - contig_displ

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

This program calls MPI_Get with an indexed datatype. The datatype comprises a single integer at an initial displacement of 1 integer. That is, the first integer in the array is to be skipped. This program found a bug in IBM's MPI in which MPI_Get ignored the displacement and got the first integer instead of the second. Run with one (1) process.

No errors

Failed Put() with fences test - epochtest

Build: Passed

Execution: Failed

Exit Status: Application_timed_out

MPI Processes: 4

Test Description:

Put with Fences used to seperate epochs. This test looks at the behavior of MPI_Win_fence and epochs. Each MPI_Win_fence may both begin and end both the exposure and access epochs. Thus, it is not necessary to use MPI_Win_fence in pairs.

The tests have the following form:

      Process A             Process B
        fence                 fence
        put,put
        fence                 fence
                              put,put
        fence                 fence
        put,put               put,put
        fence                 fence
      
Error class 13 (MPI_ERR_ARG: invalid argument of some other kind)

Passed RMA Shared Memory test - fence_shm

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This simple test uses MPI_Win_allocate_shared() with MPI_Win_fence(), MPI_Put() calls with assertions.

No errors

Passed Fetch_and_add test 2 - fetchandadd_am

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

MPI fetch and add test. Fetch and add example from Using MPI-2 (the non-scalable version,Fig. 6.12). This test is the same as rma/fetchandadd but uses alloc_mem.

No errors

Passed Fetch_and_add test 1 - fetchandadd

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

Fetch and add example from Using MPI-2 (the non-scalable version,Fig. 6.12).

No errors

Passed Fetch_and_add test 4 - fetchandadd_tree_am

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

This is the tree-based scalable version of the fetch-and-add example from Using MPI-2, pg 206-207. The code in the book (Fig 6.16) has bugs that are fixed in this test.

No errors

Passed Fetch_and_add test 3 - fetchandadd_tree

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 7

Test Description:

This is the tree-based scalable version of the fetch-and-add example from the book Using MPI-2, p. 206-207. This test is functionally attempting to perform an atomic read-modify-write sequence using MPI-2 one-sided operations.

No errors

Passed Fetch_and_op test - fetch_and_op

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a simple test that executes the MPI_Fetch_and op() calls on RMA windows.

No errors

Passed Keyvalue create/delete test - fkeyvalwin

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Free keyval window. Test freeing keyvals while still attached to an RMA windown, then make sure that the keyval delete code is still executed.

No errors

Passed Win_flush() test - flush

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Window Flush. This simple test flushes a shared window.

No errors

Passed Get_acculumate test 1 - get_acc_local

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 1

Test Description:

Get Accumalated Test. This is a simple test of MPI_Get_accumulate().

No errors

Passed Get_accumulate test 2 - get_accumulate

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Get Accumulate Test. This is a simple test of MPI_Get_accumulate().

No errors

Passed Get with fence test - getfence1

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Get with Fence. This is a simple test using MPI_Get() with fence.

No errors

Passed Win_get_group test - getgroup

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This is a simple test of MPI_Win_get_group().

No errors

Passed Parallel pi calculation test - ircpi

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test calculates pi by integrating the function 4/(1+x*x). It was converted from an interactive program to a batch program to facilitate it's use in the test suite.

Enter the number of intervals: (0 quits) 
Number if intervals used: 10
pi is approximately 3.1424259850010983, Error is 0.0008333314113051
Enter the number of intervals: (0 quits) 
Number if intervals used: 100
pi is approximately 3.1416009869231241, Error is 0.0000083333333309
Enter the number of intervals: (0 quits) 
Number if intervals used: 1000
pi is approximately 3.1415927369231254, Error is 0.0000000833333322
Enter the number of intervals: (0 quits) 
Number if intervals used: 10000
pi is approximately 3.1415926544231318, Error is 0.0000000008333387
Enter the number of intervals: (0 quits) 
Number if intervals used: 100000
pi is approximately 3.1415926535981016, Error is 0.0000000000083085
Enter the number of intervals: (0 quits) 
Number if intervals used: 1000000
pi is approximately 3.1415926535899388, Error is 0.0000000000001457
Enter the number of intervals: (0 quits) 
Number if intervals used: 10000000
pi is approximately 3.1415926535899850, Error is 0.0000000000001918
Enter the number of intervals: (0 quits) 
Number if intervals used: 0
No errors.

Passed Linked_list construction test 1 - linked_list_bench_lock_all

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Construct a distributed shared linked list using MPI-3 dynamic windows. Initially process 0 creates the head of the list, attaches it to the window, and broadcasts the pointer to all processes. Each process p then appends N new elements to the list when the tail reaches process p-1.

No errors

Passed Linked_list construction test 2 - linked_list_bench_lock_excl

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

MPI-3 distributed linked list construction example. Construct a distributed shared linked list using proposed MPI-3 dynamic windows. Initially process 0 creates the head of the list, attaches it to the window, and broadcasts the pointer to all processes. Each process "p" then appends N new elements to the list when the tail reaches process "p-1". The test uses the MPI_LOCK_EXCLUSIVE argument with MPI_Win_lock().

No errors

Passed Linked-list construction test 3 - linked_list_bench_lock_shr

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test constructs a distributed shared linked list using MPI-3 dynamic windows. Initially process 0 creates the head of the list, attaches it to the window, and broadcasts the pointer to all processes. Each process "p" then appends N new elements to the list when the tail reaches process "p-1". This test is similar to "rma/linked_list_bench_lock_excl" but uses an MPI_LOCK_SHARED parameter to MPI_Win_Lock().

No errors

Passed Linked_list construction test 4 - linked_list

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test constructs a distributed shared linked list using MPI-3 dynamic windows. Initially process 0 creates the head of the list, attaches it to an RMA window, and broadcasts the pointer to all processes. All processes then concurrently append N new elements to the list. When a process attempts to attach its element to the tail of list it may discover that its tail pointer is stale and it must chase ahead to the new tail before the element can be attached.

No errors

Passed Linked list construction test 5 - linked_list_fop

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

This test constructs a distributed shared linked list using MPI-3 dynamic windows. Initially process 0 creates the head of the list, attaches it to the window, and broadcasts the pointer to all processes. All processes then concurrently append N new elements to the list. When a process attempts to attach its element to the tail of list it may discover that its tail pointer is stale and it must chase ahead to the new tail before the element can be attached.

No errors

Passed Linked list construction test 6 - linked_list_lockall

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 4

Test Description:

Construct a distributed shared linked list using MPI-3 dynamic RMA windows. Initially process 0 creates the head of the list, attaches it to the window, and broadcasts the pointer to all processes. All processes then concurrently append N new elements to the list. When a process attempts to attach its element to the tail of list it may discover that its tail pointer is stale and it must chase ahead to the new tail before the element can be attached. This version of the test suite uses MPI_Win_lock_all() instead of MPI_Win_lock(MPI_LOCK_EXCLUSIVE, ...).

No errors

Passed RMA contention test 1 - lockcontention2

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

Test for lock contention. Tests for lock contention, including special cases within the MPI implementation; in this case, our coverage analysis showed that the lockcontention test was not covering all cases, and in fact, this test revealed a bug in the code). In all of these tests, each process writes (or accesses) the values rank + i*size_of_world for NELM times. This test strives to avoid operations not strictly permitted by MPI RMA, for example, it doesn't target the same locations with multiple put/get calls in the same access epoch.

No errors

Passed RMA contention test 2 - lockcontention3

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 8

Test Description:

Additional test for lock contention. Additional tests for lock contention. These are designed to exercise some of the optimizations within MPICH, but all are valid MPI programs. Tests structure includes:

lock local (must happen at this time since application can use load store after thelock)
send message to partner

receive message
send ack

receive ack
Provide a delay so that the partner will see the conflict

partner executes:
lock // Note: this may block rma operations (see below)
unlock
send back to partner

unlock
receive from partner
check for correct data

The delay may be implemented as a ring of message communication; this is likely to automatically scale the time to what is needed.

No errors

Passed RMA contention test 3 - lockcontention

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 3

Test Description:

This is a modified version of rma/test4. Submitted by Liwei Peng, Microsoft. tests passive target RMA on 3 processes. Tests the lock-single_op-unlock optimization.

No errors

Passed Locks with no RMA ops test - locknull

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

This test creates a window, clears the memory in it using memset(), locks and unlocks it, then terminates.

No errors

Passed Lock-single_op-unlock test - lockopts

Build: Passed

Execution: Passed

Exit Status: Execution_completed_no_errors

MPI Processes: 2

Test Description:

Test passive target RMA on 2 processes wtih the original datatype derived from