UPC Run-Time Error Detection Test Suite v1.1 Release Notes Aug. 4, 2011 Purpose: -------- Programmer productivity can be enhanced greatly by a system with the ability to detect run-time errors when they occur and provide helpful messages. The worst case is when the error could have been detected but wasn't, and the program keeps running and produces incorrect output. These tests were created to test the ability of a compiler and run-time system to detect run-time errors and to provide adequate information to correct the error. Design: ------- Runtime errors which should be detected by the run-time system were identified for Unified Parallel C. These errors were grouped into sections, and tests were written which exhibited the given errors in different contexts. A Bourne shell script named run_all_tests was written which 1) runs all the tests in a language, 2) checks each test for a pass at 5 levels A through E, 3) reports the number of passes at each level for each section, and 4) produces a grade for that language based on a five point scale E=1, A=5. "Ideal" messages are provided (with extension .ok_msgs) to provide an example of the desired message for a pass at the A level. Download: --------- Test are available in either .tar.gz or .tar format at: http://rted.public.iastate.edu/UPC/tests.html Running: -------- After download, issue either tar -zxf RTED_UPC.tar.gz or tar -xf RTED_UPC.tar as appropriate to get a directory named RTED_UPC. In RTED_UPC, go to the appropriate language directory and edit the file called CONFIGURATION. Several examples are included which can be copied and edited as needed. Issue : ./run_all_tests This may take several minutes to several hours depending upon the system. Examining output from a test: ----------------------------- Actual error messages for a UPC/section/test are stored in UPC/section/RESULTS/testname.error and a sample of a desired message is in UPC/section/RESULTS/testname.ok_msgs. These can be shown easily by issuing: (cd UPC/section/ ; ../chk testname) Version Information: --------------------- This is the initial version 1.1 released Aug. 4, 2011