Serial Run-Time Error Detection Test Suite v1.1 Release Notes Oct 17, 2005 Purpose: -------- Programmer productivity can be enhanced greatly by a system with the ability to detect run-time errors when they occur and provide helpful messages. The worst case is when the error could have been detected but wasn't, and the program keeps running and produces incorrect output. These tests were created to test the ability of a compiler and run-time system to detect run-time errors and to provide adequate information to correct the error. Design: ------- Runtime errors which should be detected by the run-time system were identified for each of the three languages C, C++ and Fortran. For each language, these errors were grouped into sections, and tests were written which exhibited the given errors in different contexts. A Bourne shell script named run_all_tests was written which 1) runs all the tests in a language, 2) checks each test for a pass at 4 levels A through D, 3) reports the number of passes at each level for each section, and 4) produces a grade for that language based on a four point scale D=1, A=4. "Ideal" messages are provided (with extension .ok_msgs) to provide an example of the desired message for a pass at the A level. Download: --------- Test are available in either .tar.gz or .tar format at: http://rted.public.iastate.edu/tests.html Version 1.0 has been moved to http://rted.public.iastate.edu/v1.0 Running: -------- After download, issue either tar -zxf RTED.tar.gz or tar -xf RTED.tar as appropriate to get a directory named RTED. In RTED, go to the appropriate language directory and edit the file called CONFIGURATION. Several examples are included which can be copied and edited as needed. Issue : ./run_all_tests This may take several minutes to several hours depending upon the system. Examining output from a test: ----------------------------- Actual error messages for a language/section/test are stored in language/section/RESULTS/testname.error and a sample of a desired message is in language/section/RESULTS/testname.ok_msgs. These can be shown easily by issuing: (cd language/section/ ; ../chk testname) Version Information: --------------------- This is version 1.1 released Oct 17, 2005. The initial release, version 1.0, was released Sept 2, 2005.