|
DataMuseum.dkPresents historical artifacts from the history of: Rational R1000/400 |
This is an automatic "excavation" of a thematic subset of
See our Wiki for more about Rational R1000/400 Excavated with: AutoArchaeologist - Free & Open Source Software. |
top - metrics - download
Length: 45490 (0xb1b2)
Types: TextFile
Notes: R1k Text-file segment
└─⟦8527c1e9b⟧ Bits:30000544 8mm tape, Rational 1000, Arrival backup of disks in PAM's R1000
└─⟦cfc2e13cd⟧ »Space Info Vol 2«
└─⟦a78d60d4f⟧
└─⟦this⟧
Rational TestMate
Release Information
Rev2_2_0 Release
\f
Copyright 1992 by Rational
Part Number: 508-003286-004
October 1992 (Software Release Rev2_2_0)
Rational and R1000 are registered trademarks and Compilation
Integrator, Rational Environment, Rational Subsystems, and
Universal Compiler Integration are trademarks of Rational.
Rational
3320 Scott Boulevard
Santa Clara, California 95054-3197
\f
Rev2_2_0 Release
1. Overview
This note documents the Rev2_2_0 release of Rational TestMate.
TestMate is a comprehensive set of tools that automates the
process of developing, performing, and evaluating software tests.
TestMate includes a test management system and a non-intrusive
coverage analyzer, both tightly integrated with the Rational
Environment.
This release has been verified to work under Environment releases
D_12_5_0 and D_12_6_5.
1.1. Components of This Release
This release includes the following:
* !TOOLS.TEST.TESTMATE.REV2_2_SPEC
* !TOOLS.TEST.TESTMATE.CODE2_2_0
* !TOOLS.TEST.TESTMATE_TOOLS.REV2_2_SPEC
* !TOOLS.TEST.TESTMATE_TOOLS.CODE2_2_0
* !MACHINE.INITIALIZATION.RATIONAL.TESTMATE_START
* !MODEL.TESTMATE
2. New Features
2.1. Procedure Setup_Rci_Tms
TestMate now supplies a procedure, Setup_Rci_Tms, that is used to
create the RCI TMS package. This package is used by RCI tests to
signal target test results back to the R1000. Any RCI tests that
call package TMS must have this package coded in the RCI world.
Setup_Rci_Tms works by parsing the text file "TMS", which is
included with each code view, into an RCI world. It accepts a
single parameter that identifies the world in which the TMS
package is to be created:
procedure Setup_Rci_Tms (In_Library : String := "$");
2.2. Formatted Closure Report
A sample routine to examine the .Closure subobject of a specified
test run file and generate a formatted report can be found in the
"Tools" directory of the TestMate code view. This routine, named
"Print_Closure", is supplied in source form.
RATIONAL October 1992 1\f
Rational TestMate Release Information
The Print_Closure routine can be used as an example of how a
user-written routine would access the information in the .Closure
file, and as an example of how the programmatic interfaces to
TestMate data can be used.
3. Limitations
3.1. General
3.1.1. Copying, Moving, or Renaming Test Data
The Test_Run files have full path names to all associated files -
such as logs, scripts, etc. - to enable resolution at a later
time independent of the current Test_Context settings. If any of
these associated files are moved, the Test_Run references must be
updated. These references can be easily updated by executing the
Update_Test_Run_References procedure (found in the Tools
subdirectory of the TestMate subsystem). Pass to
Update_Test_Run_References the name of the test run file and the
name of a new test context file that indicates where the relative
files are now located.
3.1.2. Temporary Files
When the user executes Edit_Run_Group and does not specify a
group name, a temporary file is created in !Machine.Temporary.
These files are not currently deleted by TestMate, although they
will be removed when the R1000 is next rebooted. Due to the fact
that these temporary files are quite small, this is not expected
to pose any real problem.
3.2. Editors
3.2.1. Test Case used Multiple Times in Test Set
A Test_Set cannot include multiple Test_Cases with the same
simple name. The current product does not detect this condition.
3.2.2. Applying Multiple Filters with a Single Command
The Testmate.Filter command must be used exactly as specified in
the User's Guide; the command will only use the first item if
multiple filters are specified. Thus, for "status => pass,fail",
only "pass" will be applied.
2 October 1992 RATIONAL\f
Rev2_2_0 Release
3.2.3. Editing Test Sets Containing Deleted Test Cases
The test-set editor does not remove from a test set those test
cases whose test-case files have been deleted (using
Library.Delete, for example). It is up to the user to manually
delete these cases from the set.
3.3. Scripts
3.3.1. Consistency Checking At Script Generation
TestMate does not check test sets and their constituent test
cases for consistency at script generation. Consistency is
checked at script execution, however. If the script's test cases
are "compatible" with the test cases that were used to generate
the script, the test script will execute correctly. Refer to the
"Ensuring Test Set Consistency" section in Chapter 2 of the
TestMate User's Manual for more information.
3.4. Coverage Analyzer
3.4.1. Coverage of Library Elaboration Code
The coverage analyzer does not gather coverage data for library
package elaboration unless the subject program uses pragma Main.
3.4.2. Code View and Coverage Analyzer
The Coverage Analyzer uses debug information for each unit in
order to operate in a non-intrusive manner. Code Views do not
contain debugging information, so the Coverage_Analyzer is unable
to gather coverage data for units inside of a code view.
4. Known Problems
4.1. General
4.1.1. Version Information and Code Views
Version information is not saved for units that are located
inside code views.
RATIONAL October 1992 3\f
Rational TestMate Release Information
4.2. Coverage Analyzer
4.2.1. Decision Coverage
Under certain, not yet well-defined circumstances, specifying the
collection of decision coverage data can cause the test to hang
or give incorrect results. When the particular criteria have
been fully characterized, a note will be sent to all customers
indicating under which circumstances decision coverage can safely
be used. Until then, usage of the decision coverage mode is not
recommended.
4.2.2. Null Case Statement Arms
Null case arms do not have code generated for them; therefore,
the Coverage Analyzer cannot detect segment coverage in those
arms. Null arms are not counted as missed segments. This can
result in 100% decision coverage being indicated when, in fact,
one or more null case arms were not exercised.
This is expected to be fixed in a later release.
4.2.3. Very Large Units
A sufficiently large unit (in excess of 32,000 executable R1000
instructions) will cause problems for the Coverage Analyzer due
to an inability to properly handle multiple code segment debug
table information. The Coverage Analyzer will issue a log
message and not process that unit. This should be a very rare
event as Ada units requiring multiple code segments must be very
large.
4.2.4. Multiple Subject Programs
If a test case specifies multiple subject programs, and the
Coverage_Analyzer_Params field in that test case is set to ""
(the default), the coverage analyzer will not collect coverage
data for all of the specified subject programs.
This problem can be worked around by explicitly specifying the
subject program names in the Coverage_Analyzer_Params field of
the test case. Note that the subject programs can be specified
using relative pathnames.
4 October 1992 RATIONAL\f
Rev2_2_0 Release
4.2.5. Specific Routine Within a Unit
If a test case specifies as its subject program a routine in a
particular unit ("sppkg.foo_proc", for instance), and the
Coverage_Analyzer_Params field in that test case is set to ""
(the default), the coverage analyzer will not correctly collect
coverage data for the specified routine.
This problem can be worked around by specifying the package name
in the Coverage_Analyzer_Params field of the test case.
4.3. Editors
4.3.1. Coverage Editor and Missed Segments
When the user does a [Definition] to view the missed segments for
an Ada unit, the Editor brings up that Ada unit and marks the
segments. If there are no missed segments, the Editor provides a
warning message to that effect and brings up the Ada editor.
Under certain complex circumstances involving the viewing of
coverage data for multiple test runs, the Ada editor fails to
come up properly. This only occurs for 100% covered units, and
the warning message is still properly posted.
4.3.2. Test Run Group Editor
The following sequence of events can result in an incorrect
editor image:
* Invoke the test run editor for a group of test runs
* Expand the image
* Place the cursor after the text on one of the expanded rows
(such as the test run log row) and press [Definition]. As
expected, an error message will be generated indicating that
[Definition] is not supported for this column.
* Expand the image once again.
The two title rows as well as the test run rows will all be
erased, leaving only the expanded rows.
To regain the proper image, abandon the current image and
re-execute the command used to invoke the test run editor.
RATIONAL October 1992 5\f
Rational TestMate Release Information
5. Errors
This section documents areas in TestMate where potentially
unclear or confusing error messages may arise.
5.1. General
5.1.1. Format of Persistent Objects
If the format for the textually-manipulated persistent objects
(Test_Context, Script_Construction_Control, and
Script_Execution_Control) is not followed explicitly, data layout
errors can occur. In particular, something like:
xx =>
....long name.....
will fail. The correct form is:
xx => ....long name...
An alternative form is:
xx => (
.......long name ....)
Data layout errors do not supply a detailed explanation of the
failure mode. The user will have to look at the file for
details. Note that the most common mistake is a misspelling of
one of the field identifiers.
5.2. Scripts
5.2.1. Connected and Separate Job Run Modes
If the user is running a test case with run mode set to
Separate_Job or Connected_Job, a job command is created which
must be parsed by the Environment and then executed. That
command can fail to execute for a number of reasons; TestMate
will post the entire command to the log. It is up to the user to
figure out why the command failed. This is usually done by
running the user's part of the job command string from the error
log. If that succeeds, check for missing links to the TestMate
units mentioned in the job command: the links may not be
available from the specified execution context.
Another common failure is due to the number of parameters being
incorrect either in type or number.
6 October 1992 RATIONAL\f
Rev2_2_0 Release
5.2.2. Test Drivers and Package TMS
If a test driver directly references package TMS using default
values (i.e., makes reference to the current test case or test
run), then running that driver outside of the script will cause
an exception instead of a more graceful error message.
6. Documentation
This product has been documented in the TestMate User's Guide,
product #4000-00720, dated November 1992.
6.1. Links to TestMate Packages From Worlds
The TestMate User's Guide shows how to add links to the TestMate
packages and how to update your activity to specify the correct
views. The discussion for Worlds, however, lists these
operations in the wrong order (see the bottom of page 4). Your
activity should be updated before you establish links to a
TestMate world. Otherwise, the Links.Add command will use what
it finds in your default activity (and it will fail if it doesn't
find entries for TestMate and TestMate tools).
6.2. Specifying Testmate_Tools
Pages 4 and 5 of the TestMate User's Guide specify that the
following entries must appear in your activity:
Subsystem Spec View Load View
Context
============== =============== =======================
============
TESTMATE Rev2_n_SPEC CODE2_0_m
!TOOLS.TEST
TESTMATE_TOOLS Rev0_0_n_SPEC CODE0_0_m
!TOOLS.TEST
For this release, this should read:
Subsystem Spec View Load View
Context
============== =============== =======================
============
TESTMATE Rev2_2_SPEC CODE2_2_0
!TOOLS.TEST
TESTMATE_TOOLS Rev2_2_SPEC CODE2_2_0
!TOOLS.TEST
RATIONAL October 1992 7\f
Rational TestMate Release Information
The "Subsystems" section on page 5 also discusses the importing
of the Testmate and Testmate_Tools specs; the correct specs to
import are:
!TOOLS.TEST.TESTMATE.REV2_2_SPEC
!TOOLS.TEST.TESTMATE_TOOLS.REV2_2_SPEC
7. Training
TestMate training is available; the current draft is dated
November, 1992. TestMate training is identified by product
#7000-00720.
8 October 1992 RATIONAL\f
Rev2_2_0 Release
Contents
1. Overview 1
1.1. Components of This Release 1
2. New Features 1
2.1. Procedure Setup_Rci_Tms 1
2.2. Formatted Closure Report 1
3. Limitations 2
3.1. General 2
3.1.1. Copying, Moving, or Renaming Test Data 2
3.1.2. Temporary Files 2
3.2. Editors 2
3.2.1. Test Case used Multiple Times in Test Set 2
3.2.2. Applying Multiple Filters with a Single Command 2
3.2.3. Editing Test Sets Containing Deleted Test Cases 3
3.3. Scripts 3
3.3.1. Consistency Checking At Script Generation 3
3.4. Coverage Analyzer 3
3.4.1. Coverage of Library Elaboration Code 3
3.4.2. Code View and Coverage Analyzer 3
4. Known Problems 3
4.1. General 3
4.1.1. Version Information and Code Views 3
4.2. Coverage Analyzer 4
4.2.1. Decision Coverage 4
4.2.2. Null Case Statement Arms 4
4.2.3. Very Large Units 4
4.2.4. Multiple Subject Programs 4
4.2.5. Specific Routine Within a Unit 5
4.3. Editors 5
4.3.1. Coverage Editor and Missed Segments 5
4.3.2. Test Run Group Editor 5
5. Errors 6
5.1. General 6
5.1.1. Format of Persistent Objects 6
5.2. Scripts 6
5.2.1. Connected and Separate Job Run Modes 6
5.2.2. Test Drivers and Package TMS 7
6. Documentation 7
6.1. Links to TestMate Packages From Worlds 7
6.2. Specifying Testmate_Tools 7
7. Training 8
RATIONAL October 1992 iii\f
Rational TestMate Release Information
iv October 1992 RATIONAL\f
%!PS-Adobe-2.0
%%Title: !DOCUMENTATION.RELEASE_NOTES.TESTMATE.DEVEL_WORKING.UNITS.TESTMATE_2_2_0'V(35)
%%Creator: COMPOSE 10.7.12
%%CreationDate: November 4, 1992 at 9:35:44 AM
%%For: GREGW
%%Pages: (atend)
%%DocumentFonts: (atend)
%%EndComments
/SelectFont {findfont exch dup neg 0 0 3 -1 roll 0 0 MAT astore makefont setfont} bind def
/BeginPage {/State save def /INITIAL-MATRIX matrix currentmatrix def 1 -1 scale 0.5 setlinewidth} bind def
/PositionPage {{-90 rotate pop} {0 exch neg translate} ifelse} bind def
/EndPage {State restore showpage} def
/WS {0 32 4 -1 roll widthshow} bind def
/MX {0 rmoveto} bind def
/LTAB {gsave exch (.) stringwidth pop sub exch {dup 2 div dup 0 rmoveto (.) show 0 rmoveto} repeat pop grestore} bind def
/MAT matrix def
/FINDSCALE {gsave newpath 0 0 moveto (X) false charpath
flattenpath pathbbox /CAPHEIGHT exch def pop pop pop newpath 0 0 moveto
(x) false charpath flattenpath pathbbox /XHEIGHT exch def pop pop pop
grestore XHEIGHT CAPHEIGHT XHEIGHT sub 3 div add CAPHEIGHT div } bind def
/CAP-ENCODING [ StandardEncoding aload pop ] def
8#141 1 8#172 {CAP-ENCODING exch dup 1 string dup 0 4 -1 roll 8#40 sub put cvn put} for
/COPYFONT {dup length dict /TMPDICT exch def {1 index /FID ne {TMPDICT 3 1 roll put} {pop pop} ifelse } forall TMPDICT }bind def
/SYM {save exch /newfont currentfont maxlength dict def currentfont
{exch dup /FID ne {dup /Encoding eq {exch dup length array copy newfont 3 1 roll put}
{exch newfont 3 1 roll put} ifelse } {pop pop} ifelse} forall
newfont /Encoding get 8#377 3 -1 roll put /NEWFONT newfont definefont setfont
(\377) show restore} bind def
%%EndProlog
%%Page: 1 1
BeginPage
792 false PositionPage
72 72 moveto
20 /Palatino-Roman SelectFont
( ) show
225.530 328 moveto
(Rational TestMate) show
217.090 350 moveto
(Release Information) show
228.180 394 moveto
(Rev2_2_0 Release) show
72 756 moveto
10 /Palatino-Roman SelectFont
( ) show
EndPage
%%Page: 2 2
BeginPage
792 false PositionPage
72 72 moveto
10 /Palatino-Roman SelectFont
( ) show
72 144 moveto
(Copyright ) show
/copyright SYM 7.470 MX
( 1992 by Rational) show
72 192 moveto
(Part Number: 508-003286-004) show
72 216 moveto
(October 1992 \050Software Release Rev2_2_0\051) show
72 600 moveto
9 /Palatino-Roman SelectFont
(Rational and) 3.974 WS
6.223 MX
(R1000 are registered trademarks and Compilation Integrator, Rational Environment, Rational) 3.973 WS
72 611 moveto
(Subsystems, and Universal Compiler Integration are trademarks of Rational.) show
287.480 671 moveto
10 /Palatino-Roman SelectFont
(Rational) show
259.660 683 moveto
(3320 Scott Boulevard) show
229.255 695 moveto
(Santa Clara, California 95054-3197) show
72 756 moveto
( ) show
EndPage
%%Page: 1 3
BeginPage
792 false PositionPage
72 36 moveto
10 /Palatino-Roman SelectFont
390.180 MX
(Rev2_2_0 Release) show
72 76 moveto
15 /Palatino-Bold SelectFont
(1. Overview) show
72 100 moveto
11 /Palatino-Roman SelectFont
(This note documents the Rev2_2_0 release) 1.076 WS
3.827 MX
(of Rational TestMate. TestMate is a comprehensive) 1.077 WS
72 113 moveto
(set of tools that automates the process of developing, performing, and evaluating) 0.119 WS
2.868 MX
(software tests.) 0.118 WS
72 126 moveto
(TestMate includes a test management system and) 2.844 WS
5.595 MX
(a non-intrusive coverage analyzer, both) 2.845 WS
72 139 moveto
(tightly integrated with the Rational Environment.) show
72 163 moveto
(This release has been verified to work under Environment releases D_12_5_0 and D_12_6_5.) show
72 201 moveto
13 /Palatino-Bold SelectFont
(1.1. Components of This Release) show
72 225 moveto
11 /Palatino-Roman SelectFont
(This release includes the following:) show
72 249 moveto
0 -1.100 rmoveto
6 /ZapfDingbats SelectFont
(n) show
11 /Palatino-Roman SelectFont
0 1.100 rmoveto
19.434 MX
(!TOOLS.TEST.TESTMATE.REV2_2_SPEC) show
72 267 moveto
0 -1.100 rmoveto
6 /ZapfDingbats SelectFont
(n) show
11 /Palatino-Roman SelectFont
0 1.100 rmoveto
19.434 MX
(!TOOLS.TEST.TESTMATE.CODE2_2_0) show
72 285 moveto
0 -1.100 rmoveto
6 /ZapfDingbats SelectFont
(n) show
11 /Palatino-Roman SelectFont
0 1.100 rmoveto
19.434 MX
(!TOOLS.TEST.TESTMATE_TOOLS.REV2_2_SPEC) show
72 303 moveto
0 -1.100 rmoveto
6 /ZapfDingbats SelectFont
(n) show
11 /Palatino-Roman SelectFont
0 1.100 rmoveto
19.434 MX
(!TOOLS.TEST.TESTMATE_TOOLS.CODE2_2_0) show
72 321 moveto
0 -1.100 rmoveto
6 /ZapfDingbats SelectFont
(n) show
11 /Palatino-Roman SelectFont
0 1.100 rmoveto
19.434 MX
(!MACHINE.INITIALIZATION.RATIONAL.TESTMATE_START) show
72 339 moveto
0 -1.100 rmoveto
6 /ZapfDingbats SelectFont
(n) show
11 /Palatino-Roman SelectFont
0 1.100 rmoveto
19.434 MX
(!MODEL.TESTMATE) show
72 379 moveto
15 /Palatino-Bold SelectFont
(2. New Features) show
72 417 moveto
13 /Palatino-Bold SelectFont
(2.1. Procedure Setup_Rci_Tms) show
72 441 moveto
11 /Palatino-Roman SelectFont
(TestMate now supplies a procedure, Setup_Rci_Tms, that is used to create the RCI TMS) 3.275 WS
72 454 moveto
(package. This package is used by RCI tests to signal target test results back to the) 0.963 WS
3.714 MX
(R1000. Any) 0.964 WS
72 467 moveto
(RCI tests that call package TMS must have this package coded in the RCI world.) show
72 491 moveto
(Setup_Rci_Tms works by parsing the text) 1.035 WS
3.784 MX
(file \252TMS\272, which is included with each code view,) 1.034 WS
72 504 moveto
(into an RCI world. It) 1.741 WS
4.492 MX
(accepts a single parameter that identifies the world in which the TMS) 1.742 WS
72 517 moveto
(package is to be created:) show
108 541 moveto
9 /Courier SelectFont
( procedure Setup_Rci_Tms \050In_Library : String := "$"\051;) show
72 579 moveto
13 /Palatino-Bold SelectFont
(2.2. Formatted Closure Report) show
72 603 moveto
11 /Palatino-Roman SelectFont
(A sample routine to examine the .Closure subobject of a specified test run) 1.148 WS
3.897 MX
(file and generate a) 1.147 WS
72 616 moveto
(formatted report can be found in the "Tools" directory of) 0.525 WS
3.276 MX
(the TestMate code view. This routine,) 0.526 WS
72 629 moveto
(named "Print_Closure", is supplied in source form.) show
72 653 moveto
(The Print_Closure routine can be used as an example) 2.090 WS
4.839 MX
(of how a user-written routine would) 2.089 WS
72 666 moveto
(access the information in the .Closure file, and as an example of how the programmatic) 3.199 WS
72 679 moveto
(interfaces to TestMate data can be used.) show
72 756 moveto
17 /AvantGarde-Book SelectFont
(RATIONAL) show
10 /Palatino-Roman SelectFont
( October 1992) show
310.940 MX
(1) show
EndPage
%%Page: 2 4
BeginPage
792 false PositionPage
72 36 moveto
10 /Palatino-Roman SelectFont
(Rational TestMate Release Information) show
72 76 moveto
15 /Palatino-Bold SelectFont
(3. Limitations) show
72 114 moveto
13 /Palatino-Bold SelectFont
(3.1. General) show
72 151 moveto
12 /Palatino-Bold SelectFont
(3.1.1. Copying, Moving, or Renaming Test Data) show
72 175 moveto
11 /Palatino-Roman SelectFont
(The Test_Run) 1.397 WS
4.146 MX
(files have full path names to all associated files - such as logs, scripts, etc. - to) 1.396 WS
72 188 moveto
(enable resolution at) 0.042 WS
2.793 MX
(a later time independent of the current Test_Context settings. If any of these) 0.043 WS
72 201 moveto
(associated files are moved, the Test_Run references) 1.084 WS
3.833 MX
(must be updated. These references can be) 1.083 WS
72 214 moveto
(easily updated by executing the Update_Test_Run_References procedure \050found) 1.659 WS
4.410 MX
(in the Tools) 1.660 WS
72 227 moveto
(subdirectory of the TestMate subsystem\051. Pass) 0.386 WS
3.135 MX
(to Update_Test_Run_References the name of the) 0.385 WS
72 240 moveto
(test run file and the name of a new test context file that indicates where the relative files) 1.341 WS
4.092 MX
(are) show
72 253 moveto
(now located.) show
72 290 moveto
12 /Palatino-Bold SelectFont
(3.1.2. Temporary Files) show
72 314 moveto
11 /Palatino-Roman SelectFont
(When the user executes Edit_Run_Group and does not specify a group name, a) 0.754 WS
3.503 MX
(temporary file) 0.753 WS
72 327 moveto
(is created in !Machine.Temporary. These files are not currently deleted by TestMate, although) 1.050 WS
72 340 moveto
(they will be removed when the R1000 is) 0.052 WS
2.801 MX
(next rebooted. Due to the fact that these temporary files) 0.051 WS
72 353 moveto
(are quite small, this is not expected to pose any real problem.) show
72 391 moveto
13 /Palatino-Bold SelectFont
(3.2. Editors) show
72 428 moveto
12 /Palatino-Bold SelectFont
(3.2.1. Test Case used Multiple Times in Test Set) show
72 452 moveto
11 /Palatino-Roman SelectFont
(A Test_Set cannot include multiple) 0.108 WS
2.859 MX
(Test_Cases with the same simple name. The current product) 0.109 WS
72 465 moveto
(does not detect this condition.) show
72 502 moveto
12 /Palatino-Bold SelectFont
(3.2.2. Applying Multiple Filters with a Single Command) show
72 526 moveto
11 /Palatino-Roman SelectFont
(The Testmate.Filter command must) 3.577 WS
6.326 MX
(be used exactly as specified in the) 3.576 WS
11 /Palatino-Italic SelectFont
( User's Guide) 3.576 WS
11 /Palatino-Roman SelectFont
(; the) 3.576 WS
72 539 moveto
(command will only use the first item if multiple filters are specified. Thus, for "status) 2.630 WS
5.381 MX
(=>) show
72 552 moveto
(pass,fail", only "pass" will be applied.) show
72 589 moveto
12 /Palatino-Bold SelectFont
(3.2.3. Editing Test Sets Containing Deleted Test Cases) show
72 613 moveto
11 /Palatino-Roman SelectFont
(The test-set editor does not) 1.429 WS
4.178 MX
(remove from a test set those test cases whose test-case files have) 1.428 WS
72 626 moveto
(been deleted \050using Library.Delete, for example\051. It is up) 1.193 WS
3.944 MX
(to the user to manually delete these) 1.194 WS
72 639 moveto
(cases from the set.) show
72 756 moveto
10 /Palatino-Roman SelectFont
(2) show
308.731 MX
(October 1992 ) show
17 /AvantGarde-Book SelectFont
( RATIONAL) show
EndPage
%%Page: 3 5
BeginPage
792 false PositionPage
72 36 moveto
10 /Palatino-Roman SelectFont
390.180 MX
(Rev2_2_0 Release) show
72 74 moveto
13 /Palatino-Bold SelectFont
(3.3. Scripts) show
72 111 moveto
12 /Palatino-Bold SelectFont
(3.3.1. Consistency Checking At Script Generation) show
72 135 moveto
11 /Palatino-Roman SelectFont
(TestMate does not check test sets and their constituent test cases for consistency at script) 2.770 WS
72 148 moveto
(generation. Consistency is checked at script execution, however. If the) 1.898 WS
4.649 MX
(script's test cases are) 1.899 WS
72 161 moveto
("compatible" with the test cases that were used to generate the script, the test script) 0.250 WS
2.999 MX
(will execute) 0.249 WS
72 174 moveto
(correctly. Refer) 2.223 WS
4.974 MX
(to the "Ensuring Test Set Consistency" section in Chapter 2 of the) 2.224 WS
11 /Palatino-Italic SelectFont
( TestMate) 2.224 WS
72 187 moveto
(User's Manual) show
11 /Palatino-Roman SelectFont
( for more information.) show
72 225 moveto
13 /Palatino-Bold SelectFont
(3.4. Coverage Analyzer) show
72 262 moveto
12 /Palatino-Bold SelectFont
(3.4.1. Coverage of Library Elaboration Code) show
72 286 moveto
11 /Palatino-Roman SelectFont
(The coverage analyzer does not gather coverage data for library package) 0.433 WS
3.182 MX
(elaboration unless the) 0.432 WS
72 299 moveto
(subject program uses pragma Main.) show
72 336 moveto
12 /Palatino-Bold SelectFont
(3.4.2. Code View and Coverage Analyzer) show
72 360 moveto
11 /Palatino-Roman SelectFont
(The Coverage Analyzer) 4.009 WS
6.760 MX
(uses debug information for each unit in order to operate in a) 4.010 WS
72 373 moveto
(non-intrusive manner. Code Views do) 7.403 WS
10.152 MX
(not contain debugging information, so the) 7.402 WS
72 386 moveto
(Coverage_Analyzer is unable to gather coverage data for units inside of a code view.) show
72 426 moveto
15 /Palatino-Bold SelectFont
(4. Known Problems) show
72 464 moveto
13 /Palatino-Bold SelectFont
(4.1. General) show
72 501 moveto
12 /Palatino-Bold SelectFont
(4.1.1. Version Information and Code Views) show
72 525 moveto
11 /Palatino-Roman SelectFont
(Version information is not saved for units that are located inside code views.) show
72 563 moveto
13 /Palatino-Bold SelectFont
(4.2. Coverage Analyzer) show
72 600 moveto
12 /Palatino-Bold SelectFont
(4.2.1. Decision Coverage) show
72 624 moveto
11 /Palatino-Roman SelectFont
(Under certain, not yet well-defined circumstances, specifying) 0.070 WS
2.821 MX
(the collection of decision coverage) 0.071 WS
72 637 moveto
(data can cause the test to hang or give incorrect) 0.658 WS
3.407 MX
(results. When the particular criteria have been) 0.657 WS
72 650 moveto
(fully characterized, a note will be) 1.225 WS
3.976 MX
(sent to all customers indicating under which circumstances) 1.226 WS
72 663 moveto
(decision coverage can safely be used. Until then, usage of the) 1.482 WS
4.231 MX
(decision coverage mode is not) 1.481 WS
72 676 moveto
(recommended.) show
72 756 moveto
17 /AvantGarde-Book SelectFont
(RATIONAL) show
10 /Palatino-Roman SelectFont
( October 1992) show
310.940 MX
(3) show
EndPage
%%Page: 4 6
BeginPage
792 false PositionPage
72 36 moveto
10 /Palatino-Roman SelectFont
(Rational TestMate Release Information) show
72 73 moveto
12 /Palatino-Bold SelectFont
(4.2.2. Null Case Statement Arms) show
72 97 moveto
11 /Palatino-Roman SelectFont
(Null case arms do not have code) 0.802 WS
3.553 MX
(generated for them; therefore, the Coverage Analyzer cannot) 0.803 WS
72 110 moveto
(detect segment coverage in those arms. Null arms are) 0.179 WS
2.928 MX
(not counted as missed segments. This can) 0.178 WS
72 123 moveto
(result in 100% decision coverage being indicated when, in fact, one or more null case) 0.192 WS
2.943 MX
(arms were) 0.193 WS
72 136 moveto
(not exercised.) show
72 160 moveto
(This is expected to be fixed in a later release.) show
72 197 moveto
12 /Palatino-Bold SelectFont
(4.2.3. Very Large Units) show
72 221 moveto
11 /Palatino-Roman SelectFont
(A sufficiently large unit \050in excess of 32,000 executable R1000 instructions\051) 0.598 WS
3.347 MX
(will cause problems) 0.597 WS
72 234 moveto
(for the Coverage Analyzer due to an inability to properly handle multiple code) 0.463 WS
3.214 MX
(segment debug) 0.464 WS
72 247 moveto
(table information. The Coverage Analyzer will issue a log message and not process) 1.238 WS
3.987 MX
(that unit.) 1.237 WS
72 260 moveto
(This should be a very rare event as Ada units requiring multiple code segments must) 0.962 WS
3.713 MX
(be very) 0.963 WS
72 273 moveto
(large.) show
72 310 moveto
12 /Palatino-Bold SelectFont
(4.2.4. Multiple Subject Programs) show
72 334 moveto
11 /Palatino-Roman SelectFont
(If a test case specifies multiple subject programs, and the Coverage_Analyzer_Params) 1.151 WS
3.900 MX
(field in) 1.150 WS
72 347 moveto
(that test case is set to "" \050the default\051, the coverage analyzer will not collect coverage) 0.313 WS
3.064 MX
(data for all) 0.314 WS
72 360 moveto
(of the specified subject programs.) show
72 384 moveto
(This problem can be worked around by explicitly specifying) 0.759 WS
3.508 MX
(the subject program names in the) 0.758 WS
72 397 moveto
(Coverage_Analyzer_Params field of the test case. Note that the subject) 3.467 WS
6.218 MX
(programs can be) 3.468 WS
72 410 moveto
(specified using relative pathnames.) show
72 447 moveto
12 /Palatino-Bold SelectFont
(4.2.5. Specific Routine Within a Unit) show
72 471 moveto
11 /Palatino-Roman SelectFont
(If a test case specifies as its subject program a routine in) 0.387 WS
3.136 MX
(a particular unit \050"sppkg.foo_proc", for) 0.386 WS
72 484 moveto
(instance\051, and the Coverage_Analyzer_Params field in that test) 0.354 WS
3.105 MX
(case is set to "" \050the default\051, the) 0.355 WS
72 497 moveto
(coverage analyzer will not correctly collect coverage data for the specified routine.) show
72 521 moveto
(This problem can be) 8.506 WS
11.255 MX
(worked around by specifying the package name in the) 8.505 WS
72 534 moveto
(Coverage_Analyzer_Params field of the test case.) show
72 572 moveto
13 /Palatino-Bold SelectFont
(4.3. Editors) show
72 609 moveto
12 /Palatino-Bold SelectFont
(4.3.1. Coverage Editor and Missed Segments) show
72 633 moveto
11 /Palatino-Roman SelectFont
(When the user does a [Definition] to view the missed segments for) 1.881 WS
4.632 MX
(an Ada unit, the Editor) 1.882 WS
72 646 moveto
(brings up that Ada unit and marks the segments. If there) 1.210 WS
3.959 MX
(are no missed segments, the Editor) 1.209 WS
72 659 moveto
(provides a warning message to that effect) 0.296 WS
3.047 MX
(and brings up the Ada editor. Under certain complex) 0.297 WS
72 672 moveto
(circumstances involving the viewing of coverage data for multiple test runs, the Ada) 0.127 WS
2.876 MX
(editor fails) 0.126 WS
72 685 moveto
(to come) 0.515 WS
3.266 MX
(up properly. This only occurs for 100% covered units, and the warning message is still) 0.516 WS
72 698 moveto
(properly posted.) show
72 756 moveto
10 /Palatino-Roman SelectFont
(4) show
308.731 MX
(October 1992 ) show
17 /AvantGarde-Book SelectFont
( RATIONAL) show
EndPage
%%Page: 5 7
BeginPage
792 false PositionPage
72 36 moveto
10 /Palatino-Roman SelectFont
390.180 MX
(Rev2_2_0 Release) show
72 73 moveto
12 /Palatino-Bold SelectFont
(4.3.2. Test Run Group Editor) show
72 97 moveto
11 /Palatino-Roman SelectFont
(The following sequence of events can result in an incorrect editor image:) show
72 121 moveto
0 -1.100 rmoveto
6 /ZapfDingbats SelectFont
(n) show
11 /Palatino-Roman SelectFont
0 1.100 rmoveto
19.434 MX
(Invoke the test run editor for a group of test runs) show
72 139 moveto
0 -1.100 rmoveto
6 /ZapfDingbats SelectFont
(n) show
11 /Palatino-Roman SelectFont
0 1.100 rmoveto
19.434 MX
(Expand the image) show
72 157 moveto
0 -1.100 rmoveto
6 /ZapfDingbats SelectFont
(n) show
11 /Palatino-Roman SelectFont
0 1.100 rmoveto
19.434 MX
(Place the) 0.962 WS
3.711 MX
(cursor) show
11 /Palatino-Italic SelectFont
( after) 0.961 WS
11 /Palatino-Roman SelectFont
( the text on one of the expanded rows \050such as the test run log row\051) 0.961 WS
96 170 moveto
(and press [Definition]. As) 1.978 WS
4.729 MX
(expected, an error message will be generated indicating that) 1.979 WS
96 183 moveto
([Definition] is not supported for this column.) show
72 201 moveto
0 -1.100 rmoveto
6 /ZapfDingbats SelectFont
(n) show
11 /Palatino-Roman SelectFont
0 1.100 rmoveto
19.434 MX
(Expand the image once again.) show
72 225 moveto
(The two title) 1.422 WS
4.171 MX
(rows as well as the test run rows will all be erased, leaving only the expanded) 1.421 WS
72 238 moveto
(rows.) show
72 262 moveto
(To regain the proper image, abandon the current image and re-execute) 1.159 WS
3.910 MX
(the command used to) 1.160 WS
72 275 moveto
(invoke the test run editor.) show
72 315 moveto
15 /Palatino-Bold SelectFont
(5. Errors) show
72 339 moveto
11 /Palatino-Roman SelectFont
(This section documents areas in TestMate) 4.268 WS
7.017 MX
(where potentially unclear or confusing error) 4.267 WS
72 352 moveto
(messages may arise.) show
72 390 moveto
13 /Palatino-Bold SelectFont
(5.1. General) show
72 427 moveto
12 /Palatino-Bold SelectFont
(5.1.1. Format of Persistent Objects) show
72 451 moveto
11 /Palatino-Roman SelectFont
(If the) 12.669 WS
15.420 MX
(format for the textually-manipulated persistent objects \050Test_Context,) 12.670 WS
72 464 moveto
(Script_Construction_Control, and Script_Execution_Control\051 is not followed explicitly, data) 3.175 WS
72 477 moveto
(layout errors can occur. In particular, something like:) show
108 501 moveto
9 /Courier SelectFont
( xx =>) show
108 512 moveto
( ....long name.....) show
72 536 moveto
11 /Palatino-Roman SelectFont
(will fail. The correct form is:) show
108 560 moveto
9 /Courier SelectFont
( xx => ....long name...) show
72 584 moveto
11 /Palatino-Roman SelectFont
(An alternative form is:) show
108 608 moveto
9 /Courier SelectFont
( xx => \050) show
108 619 moveto
( .......long name ....\051) show
72 643 moveto
11 /Palatino-Roman SelectFont
(Data layout errors do not supply a detailed explanation) 0.457 WS
3.208 MX
(of the failure mode. The user will have) 0.458 WS
72 656 moveto
(to look at the file for) 0.595 WS
3.344 MX
(details. Note that the most common mistake is a misspelling of one of the) 0.594 WS
72 669 moveto
(field identifiers.) show
72 756 moveto
17 /AvantGarde-Book SelectFont
(RATIONAL) show
10 /Palatino-Roman SelectFont
( October 1992) show
310.940 MX
(5) show
EndPage
%%Page: 6 8
BeginPage
792 false PositionPage
72 36 moveto
10 /Palatino-Roman SelectFont
(Rational TestMate Release Information) show
72 74 moveto
13 /Palatino-Bold SelectFont
(5.2. Scripts) show
72 111 moveto
12 /Palatino-Bold SelectFont
(5.2.1. Connected and Separate Job Run Modes) show
72 135 moveto
11 /Palatino-Roman SelectFont
(If the user is running a test case with run mode set) 1.582 WS
4.333 MX
(to Separate_Job or Connected_Job, a job) 1.583 WS
72 148 moveto
(command is created which must be parsed by) 3.113 WS
5.862 MX
(the Environment and then executed. That) 3.112 WS
72 161 moveto
(command can fail to execute for a number) 0.173 WS
2.924 MX
(of reasons; TestMate will post the entire command to) 0.174 WS
72 174 moveto
(the log. It is up to the user to figure out why the command failed.) 1.874 WS
4.623 MX
(This is usually done by) 1.873 WS
72 187 moveto
(running the user's part of the job command string) 0.344 WS
3.095 MX
(from the error log. If that succeeds, check for) 0.345 WS
72 200 moveto
(missing links to the TestMate units mentioned in the job command:) 2.637 WS
5.386 MX
(the links may not be) 2.636 WS
72 213 moveto
(available from the specified execution context.) show
72 237 moveto
(Another common failure is due to the number of parameters being incorrect either in) 1.186 WS
3.937 MX
(type or) 1.187 WS
72 250 moveto
(number.) show
72 287 moveto
12 /Palatino-Bold SelectFont
(5.2.2. Test Drivers and Package TMS) show
72 311 moveto
11 /Palatino-Roman SelectFont
(If a test) 0.186 WS
2.935 MX
(driver directly references package TMS using default values \050i.e., makes reference to the) 0.185 WS
72 324 moveto
(current test case or test run\051, then running) 2.725 WS
5.476 MX
(that driver outside of the script will cause an) 2.726 WS
72 337 moveto
(exception instead of a more graceful error message.) show
72 377 moveto
15 /Palatino-Bold SelectFont
(6. Documentation) show
72 401 moveto
11 /Palatino-Roman SelectFont
(This product has been documented in the) 1.655 WS
11 /Palatino-Italic SelectFont
( TestMate User's Guide) 1.655 WS
11 /Palatino-Roman SelectFont
(, product #4000-00720, dated) 1.655 WS
72 414 moveto
(November 1992.) show
72 452 moveto
13 /Palatino-Bold SelectFont
(6.1. Links to TestMate Packages From Worlds) show
72 476 moveto
11 /Palatino-Roman SelectFont
(The) show
11 /Palatino-Italic SelectFont
( TestMate User's Guide) 0.284 WS
11 /Palatino-Roman SelectFont
( shows how to add links to the TestMate packages) 0.284 WS
3.035 MX
(and how to update) 0.285 WS
72 489 moveto
(your activity) 2.841 WS
5.590 MX
(to specify the correct views. The discussion for Worlds, however, lists these) 2.840 WS
72 502 moveto
(operations in the wrong order \050see) 0.133 WS
2.884 MX
(the bottom of page 4\051. Your activity should be updated) 0.134 WS
11 /Palatino-Italic SelectFont
( before) 0.134 WS
72 515 moveto
11 /Palatino-Roman SelectFont
(you establish links to) 1.153 WS
3.902 MX
(a TestMate world. Otherwise, the Links.Add command will use what it) 1.152 WS
72 528 moveto
(finds in your default activity \050and it) 0.285 WS
3.036 MX
(will fail if it doesn't find entries for TestMate and TestMate) 0.286 WS
72 541 moveto
(tools\051.) show
72 579 moveto
13 /Palatino-Bold SelectFont
(6.2. Specifying Testmate_Tools) show
72 603 moveto
11 /Palatino-Roman SelectFont
(Pages 4 and 5 of the) 0.068 WS
11 /Palatino-Italic SelectFont
( TestMate User's Guide) 0.068 WS
11 /Palatino-Roman SelectFont
( specify that) 0.068 WS
2.817 MX
(the following entries must appear in your) 0.067 WS
72 616 moveto
(activity:) show
108 640 moveto
9 /Courier SelectFont
( Subsystem Spec View Load View Context) show
108 651 moveto
(============== =============== ======================= ============) show
108 662 moveto
(TESTMATE Rev2_) show
9 /Courier-Oblique SelectFont
(n) show
9 /Courier SelectFont
(_SPEC CODE2_0_) show
9 /Courier-Oblique SelectFont
(m) show
9 /Courier SelectFont
( !TOOLS.TEST) show
108 673 moveto
(TESTMATE_TOOLS Rev0_0_) show
9 /Courier-Oblique SelectFont
(n) show
9 /Courier SelectFont
(_SPEC CODE0_0_) show
9 /Courier-Oblique SelectFont
(m) show
9 /Courier SelectFont
( !TOOLS.TEST) show
72 756 moveto
10 /Palatino-Roman SelectFont
(6) show
308.731 MX
(October 1992 ) show
17 /AvantGarde-Book SelectFont
( RATIONAL) show
EndPage
%%Page: 7 9
BeginPage
792 false PositionPage
72 36 moveto
10 /Palatino-Roman SelectFont
390.180 MX
(Rev2_2_0 Release) show
72 72 moveto
11 /Palatino-Roman SelectFont
(For this release, this should read:) show
108 96 moveto
9 /Courier SelectFont
( Subsystem Spec View Load View Context) show
108 107 moveto
(============== =============== ======================= ============) show
108 118 moveto
(TESTMATE Rev2_2_SPEC CODE2_2_0 !TOOLS.TEST) show
108 129 moveto
(TESTMATE_TOOLS Rev2_2_SPEC CODE2_2_0 !TOOLS.TEST) show
72 153 moveto
11 /Palatino-Roman SelectFont
(The "Subsystems" section on page) 4.310 WS
7.061 MX
(5 also discusses the importing of the Testmate and) 4.311 WS
72 166 moveto
(Testmate_Tools specs; the correct specs to import are:) show
108 190 moveto
9 /Courier SelectFont
(!TOOLS.TEST.TESTMATE.REV2_2_SPEC) show
108 201 moveto
(!TOOLS.TEST.TESTMATE_TOOLS.REV2_2_SPEC) show
72 241 moveto
15 /Palatino-Bold SelectFont
(7. Training) show
72 265 moveto
11 /Palatino-Roman SelectFont
(TestMate training is available; the) 0.986 WS
3.735 MX
(current draft is dated November, 1992. TestMate training is) 0.985 WS
72 278 moveto
(identified by product #7000-00720.) show
72 756 moveto
17 /AvantGarde-Book SelectFont
(RATIONAL) show
10 /Palatino-Roman SelectFont
( October 1992) show
310.940 MX
(7) show
EndPage
%%Trailer
%%Pages: 9 1
%%DocumentFonts: Times-Roman Courier Courier-Oblique AvantGarde-Book Palatino-Roman Palatino-Bold Palatino-Italic ZapfDingbats