top - download
⟦d76b34497⟧ Wang Wps File
Length: 16889 (0x41f9)
Types: Wang Wps File
Notes: MOM No. 42
Names: »4740A «
Derivation
└─⟦ce4ce986f⟧ Bits:30006193 8" Wang WCS floppy, CR 0449A
└─ ⟦this⟧ »4740A «
WangText
…02…KNN/840316…02……02…#
MINUTES OF MEETING NO. 42
…02……02…CAMPS
CR/SHAPE
840315 42 CR
A/S
Minutes of Meeting held
at Christian Rovsing A/S
Ltc Hofmann Mr. Kurt Nybroe-Nielsen
Mr. A. Gardiner
During the period 13th - 16th March 1984
SHAPE performed an audit as defined in
SHAPE telex, CAMPS log No. 1640.
SHAPE found the CAMPS system compared
with the status during the previous Progress
Meeting considerably improved and various
activities for preparing the test completed.
However, during the audit SHAPE found
indicators that, under the conditions
of the 240 hours test conduct paper,
the system as currently presented has
only a low likelihood of successfully
passing the 240 hours test in a reasonable
time/period.
Furthermore, joint discussions have revealed
areas of misunderstanding which if not
rectified now will lead to differencies
and complications during the test.
To overcome this unsatisfactory situation
SHAPE is willing to support CR by hardware
and software audit as well as fast processing
of open items listed overleaf, including
ECPs and test procedure review provided
CR is ready to react in a similar fashion.
CR appreciates SHAPE's approach to the
above mentioned situation and suspends
the formal invitation to start the 240
hours test. CR is fully committed to
work on the issues closely together with
SHAPE and daily to display results of
system testing and dry runs, and include
SHAPE in the daily problem resolution
meeting.
By doing this it is CR's belief that
all the issues listed below will be solved
in a timely fashion and assurance will
we gained that the system is adequate
to pass the 240 hours test successfully.
1̲ ̲ ̲D̲O̲C̲U̲M̲E̲N̲T̲A̲T̲I̲O̲N̲ ̲P̲R̲E̲R̲E̲Q̲U̲I̲S̲I̲T̲E̲S̲
A̲C̲T̲I̲O̲N̲
a) I̲n̲ ̲P̲l̲a̲n̲t̲-̲T̲e̲s̲t̲ ̲S̲p̲e̲c̲.̲ ̲a̲n̲d̲ ̲P̲r̲o̲c̲e̲d̲u̲r̲e̲s̲,̲
̲C̲P̲S̲/̲T̲P̲R̲/̲0̲0̲7̲
SHAPE The comments of SHAPE on telex
are expected by 20th March.
The revised pages of TPR 007
will be available 5 days later
after SHAPE's final comments.
It will be sent to SHAPE as
well as
CR being made available to the SHAPE
In-Plant
SHAPE representative in final form
for fast review/ agreement.
b) E̲C̲P̲0̲3̲8̲ ̲U̲p̲d̲a̲t̲e̲s̲
ECP 038 is agreed and awaiting formal
approval by
SHAPE telex from SHAPE.
CR Updated pages to SRS, User Formats
and Supervisor formats are prepared
and will be issued immediately on
SHAPE approval (ECO 029).
c) T̲e̲s̲t̲ ̲D̲r̲i̲v̲e̲ ̲S̲y̲s̲t̲e̲m̲ ̲D̲e̲s̲i̲g̲n̲ ̲S̲p̲e̲c̲s̲
The documents were received at SHAPE
and declared satisfactory for purposes
of 240 hour test.
d) O̲p̲e̲r̲a̲t̲o̲r̲ ̲P̲o̲s̲i̲t̲i̲o̲n̲ ̲F̲o̲r̲m̲a̲t̲ ̲&̲ ̲P̲r̲o̲c̲e̲d̲u̲r̲e̲s̲
This will be available in week starting
Monday 19th March. It will be sent
to SHAPE as well as
CR being made available to SHAPE in
plant representatives.
e) A̲n̲n̲e̲x̲e̲s̲ ̲t̲o̲ ̲C̲P̲S̲/̲T̲P̲R̲/̲0̲0̲7̲
TCN 076 on timing will be updated
and be available during the week
of 19th March. It will be incorporated
as an annex of the CPS/TPR/007.
Preformatted message descriptions
will be added as
CR another annex to test plan.
f) M̲D̲S̲D̲ ̲C̲a̲l̲c̲u̲l̲a̲t̲i̲o̲n̲s̲
CR uses a graphical method to empirically
estimate the MDSD of all errors and
individual categories of errors for
the whole system and packages. Enough
data is collected to enable curve
fitting to be made as a prediction
of the MDSD during and after 240
hour test.
g) T̲e̲s̲t̲ ̲D̲r̲i̲v̲e̲ ̲S̲y̲s̲t̲e̲m̲
Listings of TDS command files will
be made
CR available in CR prior to test start.
h) T̲e̲s̲t̲ ̲D̲a̲t̲a̲ ̲B̲a̲s̲e̲
A print out of the test database
is available. A copy will be put
in the test room as a reference document.
Spot checks of the provided data
base
CR/SHAPE and
the
loaded
data
base
will
be
made
prior
to
test
start.
i) A̲s̲ ̲B̲u̲i̲l̲t̲ ̲D̲o̲c̲u̲m̲e̲n̲t̲a̲t̲i̲o̲n̲ ̲(̲D̲e̲t̲a̲i̲l̲e̲d̲
̲D̲e̲s̲i̲g̲n̲)̲
Available in typed up form are five
packages, the others are in the process
of update. The typed up and correction
masters of the documents will be
made available to SHAPE for the purpose
of
CR investigating and understanding SW
problems and proposed changes.
j) E̲C̲P̲s̲ ̲t̲o̲ ̲b̲e̲ ̲P̲r̲o̲d̲u̲c̲e̲d̲
An ECP will be produced by CR proposing
a clarification of the performance
requirements of
CR the SRS to be consistent with the
TCN 076.
A change in the treatment of first
draft messages after release will
also be included.
2̲ ̲ ̲H̲W̲ ̲A̲U̲D̲I̲T̲
a) 2̲4̲0̲ ̲H̲o̲u̲r̲s̲ ̲T̲e̲s̲t̲ ̲C̲o̲n̲n̲e̲c̲t̲i̲v̲i̲t̲y̲
The CAMPS/TDS connectivity was checked
and compared with the drawing of
the 240 hours test configuration
with the following results:
1) The speeds of the connections
as set up differ from that requirement
under the SRS. SHAPE feels that
this is not a problem if:
CR a) CR
agree
to
show
informally
that
the
system
operates
at
other
line
speeds
than
those
shown
for
the
test.
CR b) CR
will
justify
why
the
test
line
speeds
were
chosen
and
agree
that
where
the
test
line
speed
exceeds
that
required
by
the
SRS
then
the
line
speed
at
all
sites
will
be
set
at
that
value.
SHAPE/CR SHAPE
will
verify
the
line
speed
settings
together
with
CR
during
the
week
beginning
19th
March.
CR/SHAPE 2) CR
will
use
eight
low
speed
lines
to
drive
CAMPS.
CR
state
that
eight
channels
are
adequate
to
provide
the
traffic
load
specified
for
TRC
P-to-P
channels
stated
in
the
SRS.
SHAPE
will
consider
the
implications
and
reply
by
24
March
1984.
b) C̲A̲M̲P̲S̲ ̲C̲o̲n̲f̲i̲g̲u̲r̲a̲t̲i̲o̲n̲
There are three outstanding issues
on the CAMPS internal hardware configuration.
1) The system under test contains
only one TIA module per PU.
There is no provision for automatic
switchover of TDX buses on a
failure.
CR CR will issue NLT 23 March 84
an ECP to cover this HW change
considering among other items
the effect on the MTBF availability
figures.
2) The LTU processor memory has
been increased to 64K on the
NICS TARE link. CR shall give
change rational by means of
an ECP. SHAPE insists that if
a change is accepted all sites
be equipped with the same LTU
memory size as used during 240
hours test for the NICS TARE
link. CR agrees.
3) CR explained that additional
memory board is required due
to the use of test monitoring
software such as TRACE and DIAG.
CR stated that during the 240
hours test, 4 Ram boards are
required to accommodate test/monitoring
software. The SHAPE site will
be equipped with 3 boards. For
any site CR is required to deliver
sufficient memory to meet the
requirements of the SRS.
SHAPE is willing to accept the
use of 4 Ram boards if CR after
sucessful completion of the
240 hours test in the agreed
memory configuration, further
performance tests will be performed,
using the maximally connected
configurations for two board
and three board PUs. CR shall
show that the performance is
better than or equal to those
contained in the SRS requirements.
Otherwise SHAPE refers to provision
made in CPS/TPR/007, para 2.1.2.1.1.
c) H̲W̲ ̲I̲n̲v̲e̲n̲t̲o̲r̲y̲
The HW inventory was carried out
on 15. March 84 to create a list
of boards, their revisions, and the
change status of items contained
in the system under test.
CR It was found that some boards will
have to undergo an ECO to bring them
up to the latest status.
The inventory list will be forwarded
to SHAPE for verification. SHAPE
agrees to review this list and to
send comments to CR within 1 week
after receipt.
d) G̲e̲n̲e̲r̲a̲l̲ ̲R̲e̲m̲a̲r̲k̲s̲
- A check on the 240 hours test
configuration for test group
1 will be carried out prior
to the 240 hour test start.
- The boards and ECO number will
be checked prior to the 240
hour test start.
- The data base used for the test
will also be spot checked prior
to the start of the test.
- All systems equipment and provisions
which do not belong to the test
configuration will be removed
from the test room.
- terminals used during the test
will be clearly marked by means
of a sticker, which will also
bear data concerning the terminal.
- Practical arrangements to reconfigure
from test group 1 to testgroup
2/3 will be discussed between
CR and SHAPE in the week of
19. March.
…01…3̲ ̲ ̲F̲U̲N̲C̲T̲I̲O̲N̲A̲L̲ ̲A̲U̲D̲I̲T̲
a) S̲y̲s̲t̲e̲m̲ ̲I̲n̲t̲e̲g̲r̲a̲t̲i̲o̲n̲ ̲T̲e̲s̲t̲i̲n̲g̲ ̲(̲C̲P̲S̲/̲T̲P̲R̲/̲0̲1̲1̲)̲
The complete set of test cases and
test results for CPS/TPR/011 is available.
SHAPE sampled the results. Although
not a document to be delivered to
SHAPE for review, CR agreed to make
three copies of all test cases and
results sending them to SHAPE in
connection with the certification
CR effort.
A test report will be produced which
will summarise the test results showing
the following:
o The tests completed
o Error rate trends on system
and package level
o Analysis of error trends with
testing time
o Deduction of mean time to correct
errors at system and package
level
o MDSD graphs
CR o MDSD deductions
SHAPE was presented with a graphical
analysis of test results showing
that for cat. 1 and cat. 2 errors
the MDSD is better than that required
for once through successful completion
of the test. However, the calculated
MDSD for cat. 3 test would mean that
several clock resets would be expected
hence lengthening the tests and increasing
the probability of further cat. 1,
cat 2 errors.
b) D̲r̲y̲ ̲R̲u̲n̲ ̲2̲4̲0̲ ̲H̲o̲u̲r̲s̲ ̲T̲e̲s̲t̲
The ongoing dry run of the 240 hour
test procedures was witnessed by
SHAPE. The testers are completing
test logs and creating problem reports
in a proper and controlled manner.
The problem test log revealed that
between one and six problems are
reported daily from the one test
configuration and discussions revealed
that the number of system reports
per day is in the order of 1 to 2.
In order to ensure that the system
availability is adequate for the
240 hour test and to see the trends
in that availability the following
actions will be taken.
CR o The 240 hours test machine will
be brought to the actual start-of-test
configuration by 28th March.
CR o A system availability log shall
be kept
CR/SHAPE o The
availability
shall
be
compared
with
that
required
for
the
240
hour
test.
The demonstration to SHAPE on dualized
system generation was not performed.
c) S̲W̲ ̲i̲n̲v̲e̲n̲t̲o̲r̲y̲
A complete system and package release
description of the system under test
is available.
d) P̲r̲o̲b̲l̲e̲m̲ ̲R̲e̲p̲o̲r̲t̲s̲
The outstanding problem reports were
investigated. The problems are logged
per package and available for inspection
with the librarian.
On 15th March 12 problem reports
were outstanding, broken down as
follows:
1 error IOC,
TMP,
STP,
SUP
2 errors THP
3 errors SSC,
LTUX
of these 3
were
fixed
and
under
test
3
were
cosmetic
2
were
known
problems
awaiting
fixes
4
were
problems,
it
was
difficult
to
reproduce
and
hence
investigate.
The average number of new problems
per day at least 12 days is 3.5.
(Not all of these fall into the category
1, 2, and 3).
The average rate of problem correction
per day over the same period is 3.
CR should ensure that experience
and effort is applied to problem
correction to avoid that the
CR total number of outstanding problems
does not build up.
SHAPE SHAPE will monitor this trend
closely before and during the
240 hour test.
4̲ ̲ ̲T̲E̲S̲T̲ ̲O̲R̲G̲A̲N̲I̲Z̲A̲T̲I̲O̲N̲ ̲A̲N̲D̲ ̲T̲E̲S̲T̲ ̲R̲O̲O̲M̲ ̲L̲A̲Y̲O̲U̲T̲
a) I̲d̲e̲n̲t̲i̲f̲i̲c̲a̲t̲i̲o̲n̲ ̲o̲f̲ ̲C̲R̲ ̲P̲e̲r̲s̲o̲n̲e̲l̲
CR will provide the names in the
test orgainzation one week prior
to the test start.
b) P̲h̲y̲s̲i̲c̲a̲l̲ ̲E̲n̲v̲i̲r̲o̲n̲m̲e̲n̲t̲ ̲f̲o̲r̲ ̲T̲e̲s̲t̲
The space in the test room is limited
and VDU meaning, layout, and printer
control must be organized to minimize
personnel movements.
CR SHAPE makes the following recommendations
on the layout:
- The releaser VDU be moved to
the other side of the table
close to the supervisor VDUs
to leave adequate space for
user position and witness.
- One person is detailed to deal
with printers and distributed
output.
- VDUs and printers shall be clearly
marked with function profiles.
- Users shall be identified together
with profiles.
SHAPE makes the following recommendations
on the documentation which needs
to be available (in addition to the
items in para 1).
- A list of the software error
codes for the system.
- A mapping of port identity to
terminals.
- A memory map of the software
under tests for the purpose
of understanding dumps.
- Test drive system command files.
c) T̲e̲s̲t̲ ̲C̲l̲o̲c̲k̲s̲ ̲a̲n̲d̲ ̲L̲o̲g̲s̲
The log forms and problem report
forms for the test were presented
and their use to record the required
aspects of the test situation was
verified.
d) F̲a̲m̲i̲l̲i̲a̲r̲i̲z̲a̲t̲i̲o̲n̲ ̲C̲o̲u̲r̲s̲e̲
In place of a familiarization course
the first day of the test will proceed
with the testers explaining in detail
what they are doing, the test results
analysis and the test log completion.
5̲ ̲ ̲M̲I̲N̲I̲ ̲T̲E̲S̲T̲
The test cases chosen and results are
shown in figure 1.
TEST CASES TO BE RUN FOR SHAPE
------------------------------
TEST CASE DESCRIPTION RESULTS
-------------------------------------------------------------------
USER VDU
--------------
1) 1.1- 1.8 Terminal access including Completed
checks on access to blocked
VDU
2) ? Prepare/send predefined mes- Small Interpretation
sage #6 on low speed line Problem Concerning Set
ID
3) ? Prepare a flash comment and Completed
send to supervisor
4) 27.1-27.11 Queuing for printer functions Completed
5) 29.2 Message from OCR
6) 30.6 Retrieve incoming message Completed (using DTG
only)
7) 20.1-20.11 Create message with X
PLA Completed
-------------------------------------------------------------------
Supervisor VDU
--------------
1) 23 Print tables: LPLP, LORP, Completed
CIRP, TSTP, OPST
------------------------------------------------------------------
ACE CCIS
--------
1) 34.1- 4 VDU Display preparation/ Completed
send/receive/retrieve Display name must be
alpha update supervisor
format
------------------------------------------------------------------
SCARS
-----
1) 17.1-17.2 Message Relay Function Completed
------------------------------------------------------------------
NICS/TARE
---------
1) 35.1 Message with non recognizable Completed
precedence
------------------------------------------------------------------
TEST CASES TO BE RUN FOR SHAPE
------------------------------
TEST CASE DESCRIPTION RESULTS
-------------------------------------------------------------------
PT-TO-PT
--------
1) ? Message with too high
classification
2) 39.4 Flash queue time out Completed
3) 22.2-2 Encrypted message to punch Completed
------------------------------------------------------------------
Operator
--------
1) Start up dead 1 Completed
2) Emergency close down CR was unable to pre-
3) Start up warm 1 modified sent the features to
4) Automatic switchover the SHAPE representa-
5) Controlled switchover tives during this week.
To be demonstrated during
the week beginning 19th
March.
------------------------------------------------------------------
Load Test Witness TDS in operation
--------- sending messages on all Completed
channel types
------------------------------------------------------------------
MSO, MDCO Included in PT-TO-PT and user
--------- test cases Completed
------------------------------------------------------------------
Remark The set of problem solutions and actions represents
the states as of 12:00 16. March 1984. The list will
be augmented as problems occur and will be used to
record progress towards the start for the 240 hours
test.
…06…1 …02… …02… …02… …02…
C̲A̲M̲P̲S̲ ̲S̲c̲h̲e̲d̲u̲l̲e̲
CR and SHAPE developed jointly the following adaptation
to the HW installation schedule:
Site 9 (main system): start at 7 May 84.
Site 7 A: start at 3 Dec 84.
These changes do not alter any other provision of the
main contract and shall be a matter of configuration
by CR and SHAPE via telex during the week starting
19. March 84.
