Test Specification NA4-TC21.TS2

This test allows determining and verifying the successful transmission rate of a data profile for different delay emulations enabled by the communication emulator. This would allow to verify the minimum periodicity of data value sent determined in TS1 (with 99% successful transmission rate), and determine if the successfully transmitted data is similar or decreases when including emulated delays.

Test Specification Definition

ID

NA4-TC21.TS2

Reference to Test Case

TS02

Title of Test

This test allows determining and verifying the successful transmission rate of a data profile for different delay emulations enabled by the communication emulator. This would allow to verify the minimum periodicity of data value sent determined in TS1 (with 99% successful transmission rate), and determine if the successfully transmitted data is similar or decreases when including emulated delays.

Test Rationale
Specific Test System (graphical)

The test system is comprised of the components and their interconnection according to the figure shown above.

The emulation delay must be set to different values depending on the delay to be assessed. One experiment must be carried out for each of these delays

The real time simulator must send a data profile composed of integer values using “protocol 1” and a value α equal to 1. The values have to constantly increase throughout each experiment.

Additionally, the real time simulator must internally register a timestamp for each value sent and a timestamp for when this value is received (if the value is not lost).

Target measures
  • The roundtrip time that takes each value sent from the real time simulator to reach the real time simulator, going through the communication devices and the communication emulator.
Input and output parameters

Controllable input parameters:

  • The time duration for which each value from the data profile is sent (Ideally, the minimum duration determined in TS1).
  • The specific communication protocol to send the information (Protocol 1 and 2).
  • The emulation delay of the communication emulator.

Uncontrollable parameters:

  • Time that takes the data to be received by the real time simulator

Measured parameters:

  • Values received by the real time simulator
  • Roundtrip time of each value received by the real time simulator.
Test Design
  • Choose data profile to be sent around the system.
  • Choose the number of values that will be sent through the system (at least 1000 recommended for statistical purposes)
  • Choose communication protocols “Protocol 1” and “Protocol 2”
  • Select a set of delay emulation values to be assessed (e.g. {100ms, 150ms, 200ms})
  • Set the delay emulation from the communication emulator to the first value from the set
  • Run the experiment and determine for each sent value whether the real time simulator received it.
  • If the value was received, determine the roundtrip time by calculating the difference of the timestamps registered by the real time simulator.
  • Assess test criteria for each of the values.
  • Repeat procedure selecting a different delay emulation value from the set, until all the experiments have been executed.
Initial system state
  • Devices are on and running
  • The real time simulator has sent any value
  • The registrations (in the real time simulator) of successful received values and the timestamps of sending/receiving values are empty
Evolution of system state and test signals
  • The successful received values and the timestamps of sending/receiving values are registered in the real time simulator.
Other parameters

N/A

Temporal resolution
  • Polling frequency parameters of the protocols being used should be less than the value that has the minimum transmission duration. Polling frequency in the range 1ms-10ms is recommended.
Source of uncertainty

The delay that can occur within any of the devices used in the system has a stochastic nature. These are therefore sources of uncertainty.

Suspension criteria / Stopping criteria

Suspension criteria: Errors in devices

Stopping criteria: the experiment concludes when the value from the data profile reaches the previously defined number.