Requirements-Based Testing for Model Development
Test an autopilot subsystem against a requirement.
This example demonstrates testing a subsystem against a requirement, using the test manager, test harness, Test Sequence block, and Test Assessment block. The requirements document links to the test case and test harness, and verify
statements assess the component under test.
As you build your model, you can add test cases to verify the model against requirements. Subsequent users can run the same test cases, then add test cases to accomplish further verification goals such as achieving 100% coverage or verifying generated code.
This example tests the Roll Reference
subsystem against a requirement using three scenarios. A Test Sequence block provides inputs, and a Test Assessment block evaluates the component. The Roll Reference
subsystem is one component of an autopilot control system. Roll Reference
controls the reference angle of the aircraft's roll control system. The subsystem fails one assessment, prompting a design change that limits the subsystem output at high input angles.
Paths and Example Files
Enter the following to store paths and file names for the example:
topModel = 'TestAndVerificationAutopilotExample'; rollModel = 'RollAutopilotMdlRef'; testHarness = 'RollReference_Requirement1_3'; testFile = 'AutopilotTestFile.mldatx'; reqDoc = 'RollAutopilotRequirements.txt';
Open the Test File and Model
Open the RollAutopilotMdlRef
model. The full control system TestAndVerificationAutopilotExample
references this model.
open_system(rollModel)
Open the test file in the Test Manager.
tf = sltest.testmanager.load(testFile); sltest.testmanager.view;
Open the requirements document. In the test browser, expand AutopilotTestFile and Basic Design Test Cases in the tree, and click Requirement 1.3 test. In the Requirement 1.3 test tab, expand Requirements. Double-click on any of the requirements links to open the Requirements Editor, where you can review the requirements.
In the document, requirement 1.3.1 states: When roll hold mode becomes the active mode, the roll hold reference shall be set to the actual roll angle of the aircraft, except under the conditions described in the child requirements.
Child requirement 1.3.1.1 states: The roll hold reference shall be set to zero if the actual roll angle is less than 6 degrees, in either direction, at the time of roll hold engagement.
Child requirement 1.3.1.2 states: The roll hold reference shall be set to 30 degrees in the same direction as the actual roll angle if the actual roll angle is greater than 30 degrees at the time of roll hold engagement.
Child requirement 1.3.1.3 states: The roll reference shall be set to the cockpit turn knob command, up to a 30 degree limit, if the turn knob is commanding 3 degrees or more in either direction.
The test case creates three scenarios to test the normal conditions and exceptions in the requirement.
The requirements document traces to the test harness using URLs that map to the Test Sequence block and test steps. Open the test harness and highlight the component associated with reference requirement 1.3.
sltest.harness.open([rollModel '/Roll Reference'],testHarness) rmi('highlightModel','RollReference_Requirement1_3')
The Test Sequence block, Test Assessment block, and component under test link to the requirements document. Highlight requirements links by selecting Apps > Requirements Manager and then, clicking Highlight Links in the test harness model. You can also highlight links in the Test Sequence Editor by clicking Toggle requirements links highlighting in the toolstrip.
Test Sequence
Open the Test Sequence block.
open_system('RollReference_Requirement1_3/Test Sequence')
The Test Sequence block creates test inputs for three scenarios:
In each test, the test sequence sets a signal level, then engages the autopilot. The test sequence checks that PhiRef
is stable for a minimum time DurationLimit
before it transitions to the next signal level. For the first two scenarios, the test sequence sets the EndTest
local variable to 1
, triggering the transition to the next scenario.
These scenarios check basic component function, but do not necessarily achieve objectives such as 100% coverage.
Test Assessments
Open the Test Assessment block.
open_system('RollReference_Requirement1_3/Test Assessment')
The Test Assessment block evaluates Roll Reference
. The assessment block is a library linked subsystem, which facilitates test assessment reuse between multiple test harnesses. The block contains verify
statements covering:
The requirement that
PhiRef
=Phi
whenPhi
operates inside the low and high limits.The requirement that
PhiRef = 0
whenPhi < 6
degrees.The requirement that
PhiRef = 30
whenPhi > 30
degrees.The requirement that when
TurnKnob
is engaged,PhiRef = TurnKnob
ifTurnKnob >= 3
degrees.
Verify the Subsystem
To run the test, in the Test Manager, right-click Requirement 1.3 Test in the Test Browser pane, and click Run.
The simulation returns verify
statement results and simulation output in the Test Manager. The verify_high_pos
statement fails.
Click Results and Artifacts in the test manager.
In the results tree, expand Verify Statements. Click Simulink: verify_high_pos. The trace shows when the statement fails.
Click Subplots in the toolstrip and select two plots arranged vertically. Select the lower plot in the Visualize pane.
In the results tree, expand Results, Requirement 1.3 Test, and Sim Output.
Select
PhiRef
andPhi
. The output traces align with theverify
results in the above plot. Observe thatPhiRef
exceeds 30 degrees whenPhi
exceeds 30 degrees.
Update RollReference
to limit the PhiRef
signal.
Close the test harness.
Add a Saturation block to the model as shown.
Set the lower limit to
-30
and the upper limit to30
.Link the block to its requirement. From the Requirements browser, drag requirement 1.1.2 to the Saturation block. An icon appears on the block, and the requirement is highlighted.
Run the test again. The verify
statement passes, and the output in the test manager shows that PhiRef
does not exceed 30 degrees.
close_system(rollModel,0); close_system(topModel,0); close_system('RollRefAssessLib',0); sltest.testmanager.clear; sltest.testmanager.clearResults; sltest.testmanager.close; clear topModel reqDoc rollModel testHarness testFile harnessLink