Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
www.mathworks.com
www.mathworks.com/sales_and_services
User community:
www.mathworks.com/matlabcentral
Technical support:
www.mathworks.com/support/contact_us
Phone:
508-647-7000
Revision History
September 2013
March 2014
October 2014
March 2015
September 2015
Contents
1 Introduction ...................................................................................................................................... 1-1
1.1 Item / Element Identification .................................................................................................. 1-2
1.2 Tool Overview and Identification ........................................................................................... 1-3
1.3 Tool Interfaces ........................................................................................................................ 1-3
1.3.1
Tool Inputs ................................................................................................................ 1-3
1.3.2
Tool Outputs ............................................................................................................. 1-4
1.4 Tool Qualification Artifacts Summary .................................................................................... 1-5
2 Software Tool Criteria Evaluation Report ....................................................................................... 2-1
2.1 Tool Environment ................................................................................................................... 2-2
2.2 Tool Configuration.................................................................................................................. 2-3
2.3 Tool Use Cases and Reference Workflow .............................................................................. 2-4
[PBF_UC1] Static analysis of C/C++ code to assess compliance with coding standards ....... 2-4
[PBF_UC2] Static analysis of C/C++ code to determine code size and complexity metrics .. 2-4
[PBF_UC3] Determination of software quality metrics .......................................................... 2-4
[PBF_UC4] Static analysis of C/C++ code to assess interface between components ............. 2-5
[PBF_UC5] Static analysis of C/C++ code to detect systematic and potential software defects
................................................................................................................................................ 2-5
2.4 Generic Tool Classification .................................................................................................... 2-6
2.4.1
Potential Malfunctions or Erroneous Output ............................................................ 2-7
[PBF_E1] Standards compliance analysis false negative ..................................................... 2-7
[PBF_E2] Standards compliance analysis false positive ..................................................... 2-7
[PBF_E3] Complexity metrics analysis incorrect metrics value .......................................... 2-7
[PBF_E4] Quality metrics reporting incorrect metrics value ............................................... 2-7
[PBF_E5] Non interference .................................................................................................... 2-7
[PBF_E6] Usage of incorrect input data ................................................................................. 2-7
[PBF_E7] Misinterpretation of results .................................................................................... 2-7
[PBF_E8] Incorrect tool usage ................................................................................................ 2-7
[PBF_E9] Incorrect or modified tool installation.................................................................... 2-8
[PBF_E10] Incorrect operational environment ....................................................................... 2-8
2.4.2
Error Prevention and Detection Measures ................................................................ 2-8
[M1] Preceding or Subsequent Dynamic Verification (Testing) of the Software ................... 2-8
[M2] Specified Procedure for Corrective Action on Failure of Source Code Analysis .......... 2-8
[M_MISC1] Revision Control and Configuration Management to Identify the Artifacts to be
Analyzed; Use of Checksums ................................................................................................. 2-8
[M_MISC2] Competency of the Project Team ....................................................................... 2-9
[M_MISC3] Adherence to Installation Instructions; Integrity of Tool Installation ................ 2-9
[M_MISC4] Analysis of Available Bug Report Information .................................................. 2-9
Tool Classification Summary................................................................................................ 2-10
3 Software Tool Qualification Report ................................................................................................. 3-1
3.1 Requirement for Tool Qualification ........................................................................................ 3-2
vi
1 Introduction
This document constitutes the ISO 26262 Tool Qualification Package for the Polyspace Bug
Finder product. This document is intended for use in the ISO 26262 tool classification and
qualification process for software tools. It contains templates for the ISO 26262 tool
qualification work products (see ISO 26262-8, Clause 11).
The applicant shall review this template for applicability to the application under consideration,
and tailor and complete the information.
See also:
ISO 26262-8, Clause 11 provides provisions for software tools that are used to tailor activities or
tasks required by ISO 26262. The standard outlines a two-step approach to establish the required
confidence in such tools:
Tool classification determines the required level of confidence in the software tool.
Depending on the result of the tool classification, you might need to carry out a formal
tool qualification.
The following work products need to be created when applying this approach to a software tool
(see ISO 26262-8, 11.5):
Note The applicant needs to review this template for applicability to the project under
consideration and insert missing information.
<Company name>
1-2
Version (Release)
Version 2.0 (R2015b)
Tool Vendor
The MathWorks, Inc.
3 Apple Hill Drive
Natick, MA, 01760-2098
USA
Note
Depending on the actual use case(s), some of the tool inputs may not be applicable.
Configuration and project information is being shared between Polyspace Bug Finder and Polyspace
Code Prover.
1-3
Code analysis results with coding standard violations (MISRA-C-summaryreport.xml, MISRA-CPP-summary-report.xml, or JSF-summaryreport.xml)
Code metrics results (Code_Metrics.xml)
Software quality metrics results displayed in Web Dashboard or exported via Polyspace
GUI (.html, .pdf, .rtf, .docx, or .xml file)
Note
Depending on the actual use case(s), some of the tool inputs may not be applicable.
1-4
for Polyspace Bug Finder. The table also maps these tool qualification artifacts to sections in
this document and artifacts found elsewhere.
Tool Certification Artifact
Safety plan
1-5
Confirmation review of
qualification of a software tool
1-6
2-2
Setting
<Insert C or C++>
Multitasking pane
<Insert configuration parameter names>
Reporting pane
<Insert configuration parameter names>
2-3
Coding standard compliance analysis can be applied to handwritten as well as generated source
code.
Size and complexity metrics can be determined for handwritten as well as generated source
code. For more information about determining size and complexity metrics, see the Polyspace
Bug Finder Users Guide, R2015b.
2-4
are based on analysis and verification results provided by Polyspace Code Prover and Polyspace
Bug Finder.
Software quality metrics can be applied to handwritten as well as generated source code.
2-5
2-6
2-7
Dynamically verify (test) the executable code corresponding to the C or C++ source
code.
Analyze the identified issues using a defined procedure for corrective action.
The procedure for corrective action includes manual analysis and review of the issues
uncovered.
2-8
2-9
Justification Prevention /
for TI
detection
measures
Incorrect
[M1]
verification
Preceding or
result could
subsequent
prevent coding dynamic
standard
verification
violations
(testing) of the
from being
software
detected
[PBF_E2]
[PBF_UC1] TI1
Standards compliance [PBF_UC4]
analysis false
positive
Software does
not violate
coding
standard rules
[PBF_E3]
Complexity metrics
analysis incorrect
metrics value
[PBF_UC2] TI2
TD
Justification for TD
TD2
[M2]
TD1
Specified
procedure for
corrective action on
failure of source
code analysis
Complexity
[M1]
TD1
metrics could Preceding or
prevent the
subsequent
detection and dynamic
mitigation of verification
overly
(testing) of the
complex code. software
Code with
high
complexity is
more difficult
to test and has
a higher
likelihood of
error.
TCL
2-10
TCL1
Potential
malfunction or
erroneous output
[PBF_E4]
Quality metrics
reporting incorrect
metrics value
Use cases TI
[PBF_E5]
Non interference
[PBF_UC1, TI1
PBF_UC2,
PBF_UC3,
PBF_UC4,
PBF_UC5]
[PBF_UC1, TI2
PBF_UC2,
PBF_UC3,
PBF_UC4,
PBF_UC5]
[PBF_E6]
Usage of incorrect
input data
[PBF_UC3] TI2
[PBF_E7]
Misinterpretation of
results
[PBF_UC1, TI2
PBF_UC2,
PBF_UC3,
PBF_UC4,
PBF_UC5]
[PBF_E8]
Incorrect tool usage
[PBF_UC1, TI2
PBF_UC2,
PBF_UC3,
PBF_UC4,
PBF_UC5]
Justification Prevention /
for TI
detection
measures
Incorrect
[M3]
value for
Check of the
quality metrics underlying analysis
could prevent results for critical
a software
issues
problem from [M2] Specified
being detected procedure for
and analyzed corrective action on
failure of source
code analysis
Error in the
tool does not
impact
analysis
results
Incorrect or
[M_MISC1]
incomplete
Revision control
analysis
and configuration
results could management to
prevent errors identify the
from being
artifacts to be
detected
analyzed; Use of
checksums
Misinterpre- [M_MISC2]
tation of
Competency of the
analysis
project team
results could
prevent errors
from being
detected
Incorrect
[M_MISC2]
usage could
Competency of the
prevent errors project team
from being
detected
TD
Justification for TD
TD1
TD1
TCL
TD1
TD1
TCL1
TD1
TCL1
2-11
Potential
malfunction or
erroneous output
[PBF_E9]
Incorrect or modified
tool installation
Use cases TI
[PBF_E10]
Incorrect operational
environment
[PBF_UC1, TI2
PBF_UC2,
PBF_UC3,
PBF_UC4,
PBF_UC5]
[PBF_UC1, TI2
PBF_UC2,
PBF_UC3,
PBF_UC4,
PBF_UC5]
Justification Prevention /
TD
for TI
detection
measures
Incorrect or
[M_MISC3]
TD1
modified
Adherence to
installation
Installation
could prevent Instructions;
errors from
Integrity of Tool
being detected Installation
[M_MISC4]
Analysis of
available bug report
information
Incorrect
[M_MISC3]
TD1
operation
Adherence to
could prevent Installation
errors from
Instructions;
being detected Integrity of Tool
Installation
[M_MISC4]
Analysis of
available bug report
information
Justification for TD
TCL
TCL1
TCL1
There is a possibility that a safety requirement can be violated if Polyspace Bug Finder is
malfunctioning or producing erroneous output. According to the preceding analysis, the
maximum tool impact (TI) of the use cases taken into account for Polyspace Bug Finder is TI2.
According to the preceding analysis, the maximum required tool confidence level (TCL) for
Polyspace Bug Finder is TCLMAX2.
TV SD reviewed the generic tool classification and confirmed the results in Report to the
Certificate Z10 13 06 67052 012.
2-12
3-2
Evaluation of the tool development process (ISO 26262-8, Table 5, Method 1b).
Validation of the software tool (ISO 26262-8, Table 5, Method 1c).
According to ISO 26262-8, Table 5, these two methods are permissible for all ASILs.
For TCL2, method 1b is highly recommended for ASILs A, B, and C. Method 1c is highly
recommended for ASIL D.
TV SD carried out an independent tool qualification assessment. MathWorks submitted the
results of the methods applied to prequalify the Polyspace Bug Finder to TV SD.
TV SD reviewed the generic tool qualification artifacts for Polyspace Bug Finder and
confirmed the results in Report to the Certificate Z10 13 06 67052 012.
Tool qualification for the Polyspace Bug Finder can be claimed for TCL1 and TCL2 by
referencing the certification report and corresponding certificate.
3-3
3-4
4-2
4-3
4-4
4-5