Integral Test Development

This deliverable reports on the results from the activities carried out under the scope of COURAGEOUS WP4 Task 4.3 (Integral test methodology). The work that is carried out in this task, builds upon results reported in Deliverables D4.1 (Generation of Test Environment) and D4.2 (Functional Test Description), and follows up the information provided in Deliverables D2.3, D3.1 and D3.2. In this task, an integral test methodology for the Detection, Tracking and Identification (DTI) systems is given.
Based on the scenario’s provided in Deliverable D2.3 and the generic methodology drawn up in Deliverable D4.2, it is developed an integral test methodology for the full functionality of the DTI, given the DTI constitutes of a set of (sub-)functions that perform as required.
The methodology is drawn up to reveal the performance of the functions in interaction with each other, will take the presence of the DTI operator into account, and will support full DTI operation either with real or simulated data. The tests will allow for the full performance evaluation of the DTI, which encompasses the quality of the provided detection, probability of false positives and negatives, the clutter suppression, quality of the track result and the quality and reliability of the identification. Thereby the integral test methodology is well suited to reveal compliance with the operational requirements.
The test methodology is based on the evaluation of the interaction between the test environment described in Deliverable D4.1 and the DTI system and is suitable for in a simulation environment and in a relevant operational environment. The architecture presented in this deliverable shows how the methodology relates to the scenario and contextual information (e.g., environment), capturing of the integral DTI system output and the generation of evaluation-based ratings for the DTI system under test.