Testing Evidence

Prove It Works (black and white box testing)

  •  Visual indication of system checks can be used for:
    •  User interface testing and development
    •  Algorithm testing and development
    •  System connectivity
  • You may have a developers or admin page which presents the status of ALL data within the system in a table format which updated in real-time.
  • This could be used during the viva to show that the artefact internal control is responding to issues
  • For example

Computational_Testing_1

Refine Your Artefact (user testing, algorithm manipulation)

  • You must be able to prove to the markers that you have actually refined your artefact
    • Algorithm
      • Benchmarking
      • Display results in a chart and analysis
    • Interface
      • User testing
      • Display results in a chart and analysis
  • For example, a simple time-to-target test can provide a wealth of knowledge, see below
    • Now combine this with other tests like eye and mouse tracking

Refinement_Testing_2

Testing The Artefact

  • Testing the artefact requires a minimum of three stages
    • Real-world testing
      • Baseline – current performance
      • Using real-world data or respondents
    • Artefact Testing
      • Artefact works correctly
      • Artefact facets are refined
      • Use control data or test respondents
    • Real-world testing
      • Using real-world data or respondents
      • Compare new output with baseline output
      • In this example, there is a 5% difference

Testing_Top_Level_View

  • If your project does not have a baseline you need to be clear about the outcome based on research
    • For example: Increase security on website
      • Real-world testing after artefact creation must prove that the artefact is resistant to all specified attacks
  • All your results from these test stages can be used in your critical evaluation
  • We can visualise the test stages like this:

Artefact_and_Test_Data

  • However, it is critical that you create a test plan as this demonstrates your understanding and project management skills. The test plan needs to reflect the development lifestyle which you have selected (linear or nonlinear).
  • We can visualise a test plan like this: