Investigation of qualitative human oracle costs

Short Paper
Sheeva Afshan; Phil McMinn

The test data produced by automatic test data generators are often ‘unnatural’ particularly for the programs that make use of human-recognisable variables such as ‘country’, ‘name’, ‘date’, ‘time’, ‘age’ and so on. The test data generated for these variables are usually arbitrary- looking values that are complex for human testers to comprehend and evaluate. This is due to the fact that automatic test data generators have no domain knowledge about the program under test and thus the test data they produce are hardly recognised by human testers. As a result, the tester is likely to spend additional time in order to understand such data. This paper demonstrates how the incorporation of some domain knowledge into an automatic test data generator can significantly improve the quality of the generated test data. Empirical studies are proposed to investigate how this incorporation of knowledge can reduce the overall testing costs.

Type of Publication: Paper
Conference: PPIG 2011 - 23rd Annual Workshop
Publication Year: 2011
Paper #: 8
TitleInvestigation of qualitative human oracle costs
Publication TypePaper
AuthorsAfshan, S, McMinn, P
PPIG Workshop: 
2011-09-23rd