Adapting XML Instance Generators for Web Service Testing

  • Erik Haugrud The King’s University
  • Andrew F. Tappenden* The King’s University


An automated testing framework for web services using generated XML instances is presented. Three existing XML instance generators are TAXI [1], ToXgene [2], and Agoxi [3]. Through the creation of a standardized evaluation framework, the three XML instance generators can be compared. The proposed evaluation framework uses mutation analysis to accurately simulate real world programming faults in order to measure the failure detecting ability of XML instance generators [4]. The development of a module responsible for adapting each of the XML instance generators for use in the evaluation framework is presented. Given a WSDL and a test generator, the module executes the selected generator and collects the output into a standardized file for use in the evaluation framework. The results can then be passed on to the framework’s test execution module which stores the outcome of the analysis in a database. Evaluating the XML instance generators with this framework will assist in choosing the most robust choice for web service testing.


[1] D. Barbosa, A. O. Mendelzon, J. Keenleyside, and K. Lyons, ToXgene: An extensible template-based data generator for XML, in IN WEBDB, 2002, pp. 49–54.
[2] A. Bertolino, J. Gao, E. Marchetti, and A. Polini, TAXI A Tool for XML-Based Testing, in 29th International Conference on Software Engineering - Companion, 2007. ICSE 2007 Companion, 2007, pp. 53–54.
[3] Vanderveen, P., Janzen, M., & Tappenden, A. F. (2014). A Web Service Test Generator. In The Proceeding of the 2014 International Conference on Software Maintenance and Evolution (pp. 516–520). Presented at ICSME 2014, Victoria, BC.
[4] Martens, A., & Tappenden, A. F. (2014). A Benchmark for Automated Web Service Testing. Presented at the 1st CCWSR Meeting, Edmonton, Canada.

*Indicates faculty mentor

Presentation Abstracts