Towards ex vivo testing of mapreduce applications

Morán J., Bertolino A., De La Riva C., Tuya J.

Software testing  Metamorphic testing  Automatic testing  Ex vivo testing  Hadoop  Big Data  MapReduce 

Big Data programs are those that process large data exceeding the capabilities of traditional technologies. Among newly proposed processing models, MapReduce stands out as it allows the analysis of schema-less data in large distributed environments with frequent infrastructure failures. Functional faults in MapReduce are hard to detect in a testing/preproduction environment due to its distributed characteristics. We propose an automatic test framework implementing a novel testing approach called Ex Vivo. The framework employs data from production but executes the tests in a laboratory to avoid side-effects on the application. Faults are detected automatically without human intervention by checking if the same data would generate different outputs with different infrastructure configurations. The framework (MrExist) is validated with a real-world program. MrExist can identify a fault in a few seconds, then the program can be stopped, not only avoiding an incorrect output, but also saving money, time and energy of production resources.

Source: QRS 2017 - IEEE International Conference on Software Quality, Reliability and Security, pp. 73–80, Prague, Czech Republic, 25-29 July 2017

Metrics