TRUE: an Online Testing Platform for Multimedia Evaluation

TRUE (Testing platfoRm for mUltimedia Evaluation) is an online platform developed to create and perform subjective tests oriented to the evaluation of stimuli of different nature such as audio, video, graphics and text. Due to the high flexibility that the platform offers to researchers different kinds of tests can be carried out, such as emotion identification or quality assessment of synthesis systems, among others. The results can be used for different purposes depending on the research goals, e.g. to validate the emotional content of
multimedia data of a corpus or to measure the expressivity of synthesized elements. TRUE involves all the stages related to the tests lifecycle, from their creation to the results retrieval, and allows the evaluators to answer the tests using any computer with an Internet connection. Making things easy for evaluators helps to minimize negative effects of fatigue, but also allows researchers to focus their efforts on the analysis of the tests results rather than on the supervision.