All aspects of the project impact will be measured in accordance with the participants and levels. They will be both quantitative and qualitative. The software and web instruments themselves will allow direct measurement of its users – trainers, artists and their audiences. The metrics that could be measured such as – number of OER units created, number of lessons learned and tested, number of users, type of users, time spent in the system, type of system instruments and OERs used – could be part of the impact measurement. There is also a need to measure the geography scope of the users, as well as their role – whether they are trainers, artists or their audiences. On a later stage of the project, the system will be more broadly opened and all Google Analytics features will be introduced – how the system is performing and measuring usage, conversions, and dissemination performance, and how people use the e-learning platform.
The measurement of the quality of the project outputs will be directly referred to the project partners and their network of peers. The diversity of the partnership and its cohesion within the character of the project will provide diverse and accomplished quality evaluation in terms of: (1) relevance of the project outputs to the adult educational system, provided by the project partners; (2) relevance of the application of the project outputs, provided by the project partners and their peers; (3) integration of the platform within the CSS training systems in the MS, partnering the project. The specific educational qualities of the project outputs, such as project penetration within the educational and public agenda, will be measured through desk research, interviewing and focus groups meetings within the project partnership.
In addition, the direct and indirect impact will be measured through preparation of ex-ante and ex-post questionnaires. Thus, they will set a base and further give feedback on the project implication of horizontal and vertical levels. Those questionnaires will also measure the beneficiaries satisfaction with the project outcomes.
However, the most reliable quantifiable measurements of the project impact will be:
– the total number of active learners and trainers in the system;
– the total numbers of active audiences on each event;
– the number of created educational resources – pilot and by the users.
– the number of modules in the system – developed and disseminated across project partners countries – through the direct and indirect project participants, on all levels.
– the number of software customisations after its launch.
– the number of reports, questionnaires, materials and papers, events and project meetings, etc.
– the number of translations.
The media coverage will also be used as a source for measurement of the project impact. The number of online, offline and TV posts and broadcasts will be measured, as well as comments and publications.