Methodology

The project Monitoring and evaluation of the project Rijeka 2020 – European Capital of Culture represents an important and pioneer evaluation endeavour. It is based on the unique opportunity of longitudinal key data gathering that relies on the established monitoring process and, parallelly, represents an important and innovative research contribution to the development of evaluation and monitoring of changes in the culture landscape of the Republic of Croatia and beyond. More than 30 experts offered by the Consortium are actively involved in the project Monitoring and evaluation of the project Rijeka 2020 – European capital of culture. The experts are gathered in an independent, multidisciplinary research team (academia, research institute, specialized agency for market research, management experts as partners in the monitoring and evaluation project). Our approach follows recommendations presented in the Guidelines for the cities’ own evaluations of the results of their European Capitals of Culture by the European Commission. The focus of this research is on the integrative system of longitudinal field research oriented on gathering and analysis of primary data, as well as strong representation of different quantitative methods of research tailored to peculiarities of social and cultural effect evaluation of the ECoC programme.

All research areas are further developed into subareas, and each of the subareas is complemented by its own set of indicators. The table below lays out the seven research areas with their respective subareas:

Research areas Research subareas
1. Cultural vibrancy and sustainability The level of cultural offer Innovative production Local and national programme specificity
Job creation and skills development in the cultural sector Investments in the cultural sector
2. Cultural approach and participation Extent of participation
Volunteers
Audience satisfaction
Cultural approach
3. Image of the city Perception
Media
4. Management and delivery process Project management and organisational development of the project Rijeka 2020 Sponsorships and revenues
Budget The scope of management and the delivery process
5. European dimension European cooperation European audience in the city and in the regional European perception
6. Economy and tourism Job creation in the relevant sectors Number of visitors Additional spending Accommodation
7. Other areas Social cohesion Urban regeneration Environmental sustainability

Considering the different areas of evaluation, the Consortium has established for teams (culture, society, economy, management). The sectoral approach shall guarantee maximal quality and competency of the experts in each of the teams for monitoring of indicators which are relevant for a particular sector.

The main focus groups of this monitoring and evaluation project are project implementors, as well as passive and active audience.

Monitoring of the Rijeka 2020 – Ecoc project shall make possible:

  • Better management – Monitoring increases the probability that the project will deliver high-quality outcomes on time;
  • Higher likelihood that reasons for success or failure of the project will be identified;
  • Dissemination of best practices;
  • Higher likelihood of fulfilling the prescribed requirements;
  • Contribution to assessment of the effectiveness of the projects funded by the EU.
  • During the project implementation the processes of evaluation and monitoring are being combined. In that sense, monitoring will be conducted relying on the result indicators (connected to the criterion of effectivity), indicators of effect (related to the criterion of impact), as well as indicators related to management (criterion of effectivity).
  Monitoring Evaluation
Users Operational stakeholders (‘’operational management’’) Leadership, strategic partners, the developers of ‘’strategic management’’ measures
When? Continuous   After the critical phase of implementation of strategic plan/project (one year into the implementation of the action plan), and/or at the end of the implementation period of the strategic plan/project
Why? Comparisons of planned and accomplished results The comparison of planned and accomplished goals, the evaluation of impacts, evaluation of methods used, goals chosen and strategy (approach)
Who? Project management   External evaluators, internal evaluators (quality control, internal boards and so on)