medición

The European Data Portal, data.europa.eu, has just published its Data Maturity Index, an index that assesses the level of maturity of European countries in terms of open data. For its elaboration, an evaluation survey has been carried out and has been completed by 35 countries, including the 27 Member States of the European Union, three countries of the European Free Trade Association (Iceland, Norway and Switzerland) and five candidate countries (Bosnia and Herzegovina, Montenegro, Albania, Serbia and Serbia and Ukraine).  

In this year's edition, Spain obtained a score of 95% out of 100%. This places it in fifth place overall and in fourth place if only European Union (EU27) member countries are taken into account. This figure represents an improvement of three percentage points over last year's score and places Spain 12 points above the EU27 average (83%).  

The top positions in the ranking are occupied by France, Poland, Ukraine and Estonia. 

Above the EU27 average in all dimensions analyzed 

The index is accompanied by a report containing the analysis carried out and an overview of the good practices applied in Europe. In the case of Spain, it is above the EU-27 average in the four indicators analyzed:  

• Policy, focused on the open data policies of the different countries. It analyzes the existence of national governance models for open data management and the measures that have been applied to implement existing strategies. This is the indicator in which Spain obtains a higher score, with 99% compared to 89% in the EU27. The report highlights how the country's national open data strategy helps promote the openness of public information through innovative and structured actions in collaboration with public and private partners. Among other issues, the strategy includes the objective of identifying business models and business success stories to share successful practices. The report also highlights the existence of various digital strategies that complement specific policies on open data, such as the national artificial intelligence strategy, which includes provisions related to the availability of open data for the operation and training of artificial intelligence systems. 

• Impact, which analyzes the activities undertaken to monitor and measure both the reuse of open data and the impact created by such reuse. Traditionally, this has been the least mature dimension across Europe. Nevertheless, Spain scores 96% compared to 77% in the EU27. The best results are achieved in measuring the impact of open data use cases in the environmental, economic and political sectors.  

• Portal, focused on evaluating the functionalities of the national platform that allow users to access open data and help drive interaction within the community. With 96% compared to 85% in the EU27, Spain stands out in the use of analytical tools to understand user behavior, and in the implementation of strategies to ensure the sustainability of the portal and increase its visibility, including presence in social networks. It also highlights the existence of a private area that allows editors to act according to the feedback received. 

• Quality, which examines the mechanisms for ensuring the quality of (meta)data. Here Spain scores 88% compared to 82% in the EU27. Spain's score is driven by compliance with the DCAT-AP standard (providing educational materials for publishers), the existence of a systematic approach to ensure that metadata is up to date, and the wide range of data offered, both historical and current. 

The report also measures how EU27 countries are progressing in the implementation of the implementing regulation on high-value datasets. In this section, Spain ranks ninth, with 68% implementation. In general, Member States are making more progress on geospatial and statistical datasets. Progress is also being made on the underlying technical and legal requirements.  

Overall recommendations 

The report includes a number of recommendations for Spain, among other countries, including encouraging the development of initiatives at the local and regional level, fostering better coordination between teams, and activating the network of open data officers to implement monitoring activities within their organizations. Emphasis is also placed on the need to promote existing open data courses and promote new training materials, paying special attention to developing strategic awareness of the reuse and impact of open data.

Overall, the report shows good progress in open data across Europe. Although there are areas for improvement, the European open data landscape is consolidating, with Spain at the top of the table.  

In 2024, new waves of implementation of the European data strategy will present national teams with new challenges. On the one hand, they will have to redouble their efforts to inform citizens of the new data sources arising from initiatives such as the Data Governance Act and the data spaces. In this sense, coordination will be necessary between the new figures arising from these legislative developments and the traditional world of open data, enhancing the obvious synergies between the two to boost the data economy and collectivize the value generated. 

What are the needs of European public institutions that reuse open data? This is the question posed by the European Commission, through the European open data initiative data.europa.eu, and which is the starting point of the report "Measuring data demand within the public sector", recently published by the initiative.

The report is part of a series of actions that data.europa.eu is undertaking to encourage the re-use of data by the public sector. It is a year-long campaign that will include a series of articles and a webinar. The campaign will culminate in a second report on the findings.

This first report lays the groundwork for the issues to be addressed, setting out 3 objectives:

• Clarify the importance of public institutions as data re-users.
• Identify methods and good practices for assessing the demand from public institutions.
• Stimulate debate on the most appropriate way to foster the re-use of open data by public institutions.

Ultimately, the aim is to foster a data-driven public sector that recognises data as an integral asset for policy formulation, service delivery, management and public innovation.

The benefits of open data re-use by public institutions

Traditionally, in the open data ecosystem, an approach has been followed where the roles were divided: the public sector was the provider of data and the private sector was the re-user. However, this is changing and more and more institutions are realising the benefits of harnessing the potential of open data.

The report highlights how the OECD has identified three areas where data re-use can improve the effectiveness of public institutions:

1. Anticipating governance. Open data helps to predict trends and patterns in order to mitigate emerging risks and respond to developing crises. One example is the interactive dashboard developed by Eurostat with statistical, monthly and quarterly indicators. This dashboard is used by different countries to monitor the economic and social recovery linked to the COVID-19 pandemic.

2. Policy and service design and delivery. Open data helps to understand issues, engage citizens and drive evidence-based policy making. The report gives the example of the Baltic Sea regions, where cross-border use of open government data is being applied to improve social services.

3. Performance management. Open data can also have an impact on increased public sector productivity, more efficient use of resources and better policy evaluation. In this respect, the European Commission's agri-food data portal, which integrates data from multiple European institutions, facilitates the calculation of key indicators for the evaluation of agricultural policies in all countries.

Open data therefore helps to make public services and policies more efficient, but also more sustainable, inclusive and trustworthy, benefiting citizens and businesses. However, despite these advantages, we find that much data in public institutions still does not flow freely, but is siloed. There is a lack of incentive to share, but also a fear of loss of control, among other factors.

The report suggests that the solution lies in taking into account and measuring the demand for data from public institutions. Knowing the benefits of opening up certain data encourages other institutions to open up and reuse it. In this regard, the report highlights, among others, Spain's efforts in engaging with user communities and monitoring the re-use of public data through the Aporta Initiative.

Existing approaches to assessing public institutions' demand for data

After this first part focusing on the benefits, the report goes on to analyse the approaches and indicators that currently exist in the European landscape for assessing the needs of public institutions as data re-users, in order to determine which methods are the most appropriate.

The literature review and the analysis of international measurement frameworks show that demand measurement is not common. The approaches and indicators developed by EU institutions and Member States are few and far between, and focus on fostering demand for data that is already available, without determining the extent of actual re-use of publicly available data and the impact achieved with it. Moreover, they usually focus on re-users in general and on groups such as businesses, journalists, civil society, etc., while neglecting the public sector.

Among the most advanced countries in this area, the report mentions Spain, where a proactive strategy is adopted through challenges and hackathons, co-creation events, information sessions and regular training.

When it comes to measuring impact, a combination of quantitative and qualitative methods is recommended, for example:

• Analyse IP addresses and web statistics.
• Implement web crawling techniques (e.g. search APIs) to identify mentions of open data reuse.
• Quantitative analysis of Tweets mentioning open data.
• Conduct online questionnaires and interviews with re-users.
• Use of contact forms so that users can share use cases or rating systems so that they can rate datasets.

In Spain, quite a few initiatives have already implemented these mechanisms, along with additional ones.

The report also reviews some international indices and reports in search of indicators that measure demand. Many, such as the Global Open Data Index, the Open Data Barometer or the Open Data Inventory (ODIN) focus on data provision and do not include any indicators to calculate the demand for open data by or within public institutions. However, here too the situation is changing and we find other reports such as the European Open Data Maturity Assessment or the Open Data Readiness Assessment (ODRA) that do include this type of metric. Also the forthcoming Global Data Barometer, produced by the Latin American open data initiative ILDA and the Data for Development Network, will include demand indicators as part of the study.

In this sense, the report includes in the annex two tables, one with the overview of the frameworks examined and another one that groups the indicators included in these frameworks that can be used to analyse the demand for open data from public institutions.

Next steps

The paper concludes with a list of key questions emerging from the research, which will be used to trigger a debate among stakeholders on appropriate methods and indicators to measure the demand for data from public institutions, in the context of the data.europa.eu portal. Examples of such questions are: what are the appropriate activities to attract re-users in the public sector or how can automated metrics be leveraged to measure the demand for data from public institutions.

A webinar will take place on Tuesday 29 March to discuss this report. Speakers from different agencies will explain how they engage with data re-users in public institutions, measure their demand and incorporate data into their open data policies. You can register at this link.