Blog

One of the main objectives of Regulation (EU) of the European Parliament and of the Council of 13 December 2023 on harmonised rules for fair access to and use of data (Data Regulation) is to promote the development of interoperability criteria for data spaces, data processing services and smart contracts. In this respect, the Regulation understands interoperability as:

The ability of two or more data spaces or communication networks, systems, connected products, applications, data processing services or components to exchange and use data to perform their functions.

It explicitly states that 'interoperable and high quality data from different domains increase competitiveness and innovationand ensure sustainable economic growth', which requires that 'the same data can be used and reused for different purposes and in an unlimited way, without loss of quality or quantity'. It therefore believes that "a regulatory approach to interoperability that is ambitious and inspires innovation is essential toovercome the dependence on a single provider, which hinders competition and the development of new services".

Interoperability and data spaces

This concern already existed in the European Data Strategy where interoperability was seen as a key element for the valorisation of data and, in particular, for the deployment of Artificial Intelligence. In fact, interoperability is an unavoidable premise for data spaces, so that the establishment of appropriate protocols becomes essential to ensure their potential, both for each of the data spaces internally and also in order to facilitate a cross-cutting integration of several of them.

In this sense, there are frequent standardisation initiatives and meetings to try to establish specific interoperability conditions in this type of scenario, characterised by the diversity of data sources. Although this is an added difficulty, a cross-cutting approach, integrating several data spaces, provides a greater impact on the generation of value-added services and creates the right legal conditions for innovation.

According to the Data Regulation, those who participate in data spaces and offer data or data services to other actors involved in data spaces have to comply with a number of requirements aimed precisely at ensuring appropriate conditions for interoperability and thus that data can be processed jointly. To this end, a description of the content, structure, format and other conditions of use of the data shall be provided in such a way as to facilitate access to and sharing of the data in an automated manner, including in real time or allowing bulk downloading where appropriate.

It should be noted that compliance with technical and semantic standards for interoperability is essential for data spaces, since a minimum standardisation of legal conditions greatly facilitates their operation. In particular, it is of great importance to ensure that the data provider holds the necessary rights to share the data in such an environment and to be able to prove this in an automated way

Interoperability in data processing services

The Data Regulation pays particular attention to the need to improve interoperability between different data processing service providers, so that customers can benefit from the interaction between each of them, thereby reducing dependency on individual providers.

To this end, firstly, it reinforces the reporting obligations of providers of this type of services, to which must be added those derived from the general regulation on the provision of digital content and services general regulation on the provision of digital content and services. In particular, they must be in writing:

  • Contractual conditions relating to customer rights, especially in situations related to a possible switch to another provider or infrastructure.
  • A full indication of the data that may be exported during the switching process, so that the scope of the interoperability obligation will have to be fixed in advance. In addition, such information has to be made available through an up-to-date online registry to be offered by the service provider.

The Regulation aims to ensure that customers' right to free choice of data service provider is not affected by barriers and difficulties arising from lack of interoperability. The regulation even contemplates an obligation of proactivity so that the change of provider takes place without incidents in the provision of the service to the customer, obliging them to adopt reasonable measures to ensure "functional equivalence" and even to offer free of charge open interfaces to facilitate this process. However, in some cases - in particular where two services are intended to be used in parallel - the former provider is allowed to pass on certain costs that may have been incurred.

Ultimately, the interoperability of data processing services goes beyond simple technical or semantic aspects, so that it becomes an unavoidable premise for ensuring the portability of digital assets, guaranteeing the security and integrity of services and, among other objectives, not interfering with the incorporation of technological innovations, all with a marked prominence of cloud services.

Smart contracts and interoperability

The Data Regulation also pays particular attention to the interoperability conditions allowing the automated execution of data exchanges, for which it is essential to set them in a predetermined way. Otherwise, the optimal operating conditions required by the digital environment, especially from the point of view of efficiency, would be affected.

The new regulation includes specific obligations for smart contract providers and also for those who deploy smart contract tools in the course of their commercial, business or professional activity. For this purpose, a smart contract is defined as a contract that

a computer programme used for the automated execution of an agreement or part thereof, which uses a sequence of electronic data records and ensures their completeness and the accuracy of their chronological order

They have to ensure that smart contracts comply with the obligations of the Regulation as regards the provision of data and, among other aspects, it will be essential to ensure "consistency with the terms of the data sharing agreement that executes the smart contract". They shall therefore be responsible for the effective fulfilment of these requirements by carrying out a conformity assessment and issuing a declaration of compliance with these requirements.

To facilitate the enforcement of these safeguards, the Regulation provides for a presumption of compliance where harmonised standards published in the Official Journal of the European Union are respected the Commission is authorised to request European standardisation organisations to draw up specific provisions.

In the last five years, and in particular since the 2020 Strategy, there has been significant progress in European regulation, which makes it possible to state that the right legal conditions are in place to ensure the availability of quality data to drive technological innovation. As far as interoperability is concerned, very important steps have already been taken, especially in the public sector public sector where we can find disruptive technologies that can be extremely useful. However, the challenge of precisely specifying the scope of the legally established obligations still remains.

For this reason, the Data Regulation itself empowers the Commission toadopt common specifications to ensure effective compliance with the measures it envisages if necessary. However, this is a subsidiary measure, as other avenues to achieve interoperability, such as the development of harmonised standards through standardisation organisations, must be pursued first.

In short, regulating interoperability requires an ambitious approach, as recognised by the Data Regulation itself, although it is a complex process that requires implementing measures at different levels that go beyond the simple adoption of legal rules, even if such legislation represents an important step forward to boost innovation under the right conditions, i.e. beyond simple technological premises.


Content prepared by Julián Valero, Professor at the University of Murcia and Coordinator of the Research Group "Innovation, Law and Technology" (iDerTec). The contents and points of view reflected in this publication are the sole responsibility of its author.

calendar icon
Blog

The European Drug Report provides a current overview of the drug situation in the region, analysing the main trends and emerging threats. It is a valuable publication, with a high number of downloads, which is quoted in many media outlets.

The report is produced annually by the European Union Drugs Agency (EUDA), the current name of the former European Monitoring Centre for Drugs and Drug Addiction. It collects and analyses data from EU Member States, together with other partner countries such as Turkey and Norway, to provide a comprehensive picture of drug use and supply, drug harms and harm reduction interventions. The report contains comprehensive datasets on these issues disaggregated at the national level, and even, in some cases, at the city level (such as Barcelona or Palma de Mallorca).

This study has been carried out since 1993 and translated into more than 20 official languages of the European Union. However, in the last two years it has introduced a new feature: a change in internal processes to improve the visualisation of the data obtained. A process they explained in the recent webinar "The European Drug Report: using an open data approach to improve data visualisation", organised by the European Open Data Portal (data.europa.eu) on 25 June. The following is a summary of what the Observatory's representatives had to say at this event.

The need for change

The Observatory has always worked with open data, but there were inefficiencies in the process. Until now, the European Drug Report has always been published in PDF format, with the focus on achieving a visually appealing product. The internal process leading up to the publication of the report consisted of several stages involving various teams: 

  1. A team from the Observatory checked the format of the data received from the supplier and, if necessary, adapted it.
  2. A specialised data analysis team created visualisations from the data.
  3. A specialised drafting team drafted the report. The team that had created the visualisations could collaborate in this phase.
  4. An internal team validated the content of the report.
  5. The data provider checked that the Observatory had interpreted the data correctly.

Despite the good reception of the report and its format, in 2022 the Observatory decided to completely change the publication format for the following reasons:

  • Once the various steps of the publication process had been initiated, the data were formatted and were no longer machine-readable. This reduced the accessibility of the data, e.g. for screen readers, and limited its reusability.
  • If errors were detected in the different steps of the process, they were corrected directly on the format of the data in this step. In other words, if an error was detected in a chart during the revision phase, it was corrected directly on that chart. This procedure could cause errors and dull the traceability of data, limiting efficiency: the same static graph could be present several times in the document and each mention had to be corrected individually.
  • At the end of the process, the format of the source data had to be adjusted due to changes in the publication procedure.
  • Many of the users who consulted the report did so from a mobile device, for which the PDF format was not always suitable.
  • Because they are neither accessible nor mobile-friendly, PDF documents did not usually appear as the first result in search engines. This point is important for the Observatory, as many users find the report through search engines.

A responsive web format was needed, which automatically adjusts a website to the size and layout of its users' devices.  The aim was to:

  • Improved accessibility.
  • A more streamlined process for creating visualisations.
  • An easier translation process.
  • An increase in visitors from search engines.
  • Greater modularity.

The process behind the new report

In order to completely transform the publication format of the report, an ad hoc visualisation process has been carried out, summarised in the following image:

Process for creating visualizations for the European Drug Report. The user accesses the web page. The web server returns the page in html.  Browser downloads all necessary files, including the data visualization library.  The visualization library inspects the web page for “chart parameters”, downloads the data and creates a JS object that can be understood by HighCharts (or another charting library).  HighCharts creates the charts.  Source:  Webinar “The European Drug Report using an open data approach to improve data visualisation”, organized by data.europa.eu.

Figure 1. Process for creating visualizations for the European Drug Report. Source EN: Webinar “The European Drug Report using an open data approach to improve data visualisation”, organized by data.europa.eu.

The main new feature is that visualisations are created dynamically from the source data. In this way, if something is changed in these data, it is automatically changed in all visualisations that feed on it. Using the Drupal content management system, on which much of the site is based, administrators can register changes that will automatically be reflected in the HTML and therefore in the displays. In addition, site administrators have a visualisation generator which, based on data and indications - equivalent to simple instructions such as "sort from highest to lowest" expressed in HTML - creates visualisations without the need to touch code.

The same dynamic update procedure applies to the PDF that the user can download. If there are changes in the data, in the visualisations or if typographical errors are corrected, the PDF is generated again through a compilation process that the Observatory has created specifically for this task.

The report after the change

The report is currently published in HTML version, with the possibility to download chapters or the full report in PDF format. It is structured by thematic modules and also allows the consultation of annexes.

Furthermore, the data are always published in CSV format and the licensing conditions of the data (CC-BY-4.0) are indicated on the same page. The reference to the source of the data is always made available to the reader on the same page as a visualisation.

With this change in procedure and format, benefits for all have been achieved. From the readers' point of view, the user experience has been improved. For the organisation, the publication process has been streamlined.

In terms of open data, this new approach allows for greater traceability, as the data can be consulted at any time in its current format. Moreover, according to the Observatory speakers, this new format of the report, together with the fact that the data and visualisations are always up-to-date, has increased the accessibility of the data for the media.

You can access the webinar materials here:

calendar icon
Blog

The cross-cutting nature of open data on weather and climate data has favoured its use in areas as diverse as precision agriculture, fire prevention or the precision forestry. But the relevance of these datasets lies not only in their direct applicability across multiple industries, but also in their contribution to the challenges related to climate change and environmental sustainability challenges related to climate change and environmental sustainability, which the different action lines of the which the different action lines of the European Green Pact seek to address.

Meteorological data are considered by the European Commission, high value data in accordance with the annex to Regulation 2023/138. In this post we explain which specific datasets are considered to be of high value and the level of availability of this type of data in Spain.

The State Meteorological Agency

In Spain, it corresponds to the State Agency for Meteorology (AEMET) the mission of providing meteorological and climatological services at national level. As part of the Ministry for Ecological Transition and the Demographic Challenge. AEMET leads the related activities of observation, prediction and study of meteorological and climatic conditions, as well as research related to these fields. Its mission includes the provision and dissemination of essential information and forecasts of general interest. This information can also support relevant areas such as civil protection, air navigation, national defence and other sectors of activity.

In order to fulfil this mission, AEMET manages an open data portal that enables the reuse by natural or legal persons, for commercial or non-commercial purposes, of part of the data it generates, prepares and safeguards in the performance of its functions. This portal, known as AEMET OpenData currently offers two modalities for accessing and downloading data in reusable formats:

  • General access, which consists of graphical access for the general public through human-friendly interfaces.
  • AEMET OpenData API, designed for periodic or scheduled interactions in any programming language, which allows developers to include AEMET data in their own information systems and applications.

In addition, in accordance with Regulation 2023/138, it is envisaged to enable a third access route that would allow re-users to obtain packaged datasets for mass downloading where possible.

In order to access any of the datasets, an access key (API Key) which can be obtained through a simple request in which only an e-mail address is required, without any additional data from the applicant, for the sending of the access key. This is a control measure to ensure that the service is provided with adequate quality and in a non-discriminatory manner for all users.

AEMET OpenData also pioneered the availability of open meteorological data in Europe, reflecting AEMET''s commitment to the continuous improvement of meteorological services, support to the scientific and technological community, and the promotion of a more informed and resilient society in the face of climate challenges.

High-value meteorological datasets

The Annex to Regulation (EU) 2023/138 details five high-value meteorological data sets: weather station observations, validated weather data observations, weather warnings, radar data and numerical prediction model (NMP) data. For each of the sets, the regulation specifies the granularity and the main attributes to be published.

If we analyse the correspondence of the datasets that are currently available grouped in 14 categories in the portal AEMET OpenData portal, with the five datasets that will become mandatory in the coming months, we obtain the conclusions summarised in the following table:

High-value meteorological datasets Equivalence in the AEMET OpenData datasets
Observation data measured by meteorological stations The "Conventional Observation" dataset, generated by the Observing Service, provides a large number of hourly variables on liquid and solid precipitation, wind speed and direction, humidity, pressure, air, soil and subsoil temperature, visibility, etc. It is updated twice an hour. In accordance with the Regulation, ten-minute data shall be included with continuous updating.
Climate data: validated observations Within the category "Climatological Values", four datasets on climate data observations are provided: "Daily climatologies", "Monthly/annual climatologies", "Normal values" and "Recorded extremes". The validated dataset provided by the National Climatological Data Bank Service is normally updated once a day with a delay of four days due to validation processes. Attributes available include daily mean temperature, daily precipitation in its standard 07:00 to 07:00 measurement form, daily mean relative humidity, maximum gust direction, etc. In accordance with the Regulation, the inclusion of hourly climatology is planned.
Weather warnings Adverse weather warnings" are provided for the whole of Spain, or segmented by province or Autonomous Community. Both the latest issued and the historical ones since 2018. They provide data on observed and/or forecast severe weather events, from the present time until the next 72 hours. These warnings refer to each meteorological parameter by warning level, for each weather zone defined in the Meteoalert Plan. It is generated by the Adverse Events Functional Groups and the information is available any time an adverse weather event is issued, in line with the Regulation, which requires the dataset to be published "as issued or hourly". In this case, AEMET announces preferential broadcasting hours: 09:00, 11:30, 23:00 y 23:50.
Radar data There are two sets of data: "Regional radar graphic image" and "National radar composition image", which provide reflectivity images, but not the others described in the Regulation (backscatter, polarisation, precipitation, wind and echotop). The dataset is generated by the Land Remote Sensing group and the information is available at a periodicity of 10 minutes instead of the 5 minutes recommended in the Regulation. However, according to the Strategic Plan 2022-2025 of the AEMET the updating of the 15 weather radars and the incorporation of new radars with higher resolution is foreseen, so that in addition to strengthening the early warning system, the obligations of the Regulation can be fulfilled.
PMN model data There are several datasets with forecast information, some available for download and some available on the web: weather forecast, normalised text forecast, specific forecasts, maritime forecast and maps of weather variables maps of the HARMONIE-AROME numerical models for different geographical areas and time periods. However, the AEMET, according to their frequently asked questions document does not currently consider numerical model outputs as open data. AEMET offers the possibility of requesting this or any other dataset through the general register  or through the electronic site but this is not an option provided for in the Regulation. In line with this, the inclusion of numerical atmospheric and wave model outputs is foreseen.

Figure 1: Table showing the equivalence between high value datasets and AEMET OpenData datasets.

 

The regulation also sets out a number of requirements for publication in terms of format, licence granted, frequency of updating and timeliness, means of access and metadata provided.

In the case of metadata, AEMET publishes, in machine-readable format, the main characteristics of the downloaded file: who prepares it, how often it is prepared, what it contains and its format, as well as information on the data fields (meteorological variable, unit of measurement, etc.). The copyright and terms of use are also specified by means of the legal notice. In this regard, it is foreseen that the current licences will be reviewed to make the datasets available under a licensing scheme compliant with the Regulation, possibly following the recommendation by adopting the license CC BY-SA 4.0.

All in all, it seems that the long track record of the State Meteorological Agency (AEMET) in providing quality open data has put it in a good position to comply with the requirements of the new regulation, making some adjustments to the datasets it already offers through AEMET OpenData to align them with the new obligations. AEMET plans to include in this service the datasets required by the Regulation and which are currently not available, as it adapts its regulations on public prices, as well as the infrastructure and systems that make this possible. Additional datasets that will be available will be ten-minute observation data, hourly climatologies and some data parameters from regional radars and numerical wave and forecast models.


Content prepared by Jose Luis Marín, Senior Consultant in Data, Strategy, Innovation & Digitalization. The contents and views reflected in this publication are the sole responsibility of the author.

calendar icon
Blog

Spain, as part of the European Union, is committed to the implementation of the European directives on open data and re-use of public sector information. This includes the adoption of initiatives such as the Implementing Regulation (EU) 2023/138 issued by the European Commission, which defines specific guidelines for government entities with regard to the availability of High value datasets (HVD). These data are categorised into themes previously detailed in earlier discussions: Geospatial, Earth Observation and Environment, Meteorology, Statistics, Societies and Societal Properties, and Mobility. In this article we will focus on the last group mentioned.

The Mobility category encompasses data collections falling under the domain of "Transport Networks", as demarcated in Annex I of the Directive 2007/2/EC of the European Parliament and of the Council of 14 March 2007 establishing an Infrastructure for Spatial Information in the European Community (INSPIRE). In particular, this Directive refers to the requirement to make available to users datasets relating to road, rail, air and inland waterway networks, with their associated infrastructure, connections between different networks and the trans-European transport network, as defined by Decision No 1692/96/EC of the European Parliament and of the Council of 23 July 1996 on Community guidelines for the development of the trans-European transport network.

In addition, it includes the datasets as described in the Directive 2005/44/EC of the European Parliament and of the Council of 7 September 2005 on harmonised River Information Services (RIS) on inland waterways in the Community. The main objective of the Directive is to improve inland waterway traffic and transport, and it applies to canals, rivers, lakes and ports capable of accommodating vessels of between 1,000 and 1,500 tonnes. These datasets include:

Data type Inland waterways datasets
Static data
  • Fairway characteristics
  • Long-time obstructions in the fairway and reliability
  • Rates of waterway infrastructure charges
  • Other physical limitations on waterways
  • Regular lock and bridge operating times
  • Location and characteristics of ports and transhipment sites
  • List of navigation aids and traffic signs
  • Navigation rules and recommendations
Dynamic data
  • Water depths contours in the navigation channel
  • Temporary obstructions in the fairway
  • Present and future water levels at gauges
  • State of the rivers, canals, locks and bridges
  • Restrictions caused by flood and ice
  • Short term changes of lock and bridge operating times
  • Short term changes of aids to navigation
Inland electronic and navigational charts (Inland ENC according to the Inland ECDIS Standard)
  • Waterway axis with kilometres indication
  • Links to the external xml-files with operation times of restricting structures
  • Location of ports and transhipment sites
  • Reference data for water level gauges relevant to navigation
  • Bank of waterway at mean water level
  • Shoreline construction
  • Contours of locks and dams
  • Boundaries of the fairway/navigation channel
  • Isolated dangers in the fairway/navigation channel under and above water
  • Official aids-to-navigation (e.g. buoys, beacons, lights, notice marks)

Figure 1: Table with the high value datasets related to Directive 2005/44/EC for the creation of a trans-European river information network.

In order for all of us to make the most of the information available, the Regulation defines some basic rules on how this data is shared:

  • Free and easy to use. The data must be ready to be used and shared with everyone for any purpose by acknowledging and citing the source of the data, as prescribed by the Creative Commons BY 4.0 licence.
  • Easy to read and use. Data will be presented in a way that both people and computers can easily understand them and everything will be explained in public.
  • Direct and easy access. There will be special ways (called APIs) that allow programs to access data automatically. In addition, the user can alternatively download a lot of information at once.
  • Always up to date. It is important that data is up to date, so there will be access to the most recent version. But if the user needs to access previous data, it will also be possible to view previous versions.
  • Detailed and precise. Data will be shared in as much detail as possible, to a very fine level of accuracy, so that the whole territory is covered when combined.
  • Information on information. There will be "information about the information" (metadata) that will tell everything about the data. The metadata shall contain at least the elements listed in the Annex to Commission Regulation (EC) No 1205/2008 of 3 December 2008.
  • Understandable and orderly: It will explain well how the data are organised and what all means, in a way that is easy for everyone to understand (structure and semantics).
  • Common language. Data shall use vocabularies, code lists and categories that are recognised and accepted at European or global level.

in Spain, who is responsible for the creation and maintenance of mobility data?

In Spain, the responsibility for the creation and maintenance of mobility data generally lies with different governmental entities, depending on the type of mobility and the territorial scope:

  • Level national level. The Ministry of Transport and Sustainable Mobility is the main body in charge of mobility in terms of infrastructure and transport at national level. This would include data on roads, railways, air and maritime transport.
  • Regional and local level. Autonomous communities and municipalities also play an important role in urban and regional mobility. They are responsible for urban mobility, public transport and public roads, within their respective jurisdictions.
  • Public business entities. There are entities such as ADIF (acronym for Administrador de Infraestructuras Ferroviarias, that is Railway Infrastructure Administrator), AENA (acronym for Aeropuertos Españoles y Navegación Aérea, that is Spanish Airports and Air Navigation), Puertos del Estado (State Ports) and others tentities hat manage specific data related to their field of action in rail, air and maritime transport, respectively.

In Spain, the Ministry of Transport and Sustainable Mobility, in collaboration with the autonomous communities, plays a key role in providing access to a wide range of mobility data. In compliance with INSPIRE and LISIGE (Law 14/2010 of 5 July 2010 on geographic information infrastructures and services in Spain, which transposes the INSPIRE Directive), it offers resources such as the Geoportal of the Spatial Data Infrastructure of Spain (IDEE in Spanish acronyms) where citizens and professionals can access geographic data and services, especially with regard to mobility.

Does Spain comply with the HVD Mobility Regulation?

To solve this question we have to go to the INSPIRE Geoportal  where official information classified as high value datasets in Europe is available. Specifically in the mobility category.

Inspire portal snapshot of high-value mobility data

Figure 2: Screenshot of the Inspire Geoportal.

As of April 2024 Spain has published the following information in the INSPIRE Geoportal:

  • Port service areas in Spain. The port service areas include the cartographic and alphanumeric information of the land service area and water areas I and II. The Spanish State-owned Port System is made up of 46 ports of general interest, managed by 28 Port Authorities.
  • Spanish Transport Networks. The Transport Network of the Geographic Reference Information of the National Cartographic System of Spain is a three-dimensional network of national coverage, defined and published in accordance with the INSPIRE Directive, which contemplates five modes of transport: road, rail, inland waterways, air and cable, together with their respective intermodal connections and the infrastructures associated with each mode. This information has the linear geometry of the roads and the punctual geometry of the portals and kilometre points.
  • ADIF''s Spanish Rail Transport Network. Public geographic dataset on the adaptation of the Spanish ADIF Common Traamification to the INSPIRE regulations (Transport Networks Annex I).

The publication of these high-value datasets responds positively to the question of Spain''s compliance with the HVD regulation, and is an achievement that reflects Spain''s continued commitment to transparency and access to mobility data.

The joint effort between the Ministry of Transport, Mobility and Urban Agenda, the National Cartographic System and the Autonomous Communities and Public Business Entities underlines the importance of a collaborative approach to mobility information management.

The availability of this data highlights Spain''s commitment to publishing high-value datasets and underlines the importance of continuously improving access to information to optimise inland navigation and mobility data.


Content prepared by Mayte Toscano, Senior Consultant in Data Economy Technologies. The contents and points of view reflected in this publication are the sole responsibility of its author.

calendar icon
Blog

The transformative potential of open data initiatives is now widely recognised as they offer opportunities for fostering innovation, greater transparency and improved efficiency in many processes. However, reliable measurement of the real impact of these initiatives is difficult to obtain.

From this same space we have also raised on more than one occasion the recurring question of what would be the best way to measure the impact of open data, we have reviewed different methods and best practices to try to quantify it, as well as to analyse it through detailed use cases or the specific impact on specific topics and sectors such as employment, geographic data, transport or sustainable development objectives. Now, thanks to the report "Indicators for Open Data Impact Assessment" by the data.europa.eu team, we have a new resource to not only understand but also be able to amplify the impact of open data initiatives by designing the right indicators. This publication will provide a quick analysis of the importance of these indicators and also briefly explain how they can be used to maximise the potential of open data.

Understanding open data and its value chain

Open data refers to the practice of making data available to the public in a way that makes it freely accessible and usable. Beyond ensuring simple availability, the real value of open data lies in its use in various domains, fostering economic growth, improving public sector transparency and driving social innovation. However, quantifying the real impact of data openness poses significant challenges due to the multiple ways in which data is used and the wide-ranging implications it can have for society. 

To understand the impact of open data, we must first understand its value chain, which will provide us with a structured and appropriate framework for transforming raw data into actionable insights. This chain includes four main stages that form a continuous process from the initial production to the final use of the data: 

Figure 1: Open Data Value Chain

  1. Collection: this consists of identifying existing data and establishing the necessary procedures for their cataloguing.
  2. Publication: making data available in an accessible form and easy to locate.
  3. Uptake:will come sooner when data is easy to use and accompanied by the right incentives to use it.
  4. Application:either through direct consumption of the data or through some transformation that adds new value to the initial data.

Each of these steps will play a critical role in contributing to the overall effectiveness and value derived from open data. The indicators developed to assess the impact of open data will also be closely linked to each of these stages, providing a holistic view of how data is transformed from simple information into a powerful tool for development.

Indicators for impact assessment

The report introduces a set of robust indicators that are specifically designed to monitor open data initiatives through their outputs, outcomes and impact as a result of their value chain. These indicators should not be seen as simple metrics, but as tools to help us understand the effectiveness of open data initiatives and make strategic improvements. Let us look at these indicators in a little more detail:

  • Output indicators: are those that focus on measuring the immediate results that come from making open data available. Examples would be the number of datasets released, the frequency of dataset updates , the number of visitors to the data catalogue, the accessibility of the data across various platforms, or even the efforts made to promote the data and increase its visibility. Output indicators help us to assess the efficiency of data publication and dissemination processes and are generally easy to measure, although they will only give a fairly superficial measure of impact.

  • Indicators of effect: Outcome indicators measure the short- and medium-term consequences of open data. These indicators are crucial to understand how open data influences decision-makingprocesses, leads to the development of new applications or improves government transparency. Thus, improved public transport planning based on usage data, increased citizen participation in the development of public policies to tackle climate change brought about by the increased availability of data and information, or improved productivity of public services through the use of data can be considered as significant examples of outcome indicators.

  • Impact indicators: This is the deepest level of measurement, as impact indicators assess the broader, long-term effects of open data. These indicators may include economic benefits such as job creation or GDP growth, social impacts such as improved trust in public entities, or even environmental impacts such as the effective reduction of greenhouse gases. At this level, indicators are much more complex and specific, and should therefore be defined for each specific domain to be analysed and also according to the objectives set within that domain.

Figure 2: Indicators for impact assessmen

Implementing these indicators in practice will require the implementation of a robust methodological framework that can capture and analyse data from a variety of sources. It is recommended to combine automated and survey-based data collection methods to collect more comprehensive data. This type of dual approach allows for capturing quantitative data through automated systems while also incorporating qualitative insights through user feedback and more in-depth use case analysis.

Looking to the future

The future of open data impact assessment looks towards refining the indicators used for measurement and consolidating them through the use of interactive monitoring tools. Such tools would enable the possibility of a more continuous assessment that would provide real-time information on how open data is being used and its effects in different sectors. In addition, the development of standardised metrics for these indicators would facilitate comparative analysis across regions and over time, further improving the overall understanding of the impact of open data.

Another important factor to take into account are possible privacy and ethical considerations applicable to the selected indicators. As in any other data-centric initiative, privacy and data protection considerations will be paramount and mandatory for the indicators developed. However, once we get into its use by users, it could lead to more delicate situations. Generally, this should not be a particularly problematic issue when monitoring data. However, once we get into its use by users, it could lead to more delicate situations. Ensuring anonymity in indicators and secure practices in their management is also crucial to maintaining trust and integrity in open data processes.

In conclusion, the development and implementation of specific detailed indicators following the recommendations of the report"Indicators for an Open Data Impact Assessment" would be a significant step forward in terms of how we measure and understand the impact of open data.Continuous refinement and adaptation of these indicators will also be crucial as they evolve in tandem with the open data strategies they accompany and their growing sphere of influence. In the medium term the European Commission will further develop its analysis in this area of work through the data.europa.eu project with the ultimate goal of being able to formulate a common methodology for the assessment of the impact of the re-use of public data and to develop an interactive monitoring tool for its implementation.


Content prepared by Carlos Iglesias, Open data Researcher and consultant, World Wide Web Foundation. The contents and views expressed in this publication are the sole responsibility of the author.

calendar icon
Blog

The European Commission Implementing Regulation (EU) 2023/138 sets clear guidelines for public bodies on the availability of high-value datasets within 16 months from 20 January 2023. These high-value high value datasets (High value datasets or HVD) are grouped into the following themes, which were already described in this post: geospatial Earth observation and environment, Meteorology, Statistics, Societies and corporate ownership, and Mobility.

This article focuses on the category of Earth observation and environment, referred to as High Value Datasets for Earth Observation and Environment (HVDOM ).

Earth observation and environmental data in the regulation of high-value arrays

The HVDOM include data obtained in the following areas:

  • Spatial or remotely sensed data.
  • Ground or in situ data.

In particular, public bodies are faced with the obligation to make available to citizens high-value datasets that appear in various pieces of legislation:

  1. The environmental and climate datasets listed in the annexes of the Directive 2007/2/EC of the European Parliament and of the Council of 14 March 2007 establishing an Infrastructure for Spatial Information in Europe ( INSPIRE) indicated in the following visual:
Inspire theme Appendix
Hydrography I
Protected sites I
Elevations II
Geology II
Land cover II
Orthoimaging II
Areas to management, restrictions or regulations and reporting units III
Biogeographical regions III
Energy resources III
Environmental observation facilities III
Habitats and biotopes III
Land use III
Mineral resources III
Natural hazard zones III
Oceanographic geographical features III
Production and industrial facilities III
Marine regions III
Soils III
Species distribution III

 

2. Data sets produced in the context of legal acts and known as priority data, defined in the table below:

Ámbito Medioambiental Actos jurídicos que establecen las principales variables
Air Directive 2008/50/CE Air Quality Directive
Directive 2004/107/CE It adresses arsenic, cadmium, mercury, nickel and polycyclic aromatic hydrocarbons in ambient air.
Climate Regulation (UE) 2018/1999 Governance of the Energy Union and Climate Action.
Regulation (CE) 1005/2009 Substances that deplete the ozone layer.
Emissions Directive 2010/75/UE Industrial Emissions Directive.
Directive 2012/18/UE SEVESO III Directive.
Directive 91/676/CEE Nitrates Directive.
Regulation (CE) 166/2006 European Pollutant Release and Transfer Register.
Regulation (UE) 2017/852 Mercury Regulation.
Directive (EU) 2016/2284 Reduction of national emissions of certain atmospheric pollutants.
Nature protection and biodiversity Directive 2009/147/CE Birds directive
Directive 92/43/CEE Habitats Directive
Regulation (UE) 1143/2014 Invasive Alien Species Directive
Data for the inventory of nationally designated protected areas (NDAAs), national biogeographic regions EEA Annual Work Programme - Nationally Designated Areas - CDDA National legislation - National biogeographic regions
Noise Directive 2002/49/CE Noise Directive
Waste Directive 1999/31/CE Landfill Directive
Directive 2006/21/CE Directive on extractive waste
Directive 86/278/CEE Sewage Sludge Directive
Directive 91/271/CEE Urban Waste Water Treatment Directive
Regulation (UE) 2019/1021 Persistent Organic Pollutants (POPs) Regulation
Recommendation 2014/70/UE Recommendation on hydraulic fracturing
Water Directive 91/271/CEE Urban Waste Water Treatment Directive
Directive 98/83/CE Drinking Water Directive
Directive 2006/7/CE Bathing Water Directive
Directive 2000/60/CE Water Framework Directive
Directive 2006/118/CE Groundwater Directive
Directive 2008/105/CE Environmental Quality Standards Directive
Directive 2020/2184/UE Drinking Water Directive
Directive 2007/60/CE Floods Directive
Directive 2008/56/CE Marine Strategy Framework Directive
Horizontal legislation Directive 2004/35/CE Prevention and remediation of environmental damage
Regulation (UE) 2020/852 EU Taxonomy

 

At this URL of the INSPIRE register, the list of datasets related to environmental reporting, to be made available by Member States in a step-by-step manner, is published.

To ensure the accessibility and re-use of all these valuable datasets, it is imperative to follow certain provisions to facilitate their publication. Here are the key requirements, which are common to all categories:

  • Open licence: All datasets must be made available for reuse under a licence Creative Commons BY 4.0 or any equivalent less restrictive open licence. This encourages the freedom to share and adapt information.
  • Open and machine-readable format: Data should be presented in an open, machine-readable format and be publicly documented. This ensures that the information is easily understandable and accessible to any person or automated system.
  • Application Programming Interfaces (APIs) and bulk downloading: Application programming interfaces (APIs) should be provided to facilitate programmatic access to data such as direct access download services like Web Feature Services, WFS. In addition, direct bulk downloading of datasets should be possible, allowing flexible options for users according to their needs
  • Updated version: The availability of datasets in their most up-to-date version is essential. This ensures that users have access to the latest information, promoting the relevance and accuracy of data. Therefore, it will be necessary to have the most up-to-date datasets as well as historical versions of the available datasets.
  • Scale and granularity: Data will need to be published at the available levels of generalisation up to the scale of 1:5000, and covering the whole Member State when combined. If datasets are not available at this scale, but are available at higher spatial resolutions, they shall be provided at the available spatial resolution.
  • Metadata: The metadata describing the data concerning the set of themes within the scope of the INSPIRE infrastructure for spatial information shall contain at least the metadata elements set out in the Annex to the Commission Regulation (EC) No 1205/2008 of 3 December 2008of 3 December 2008.
  • Semantics: The datasets shall be described in a comprehensive and publicly available online documentation describing at least the data structure and semantics.
  • Vocabularies: The datasets shall use Union-controlled or internationally recognised and publicly documented vocabularies and taxonomies. Such as the checklists defined in the INSPIRE register.

In Spain, who is responsible for the creation and maintenance of the Earth Observation and Environment HVDs ?


There are several organisations responsible for these datasets, for example, at the national level, we highlight:

  • The National Cartographic System (NCS), which publishes orthoimagery, hydrography, elevations, land use or land cover.
  • The Geological and Mining Institute (IGME), responsible for geological data.
  • The Spanish Institute of Oceanography  (IEO) of the Spanish National Research Council (CSIC) is responsible for oceanographic features.
  • The General Directorate of Cultural Heritage and Fine Arts of the Ministry of Culture publishes the protected sites of historical heritage and culture.
  • The Ministry for Ecological Transition and Demographic Challenge (MITECO) and the Ministry of Agriculture, Fisheries and Food (MAPA) are responsible for the datasets subject to other environmental legislation, the priority data.

All these organisations play a crucial role in the implementation and enforcement of the INSPIRE Directives  INSPIRE Directives y LISIGE (Law on Geographic Information Infrastructures and Services in Spain), both of which are fundamental in the management of geographic and environmental information.

  • The INSPIRE Directive was developed in cooperation with the Member States and accession countries of the European Union. Its main objective is to make available the geographical information needed for the management of EU environmental policies.
  • In Spain, it is transposed by Law 14/2010, known as LISIGE, which was subsequently amended by Law 2/2018 Law 2/2018. This law regulates geographic data and services, applying to those that refer to a geographic area of the national territory and that have been generated or are under the responsibility of public administrations. These data must be in electronic format and be the responsibility of a public sector administration or body.

Both the SCN an instrument regulated by the LISIGE that publishes geographic information through the coordination of national organisations and the Autonomous Communities, has been set up by the LISIGE. The Spanish and Spanish public administrations, such as MITECO and MAPA, in coordination with the autonomous communities, provide access to a wide range of data and information related to biodiversity, climate change, environmental quality and many other environmental issues. This includes the maintenance of the Spatial Data Infrastructure (SDI) of MITECO and MAPA, which is aligned with the INSPIRE, environmental and LISIGE Directives, publishing the datasets through interoperable services and locatable in the Official Catalogue of INSPIRE Data and Services (CODSI)where geographic data and services regulated by the LISIGE on environmental and Earth observation matters are available .

We highlight, for example, that MITECO is making efforts to ensure the adaptation of the main datasets of the Spanish Inventory of Natural Heritage and Biodiversity to the INSPIRE Directive, covering topics such as biogeographic regions, habitats, biotopes and species distribution.

 MITECO plays an essential role in the implementation of the INSPIRE and LISIGE Directives in Spain, providing access to key geographic data and information for the management of environmental policies and the protection of natural heritage, as historical and cultural heritage falls under the Ministry of Culture.

Does Spain comply with the HVD Regulation on Earth observation and environment?
 

Thanks to the continued work of the Consejo Directivo de la Infraestructura de Información Geográfica de España (CODIIGE) since the implementation of LISIGE, Spain has reached an important achievement. Currently, in the INSPIRE Geoportal portal is currently available a wide variety of information, classified as high-value Earth observation and environmental datasets. This information comes from the resources stored in CODSI.

 

As of May 2024, Spain has published the following information on the CODSI Geoportal:

  • INSPIRE Datasets:  The number of datasets published by Spain in each of the mandatory INSPIRE themes is shown below.
INSPIRE Themes Number of published datasets
Hydrography 33
Protected sites 27
Elevations 20
Geology 10
Land cover 60
Orthoimaging 16
Areas to management, restrictions or regulations and reporting units 147
Biogeographical regions 1
Environmental observation facilities 100
Energy resources 10
Habitats and biotopes 9
Land use 25
Mineral resources 0
Natural risk areasl 70
Oceanographic geographical features 2
Facilities production and industrial 27
Species distributions 10
Soil 17
Marine regions 9
GENERAL TOTAL 593

 

See here for the definition of each of the INSPIRE themes.

  • Environmental legislation: refers to priority datasets grouped by relevant environmental reporting legislation. The commission called these datasets "Priority Data" to reinforce their importance once the baseline data were already published


https://inspire-geoportal.ec.europa.eu/srv/eng/catalog.search#/qsEnvDom…

All categories are listed below (also indicating those that do not apply to Spain with the acronym N/D):

Environment Legal acts establishing the main variables
Air Directive 2008/50/CE Air Quality Directive 4
Directive 2004/107/CE It adresses arsenic, cadmium, mercury, nickel and polycyclic aromatic hydrocarbons in ambient air.  N/D*
Climate Regulation (UE) 2018/1999 Governance of the Energy Union and Climate Action. 0
Regulation (CE) 1005/2009 Substance that deplete the ozone layer 0
Emissions Directive 2010/75/UE Industrial Emissions Directive 1
Directive 2012/18/UE SEVESO III Directive 0
Directive 91/676/CEE Nitrates Directive 5
Regulation (CE) 166/2006 European Pollutant Release and Transfer Register 2
Regulation (UE) 2017/852 Mercury Regulation 0
Directive (EU) 2016/2284 Reduction of national emissions of certain atmospheric pollutants 0
Nature protection and biodiversity Directive 2009/147/CE Birds Directive 3
Directive 92/43/CEE Habitats Directive 8
Regulation (UE)  1143/2014 Invasive Alien Species Directive 1
Data for the inventory of nationally designated protected areas (NDAAs), national biogeographic regions EEA Annual Work Programme - Nationally Designated Areas - CDDA and National Legislation - National Biogeographic Regions 0
Noise Directive 2002/49/CE Noise Directive 0
Waste Directive 1999/31/CE Landfill Directive 2
Directive 2006/21/CE Directive on extractive waste 1
Directive 86/278/CEE Sewage Sludge Directive 1
Directiva 91/271/CEE Urban Waste Water Treatment Directive 9
Regulation (UE) 2019/1021 Persistent Organic Pollutants (POPs) Regulation 0
Recommendation 2014/70/UE Recomendation on hydraulic fracturing 0
Water Directive 91/271/CEE Urban Waste Water Treatment Directive 9
Directive 98/83/CE Drinking Water Directive 0
Directive 2006/7/CE Bathing Water Directive 1
Directive 2000/60/CE Water Framework Directive 17
Directive 2006/118/CE Groundwater Framework Directive N/D*
Directive 2008/105/CE Environmental Quality Standards Directive 0
Directive 2020/2184/UE Drinking Water Directive 0
Directive 2007/60/CE Floods Directive 31
Directive 2008/56/CE Marine Strategy Framework Directive 4
Horizontal legislation Directive 2004/35/CE Prevention and remediation of environmental damage N/D*
Regulation (UE) 2020/852 EU Taxonomy N/D*
Total 99

*N/D= No data, these categories do not apply to Spain

The publication of all these high-value datasets is an achievement that reflects our country''s continued commitment to transparency and access to high-quality environmental and Earth observation data.

Spain has made significant progress in complying with the High Value Sets of Earth Observation and Environment Regulation, with a remarkable amount of datasets available through the INSPIRE Geoportal. This ranges from Directive 2008/50/EC on air quality to Directive 2008/56/EC on Marine Strategy, reflecting a holistic approach to environmental information management.

Compliance with European Directives and regulations demonstrates Spain''s commitment to transparency and access to high quality environmental information. In addition, efforts to ensure the updating and accessibility of data are highlighted, including the adaptation of the main datasets of the Spanish Inventory of Natural Heritage and Biodiversity to the INSPIRE Directive.

The joint effort between MITECO, MAPA and the National Cartographic System and the autonomous communities underlines the importance of a collaborative approach to the management of environmental information and Earth observation, fundamental in the protection and sustainable development of natural heritage.

In short, we can say that Spain currently complies with the HVD Regulation in almost all categories, but does not comply in the following categories:

No API or bulk download

  • Orthoimaging
  • Oceanographic geographical features

Lack of data related to the following environmental legislation:

  • Directive 98/83/EC - Drinking Water Directive
  • Directive 2002/49/EC - Noise Directive
  • Directive 2012/18/EU - SEVESO III Directive
  • National legislation - National bio-geographical regions
  • Recommendation 2014/70/EU - Recommendation on hydraulic fracturing
  • Regulation (EU) 2017/852 - Regulation of Mercury

In summary, Spain has demonstrated a strong commitment to transparency and accessibility to high quality environmental information, complying with most European directives, although it still needs to improve in specific areas such as the provision of APIs and the updating of certain environmental datasets.

Content prepared by Mayte Toscano, Senior Consultant in Data Economy Technologies. The contents and points of view reflected in this publication are the sole responsibility of the author.

calendar icon
Blog

The recent Regulation (EU) 2023/2854 of the European Parliament and of the Council of 13 December 2023 on harmonised rules for fair access to and use of data (Data Act) introduces important new developments in European legislation to facilitate access to data generated by connected products and related services. In addition to establishing measures to boost interoperability in data spaces, data processing services and smart contracts, the new regulation also incorporates an important novelty by regulating data sharing with public entities in exceptional situations.

A new orientation in European regulation?

The main aim of the regulation on the re-use of public sector information was to facilitate access to data generated by public sector entities in order to foster the development of value-added services based on technological innovation. In fact, as expressly stated in the 2019 Directive, the reform it carried out was largely justified by the need to update the applicable regulatory framework to the new challenges posed by digital technology and, in particular, Artificial Intelligence or the Internet of Things.

Subsequently, under the European Data Strategy, a regulation on governance was approved, data spaces have been promoted and the Data Act was published only a few months ago. The latter implies an important shift from the point of view of the subjects concerned since, unlike the previous regulations focused on the obligations of public sector entities, on the one hand, it disciplines relations between private parties and, on the other hand, it establishes an important measure aimed at private entities providing data to public bodies under certain singular conditions.

In which situations should data be provided?

First of all, it is necessary to emphasise that the Data Act is not intended to extend the cases in which private entities have to hand over data to public bodies in compliance with their supervisory and enforcement powers, such as in the case of prevention, investigation and imposition of criminal or administrative sanctions. Thus, it does not affect the obligations that private parties already have to fulfil in order that, on the basis of the data requested, public bodies may carry out their usual activities in the exercise of a public service mission such as those indicated.

On the other hand, it is a regulation intended to deal with exceptional, unforeseeable and time-limited situations that may arise:

  • or to the need to obtain data to respond to a public emergency that are not available by alternative means under equivalent conditions, such as the provision of data in existing environments and platforms that have already been deployed for another purpose (e.g. provision of a service, implementation of a collaborative project...);
  • or, as the case may be, the impossibility for the public body to dispose of specific data in order to fulfil a task assigned by law and performed in the public interest when all other means at its disposal have been exhausted, such as the purchase of non-personal data on the market by the public body, the consultation of a public database or their collection on the basis of previously existing obligations for private subjects.

In the latter case, i.e. when the need for the data is not justified by the requirement to respond to emergency situations, the subject of the request may not refer to personal data unless, by the very nature of the request, it is essential to be able to know at some point in time the identity of the data subject. In this case, pseudonymisation will be necessary. Consequently, given that the data would not be anonymised, the guarantees established by data protection regulations must be taken into account. Specifically:

  • Data must be separated from the data subject so that the data subject cannot be identified by another unauthorised person
  • Technical and organisational measures must be taken to prevent the re-identification of the data subject, except by those entitled to do so where necessary.

For which purposes may the data not be used?

Unless expressly authorised by the private entity providing the data, public bodies may not use the data for a purpose other than that for which they were made available. However, in the field of official statistics or when it is necessary to carry out scientific research or analytical activities which cannot be carried out by the public bodies requesting the data themselves, it is permitted that the data may be transferred to other bodies for the purpose of carrying out such activities. However, there are important limitations to this possibility, as such activities must be compatible with the purposes for which the data were obtained, which would prevent for example using the data to train algorithms that can then be used for the exercise of other functions or competences of the public body not related to research or analysis. Furthermore, the data may only be made available to non-profit or public interest entities such as universities and public research organisations.

Nor may the data be used to develop or improve products and services related to the entity providing the data, or shared with third parties for such purposes. This would prevent, for example, the use of the data to train Artificial Intelligence systems by the public entity or one of its contractors that would negatively affect the object of the normal business of the entity that provided the data.

Finally, the data obtained in application of this regulation cannot be made available to other subjects under the open data and public sector re-use regulation, so its application is expressly excluded.

what safeguards are provided for the data subject obliged to hand over the data?

The request for the data must be made by the public body by means of a formal request in which it is necessary to identify the data needed and to justify why it is addressed to the entity receiving the request. In addition, it will be essential to explain the exceptional reasons supporting the request and, in particular, why it is not possible to obtain the data by other means.

As a general rule, the data subject has the right to lodge a complaint against the request for the data, which must be addressed to the competent authority designated by each State to ensure the application of the Regulation and which will be included in the register to be set up by the European Commission.

Finally, in certain cases, the data subject has the right to request reasonable compensation for the costs and a reasonable margin necessary to make the data available to the public entity, although the latter may challenge the requested compensation before the authority referred to above. However, where the request for access to the data is justified by the need to respond to public emergencies or the safeguarding of a significant public interest, no compensation to data subjects is envisaged. This would be the case of an event of natural origin (earthquakes, floods, etc.) or unforeseen and serious situations affecting the normal functioning of society in essential areas such as health or public order.

 

In short, the obligation of private parties to provide data to public entities in these cases goes beyond the objective of promoting a single market for data at the level of the European Union, a goal that had largely underpinned the progress in data regulation in recent years. However, the seriousness of the situation generated as a result of COVID-19 has highlighted the need to establish a general regulatory framework to ensure that public entities can have the necessary data at their disposal to deal with exceptional situations in the public interest. In any case, the effectiveness of these measures can only be verified as of September 2025, when they are expected to be effectively implemented.

 


Content prepared by Julián Valero, Professor at the University of Murcia and Coordinator of the Research Group "Innovation, Law and Technology" (iDerTec). The contents and points of view reflected in this publication are the sole responsibility of its author.

calendar icon
Blog

The carbon footprint is a key indicator for understanding the environmental impact of our actions. It measures the amount of greenhouse gas emissions released into the atmosphere as a result of human activities, most notably the burning of fossil fuels such as oil, natural gas and coal. These gases, which include carbon dioxide (CO2), methane (CH4) and nitrous oxide (N2O), contribute to global warming by trapping heat in the earth's atmosphere.

Many actions are being carried out by different organisations to try to reduce the carbon footprint. These include those included in the European Green Pact or the Sustainable Development Goals. But this is an area where every small action counts and, as citizens, we can also contribute to this goal through small changes in our lifestyles.

Moreover, this is an area where open data can have a major impact. In particular, the report "The economic impact of open data: opportunities for value creation in Europe (2020)" highlights how open data has saved the equivalent of 5.8 million tonnes of oil every year in the European Union by promoting greener energy sources. This include 79.6 billion in cost savings on energy bills.

This article reviews some solutions that help us measure our carbon footprint to raise awareness of the situation, as well as useful open data sources .

Calculators to know your carbon footprint

The European Union has a web application where everyone can analyse the life cycle of products and energy consumed in five specific areas (food, mobility, housing, household appliances and household goods), based on 16 environmental impact indicators. The user enters certain data, such as his energy expenditure or the details of his vehicle, and the solution calculates the level of impact. The website also offers recommendations for improving consumption patterns. It was compiled using data from Ecoinvent y Agrifoot-print, as well as different public reports detailed in its methodology.

The UN also launched a similar solution, but with a focus on consumer goods. It allows the creation of product value chains by mapping the materials, processes and transports that have been used for their manufacture and distribution, using a combination of company-specific activity data and secondary data. The emission factors and datasets for materials and processes come from a combination of data sources such as Ecoinvent, the Swedish Environment Institute, DEFRA (UK Department for Environment, Food and Rural Affairs), academic papers, etc. The calculator is also linked to the the Platform for carbon footprint offsetting of the United Nations. This allows users of the application to take immediate climate action by contributing to UN green projects. 

Looking at Spain, the Ministry for Ecological Transition and the Demographic Challenge has several tools to facilitate the calculation of the carbon footprint aimed at different audiences: organisations, municipalities and farms. They take into account both direct emissions and indirect emissions from electricity consumption. Among other data sources, it uses information from National Greenhouse Gas Inventory. It also provides an estimate of the carbon dioxide removals generated by an emission reduction project.

Another tool linked to this ministry is ComidaAPrueba, launched by the Fundación Vida Sostenible and aimed at finding out the sustainability of citizens' diets. The mobile application, available for both iOs and Android, allows us to calculate the environmental footprint of our meals to make us aware of the impact of our actions. It also proposes healthy recipes that help us to reduce food waste.

But not all actions of this kind are driven by public bodies or non-profit associations. The fight against the deterioration of our environment is also a niche market offering business opportunities. Private companies also offer solutions for calculating the carbon footprint, such as climate Hero, which is based on multiple data sources.

Data sources to feed carbon footprint calculators

As we have seen, in order to make these calculations, these solutions need to be based on data that allow them to calculate the relationship between certain consumption habits and the emissions generated. To do this, they draw on a variety of data sources, many of which are open. In Spain, for example, we find:

Other international data services to consider are:

  • EarthData. This service provides full and open access to NASA' s collection of Earth science data to understand and protect our planet. This web provides links to commonly used data on greenhouse gases, including carbon dioxide, methane, nitrous oxide, ozone, chlorofluorocarbons and water vapour, as well as information on their environmental impact.
  • Eurostat. The Statistical Office of the European Commission regularly publishes estimates of quarterly greenhouse gas emissions in the European Union, broken down by economic activity. The estimates cover all quarters from 2010 to the present.
  • Life Cycle Assessment (LCA). This platform is the EU's knowledge base on sustainable production and consumption. It provides a product life cycle inventory for supply chain analysis. Data from business associations and other sources related to energy carriers, transport and waste management are used.
  • Our World in Data. One of the most widely used datasets of this portal contains information on CO2 and greenhouse gas emissions through key metrics. Various primary data sources such as the US Energy Information Agency and The Global Carbon Project have been used for its elaboration. All raw data and scripts are available in their GitHub repository.

These repositories are just a sample, but there are many more sources whit valuable data to help us become more aware of the climate situation we live in and the impact our small day-to-day actions have on our planet. Reducing our carbon footprint is crucial to preserving our environment and ensuring a sustainable future. And only together will we be able to achieve our goals.

calendar icon
Blog

Last November 2023, Crue Spanish Universities published the report TIC360 "Data Analytics in the University". The report is an initiative of the Crue-Digitalisation IT Management working group and aims to show how the optimisation of data extraction and processing processes is key to the generation of knowledge in Spanish public university environments. To this end, five chapters address certain aspects related to data holdings and the analytical capacities of universities to generate knowledge about their functioning.

The following is a summary of the chapters, explaining to the reader what can be found in each chapter.

Why is data analytics important and what are the challenges?

In the introduction, the concept of data analytics is recalled as the extraction of knowledge from available data, highlighting its growing importance in the current era. Data analytics is the right tool to obtain the necessary information to support decision-making in different fields. Among other things, it helps to optimise management processes or improve the energy efficiency of the organisation, to give a few examples. While fundamental to all sectors, the paper focuses on the potential impact of data on the economy and education, emphasising the need for an ethical and responsible approach.

The report explores the accelerated development of this discipline, driven by the abundance of data and advanced computing power; however, it also warns about the inherent risks of tools based on techniques and algorithms that are still under development, and that may introduce biases based on age, background, gender, socio-economic status, etc.In this regard, it is important to bear in mind the importance of privacy, personal data protection, transparency and explainability, i.e. when an algorithm generates a result, it must be possible to explain how that result has been arrived at.

A good summary of this chapter is the following sentence by the author: "Good use of data will not lead us to paradise, but it can build a more sustainable, just and inclusive society. On the contrary, its misuse could bring us closer to a digital hell.

How would universities benefit from participating in Data Spaces?

The first chapter, starting from the premise that data is the main protagonist and the backbone asset of the digital transformation, addresses the concept of the Data Spacehighlighting its relevance in the European Commission's strategy as the most important asset of the data economy.

Highlighting the potential benefits of data sharing, the chapter highlights how the data economy, driven by a single market for shared data, can be aligned with European values and contribute to a fairer and more inclusive digital economy. Initiatives such as the Digital Spain Strategy 2026which highlights the role of data as a key asset in digital transformation.

There are many advantages to university participation in data spaces, such as sharing, accessing and reusing data resources generated by other university communities. This allows for faster progress in research, optimising the public resources previously dedicated to research. One initiative that demonstrates these benefits is the European Open Science Space (EOSC)which aims to link researchers and practitioners in science and technology in a virtual environment with open and seamless services for the storage, management, analysis and re-use of scientific data, across physical boundaries and scientific disciplines. The chapter also introduces different aspects related to data spaces such as guiding principles, legislation, participants and roles to be considered. It also highlights some issues related to the governance of data spaces and the technologies needed for their deployment.

What is the European Skill Data Space (ESDS)?

This second chapter explores the creation of a common European data space, with a focus on skills. This space aims to reduce the gap between educational skills and labour market needs, increasing productivity and competitiveness through cross-border access to key data for the creation of applications and other innovative uses. In this respect, it is essential to take into account the release of the version 3.1 of the European Learning Model (ELM)which is to be consolidated as the single European data model for all types of learning (formal, non-formal, informal) as the basis for the European Skills Data Space.

The report defines the key phases and elements for the creation and integration into the European Skills Data Space, highlighting what contributions the different roles (education and training provider, jobseeker, citizen, learner and employer) could make and expect.

what is the role of the Spanish university in the context of European Data Spaces?

This chapter focuses on the role of Spanish universities within European data spaces as a key agent for the country's digital transformation. To achieve these results and reap the benefits of data analytics and interaction with European data spaces, institutions must move from a static model, based on medium- and long-term planning criteria, to flexible models more suited to the liquid reality in which we live, so that data can be harnessed to improve education and research.

In this context, the importance of collaboration and data exchange at European level is crucial, but taking into account existing legislation, both generic and domain-specific.  In this sense, we are witnessing a revolution for which compliance and commitment on the part of the university organisation is crucial. There is a risk that organisations that are not able to comply with the regulatory block will not be able to generate high quality datasets.

Finally, the chapter offers a number of indications as to what kind of staff universities should have in order not to be deprived of creating a corps of analysts and computer experts, vital for the future.

What kind of certifications exist in the field of data?

In order to address the challenges introduced in the chapters of the report, universities need to have in place: (1) data with adequate standards; (2) good practices with regard to governance, management and quality; and (3) sufficiently qualified and skilled professionals to perform the different tasks. To convey confidence in these elements, this chapter justifies the importance of having certifications for the three elements presented:

  • Data product quality level certifications such as ISO/IEC 25012, ISO/IEC 25024 and ISO/IEC 25040.
  • Organisational maturity level certifications with respect to data governance, data management and data quality management, based on the MAMD model.
  • Certifications of personal data competences, such as those related to technological skills or professional competence certifications, including those issued by CDMP or the CertGed Certification.

What is the state of the University in the data age?

Although progress has been made in this area, Spanish universities still have a long way to go to adapt and transform themselves into data-driven organisations in order to get the maximum benefit from data analytics. In this sense, it is necessary to update the way of operating in all the areas covered by the university, which requires acting and leading the necessary changes in order to be competitive in the new reality in which we are already living.

The aim is for analytics to have an impact on the improvement of university teaching, for which the digitisation of teaching and learning processesis fundamental. This will also generate benefits in the personalisation of learning and the optimisation of administrative and management processes.

In summary, data analytics is an area of great importance for improving the efficiency of the university sector, but to achieve its full benefits, further work is needed on both the development of data spaces and staff training. This report seeks to provide information to move the issue forward in both directions.

The document is publicly available for reading at: https://www.crue.org/wp-content/uploads/2023/10/TIC-360_2023_WEB.pdf  

Content prepared by Dr. Ismael Caballero, Full Professor at UCLM

The contents and points of view reflected in this publication are the sole responsibility of its author.

calendar icon
Blog

The growing importance of data goes beyond the economic and social spheres at state level to a multinational dimension that raises the challenges, opportunities, threats and uncertainties surrounding the development of the Data Economy to a global scale. In the case of the European Union, the issue has been on the institutional agenda in recent years, as evidenced by the profusion of specific and cross-cutting regulations already adopted or in progress; or the promotion of multilateral initiatives both within the framework of the Union and beyond its borders. In July 2022, this global political dimension took a major qualitative leap forward with the adoption by the EU Council of what it called 'Conclusions on EU Digital Diplomacy'Conclusions on EU Digital Diplomacywhich aimed to set out priority actions to strengthen EU action in international digital affairs.

These conclusions - updated in July 2023 - are, in a way, a milestone in that they give the concept of 'digital diplomacy' a legal status. They recognised, on the one hand, the need for "stronger, strategic, coherent and effective" EU policy and action on digital issues; and detailed, on the other hand, priority actions to respond to that need.         

Three ways to engage with third countries

Under the title 'The European Data Strategy from a multidimensional perspectivethe think tank network PromethEUs1 published in June 2023 an analysis that breaks down the European Data Strategy from two main perspectives: the political and regulatory aspects, and the geopolitical aspects.. The analysis of the latter was prepared by Raquel Jorge Ricart of the Real Instituto Elcano, and explains that the EU has been addressing the way in which its goods, services, assets and personal data relate to third countries through various channels:

The analysis of the latter was carried out by the whose researchers explain that the EU has been addressing how its goods, services, assets and personal data relate to third countries through various channels:

  1. The regulatory route, which, as they say, "has been closely followed by most stakeholders". 
  2. Through multilateral initiatives, "coalitions of the willing" and international meetings.
  3. "Through the importance of digital diplomacy, as a policy area to institutionalise the geopolitics of data, along with other technological challenges". In this sense, the term 'digital diplomacy' is used to bring together in a single 'box' all the initiatives that, independently, would have been carried out to date.

Further information on each of these pathways is provided below.

Regulatory pathway

In relation to the regulatory approach, the main challenge for the EU to deploy the regulatory tool as a geopolitical asset lies, according to the Elcano researchers, in influencing other countries to follow the same approach. "It is not just a matter of imposing standards on those who already interact with the EU, but of encouraging others to do the same with theirs," they say. Likewise, they add, "another challenge for the geopolitical instrumentalisation of these regulations is to understand that geopolitical strategies must vary according to the country and the type of technology company", as they may have different geopolitical approaches.

But, the authors conclude, regulation, while important, is not the only approach on which the EU should build its data geopolitics. The other two approaches are as important as they are strategic.

Multilateral initiatives

With regard to international forums for dialogue, the following stand out:

Digital diplomacy

Regarding the third approach - the promotion of digital diplomacy - Elcano analysts highlight as positive the various regional technological partnership initiatives that the EU has deployed in recent years, and stress that already in 2019 'the EU began to see technology through the lens of ethics' and as a political and geopolitical issue. In this respect, they underline that the Conclusions of the European Council on Digital Diplomacy (July 2022) are the starting point "with which the EU institutionalised all aspects related to the external agenda in third countries and digital policy as a unique aspect of EU foreign policy". And that is why the goal of digital diplomacy deployed by the EU through its External Action Service is none other than to "secure the EU's global role in the digital world, protect its strategic interests and promote its dynamic and people-centred regulatory framework for an inclusive digital transformation".

The latter is, moreover, a crucial factor, as revealed by the priority actions set out at the initial European Council meeting in July 2022, revised in july 2023. The EU, says the Council, must promote a human rights-based and people-centred digital transformation, which translates, for example, into:

  • Regular and thorough" human rights due diligence practices and human rights impact assessments.
  • Pay special attention to the protection of the rights of vulnerable or marginalised people.
  • Bridging the gender digital divide.
  • Promote an open, free, neutral, global, interoperable, reliable and secure Internet.

The Spanish Charter of Digital Rightslaunched in July 2021, and the European Declaration on Digital Rights and Principles for the Digital Decadeare a clear example of the vocation with which the European Union wants to provide itself with an internal or domestic reference, while establishing a shared framework for its action in the field of digital diplomacy.

The EU's challenges

In any case, from the analysis of the different actions established by the EU in this area, the Elcano Institute's researchers identify three major challenges:

  1. How to address the role of member states in EU data geopolitics, as most foreign and security policy provisions depend on the unanimity of all 27 countries, and this "may make it difficult for certain activities related to data governance to be approved".
  2. How to partner with developing countries "or, particularly, with non-aligned countries", a concept that could be undergoing some revitalisation and which, they argue, "should be an area for further work". The global Gateway initiative would be in this area and, in fact, is one of those that the EU wants to promote by also broadening private sector participation.
  3. How to "pay attention to certain technologies that are still underdeveloped, notyetwidely commercialised or not yet deployed, but which could generate a great deal of competition between countries".

In short, the development of digital diplomacy is already a crucial vector in the development of the Data Economy and, in fact, the EU Council will return to this issue before the summer of 2024, two years after the issuing of the Conclusions and one year since the first review. Indeed, until then, the Council "invites the High Representative, the Commission and Member States to assess progress on a regular basis and to continue to report regularly to the Council on the implementation of digital diplomacy". To take its diplomacy to the next level, they stress, "the EU must act with a Team Europe approach - that is, EU institutions and EU member states, together with other partner actors - jointly protecting its strategic interests and promoting its people-centred approach to the digital transition".

Economic security

The aforementioned link between digital diplomacy, the Union's strategic interests and the Data Economy underlies the European Economic Security Strategy a joint communication adopted by the Commission and the High Representative on 20 June 2023.  The strategy is based on a three-pillar approach:

  • Promoting the EU's economic base and competitiveness
  • Protection against risks
  • Partnering with as many countries as possible to address common concerns and interests.

Fostering (competitiveness); preserving (economic security); and cooperating (with each other and with others) are the vectors that the Strategy defines to address the four risks it identifies. Namely:

  1. Risks related to the resilience of supply chains.
  2. Risks to the physical and cyber security of critical infrastructures.
  3. Risks related to technology security and technology leaks.
  4. Risks of economic dependencies being used as a weapon or economic coercion.

As a first follow-up to the Strategy, the Commission adopted on 3 October 2023 a Recommendation on critical technology areas for EU economic security, identifying ten critical technology areas, four of which are identified as "highly likely": advanced semiconductors, artificial intelligence, quantum technologies and biotechnologies.

In order to make immediate risk assessments on these areas, the Commission will deploy an intensive dialogue with Member States with results expected by spring 2024. A dialogue in which the Data Economy, with an increasingly relevant weight in European productive ecosystems, will be omnipresent. And Spain, as an international hub and secure destination for information flows and data storage, should pay special attention to aspects such as guaranteeing the correct integration of the different data infrastructures; guaranteeing interoperability between the different actors; and reinforcing its cybersecurity, especially in view of the vulnerability of the supply chain and the need to guarantee effective competition and diversity of suppliers.

 

1PromethEUs is a network of think tanks composed of the Institute of Public Policy (Portugal); the Real Instituto Elcano (Spain); the Istituto per la Competitività I-Com (Italy); and the Foundation for Economic & Industrial Research - IOBE (Greece).

calendar icon