Enhancing Public Sector Efficiency: The EU's Approach to Data

__This article is written by a public servant at the European Commission working on the Big Data Test Infrastructure project. It was published anonymously. __

The public sector faces increasingly complex socio-economic problems that require innovative solutions. Big data and data-informed decision-making offer a pathway to better solutions, greater transparency, and enhanced trust in public administration. However, implementing these technologies needs skills, experience, and appropriate digital tools, which are often lacking.

__Introducing the EU’s Big Data Test Infrastructure: Functionality and Benefits for Public Administrations __

To tackle these challenges, the European Commission launched the Big Data Test Infrastructure (BDTI) under the Digital Europe Programme . The BDTI aims to promote the reuse of public sector data and facilitate a data-informed public sector across EU Member States. It provides public administrations with a comprehensive set of mainstream open-source tools for data storage, processing, and analytics, all hosted in the cloud and free of charge.

This service empowers civil servants at all government levels to conduct pilot projects independently, demonstrating the value of data in policymaking and administration. Public administrations can utilise the BDTI to prototype solutions and test ideas and proof of concepts.

The BDTI offers a variety of open-source tools to facilitate data-driven projects, including data storage and processing tools for handling large datasets, analytics tools for analysis and visualisation, and cloud infrastructure for running data-intensive tasks. Its open-source nature ensures flexibility, allowing public administrations to explore different solutions cost-effectively.

__How Public Administrations are using the BDTI __

Several public administrations have utilized and continue to use the BDTI to enhance decision-making processes. For example, the City of Valencia Health Services previously employed BDTI to apply text mining techniques for extracting valuable insights from health data. Similarly, the Norwegian Digitalisation Agency used BDTI to optimize public procurement processes through data analytics, while the City of Florence utilized BDTI to understand the impact of COVID-19 on the city through data analytics.

Currently, numerous public administrations are leveraging BDTI. For instance, the University of Macedonia in Greece transformed data gathered through the MITOS API (Greek National Registry of Administrative Public Service) into linked data aligned with the EU standard model to support more public services. The city of Bochum is using BDTI to analyze the health of trees, providing valuable insights for urban planning and environmental management. Additionally, the City of Naples is leveraging BDTI to collect data related to public spaces and mobility, streamlining citizen participation, and creating a transportation dataset tailored for public administration in order to enhance urban planning and mobility strategies through advanced analytics on public space and mobility-related data in compliance with the open data directive.

Additionally, the BDTI website highlights various use cases, such as the search analytics project based on the CORDIS open dataset, which shows how data can be used to enhance search functionalities. Another example is the low code analytics project that utilises the EMHIRES dataset, focusing on solar power generation, to illustrate the application of low code solutions in data analytics.

__Get to know the BDTI: Resources for Public Administrations __

To further support public administrations, the BDTI team has developed a BDTI Essentials course, available for free. This course consists of five one-hour webinars, targeting public administration officials to help them better understand how to use the BDTI with concrete examples. This educational resource aims to build the necessary skills and knowledge to effectively leverage the BDTI for data-driven projects. Additionally, the BDTI team has recently launched a new online course in collaboration with the interoperability academy, to help public sector actors advance their data literacy journey and understand how BDTI can help shortcut their data maturity efforts.

In line with their commitment to inclusivity, the BDTI team has also taken the initiative to translate key BDTI materials into the 24 European official languages. This effort allows individuals from diverse linguistic backgrounds to fully understand and engage with the content.

Public administrations interested in using the BDTI can subscribe to the Joinup page or to “The BDTI Kitchen: Baking Data Stories” newsletter for updates on future events and initiatives.

Transforming Public Services: The Impact and Promise of the BDTI

The BDTI represents a significant step towards a data-informed public sector in the EU, offering public administrations the tools and infrastructure needed to get familiar with data literacy and harness the power of big data. Through pilot projects and real-life use cases, the BDTI demonstrates the transformative potential of data analytics in improving public services and policymaking. By enabling experimentation and innovation in a cost-effective manner, the BDTI helps public administrations overcome data challenges, fostering a more transparent, efficient, and trustworthy public sector.

Are you a civil servant interested in developing your own use case on the BDTI or a student and researcher eager to support a public administration? Apply for a BDTI pilot project here, or reach out to the team via EC-BDTI-PILOTS@ec.europa.eu.

(Image credit: Unsplash)