The imperative of high-quality, trusted data in UK Government
Abstract
“The only thing that gives information value is what can be accomplished with it.” - Brig. Gen. Daniel Clayton, the Air Force’s Director of the ABMS cross-functional team.
Quality data is increasingly acknowledged as a critical determinant of efficiency, transparency, and innovation. This article examines the importance of such data in the UK Government, the challenges arising from inadequate data management, the strategies employed by various governments to bolster their data frameworks, and an analysis of the UK's current and future data agenda.
Introduction
In the era of digital transformation, data is often likened to a new form of currency or oil, and its role as a critical asset in the UK Government’s project delivery is undeniable. High-quality, trusted and accessible data has the potential to revolutionise the government’s operational capabilities, and is a prerequisite for informed policymaking, efficient public service provision, and the achievement of national goals such as 'Levelling Up' and reaching 'net zero' by 2050.
The significance of data quality in government projects
Quality data empowers a government to be agile, allowing for the swift adaptation to emerging trends and unforeseen circumstances. This agility is crucial during global events such as the COVID-19 pandemic, where data-driven insights were indispensable for real-time crisis management and decision-making. Furthermore, high-quality data is indispensable for maintaining transparency and accountability, as it enables the tracking of a project’s true progress against stated goals and ensures that each decision is not just an educated guess, but a calculated move backed by empirical evidence.
Consequences of poor data quality
The lack of robust data or the presence of poor-quality data can lead to detrimental outcomes: misinformed policies, inefficient resource allocation, and ultimately, the erosion of public trust. Projects may suffer from cost overruns, delayed timelines, and suboptimal outcomes, which can have far-reaching implications on national objectives and societal welfare.
Trends globally
Governments worldwide are placing heightened emphasis on data quality and are instituting comprehensive strategies to enhance their data ecosystems. The US Department of Defense, for example, has anchored its recently released Data Strategy emphasising the importance of data integrity. They state, “The 2023 strategy orients the Department’s data, analytics and AI adoption activities towards an ‘AI Hierarchy of Needs’, with quality data as its foundation, and a focus on speed, agility, learning and responsibility.” This hierarchy is conceptualised as a pyramid, with a vast base of data leading up to ‘responsible AI’ at the apex, defined as the ethical application of AI that yields better, faster insights and improved mission outcomes.
The UK Government’s data initiatives
The UK Government has made concerted efforts to elevate its data agenda, spearheaded by initiatives like ‘Transforming for a Digital Future’, a roadmap penned collaboratively by the Central Digital and Data Office (CDDO) and various departments. The roadmap outlines a vision and specific actions for a digital and data evolution by 2025. It emphasises the need for this transformation to support the government’s priorities and articulates a vision where digital government surpasses public expectations, civil servants are adept in digital capabilities, and operations are more cohesive and secure.
The CDDO facilitates the implementation of this vision, with a particular focus on revamping the ‘Top 75 services’ for better user experience and efficiency. This includes initiatives like the ‘GOV.UK One Login’ for streamlined access to government services and the Data Marketplace for ethical data sharing. Departments like the Ministry of Justice and the Department for Business and Trade have made significant strides, developing data dashboards for criminal justice and supporting business growth with data insights, respectively. Additionally, the Office for National Statistics’ Integrated Data Service (IDS) initiative exemplifies a forward-looking approach to data sharing and utilisation for informed decision-making.
The UK Government’s future data strategy
Looking ahead, the UK Government’s data strategy is focused on cultivating a sophisticated data infrastructure, enhancing data literacy among civil servants, and promoting ethical data sharing practices. The emphasis on secure, sustainable technology and the development of a cross-government data-sharing platform are indicative of the government’s resolve to create a more agile and informed administration. This will facilitate more nuanced policymaking and improve the granularity of data analysis, fortifying the government’s decision-making apparatus.
The significance of digital skills requirements in government cannot be overstated, illustrated by case studies such as The Department for the Environment, Food and Rural Affairs (Defra) launching the Digital, Data and Technology Service (DDTS) Academy to bolster skills for the future. The Academy offers digital and technical apprenticeships, with a special focus on growing our own talent in hard to recruit roles. This new approach is aimed at helping to address key digital and cyber skills shortages and support development of early career talent.
However, despite the great progress made by these departments in advancing digital capabilities, the UK Government acknowledges the need for substantial growth in this area. The Public Accounts Committee’s (PAC) recent report from September 2023 starkly highlights the current shortfall in digital expertise across Whitehall. With only an estimated 4.5% of the necessary digital, data, and tech professionals within the civil service – less than half of what is needed compared to the industry average – the gap is significant.
The report criticises the incremental upgrades that are the result of this skills shortage, which poses a risk of increased costs and continued reliance on outdated legacy systems. The PAC has identified a pressing need for the civil service to double its digital workforce, a target that’s currently hampered by pay constraints and competitive disadvantages against the private sector. Cybersecurity expertise is particularly scarce, a concerning revelation given the premium commanded by such skills.
The ability to harness the right skills in a rapidly evolving digital landscape is directly impacting the government’s capacity to deliver on its ambitious priorities.
Conclusion
The road ahead is complex, with the need to reconcile the demand for advanced digital capabilities against the backdrop of budgetary constraints and the lure of the private sector. Yet, the potential benefits are substantial. A government fortified with high-calibre data expertise and a robust data infrastructure can vastly improve policy outcomes, project delivery, and public service provision.
The UK Government must continue to adapt, innovate, and invest in its data and digital assets to navigate the challenges of the 21st century effectively.
