What sort of data do the Office for National Statistics (ONS) collect?
To produce our statistics, we collect data on a wide range of topics, including age, sex, pay and well-being. We also collect information about things such as employment status, as well as important life events such as births, deaths and marriages.
We have a legal obligation to protect personal data. It is a criminal offence to improperly disclose information held by us that identifies a person or business.
We remove any information that could identify someone from the data we use, and rigorous safeguards are in place to ensure everyone's privacy is protected.
How do you store data and keep data secure?
The safety of your information is our top priority, and we have a long track record of safely protecting the public's data.
We hold data securely, in line with our data protection policy. We use state of the art information security that is regularly tested by the National Cyber Security Centre.
We only allow approved and trained researchers to access the data, and always in secure areas. We do not allow anyone to remove these data from our secure systems.
Learn more about how we keep data secure and confidential.
How long do you store data for?
Data protection law requires that personal data are kept for no longer than is necessary, depending on how we will use the data. However, the law allows information that is being held for statistical purposes to be kept for slightly longer.
We will only continue to hold personal data while we are still using the data to produce statistics. We also de-identify or anonymise data at the earliest opportunity we can. This means removing all information that could identify an individual.
Is data shared with other organisations?
While most work areas at the ONS do not share data with any third parties, we do operate a Secure Research Service (SRS). The SRS gives accredited researchers secure access to de-identified, unpublished data.
Without the SRS, government bodies and local councils, charities, businesses and individuals could not access reliable facts and figures to help them make important decisions.
We have been accredited by the UK Statistics Authority for the preparation and provision of data for research purposes. We also meet the standards set out in the Digital Economy Act's Research Code of Practice and Accreditation Criteria Statement of Principles, which have been approved by Parliament.
Where do you get data from?
We collect, store, process and use data to produce statistics. Some of these data come from our own surveys. We carry out these surveys online, through posted questionnaires, on the phone and in person.
We also run the census every 10 years. This gives us the most accurate estimate of all the people and households in England and Wales. The information you share in the census helps decide how services are planned and funded in your local area.
We also use data from other sources. This includes "administrative data", which are made up of information we all provide when we access public services such as the tax, benefits, health and education systems.
We get data from central government departments, including:
the Department for Work and Pensions (DWP)
the Home Office
HM Revenue and Customs (HMRC)
We also get data from other public bodies, such as:
NHS England
local authorities
the Higher Education Statistics Authority (HESA)
And we source data from commercial organisations. You can see some of these alternative data sources in our plans to transform UK consumer price inflation statistics. They include:
Auto Trader
the Rail Delivery Group
point-of-sale scanner data from some of the UK's largest retailers, including the Co-op
You can see a collection of our sources of data, including administrative and commercial sources, and further information about health sources.
We want to transform the way we produce statistics at the ONS by using new and innovative sources of data. By doing this, we can keep up with society's changing needs.
What do you mean when you say you are transforming the way you produce statistics?
The world is changing fast, and we need to track these changes and adapt our methods. This will ensure our statistics keep up to date and are as accurate as they can be. That is why we want to transform the way we produce statistics at the ONS.
Transformation will involve us changing and updating the way we access, use, process and make data available.
By using new and innovative sources of data, such as administrative data and linked data, we can make our statistics more detailed, frequent, relevant and accurate.
Transforming the way that we produce statistics will also allow us to respond quicker to the changing needs of the people and organisations that use our data.
Find out more about how we are transforming statistics and have your say by responding to our consultation on the future of population and migration statistics in England and Wales.
Watch our animated video to find out more about why we are transforming the way we produce population and migration statistics [opens new window to YouTube video player].
What are population and migration statistics?
We publish population and migration statistics that describe the number of people living in different parts of the country. They also show how the number of people changes over time.
Organisations need up-to-date information about the size of the population at a national and local level, and the different people that make it up. They also need an understanding of how people's movements change across days, months and seasons. This helps decision-makers plan services to meet the changing needs of different communities, from waste collection to the availability of green spaces.
Government departments, local authorities, businesses, charities and many more organisations use population and migration statistics to inform decisions and policies that affect everyone. For example, they can help to decide the amount of housing we need and the numbers of school and hospital places.
What is the Dynamic Population Model (DPM)?
To create population estimates, we use census data that we collect every 10 years. Every year, we add births and people who move into the country or local area and remove people who have died or who have moved away.
But the accuracy of these estimates declines as we move away from the census year, and because our population is changing more rapidly than ever, decision makers need this information faster.
To meet this need, and as part of our transformation plans, we have developed the Dynamic Population Model, or DPM.
The DPM still uses information about births, deaths, and internal and international migration. But it also uses new information, and it uses more of it in different ways to get the best from all available sources of data.
We have built the DPM to produce statistics that are:
flexible and resilient
accurate and timely
responsive and smart
high-quality and reliable
Watch our animated video about the DPM [opens new window to YouTube video player] to find out more.
What is the Reference Data Management Framework (RDMF)?
The Reference Data Management Framework is a service that was developed and created by us at the ONS. It allows analysts to easily link data in a safe, secure and confidential way, supporting more effective research and analysis. In the future, it will be available to the rest of government for the processing, linking and enrichment of data.
The framework is made up of five indexes that link and match data on:
- addresses
- businesses
- classifications
- demographics
- location.
The RDMF will allow analysts to easily access connected data in a standardised way. This also allows us to protect individuals' privacy and makes it easier for people to use datasets ethically and safely.
What is the Integrated Data Service (IDS)?
The Integrated Data Service, also known as the IDS, is a secure central digital platform that provides access to advanced data, analytical and visualisation tools. It allows accredited researchers to produce insight quickly and effectively on the major issues facing society.
The IDS is a cross-government service. Its development is an important step in achieving the aims of the government's National Data Strategy.
Collaboration is important to the success of the IDS. At the ONS, we are working closely with partners across government, the devolved administrations and the external research community to lead on its delivery.