Skip to main content
Loading…
Chamber and committees

Public Audit Committee, 17 Jun 2009

Meeting date: Wednesday, June 17, 2009


Contents


National Health Service (Information Issues)

Item 3 is a briefing from the Auditor General on information issues identified in recent Audit Scotland reports on the national health service in Scotland.

Mr Black:

As the committee is well aware, a recurrent theme in reports on the NHS presented in my name is limited management information on the cost, quality and accessibility of services. Following a discussion at its meeting on 12 November, the committee asked for a briefing paper from Audit Scotland that would pull together the main themes relating to information issues that have arisen in our recent health reports. As a result, this is not a formal report in my name; it has been prepared for the committee by Audit Scotland and we hope that members find it informative and useful.

We tried to provide the committee with an update on some of the most relevant developments in recent months. The Scottish Government very usefully provided the team with detailed information, which is summarised in the paper. We thought it important to give the committee a sense of the work that is taking place at the moment, although we have not examined all the developments in detail for this report. The committee should be aware that this is a very dynamic time in the health service, with a lot of good work being carried out. However, unlike the formal reports that we present to the committee, we have not audited the work to validate what the Scottish Government has told us and therefore cannot draw robust conclusions about what is going on.

With your agreement, convener, I will ask Tricia Meldrum to take the committee through some of the report's main findings.

Tricia Meldrum (Audit Scotland):

The briefing paper looks at the 11 reports on the NHS that we published between January 2007 and April 2009. I draw the committee's attention to five main findings.

First, all the Auditor General's reports on the NHS that have been published since January 2007 have identified a need for better information to ensure that the service is achieving value for money. As the table on pages 2 and 3 of the paper shows, we have grouped that information into four themes: financial information; management information; information to plan new services, national initiatives or significant changes in services; and information for monitoring and evaluation.

Our second main finding is that a wealth of information is available on the NHS in Scotland. Appendix 1 in the briefing paper lists some of the main sources of those data. In particular, I draw the committee's attention to the range of data that are published by ISD Scotland, which is a valuable resource for the NHS. However, the reports that we have published over the past two and a half years have all identified some gaps in key information that is needed to manage and evaluate services. Some of the gaps exist because the data are not collected at all and some because the data are not of a good enough quality to enable robust conclusions to be drawn.

Significant staff costs are involved in collecting, analysing and reporting data for the Scottish Government, ISD Scotland and the health boards. In light of that significant investment, it is important that what is produced is fit for purpose and meets the needs of the wide range of users.

The third main finding is that national and local data need to keep pace with changes in the way that the NHS and its partners provide services. Some of our studies found that the data that are recorded do not fully reflect changes in care, such as the shift to more community-based services; more care being provided by nurses and other members of multidisciplinary teams; and more care being provided on a day care or same-day basis. As services change, the changes need to be reflected in the data that are recorded so that we can get a full picture of the wide range of NHS services. We understand that ISD Scotland is developing some of the necessary data and we refer to that work in the paper.

The fourth finding is that the quality of the national cost data needs to improve. Our reports have highlighted to the committee some concerns about those data, and the Parliament's Health and Sport Committee also heard evidence about gaps in NHS cost information in evidence-taking sessions on the draft 2008-09 budget and the new NHS Scotland resource allocation committee—NRAC—formula.

The Scottish Government is carrying out a review of the current cost data and the costing methodology that is used with a view to making the data fit for purpose. It consulted users earlier this year and is due to make recommendations to the cabinet secretary by the end of the year.

The final finding is that the Scottish Government, ISD Scotland and other national bodies are involved in work that is expected to address many of the issues that we identified. The Scottish Government provided us with an update on developments relevant to the issues that we identified from the NHS reports, and we have summarised its comments against the appropriate issues in appendix 2 of the briefing paper. The development work includes: work to develop cost information that is fit for purpose; updating the way that activity information is recorded to reflect changes in how boards provide services; and information to support boards and their partners in moving to more community-based services. That work is in addition to specific actions that relate to individual studies. As the Auditor General mentioned at the start, we have not audited those new developments and so cannot comment on how robust they are. However, they are clearly a step in the right direction.

I am happy to take any questions that you have.

The Convener:

Thank you for that briefing and the summary report. You mentioned pages 2 to 3 of the report. On one level, what we read there is worrying. For example, the gap identified under "Financial information" is:

"A lack of information on the amount of money spent on different services".

Without that, how is it possible to manage properly? Under "Management information", we read, for example, of

"A lack of information on:

• how medicines are used in hospitals …

• the condition of the NHS estate and maintenance requirements …

• turnaround times for diagnostic tests and rates of repeat testing".

Under "Information to plan new services, national initiatives or significant changes in services" we read:

"Decisions on the use of resources to provide services are made with little evidence of what works".

Under "Monitoring / evaluation information", we are told that there is

"A lack of evaluation of the impact of initiatives and developments on outcomes for service users".

If we were to look at that information alone, we would say that it was a damning indictment, but I am interested to know two things. First, notwithstanding what has happened historically, do you see signs of progress? That is the important thing. You have identified problems, but are they being addressed? Secondly, is there an opportunity for us to come back to some of the performance issues in the health service and consider them in depth in any of the work that you are planning in the next six months to a year?

Tricia Meldrum:

The two points are closely linked. We are seeing signs of progress through the information that the Government and other bodies have provided, but we will want to follow up some of the issues as we carry out follow-up work on some of our studies. We routinely assess the impact of our reports, at a high level at least, to get a sense of what has happened and what has been developing. That helps us identify areas on which we want to do further more detailed follow-up work, perhaps because we are not as confident that progress is being made and things are happening. We will continue to consider information issues in all our studies and we will continue to report on it in our reports and to the committee.

Can we reasonably say that, although there are still weaknesses, we are confident that progress is being made?

Tricia Meldrum:

We are confident that progress is being made. We cannot comment on whether the developments will address all the issues that we have identified, because we have not done the validation work on that.

In the specific pieces of work that you will undertake in the near future, is there anything that is likely to come back to the committee that will enable us to consider some of the issues in more detail?

Mr Black:

That is a good question. Towards the end of the year, we will produce our biennial performance and financial overview of the NHS. If the committee felt that it would be useful, we could ensure that that report, which examines general performance issues, includes a theme on information issues and what progress is being made. If the committee was so minded and felt that it was appropriate, that might be a good opportunity for it to take evidence on those matters and on any other matters relating to the general performance of the health service. We must recognise that information is there for a purpose, so it is rather good to link the issue to how the information is used for performance measurement and performance management purposes.

Murdo Fraser (Mid Scotland and Fife) (Con):

I have a comment and a question. The paper is an excellent summary and it sets out the information in a helpful way. In particular, the tabular format in appendix 2 is helpful for identifying the issues. My comment relates to Tricia Meldrum's important point that there is a substantial cost burden on NHS boards in collating the information. We heard earlier about the backdrop of a great deal of pressure on public finances, which will mean a great deal of pressure on politicians to ensure that in the health service, for example, front-line services are preserved. That will inevitably mean that much greater pressure will be put on backroom functions, such as the collection of data. In the years ahead, we must all be aware of the extent to which it will be possible to maintain robustness in the collection of information, given that severe efficiency targets will be put on health boards. That is just a comment, although the Audit Scotland team are welcome to respond if they wish.

My question is about the details of appendix 2, which picks up on various issues and reports. The right-hand column contains comments on how work is being taken forward but, as far as I can see, there is no particular timescale within which we can expect implementation. Is that because it is a moveable feast, or is there another particular reason why you have not identified when you expect progress to be made?

Tricia Meldrum:

Sorry, but which table are you referring to?

The table in appendix 2. I am looking at the right-hand column, which is on monitoring and evaluation information. You identify several issues on which on-going work is being done, but at no point are there target dates for progress.

Tricia Meldrum:

The updates that are in italics are based on information that was provided by the Government. We gave the Government the table and, in some cases, it provided more detailed information, which we summarised to make it easier to understand. However, we did not strip out any dates from the information that the Government provided. If we follow up on individual reports and studies, we would ask for the details of timescales and timelines.

May I comment on your point about the cost burden on the NHS?

Yes, of course.

Tricia Meldrum:

We are talking about core information that bodies need to manage their services efficiently and appropriately. We do not see it as an optional add-on; rather, it is core to managing services in the best way possible. The issue is ensuring that it is fit for purpose; it is not about collecting information for the sake of it. The information is core to business.

Willie Coffey:

I will ask about the comments on page 3 of the paper, on monitoring and evaluation and the lack of national information to allow benchmarking to take place across the health boards. The paper mentions a national benchmarking project with more than 90 indicators in place. Is everybody embracing that project? If they are not, why are they not? If consistency in reporting is lacking across the boards, what is that national benchmarking project doing?

Tricia Meldrum:

We have tried to use some of the benchmarking information in the past in considering the diagnostics project, for example, and there is also work on benchmarking radiology information. However, we have found problems with consistency and data quality. The project is taking forward work on that. Work is being done to improve that information, which the Government has given us an update on. However, we could not draw robust conclusions from that, given the differences in definitions and the data quality issues. We want to consider benchmarking work that is relevant to individual studies, and we have done so in the past, but we have not always found it to be as robust as it could be.

Willie Coffey:

Does an across-Scotland knowledge management strategy need to emerge or develop in the NHS to assist us in getting consistency of reporting across the boards? Is something lacking? You have said several times that no national information is available to us to allow us to benchmark, and the benchmarking framework does not seem to be quite what we want. Do we need to move things a step forward and consider knowledge management in a different way? Obviously, clinical and IT management expertise would be used to bring information together so that we get what we are looking for in the long run.

Tricia Meldrum:

I think that there is a national knowledge management strategy—it might not be called that, although it could be called something similar—but I am not sure about the extent to which it takes in some of the clinical information. I think that it is more to do with things such as access to evidence-based health care and evidence-based management. We have looked more at individual topics related to individual studies and consistency in that context rather than across the whole of knowledge management.

The Convener:

As members have no other questions, do they agree to note the report? We thank Audit Scotland for providing a helpful report and look forward to it trying to work it into future reports so that we will have the opportunity to return to the issues and reconsider them in more detail.

Mr Black:

We would be happy to do that, convener.

Thank you very much.