The Data Meeting on 23rd June 2016 included presentations about data quality from Lambeth & Southwark, a walk through of one of the Hackathon apps ‘How am I doing?’, an update from the CYP Mental Health Outcomes Expert Advisory Group and MHSDS so far, as well as an overview of a new London NHS dashboard.
Chaired by: Dr Rebecca Wheatcroft (Clinical Psychologist & CYP-IAPT Lead, Greenwich CAMHS) and Alex Goforth (CYP-IAPT London & SE Collaborative Project Lead)
Troubleshooting working groups
During the meeting, users of the main patient record systems considered the main challenges of their system and the next steps to overcoming them:
- Issue: Some questionnaire scores are summing incorrectly
- Next steps: Make sure others high in the organisation are aware of issues (inc. directors) and go back to company to ask them to address the problem and keep all informed.
- Issue: Some systems do not allow for recording outcomes but others do. Also, extracting data from the warehouse is sometimes difficult and slow due to busy informatics teams with other priorities
- Next steps: Functionality can be enabled on the system to allow for recording outcomes – but this may cost extra? For data extraction, could request for ‘superusers’ in each team to access the data back end in order to circumvent informatics teams
- Issue: Services have developed different methods
- Next steps: Communication with others users of the same platform to trouble shoot and share tips etc.
Presentations from the day
Data Quality in Lambeth & Southwark (Tracey Lewis, Service manager & Lynette Antwi-Marful, CYP IAPT administrator)
Tracey and Lynette spoke about the system Lambeth and Southwark use for ensuring quality data. As well as equipping all team bases with an in depth IAPT induction folder and measures packs (5 premade packs depending on age group and ability to fill out measures – assessment and discharge), the CYP IAPT administrator provides training for new staff coming into the services, support with data entry onto patient records and provides regular feedback reports and checks on data quality. They are now moving towards a system where clinicians enter their own data onto patient records.
CYP Mental Health Outcomes Expert Advisory Group (Duncan Law, CYP IAPT London & SE Collaborative Clinical Lead)
Duncan provided an overview of the CYP Mental Health Outcomes Expert Advisory Group, which is Department of Health lead with reps from NHSE, Department for Education (DfE), voluntary sector, local authority CYP IAPT, NHS Digital and Royal College of Psychiatrists to “bring together key partners efforts on children and young people’s mental health data and metrics to drive improvement in outcomes”.
Work to date has involved advising on metrics for MHSDS and KPIs for Local Transformation Plans, as well as linking with other outcome focused groups such as schools, ICHOM and the Five Year Forward View guidance (adults).
Future work plan of the group includes: High level metrics and MHSDS development; advise on outcomes monitoring; alignment with data and information networks and horizon scanning; making better use of digital technology and data linkage between systems as well as the local measurement and monitoring of the Local Transformation process.
Hackathon # 1 App presentation: How Am I Doing? (Alex Goforth, CYP IAPT London & SE Collaborative Project Lead)
Alex Goforth gave a walk through of the ‘How am I doing?’ app developed at the last Hackathon. The app collects RCADS outcome data for mood and presents it in graphs and summary tables. The app also allows the sharing of data with clinicians and others. You can find more about the Hackathon apps here. The next Hackathon will be starting on 12th September – click here for more details.
Mental Health Minimum Dataset (MHMDS; Dominic Gair, Section Head [Community], Mental Health and Community team, HSCIC/NHS Digital)
Dominic joined the meeting remotely. He spoke of the current status of the MHMDS reports – 3 months of submission now imported and published (latest March 2016 on 21st June). This is an evolving process and, given that data quality has large impact on timeframes and capacity is finite for analysis, HSCIC are working with the Mental Health Data and Information Programme board (MHDPB) to collate and prioritise the work backlog and content will expand with every release.
What do we know so far? March 2016
- 304,559 referrals (under 19 years) reported were active at any point during the month
- Of these, 40,104 were new referrals raised for 33,510 people
- 5% were self-referrals
- 14,563 new referrals to CYP MH in the reporting period
Some issues arising…
Relationships between levels of activity by age group and service type are not quite as expected and are being investigated. This will be important for future payments and to keep in mind for integrated mental health services.
Eating Disorder data is to be used to report access and waiting time standards however only 20 organisations have reported (since Jan 2016, just 600 people nationally). NHSE expect 2% of all new referrals to be for treatment of ED which is not reflected in current data. Limited reporting may result in NHSE exploring other means to get this information.
There are still some data quality issues, especially around coverage of organisations able to report data, which should be taken into account when viewing the data.
You can find all published datasets on the HSCIC website. They encourage feedback on the reports and what you would like to see.
NHS London Mental Health Dashboard (Stephen Watkins, NHS Benchmarking)
Stephen presented an overview of the Pan London mental health dashboard which is to be published at the end of July 2016. Developed in consultation with various expert reference groups, the dashboard will become a reference source for London’s mental health and allow tracking of strategic objectives and exploration of variation across the capital.
Decisions are currently being made about the content as CAMHS data is less predictable than adults (e.g. 11% increase in referrals across the NHS. Length of stay increased last year – lots of change). Every exec team in London for CCGs and Trusts will get a PDF report from the dashboard published quarterly.