Warning - this repository is a snapshot of a repository internal to NHS England. This means that links to videos and some URLs may not work.
Repository owner: Analytical Services: Community and Mental Health
Email: mh.analysis@nhs.net
To contact us raise an issue on Github or via email and we will respond promptly.
This codebase is used in the creation of the Mental Health Services Monthly Statistics publication. There are three separate pipelines (menh_analysis, Menh_publications and mental_health_bbrb) which contribute to the production of the Mental Health Monthly Statistics. These are all included in the repository. This publication uses the Mental Health Services Dataset (MHSDS), further information about the dataset can be found at https://digital.nhs.uk/data-and-information/data-collections-and-data-sets/data-sets/mental-health-services-data-set.
The full publication series can be found at https://digital.nhs.uk/data-and-information/publications/statistical/mental-health-services-monthly-statistics.
Other associated metadata which includes pseudo code and descriptions and a full list of the measures produced by NHS Digital across the mental health publications can be found at https://digital.nhs.uk/data-and-information/data-collections-and-data-sets/data-sets/mental-health-services-data-set/statistics-and-reports.
Other Mental Health related publications and dashboards can be found at the Mental Health Data Hub: https://digital.nhs.uk/data-and-information/data-tools-and-services/data-services/mental-health-data-hub
The repository is structured as follows:
│ README.md
│
└───mental-health-monthly-statistics
▒▒▒▒Mental_Health_Monthly_Statistics
▒▒▒▒menh_analysis_clean
▒ ▒▒▒▒notebooks
▒ ▒ ▒▒▒▒00_Master
▒ ▒ ▒▒▒▒01_Prepare
▒ ▒ ▒▒▒▒02_Aggregate
▒ ▒ ▒ ▒▒▒▒1.Main_monthly_agg
▒ ▒ ▒ ▒ ▒▒▒▒1.National
▒ ▒ ▒ ▒ ▒▒▒▒2.CCG
▒ ▒ ▒ ▒ ▒▒▒▒3.Provider
▒ ▒ ▒ ▒ ▒▒▒▒4.LA-CASSR
▒ ▒ ▒ ▒▒▒▒5.CYP_monthly_agg
▒ ▒ ▒ ▒▒▒▒1.National
▒ ▒ ▒ ▒▒▒▒2.CCG
▒ ▒ ▒ ▒▒▒▒3.Provider
▒ ▒ ▒▒▒▒03_Extract
▒ ▒ ▒ ▒▒▒▒001_Monthly_Code
▒ ▒ ▒▒▒▒v4_code_DO_NOT_DELETE
▒ ▒ ▒▒▒▒notebooks
▒ ▒ ▒▒▒▒00_Master
▒ ▒ ▒▒▒▒01_Prepare
▒ ▒ ▒▒▒▒02_Aggregate
▒ ▒ ▒▒▒▒1.Main_monthly_agg
▒ ▒ ▒ ▒▒▒▒1.National
▒ ▒ ▒ ▒▒▒▒2.CCG
▒ ▒ ▒ ▒▒▒▒3.Provider
▒ ▒ ▒ ▒▒▒▒4.LA-CASSR
▒ ▒ ▒▒▒▒5.CYP_monthly_agg
▒ ▒ ▒▒▒▒1.National
▒ ▒ ▒▒▒▒2.CCG
▒ ▒ ▒▒▒▒3.Provider
▒ ▒▒▒▒schemas
▒ ▒▒▒▒00_DB
▒ ▒▒▒▒99_update_testdata_db
▒▒▒▒menh_publications_clean
▒ ▒▒▒▒notebooks
▒ ▒ ▒▒▒▒00_common_objects
▒ ▒ ▒▒▒▒02_72HOURS
▒ ▒ ▒ ▒▒▒▒00_Master
▒ ▒ ▒ ▒▒▒▒01_Prepare
▒ ▒ ▒ ▒▒▒▒02_Aggregate
▒ ▒ ▒▒▒▒03_RestrictiveInterventions
▒ ▒ ▒ ▒▒▒▒00_Master
▒ ▒ ▒ ▒▒▒▒01_Prepare
▒ ▒ ▒ ▒▒▒▒02_Aggregate
▒ ▒ ▒ ▒ ▒▒▒▒1.National
▒ ▒ ▒ ▒ ▒▒▒▒2.Provider
▒ ▒ ▒ ▒ ▒▒▒▒3.ProviderType
▒ ▒ ▒ ▒ ▒▒▒▒4.Suppress
▒ ▒ ▒ ▒▒▒▒03_Extract
▒ ▒ ▒▒▒▒04a_CYP_ED_WaitingTimes
▒ ▒ ▒ ▒▒▒▒00_Master
▒ ▒ ▒ ▒▒▒▒01_Prepare
▒ ▒ ▒ ▒▒▒▒02_Aggregate
▒ ▒ ▒▒▒▒04_CYP_ED_WaitingTimes
▒ ▒ ▒ ▒▒▒▒00_Master
▒ ▒ ▒ ▒▒▒▒01_Prepare
▒ ▒ ▒ ▒▒▒▒02_Aggregate
▒ ▒ ▒▒▒▒05_MHA_Monthly
▒ ▒ ▒ ▒▒▒▒00_Master
▒ ▒ ▒ ▒▒▒▒01_Prepare
▒ ▒ ▒ ▒▒▒▒02_Aggregate
▒ ▒ ▒▒▒▒06_CYP_Outcome_Measures
▒ ▒ ▒ ▒▒▒▒00_Master
▒ ▒ ▒ ▒▒▒▒01_Prepare
▒ ▒ ▒ ▒▒▒▒02_Aggregate
▒ ▒ ▒▒▒▒07_EIP
▒ ▒ ▒ ▒▒▒▒00_Master
▒ ▒ ▒ ▒▒▒▒01_Prepare
▒ ▒ ▒ ▒▒▒▒02_Aggregate
▒ ▒ ▒▒▒▒08_ASCOF
▒ ▒ ▒ ▒▒▒▒00_Master
▒ ▒ ▒ ▒▒▒▒01_Prepare
▒ ▒ ▒ ▒▒▒▒02_Aggregate
▒ ▒ ▒▒▒▒99_Extract
▒ ▒▒▒▒schemas
▒ ▒▒▒▒00_create_common_objects
▒ ▒▒▒▒02_72HOURS
▒ ▒▒▒▒03_RestrictiveInterventions
▒ ▒▒▒▒04_CYP_ED_WaitingTimes
▒ ▒▒▒▒05_MHA_Monthly
▒ ▒▒▒▒06_CYP_Outcome_Measures
▒ ▒▒▒▒07_EIP
▒ ▒▒▒▒08_ASCOF
▒▒▒▒mental_health_bbrb_clean
▒▒▒▒MHSDS_OAPs
▒▒▒▒MHSDS_V5_BBRB
▒▒▒▒CMH_v5
▒ ▒▒▒▒CMH NHS D Code
▒ ▒▒▒▒CMH_Agg
▒ ▒▒▒▒CMH_Prep
▒▒▒▒CYP and Perinatal monthly V5
▒ ▒▒▒▒Archive
▒▒▒▒EIP_CaseloadSNoMED
▒▒▒▒menh_bbrb_measures
▒ ▒▒▒▒Prep
▒▒▒▒Perinatal Qtr V5
▒ ▒▒▒▒1920 versions
▒ ▒ ▒▒▒▒Version 2 for publishing
▒ ▒▒▒▒21_22 version V5
▒▒▒▒Restraints_v5_Apr2022_onwards
▒▒▒▒Restraints_Published_CSV_Build
▒▒▒▒Restraints_Suppression
The menh_analysis pipeline contains most high level measures such as MHS01, People in contact with mental health services. Menh_publications contains metrics such as EIP, 72 hour follow ups and numbers of detentions under the Mental Health Act. The mental_health_bbrb code contains newer metrics such as Children and Young Peoples Access, Perinatal Access and Children and Young Peoples Outcomes.
Please note that the code included in this project is designed to be run on Databricks within the NHS England systems. As such some of the code included here may not run on other MHSDS assets. The logic and methods used to produce the metrics included in this codebase remain the same though.
MHSDS is collected on a monthly basis from providers of secondary mental health services. On average around 210 million rows of data flow into the dataset on a monthly basis. More information on the data quality of the dataset, including the numbers of providers submitting data and the volumes of data flowing to each table can be found in the Data Quality Dashboard: https://digital.nhs.uk/data-and-information/data-tools-and-services/data-services/mental-health-data-hub/data-quality/mental-health-services-dataset---data-quality-dashboard
The MHSDS tables and fields used within the code are all documented within the MHSDS tools and guidance. This guidance can be found here: https://digital.nhs.uk/data-and-information/data-collections-and-data-sets/data-sets/mental-health-services-data-set/tools-and-guidance
Within the guidance are three key documents:
- MHSDS Technical Output Specification - This provides technical details of all of the fields and tables contained within the dataset. It also contains details of the validations applied to specific tables and fields. The specification also includes details of derivations and how they are constructed.
- MHSDS Data Model - This details all of the tables and fields within the dataset and how they relate to each other.
- MHSDS User Guidance - This document provides details of all of the tables and fields within the dataset and gives examples of how a user might populate the data in certain scenarios.
Additionally, users might want to consult the Data Dictionary for specific fields within the dataset: https://www.datadictionary.nhs.uk/
In places the notebooks above use some acronyms. The main ones used are as follows:
- MHSDS: Mental Health Services Dataset
- CCG: Clinical Commissioning Group. These were replaced by Sub Integrated Care Boards (ICBs) in July 2022.
- ICB: Integrated Care Board. These came into effect on July 1st 2022. Further information can be found at https://www.kingsfund.org.uk/publications/integrated-care-systems-explained#development.
- Provider: The organisation is providing care. This is also the submitter of MHSDS data -LA: Local Authority
If you have any questions or issues regarding the constructions or code within this repository please contact mh.analysis@nhs.net
Community and Mental Health Team, NHS England mh.analysis@nhs.net
The menh_bbrb codebase is released under the MIT License. The documentation is © Crown copyright and available under the terms of the [Open Government 3.0] (https://www.nationalarchives.gov.uk/doc/open-government-licence/version/3/) licence.