Voror_Wiki - User contributions [en-gb]

Discovery Explorer

2021-06-15T09:28:27Z

NickCable:

== Explorer and it's capabilities ==
Discovery Explorer is a user interface web application which allows users to build queries, dashboards and view results without any knowledge needed of the database structure or of the SQL language.

Explorer will by nature produce more accurate results because it ‘understands’ the database structures and clinical model, and the machine generates the SQL that’s already been pre-tested.

The features and benefits of using Discovery Explorer are:

* Create and build your own value sets with an inbuilt browser.
* Bulk upload your value sets from a CSV file.
* Create your own detailed queries with our intuitive query engine that is able to handle highly sophisticated queries in a user friendly experience - no SQL skills required.
* Build queries to identify patients at risk or in need of further intervention.
* View historical trends of query results.
* View registries to show compliance of QOF and other data sets, easily comparing, practices, CCGS and hospitals.
* Drill-down to lists of patients behind query results.
* View each patient’s complete integrated care record.
* Use our dashboard suit or create a csv output for your query to interrogate in 3rd party applications.
* Create outputs containing demographic, medication, encounter or clinical data.
* View intuitive dashboards at STP, CCG, PCN or practice level, patient identifiable or de identifiable dependent on your permission level.
* View geospatial maps show prevalence of diseases, conditions or vaccination up take by area.

Further details explaining the access and authentication levels can be found in the [[Discovery Explorer- Specification]] article.

== Access and support ==
Access and support are controlled by the Discovery Programme team in London.

Access is controlled by [mailto:andy.thomas3@nhs.net Andy Thomas] and can be requested using this [https://app.smartsheet.com/b/form/45cfd0c985554afdb8670e459836c4f1 Discovery Explorer User Request Form]

== Training Videos ==
Training videos are available within the application to help you to navigate and utilise the system. Below are videos that will assist you in using Discovery Explorer:

====== Key features ======
[https://youtu.be/HPk6d_cV6uw Explanation of the key features available in Discovery Explorer.]

====== Logon and navigation ======
How to logon to the application and navigate around the menus and modules:

[https://www.youtube.com/watch?v=4yv0i5W36_o Video]

[[Discovery Explorer/Access and Navigation|Article]]

====== Covid library ======
[https://www.youtube.com/watch?v=uqWROH6UiSY How to use the COVID-19 dashboards.]

====== Dashboard library ======
[https://www.youtube.com/watch?v=9MBqcwBsQxQ How to create and view your own dashboards.]

====== Maps ======
[https://www.youtube.com/watch?v=i2cpVCd0AY0 How to use the geospatial maps.]

====== Query results ======
[https://www.youtube.com/watch?v=echEph4_BPk How to view results of queries and drill-down to records.]

====== Query & data set library ======
[https://www.youtube.com/watch?v=7h4d2n7LGyc How to create queries, data sets and visualisations.]

====== Query queue ======
[https://www.youtube.com/watch?v=i6eQk3mJpnU Explanation of the query queue module.]

====== Value set library ======
How to create and modify value sets used by queries.:

[https://www.youtube.com/watch?v=rOqc8H2-52s Video]

[[Discovery Explorer/Value Set Library|Article]]

====== Population counts ======
[https://www.youtube.com/watch?v=tMFBjhGN0As Explanation of the population counts module.]

__FORCETOC__

Working with Discovery

2021-04-27T09:58:28Z

NickCable: code review addition

== Getting started ==
'''How do I access the DDS?'''

Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) for access.

'''How do I communicate with LHS?'''

Where LHS are asked to support an organisation, all communication is via [[Jira]]. This helps to ensure that issues and questions are tracked, lessons are learnt and activity can be reported.

'''How do I upload code to the Github repository?'''

Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) for access and ways of working. See [[GitHub repositories]] for a description of each repository.

'''What data sets are currently published to the DDS?'''

See [[Current data sets]] for the data sets that are currently published to the DDS by different supplier systems.

'''What data is currently published to the DDS?'''

See [[Current published data]] for the latest data publisher information by sector, geographical area, service, and system provider.

'''What is the status of the publisher feeds?'''

See [[Publisher feed status]] for the latest published data status of the three main system suppliers.

'''How do I access and add DDS wiki articles?'''

See [[Welcome to the Discovery Data Service knowledge base#Wiki tips|Wiki tips]] for more details.

__FORCETOC__
== Publishing data ==
'''What is the capacity of the DDS?'''

The Discovery Data Service has been designed from the ground up to work in the cloud with a modular architecture designed to scale. The current cloud provider has the capacity to go well beyond all patient records in the UK, the current system is operating at over 12.5 million distinct patient records. See [[Current published data]] for details on the data already published.

'''How are CDS extracts transformed?'''

See [[Barts Health CDS FHIR Mapping]].

'''How is data publication to the DDS secured?'''

See [[Secure publication to the DDS]].

'''How is data stored in the DDS?'''

See [[Data Storage Architecture|Data storage architecture]] for more details.

'''How is data encrypted in the DDS?'''

Data is transferred, via HSCN, into the DDS HSCN connected AWS instance by SFTP, HTTP, or MLLP. See [[Secure publication to the DDS]] for more details.

'''How is ADT data mapped in FHIR?'''

See [[Homerton ADT FHIR Mapping]] for more details.

'''Is there an overview of the inbound pipeline?'''

See [[Inbound Transformation Pipeline]] for more details.

'''How is data being published to the DDS monitored?'''

See [[Monitoring and alerting]] for more details.

== Development projects ==
'''How do I access a development version of the DDS?'''

Applications should be made to the London Discovery Technical leads. Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) or Gary McAlister (email [mailto:gary.mcallister@nhs.net gary.mcallister@nhs.net]) for access.

'''Is there an overview of the outbound data pipeline?'''

See [[Outbound Transformation Pipeline]] for more details.

'''How do I access and use the DDS FHIR Get Structured Record API?'''

See the [[FHIR Get Structured Record API]] page for more details.

'''How do I access and use the DDS HL7v2 API?'''

See the [[HL7v2 API]] page for more details.

'''How do I access Jira to view current development projects?'''

See the [[Jira]] page for more details.

'''What are the Standard Operating Procedures for developing for DDS?'''

See [https://drive.google.com/file/d/1RDb1NGINnNLmT0gsLiUQK1VmWSih8go4/view?usp=sharing Discovery Software Development Standard Operating Procedures.doc] for details that include:

* Roles & responsibilities
* Development & coding standards
** Java
** HTML5 & CSS
** Javascript
* Development framework, tools & technologies
* Development environments
* Processes & controls
* Security & assurance

'''What code reviews will take place?'''

The code review for all contractor submissions to DDS will cover as a minimum:

* Data sharing manager API has been used to control access to data
* The config database has been used correctly to establish correct connections to the correct databases
* The correct SQL connection classes and patterns have been used to ensure DB pool connections are created and released correctly
* No SQL penetration vulnerabilities
* SQL accuracy and efficiency
* The information model has been used correctly to apply the correct value sets to the queries
* REST API security and use of auth tokens
* Code algorithm accuracy
* Adequate exception handling
* Code standards adherence
* Code is adequately commented

In addition to the code review there will be a deployment review to check that the correct build and deployment scripts have been integrated into the project code.

'''What is the Software Development Project Lifecycle & Assurance Report?'''

A typical development project lifecycle is illustrated within the steps contained in the [https://drive.google.com/file/d/1hYmfk2pyQlWslyaDQ-5XyTSnCdCgmn2M/view?usp=sharing Project Assurance template].

'''How are the data feeds monitored?'''

A set of internal dashboards are used to monitor data flows in to and out of DDS. These dashboards have been built into an application called DDS-UI which provides many back-end DDS management utilities. For more information see the [[DDS-UI dashboards]] page.

'''Where are the GitHub Repositories and how do I access them?'''

See the [[GitHub repositories|GitHub Repositories]] page for a list of all repositories. Applications should be made to the London Discovery Technical leads. Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) or Gary McAlister (email [mailto:gary.mcallister@nhs.net gary.mcallister@nhs.net]) for access.

The code within Discovery follows the GitFlow workflow for software development where master is the main branch, develop is created for developments and feature branches are created from development where appropriate. Once features have been developed and are ready for including in the development system the feature branches are merged back to develop and then main accordingly.

A summary of GitFlow can be found here: https://datasift.github.io/gitflow/IntroducingGitFlow.html

Guides to using GitHub can be found here: https://guides.github.com/

'''How is data access linked to sharing and processing agreements?'''

Use Data Sharing Manager to determine which data is processed and shared according to projects linked to sharing and processing agreements. See [[Data Sharing Manager]] for more details.

'''How is access to the data in the DDS controlled?'''

Data is made available to particular systems or people using attribute based access control. See [[Identity Authentication Authorisation]] for more details.

== Subscriber projects ==
'''Is there an overview of the outbound pipeline?'''

See [[Outbound Transformation Pipeline]] for more details.

== Primary care ==

== Testing and assurance ==

Working with Discovery

2021-04-27T08:54:55Z

NickCable: Monitoring added

== Getting started ==
'''How do I access the DDS?'''

Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) for access.

'''How do I communicate with LHS?'''

Where LHS are asked to support an organisation, all communication is via [[Jira]]. This helps to ensure that issues and questions are tracked, lessons are learnt and activity can be reported.

'''How do I upload code to the Github repository?'''

Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) for access and ways of working. See [[GitHub repositories]] for a description of each repository.

'''What data sets are currently published to the DDS?'''

See [[Current data sets]] for the data sets that are currently published to the DDS by different supplier systems.

'''What data is currently published to the DDS?'''

See [[Current published data]] for the latest data publisher information by sector, geographical area, service, and system provider.

'''What is the status of the publisher feeds?'''

See [[Publisher feed status]] for the latest published data status of the three main system suppliers.

'''How do I access and add DDS wiki articles?'''

See [[Welcome to the Discovery Data Service knowledge base#Wiki tips|Wiki tips]] for more details.

__FORCETOC__
== Publishing data ==
'''What is the capacity of the DDS?'''

The Discovery Data Service has been designed from the ground up to work in the cloud with a modular architecture designed to scale. The current cloud provider has the capacity to go well beyond all patient records in the UK, the current system is operating at over 12.5 million distinct patient records. See [[Current published data]] for details on the data already published.

'''How are CDS extracts transformed?'''

See [[Barts Health CDS FHIR Mapping]].

'''How is data publication to the DDS secured?'''

See [[Secure publication to the DDS]].

'''How is data stored in the DDS?'''

See [[Data Storage Architecture|Data storage architecture]] for more details.

'''How is data encrypted in the DDS?'''

Data is transferred, via HSCN, into the DDS HSCN connected AWS instance by SFTP, HTTP, or MLLP. See [[Secure publication to the DDS]] for more details.

'''How is ADT data mapped in FHIR?'''

See [[Homerton ADT FHIR Mapping]] for more details.

'''Is there an overview of the inbound pipeline?'''

See [[Inbound Transformation Pipeline]] for more details.

'''How is data being published to the DDS monitored?'''

See [[Monitoring and alerting]] for more details.

== Development projects ==
'''How do I access a development version of the DDS?'''

Applications should be made to the London Discovery Technical leads. Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) or Gary McAlister (email [mailto:gary.mcallister@nhs.net gary.mcallister@nhs.net]) for access.

'''Is there an overview of the outbound data pipeline?'''

See [[Outbound Transformation Pipeline]] for more details.

'''How do I access and use the DDS FHIR Get Structured Record API?'''

See the [[FHIR Get Structured Record API]] page for more details.

'''How do I access and use the DDS HL7v2 API?'''

See the [[HL7v2 API]] page for more details.

'''How do I access Jira to view current development projects?'''

See the [[Jira]] page for more details.

'''What are the Standard Operating Procedures for developing for DDS?'''

See [https://drive.google.com/file/d/1RDb1NGINnNLmT0gsLiUQK1VmWSih8go4/view?usp=sharing Discovery Software Development Standard Operating Procedures.doc] for details that include:

* Roles & responsibilities
* Development & coding standards
** Java
** HTML5 & CSS
** Javascript
* Development framework, tools & technologies
* Development environments
* Processes & controls
* Security & assurance

'''What is the Software Development Project Lifecycle & Assurance Report?'''

A typical development project lifecycle is illustrated within the steps contained in the [https://drive.google.com/file/d/1hYmfk2pyQlWslyaDQ-5XyTSnCdCgmn2M/view?usp=sharing Project Assurance template].

'''How are the data feeds monitored?'''

A set of internal dashboards are used to monitor data flows in to and out of DDS. These dashboards have been built into an application called DDS-UI which provides many back-end DDS management utilities. For more information see the [[DDS-UI dashboards]] page.

'''Where are the GitHub Repositories and how do I access them?'''

See the [[GitHub repositories|GitHub Repositories]] page for a list of all repositories. Applications should be made to the London Discovery Technical leads. Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) or Gary McAlister (email [mailto:gary.mcallister@nhs.net gary.mcallister@nhs.net]) for access.

The code within Discovery follows the GitFlow workflow for software development where master is the main branch, develop is created for developments and feature branches are created from development where appropriate. Once features have been developed and are ready for including in the development system the feature branches are merged back to develop and then main accordingly.

A summary of GitFlow can be found here: https://datasift.github.io/gitflow/IntroducingGitFlow.html

Guides to using GitHub can be found here: https://guides.github.com/

'''How is data access linked to sharing and processing agreements?'''

Use Data Sharing Manager to determine which data is processed and shared according to projects linked to sharing and processing agreements. See [[Data Sharing Manager]] for more details.

'''How is access to the data in the DDS controlled?'''

Data is made available to particular systems or people using attribute based access control. See [[Identity Authentication Authorisation]] for more details.

== Subscriber projects ==
'''Is there an overview of the outbound pipeline?'''

See [[Outbound Transformation Pipeline]] for more details.

== Primary care ==

== Testing and assurance ==

Working with Discovery

2021-04-27T08:23:27Z

NickCable: Outbound pipeline

== Getting started ==
'''How do I access the DDS?'''

Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) for access.

'''How do I communicate with LHS?'''

Where LHS are asked to support an organisation, all communication is via [[Jira]]. This helps to ensure that issues and questions are tracked, lessons are learnt and activity can be reported.

'''How do I upload code to the Github repository?'''

Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) for access and ways of working. See [[GitHub repositories]] for a description of each repository.

'''What data sets are currently published to the DDS?'''

See [[Current data sets]] for the data sets that are currently published to the DDS by different supplier systems.

'''What data is currently published to the DDS?'''

See [[Current published data]] for the latest data publisher information by sector, geographical area, service, and system provider.

'''What is the status of the publisher feeds?'''

See [[Publisher feed status]] for the latest published data status of the three main system suppliers.

'''How do I access and add DDS wiki articles?'''

See [[Welcome to the Discovery Data Service knowledge base#Wiki tips|Wiki tips]] for more details.

__FORCETOC__
== Publishing data ==
'''What is the capacity of the DDS?'''

The Discovery Data Service has been designed from the ground up to work in the cloud with a modular architecture designed to scale. The current cloud provider has the capacity to go well beyond all patient records in the UK, the current system is operating at over 12.5 million distinct patient records. See [[Current published data]] for details on the data already published.

'''How are CDS extracts transformed?'''

See [[Barts Health CDS FHIR Mapping]].

'''How is data publication to the DDS secured?'''

See [[Secure publication to the DDS]].

'''How is data stored in the DDS?'''

See [[Data Storage Architecture|Data storage architecture]] for more details.

'''How is data encrypted in the DDS?'''

Data is transferred, via HSCN, into the DDS HSCN connected AWS instance by SFTP, HTTP, or MLLP. See [[Secure publication to the DDS]] for more details.

'''How is ADT data mapped in FHIR?'''

See [[Homerton ADT FHIR Mapping]] for more details.

'''Is there an overview of the inbound pipeline?'''

See [[Inbound Transformation Pipeline]] for more details.

'''How is data being published to the DDS monitored?'''

See [[Monitoring and alerting]] for more details.

== Development projects ==
'''How do I access a development version of the DDS?'''

Applications should be made to the London Discovery Technical leads. Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) or Gary McAlister (email [mailto:gary.mcallister@nhs.net gary.mcallister@nhs.net]) for access.

'''Is there an overview of the outbound data pipeline?'''

See [[Outbound Transformation Pipeline]] for more details.

'''How do I access and use the DDS FHIR Get Structured Record API?'''

See the [[FHIR Get Structured Record API]] page for more details.

'''How do I access and use the DDS HL7v2 API?'''

See the [[HL7v2 API]] page for more details.

'''How do I access Jira to view current development projects?'''

See the [[Jira]] page for more details.

'''What are the Standard Operating Procedures for developing for DDS?'''

See [https://drive.google.com/file/d/1RDb1NGINnNLmT0gsLiUQK1VmWSih8go4/view?usp=sharing Discovery Software Development Standard Operating Procedures.doc] for details that include:

* Roles & responsibilities
* Development & coding standards
** Java
** HTML5 & CSS
** Javascript
* Development framework, tools & technologies
* Development environments
* Processes & controls
* Security & assurance

'''What is the Software Development Project Lifecycle & Assurance Report?'''

A typical development project lifecycle is illustrated within the steps contained in the [https://drive.google.com/file/d/1hYmfk2pyQlWslyaDQ-5XyTSnCdCgmn2M/view?usp=sharing Project Assurance template].

'''Where are the GitHub Repositories and how do I access them?'''

See the [[GitHub repositories|GitHub Repositories]] page for a list of all repositories. Applications should be made to the London Discovery Technical leads. Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) or Gary McAlister (email [mailto:gary.mcallister@nhs.net gary.mcallister@nhs.net]) for access.

The code within Discovery follows the GitFlow workflow for software development where master is the main branch, develop is created for developments and feature branches are created from development where appropriate. Once features have been developed and are ready for including in the development system the feature branches are merged back to develop and then main accordingly.

A summary of GitFlow can be found here: https://datasift.github.io/gitflow/IntroducingGitFlow.html

Guides to using GitHub can be found here: https://guides.github.com/

'''How is data access linked to sharing and processing agreements?'''

Use Data Sharing Manager to determine which data is processed and shared according to projects linked to sharing and processing agreements. See [[Data Sharing Manager]] for more details.

'''How is access to the data in the DDS controlled?'''

Data is made available to particular systems or people using attribute based access control. See [[Identity Authentication Authorisation]] for more details.

== Subscriber projects ==
'''Is there an overview of the outbound pipeline?'''

See [[Outbound Transformation Pipeline]] for more details.

== Primary care ==

== Testing and assurance ==

Working with Discovery

2021-04-27T08:17:44Z

NickCable: Github update

== Getting started ==
'''How do I access the DDS?'''

Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) for access.

'''How do I communicate with LHS?'''

Where LHS are asked to support an organisation, all communication is via [[Jira]]. This helps to ensure that issues and questions are tracked, lessons are learnt and activity can be reported.

'''How do I upload code to the Github repository?'''

Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) for access and ways of working. See [[GitHub repositories]] for a description of each repository.

'''What data sets are currently published to the DDS?'''

See [[Current data sets]] for the data sets that are currently published to the DDS by different supplier systems.

'''What data is currently published to the DDS?'''

See [[Current published data]] for the latest data publisher information by sector, geographical area, service, and system provider.

'''What is the status of the publisher feeds?'''

See [[Publisher feed status]] for the latest published data status of the three main system suppliers.

'''How do I access and add DDS wiki articles?'''

See [[Welcome to the Discovery Data Service knowledge base#Wiki tips|Wiki tips]] for more details.

__FORCETOC__
== Publishing data ==
'''What is the capacity of the DDS?'''

The Discovery Data Service has been designed from the ground up to work in the cloud with a modular architecture designed to scale. The current cloud provider has the capacity to go well beyond all patient records in the UK, the current system is operating at over 12.5 million distinct patient records. See [[Current published data]] for details on the data already published.

'''How are CDS extracts transformed?'''

See [[Barts Health CDS FHIR Mapping]].

'''How is data publication to the DDS secured?'''

See [[Secure publication to the DDS]].

'''How is data stored in the DDS?'''

See [[Data Storage Architecture|Data storage architecture]] for more details.

'''How is data encrypted in the DDS?'''

Data is transferred, via HSCN, into the DDS HSCN connected AWS instance by SFTP, HTTP, or MLLP. See [[Secure publication to the DDS]] for more details.

'''How is ADT data mapped in FHIR?'''

See [[Homerton ADT FHIR Mapping]] for more details.

'''Is there an overview of the inbound pipeline?'''

See [[Inbound Transformation Pipeline]] for more details.

'''How is data being published to the DDS monitored?'''

See [[Monitoring and alerting]] for more details.

== Development projects ==
'''How do I access a development version of the DDS?'''

Applications should be made to the London Discovery Technical leads. Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) or Gary McAlister (email [mailto:gary.mcallister@nhs.net gary.mcallister@nhs.net]) for access.

'''How do I access and use the DDS FHIR Get Structured Record API?'''

See the [[FHIR Get Structured Record API]] page for more details.

'''How do I access and use the DDS HL7v2 API?'''

See the [[HL7v2 API]] page for more details.

'''How do I access Jira to view current development projects?'''

See the [[Jira]] page for more details.

'''What are the Standard Operating Procedures for developing for DDS?'''

See [https://drive.google.com/file/d/1RDb1NGINnNLmT0gsLiUQK1VmWSih8go4/view?usp=sharing Discovery Software Development Standard Operating Procedures.doc] for details that include:

* Roles & responsibilities
* Development & coding standards
** Java
** HTML5 & CSS
** Javascript
* Development framework, tools & technologies
* Development environments
* Processes & controls
* Security & assurance

'''What is the Software Development Project Lifecycle & Assurance Report?'''

A typical development project lifecycle is illustrated within the steps contained in the [https://drive.google.com/file/d/1hYmfk2pyQlWslyaDQ-5XyTSnCdCgmn2M/view?usp=sharing Project Assurance template].

'''Where are the GitHub Repositories and how do I access them?'''

See the [[GitHub repositories|GitHub Repositories]] page for a list of all repositories. Applications should be made to the London Discovery Technical leads. Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) or Gary McAlister (email [mailto:gary.mcallister@nhs.net gary.mcallister@nhs.net]) for access.

The code within Discovery follows the GitFlow workflow for software development where master is the main branch, develop is created for developments and feature branches are created from development where appropriate. Once features have been developed and are ready for including in the development system the feature branches are merged back to develop and then main accordingly.

A summary of GitFlow can be found here: https://datasift.github.io/gitflow/IntroducingGitFlow.html

Guides to using GitHub can be found here: https://guides.github.com/

'''How is data access linked to sharing and processing agreements?'''

Use Data Sharing Manager to determine which data is processed and shared according to projects linked to sharing and processing agreements. See [[Data Sharing Manager]] for more details.

'''How is access to the data in the DDS controlled?'''

Data is made available to particular systems or people using attribute based access control. See [[Identity Authentication Authorisation]] for more details.

== Subscriber projects ==
'''Is there an overview of the outbound pipeline?'''

See [[Outbound Transformation Pipeline]] for more details.

== Primary care ==

== Testing and assurance ==

Working with Discovery

2021-04-26T16:27:42Z

NickCable: Assurance document link added

== Getting started ==
'''How do I access the DDS?'''

Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) for access.

'''How do I communicate with LHS?'''

Where LHS are asked to support an organisation, all communication is via [[Jira]]. This helps to ensure that issues and questions are tracked, lessons are learnt and activity can be reported.

'''How do I upload code to the Github repository?'''

Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) for access and ways of working. See [[GitHub repositories]] for a description of each repository.

'''What data sets are currently published to the DDS?'''

See [[Current data sets]] for the data sets that are currently published to the DDS by different supplier systems.

'''What data is currently published to the DDS?'''

See [[Current published data]] for the latest data publisher information by sector, geographical area, service, and system provider.

'''What is the status of the publisher feeds?'''

See [[Publisher feed status]] for the latest published data status of the three main system suppliers.

'''How do I access and add DDS wiki articles?'''

See [[Welcome to the Discovery Data Service knowledge base#Wiki tips|Wiki tips]] for more details.

__FORCETOC__
== Publishing data ==
'''What is the capacity of the DDS?'''

The Discovery Data Service has been designed from the ground up to work in the cloud with a modular architecture designed to scale. The current cloud provider has the capacity to go well beyond all patient records in the UK, the current system is operating at over 12.5 million distinct patient records. See [[Current published data]] for details on the data already published.

'''How are CDS extracts transformed?'''

See [[Barts Health CDS FHIR Mapping]].

'''How is data publication to the DDS secured?'''

See [[Secure publication to the DDS]].

'''How is data stored in the DDS?'''

See [[Data Storage Architecture|Data storage architecture]] for more details.

'''How is data encrypted in the DDS?'''

Data is transferred, via HSCN, into the DDS HSCN connected AWS instance by SFTP, HTTP, or MLLP. See [[Secure publication to the DDS]] for more details.

'''How is ADT data mapped in FHIR?'''

See [[Homerton ADT FHIR Mapping]] for more details.

'''Is there an overview of the inbound pipeline?'''

See [[Inbound Transformation Pipeline]] for more details.

'''How is data being published to the DDS monitored?'''

See [[Monitoring and alerting]] for more details.

== Development projects ==
'''How do I access a development version of the DDS?'''

Applications should be made to the London Discovery Technical leads. Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) or Gary McAlister (email [mailto:gary.mcallister@nhs.net gary.mcallister@nhs.net]) for access.

'''How do I access and use the DDS FHIR Get Structured Record API?'''

See the [[FHIR Get Structured Record API]] page for more details.

'''How do I access and use the DDS HL7v2 API?'''

See the [[HL7v2 API]] page for more details.

'''How do I access Jira to view current development projects?'''

See the [[Jira]] page for more details.

'''What are the Standard Operating Procedures for developing for DDS?'''

See [https://drive.google.com/file/d/1RDb1NGINnNLmT0gsLiUQK1VmWSih8go4/view?usp=sharing Discovery Software Development Standard Operating Procedures.doc] for details that include:

* Roles & responsibilities
* Development & coding standards
** Java
** HTML5 & CSS
** Javascript
* Development framework, tools & technologies
* Development environments
* Processes & controls
* Security & assurance

'''What is the Software Development Project Lifecycle & Assurance Report?'''

A typical development project lifecycle is illustrated within the steps contained in the [https://drive.google.com/file/d/1hYmfk2pyQlWslyaDQ-5XyTSnCdCgmn2M/view?usp=sharing Project Assurance template].

'''Where are the GitHub Repositories and how do I access them?'''

See the [[GitHub repositories|GitHub Repositories]] page for a list of all repositories. Applications should be made to the London Discovery Technical leads. Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) or Gary McAlister (email [mailto:gary.mcallister@nhs.net gary.mcallister@nhs.net]) for access.

The code within Discovery follows the GitFlow workflow for software development where master is the main branch, develop is created for developments and feature branches are created from development where appropriate. Once features have been developed and are ready for including in the development system the feature branches are merged back to develop and then main accordingly.

A summary of GitFlow can be found here: https://datasift.github.io/gitflow/IntroducingGitFlow.html

'''How is data access linked to sharing and processing agreements?'''

Use Data Sharing Manager to determine which data is processed and shared according to projects linked to sharing and processing agreements. See [[Data Sharing Manager]] for more details.

'''How is access to the data in the DDS controlled?'''

Data is made available to particular systems or people using attribute based access control. See [[Identity Authentication Authorisation]] for more details.

== Subscriber projects ==
'''Is there an overview of the outbound pipeline?'''

See [[Outbound Transformation Pipeline]] for more details.

== Primary care ==

== Testing and assurance ==

Working with Discovery

2021-04-26T16:19:19Z

NickCable: Project lifecycle update

== Getting started ==
'''How do I access the DDS?'''

Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) for access.

'''How do I communicate with LHS?'''

Where LHS are asked to support an organisation, all communication is via [[Jira]]. This helps to ensure that issues and questions are tracked, lessons are learnt and activity can be reported.

'''How do I upload code to the Github repository?'''

Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) for access and ways of working. See [[GitHub repositories]] for a description of each repository.

'''What data sets are currently published to the DDS?'''

See [[Current data sets]] for the data sets that are currently published to the DDS by different supplier systems.

'''What data is currently published to the DDS?'''

See [[Current published data]] for the latest data publisher information by sector, geographical area, service, and system provider.

'''What is the status of the publisher feeds?'''

See [[Publisher feed status]] for the latest published data status of the three main system suppliers.

'''How do I access and add DDS wiki articles?'''

See [[Welcome to the Discovery Data Service knowledge base#Wiki tips|Wiki tips]] for more details.

__FORCETOC__
== Publishing data ==
'''What is the capacity of the DDS?'''

The Discovery Data Service has been designed from the ground up to work in the cloud with a modular architecture designed to scale. The current cloud provider has the capacity to go well beyond all patient records in the UK, the current system is operating at over 12.5 million distinct patient records. See [[Current published data]] for details on the data already published.

'''How are CDS extracts transformed?'''

See [[Barts Health CDS FHIR Mapping]].

'''How is data publication to the DDS secured?'''

See [[Secure publication to the DDS]].

'''How is data stored in the DDS?'''

See [[Data Storage Architecture|Data storage architecture]] for more details.

'''How is data encrypted in the DDS?'''

Data is transferred, via HSCN, into the DDS HSCN connected AWS instance by SFTP, HTTP, or MLLP. See [[Secure publication to the DDS]] for more details.

'''How is ADT data mapped in FHIR?'''

See [[Homerton ADT FHIR Mapping]] for more details.

'''Is there an overview of the inbound pipeline?'''

See [[Inbound Transformation Pipeline]] for more details.

'''How is data being published to the DDS monitored?'''

See [[Monitoring and alerting]] for more details.

== Development projects ==
'''How do I access a development version of the DDS?'''

Applications should be made to the London Discovery Technical leads. Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) or Gary McAlister (email [mailto:gary.mcallister@nhs.net gary.mcallister@nhs.net]) for access.

'''How do I access and use the DDS FHIR Get Structured Record API?'''

See the [[FHIR Get Structured Record API]] page for more details.

'''How do I access and use the DDS HL7v2 API?'''

See the [[HL7v2 API]] page for more details.

'''How do I access Jira to view current development projects?'''

See the [[Jira]] page for more details.

'''What are the Standard Operating Procedures for developing for DDS?'''

See [https://drive.google.com/file/d/1RDb1NGINnNLmT0gsLiUQK1VmWSih8go4/view?usp=sharing Discovery Software Development Standard Operating Procedures.doc] for details that include:

* Roles & responsibilities
* Development & coding standards
** Java
** HTML5 & CSS
** Javascript
* Development framework, tools & technologies
* Development environments
* Processes & controls
* Security & assurance

'''What is the Software Development Project Lifecycle & Assurance Report?'''

A typical development project lifecycle is illustrated within the steps contained in the Project Assurance document

'''Where are the GitHub Repositories and how do I access them?'''

See the [[GitHub repositories|GitHub Repositories]] page for a list of all repositories. Applications should be made to the London Discovery Technical leads. Contact Stephen Janering (email [mailto:stephen.janering@nhs.net stephen.janering@nhs.net]) or Gary McAlister (email [mailto:gary.mcallister@nhs.net gary.mcallister@nhs.net]) for access.

The code within Discovery follows the GitFlow workflow for software development where master is the main branch, develop is created for developments and feature branches are created from development where appropriate. Once features have been developed and are ready for including in the development system the feature branches are merged back to develop and then main accordingly.

A summary of GitFlow can be found here: https://datasift.github.io/gitflow/IntroducingGitFlow.html

'''How is data access linked to sharing and processing agreements?'''

Use Data Sharing Manager to determine which data is processed and shared according to projects linked to sharing and processing agreements. See [[Data Sharing Manager]] for more details.

'''How is access to the data in the DDS controlled?'''

Data is made available to particular systems or people using attribute based access control. See [[Identity Authentication Authorisation]] for more details.

== Subscriber projects ==
'''Is there an overview of the outbound pipeline?'''

See [[Outbound Transformation Pipeline]] for more details.

== Primary care ==

== Testing and assurance ==

Working with Discovery

2021-04-23T09:42:55Z

NickCable: HL7v2 API link added

Working with Discovery

2021-04-22T15:09:24Z

NickCable: API details updated

Working with Discovery

2021-04-22T14:35:02Z

NickCable: Updated FHIR Get Structured Record API details

Working with Discovery

2021-04-22T14:33:04Z

NickCable: Addition of GitFlow link

Working with Discovery

2021-04-22T14:13:18Z

NickCable:

Working with Discovery

2021-04-22T12:59:21Z

NickCable: Addition of GitHub information

Working with Discovery

2021-04-22T12:44:31Z

NickCable: Minor change to development section

Working with Discovery

2021-04-22T12:38:36Z

NickCable: Minor updates to Development projects section