Tag Archives: Impact Toolkit

Value and Impact Task and Finish Group Update

As the Value and Impact Tasks and Finish Group prepares to launch the refreshed Impact Toolkit we reflect on our progress during the last year.

At our first meeting in May 2015 the group adopted the definition of Impact ISO 16439:2014 Information and documentation — Methods and procedures for assessing the impact of libraries as:

Difference or change in an individual or group resulting from the contact with library services

A scoping literature search was undertaken, together with an analysis of fully compliant LQAF submissions for Criterion 1.3C to further inform our work.

An enthusiastic reference group was established with members recruited based on known interest and through local email groups and LIS medical. The Task and Finish group would like to take this opportunity to acknowledge the vital contributions made to this project and thank members for their commitment to the work.

Consultation of the wider NHS LKS workforce was undertaken through a SurveyMonkey questionnaire tool which was developed with the assistance of the reference group. This gave an insight into how LKS staff currently made use of the existing toolkit, what the results were used for, and invited suggestions for improvement.

Members of the task and finish group spent a tiring but productive day in London meticulously mapping and collating evidence from the survey with literature from the evidence base to produce a new basic set of core questions to form a toolkit. The resulting questions are few in number but have been deliberately chosen as being applicable to a range of services provided by LKS. They have also been chosen with the intention of avoiding bias towards any acute sector settings.

These core questions have been piloted on library service users within NHS LKS throughout England and minor amendments made to the language used in order to aid understanding. The recommendation is that all NHS LKS will use these core questions as a basis in their own Impact surveys so that national collation of results can be undertaken in the future. Alongside the core questions, the toolkit also offers a question bank of optional additional questions which LKS may choose to add to their survey to tailor it to their local needs.

Additional resources provided through the refreshed toolkit include a refreshed interview and case study template and guidance. There is also an Impact Mapping Tool which has been designed by an experienced researcher to assist NHS LKS staff to identify the right tools for their needs when they approach the process of obtaining feedback around the value and impact of their services.

As we move into the next year of Knowledge for Healthcare, the Task and Finish Group will help to publicise the refreshed toolkit via the NHS LKS networks. We hope to have a presence at the HLG conference and there are publications planned for the summer period onwards.

At the point of writing the refreshed toolkit has not yet been launched, although we anticipate that it will be made available in the very near future. Monitor the e-mail lists for announcements and further information.

Membership of the Value and Impact Task and Finish Group

  • Jenny Turner – East Sussex Healthcare NHS Trust (Chair)
  • Stephen Ayre – George Eliot Hospital NHS Trust
  • Alison Brettle – Acting Director Post Graduate Research, University of Salford
  • Douglas Knock – King’s College Hospital NHS Foundation Trust
  • Rebecca Mitchelmore – Isle of Wight NHS Trust
  • Susan Smith – Mid Cheshire Hospitals NHS Foundation Trust
  • Sophie Pattison – Royal Free London NHS Foundation Trust/University College London
  • Dominic Gilroy – Health Education England working across Yorkshire and the Humber

Value and Impact Task and Finish Group Update

Since our last blog in September, the group has done some further analysis of results of the survey of current use of the Impact Toolkit by the NHS library and knowledge workforce.  This is necessary preparation for the approaching task of refreshing the toolkit.

Question 9 of the survey asked staff to “suggest useful changes or additions to the Impact Toolkit”. The responses to this question are of particular value in identifying what NHS library staff are expecting from the revised toolkit.  Some of the recurrent themes are captured in the word cloud below (Click on the word cloud to see it more clearly!):

vit

The group are scheduled to meet on 23rd November to tackle some more practical work around creating and including further resources in the Impact Toolkit.  The target date for completion of the toolkit refresh is the end of March 2016.

Membership of the Value and Impact Task and Finish Group

Jenny Turner – East Sussex Healthcare NHS Trust (Chair)

Stephen Ayre – George Eliot Hospital NHS Trust

Douglas Knock – King’s College Hospital NHS Foundation Trust

Rebecca Mitchelmore – Isle of Wight NHS Trust

Susan Smith – Mid Cheshire Hospitals NHS Foundation Trust

Sophie Pattison – University College London

Dominic Gilroy – Leeds and York Partnership NHS Foundation Trust

Hello from the Value and Impact Task and Finish Group

Value and Impact is one of two task and finish groups operating within the Quality and Impact work stream of the Knowledge for Healthcare programme.  The group has the remit of refreshing the online Impact Toolkit with the aim of broadening its relevance to library services working outside the acute sector, and to increase the range of tools available to enable the assessment of impacts upon areas such as management and commissioning.

The group first met in May 2015 and decided early in its development that an agreed definition of impact would be valuable in establishing a common baseline.  The adopted definition was taken from ISO 16439:2014 Information and documentation — Methods and procedures for assessing the impact of libraries:

Difference or change in an individual or group resulting from the contact with library services

As preparatory work a scoping literature search was undertaken together with an analysis of fully compliant LQAF submissions for Criterion 1.3C.  These were supplied by LKSL Leads with permission of local managers (3 regions returned, 24 fully compliant submissions).

Consultation with the NHS Library workforce was essential before work on refreshing the toolkit could begin.  A committed and enthusiastic reference group assisted with the creation and testing of a SurveyMonkey-based questionnaire looking at how (if at all) library staff made use of the Impact Toolkit, whether they used any alternatives, what they did with the results, and invited suggestions for improvement of the toolkit resource.

The survey was open during August 2015 and received responses from 136 services (63% based on figures reported in Knowledge for Healthcare) with representation from all the LETBs.

An initial analysis of the responses to the survey shows that although over 95% of respondents already collect impact data, reported usage of the toolkit itself is quite low.  Looking at what impact information is used for, the evaluation and modification of services came out top with 89% while publicity and marketing (79%) and justification for business cases/funding bids (60%) were also popular responses.

Over the next few weeks we will be analysing the written responses to the survey and will report on these in the next blog.  We will then move on to work on refreshing the toolkit based on results and suggestions from the survey and other evidence.  The target date for completion of the toolkit refresh is the end of March 2016.

Membership of the Value and Impact Task and Finish Group

  • Jenny Turner – East Sussex Healthcare NHS Trust (Chair)
  • Stephen Ayre – George Eliot Hospital NHS Trust
  • Douglas Knock – King’s College Hospital NHS Foundation Trust
  • Rebecca Mitchelmore – Isle of Wight NHS Trust
  • Susan Smith – Mid Cheshire Hospitals NHS Foundation Trust
  • Sophie Pattison – University College London
  • Dominic Gilroy – Leeds and York Partnership NHS Foundation Trust