Tag Archives: Evaluation

Evaluating Health Information Week 2019

It’s a while ago now, but #Health Information Week 2019 (#HIW2019) was a great opportunity to promote the value of high quality health information. We’ve collated all the feedback received from our smart survey and individual evaluations into this report.

Some highlights of the report:

  • A wide range of organisations participated, including charities and NHS and public libraries. About 20% of survey respondents (10 teams) had not previously been involved in #HIW, showing the event is growing in reach and popularity.
  • There were over 1,700 recorded interactions at events and displays, and over 1,600 leaflets given away over the week. These enabled patients, members of the public, and NHS staff to learn more about finding high quality information to support their health and wellbeing.
  • There was a wide range of events, including a mindfulness walk, a human library, healthy eating children’s storytime, and a book group looking at graphic novels and health.
  • Many people used #HIW2019 to develop partnership working with organisations in other sectors.
  • The amount of time spent on #HIW2019 varied widely, showing people are able to put as much or as little into the week as they choose.
  • There was high demand for national marketing templates to be available much earlier next year – for #HIW2020 we plan to have them ready in April. As a result of your feedback, these will be professionally produced.

Health Information Week 2020 (#HIW2020) will take place from 6th-12th July 2020. It seems a long way away now, but several teams said they would like to start planning earlier for 2020. The #HIW2019 evaluation report also gives plenty of examples of what worked well and what could be done better next year for local events. You may also like to take a look at the #HIW2019 Ideas Bank to get some ideas and inspiration!

Can you find out the longer-term impact of the “Making LKS Business Critical” Workshops?

This was the challenge set for the Knowledge for Healthare Continuing Professional Development (CPD) Group. Anne Gray delivered Making LKS Business Critical workshops between January 2017 and Spring 2018 and 148 people attended. This was a perfect opportunity to test the Impact Evaluation Form developed by the group in 2017.

The Evaluation Form was adapted into an online survey and sent to all particpants. 29% responded and here are some of the key findings:

Word cloud of summarised general feedback
  • 87% of respondents said that the information, knowledge or skills gained have led, or might lead, to improving service delivery to customers.  Over 60% respondents said that personal or professional development and sharing information with, or advising , other staff or colleagues were gained.
  • 68% respondents said they gained new knowledge and 58% considered that the information, knowledge or skills gained had generated new ideas.
  • 53% respondents stated that the training had impacted by contributing to service development and delivery and 5% indicated that the training had an impact by saving money or contributed to financial effectiveness
  • Of those that had not used the skills or knowledge from the session 26% said they will probably use it in the future.  16% cited lack of time/capacity, 11% stated that the session did not meet their expectations.
  • Replies to the question What have you done differently as a result of attending this event? were grouped into the following themes:  Approach to searches, outlook about handling this type of enquiry, approach to presenting search information, use of specific resources, skill development and confidence in approaching senior management. 

            “I am more confident in offering and providing this service to the members of  the Trust’s board”

  • When asked about the impact upon service or service users, responses included greater consideration of business objectives, improved quality of service and saving users’ time.  A couple of responses were very specific:

     “In the recent organisational change, I managed to get recognition of the chartered librarian as a job profile and ensure me a role with my teams for the next 3 years.”

     “I was able to do an evidence search for a manager in the Trust shortly after attending the course. I was able to expand the search beyond the usual HDAS which led me to find more pertinent results. I regularly use the additional sources in searches now”

  • Respondents were asked to describe any ideas or work undertaken to consider the specific objective of the course – to generate ideas or work for collaborative resources to support LKS knowledge services to NHS Managers/Commissioners.  10 respondents said they had undertaken work or had ideas and these ranged from working collaboratively with other services to provide a business critical information service to more shared evidence bulletins.

Seeking the longer term impact of training is not always straight-forward – the reponse rate is often low as people have moved roles or are facing a change in cirucmstances since attending the workshop and at least one respondent had difficulty completing the longer term impact evaluation as they felt too much time had lapsed between taking the workshop and completing the evaluation. However, the responses that we did receive showed that some respondents welcomed the opportunity to re-visit the workshop materials and that significant developments had resulted from using the newly acquired skills and knowledge. Click below to download the full evaluation responses:

The CPD Group would like to express thanks to Anne for using her workshops as a”guinea pig” for the impact evaluation and to all of those who took the time to complete the survey.

Don’t forget that the full Development Needs Analysis consultation will begin in the Autumn this year. This will be your opportunity to say what skills and knowledge devevelopment you need for your role now and in the future. Start planning now by taking a look at the Health Professional Knowledge and Skills Base (PKSB) to help you spot any gaps.

On behalf of the CPD Group

Evaluation Framework – measuring our success

The Evaluation Framework

How do we know that we are progressing towards achieving the delivery of the vision for Knowledge for Healthcare?

The aim for the Quality and Impact work-stream in delivering the vision is to enhance the quality and demonstrate value of library and knowledge services. Working with Sharon Markless, strategic development of an overarching Evaluation Framework for healthcare library and knowledge services has been produced.

The framework will enable the evaluation of library and knowledge service delivery providing data to demonstrate impact, assure quality of services, and enable service improvement.  The framework is based around six objectives defining the contribution Library and knowledge services can make to the achievement of Knowledge for Healthcare.  These have been chosen areas which are in the direct sphere of influence and action by library and knowledge services.

The Six Impact Objectives:

  • Organisations are more effective in mobilising evidence and internally generated knowledge
  • Patients, carers and the public are empowered to use information to make health and well-being choices
  • Improved consistency and increased productivity and efficiency of healthcare library and knowledge services
  • Enhanced quality of healthcare library and knowledge services
  • Partnership working is the norm in delivering knowledge to healthcare
  • Increased capability, confidence and capacity of library and knowledge services workforce

The framework will provide a clear purpose for the collection of evidence, activity and statistical collections.  The implementation of the framework will begin from July 2017 and there will be an opportunity for involvement in development and piloting of the supporting evaluation processes.

The framework and supporting documents have been published on the new blog section Evaluation Framework. There are also some Frequently Asked Questions 


Clare Edwards

clare.edwards@hee.nhs.uk 

Education Development Programme Lead, Health Education England

Chair Quality and Impact Working Group