Use your keyboard arrow keys to navigate

Contents

Photo: Canva

Project Highlights

Photo: Unsplash

Project Overview

Culture Counts, in conjunction with Public Libraries Australia (PLA) and more than 30 participating libraries across Australia, has completed the fifth year of a nation-wide data collection initiative to better understand and illustrate the vital outcomes generated by libraries. This document provides a snapshot of the Public Library Evaluation Network (PLEN) results from 2023-24, along with year-on-year comparisons beginning from the first year of the project.

Aim

Libraries are an extremely important asset to local communities, but membership numbers and lending statistics only address a small part of the value of a library to its community. Measuring the role of libraries and the value that communities place on them gives libraries the ability to engage more deeply with the public, impact the community more strongly, and provide an evidence-based argument for greater funding. The use of standardised measures means that libraries can learn from direct comparisons with their peers, or from wider sector trends and insights. The project gives libraries the opportunity to test outcome metrics and evaluation methods and provide feedback to ensure appropriateness from an Australian library perspective.

Network Methodology

Participating libraries subscribe to the Culture Counts survey platform; accessing standardised survey templates, unlimited evaluations, in-built metrics, client support and training. Each library surveys public library users at least once annually on outcome measures and usage, and provides the project with annual data related to library expenditure, collections, loans and visitation. All results collected through the project contribute to a large body of evidence about the value of the sector as a whole, with participants able to access a dynamic, filterable big data dashboard. Participants also receive an advocacy report that celebrates their own annual results. Quarterly webinars enable participants to connect, interrogate the big data dashboard, and discuss implications and learnings.

Evaluation Methodology

Libraries involved in the network collect feedback on library use, performance, personal and community outcomes from public users of the library. This feedback is collected through a short standardised online survey (~4 minutes) that the library can email to its member database, link to on internal computers, deliver to library users via an iPad or tablet device, or encourage users to complete on their own smartphones.

Library staff (self-assessors) and external peer assessors (such as council members or library staff from another library) are also able to reflect on the library service using the same standard outcome measures. This can help the library to identify where its views and expectations are aligned or different to those of the community.

A representative of the library also completes an additional survey for the annual period containing library lending, staff and expenditure statistics.

Photo: Canva

Library Outcomes

A key part of the project involves asking community members around Australia if they agree or disagree with a statement relating to their experience of the library service, across 11 key outcome areas. Outcomes assessment provides evidence of the impact that library services have on people’s lives and the value that this adds to personal, community and economic wellbeing. The outcome areas align with the Outcome Measures for Australian Public Libraries research (ALIA, APLA, NSLA), ILFA generic learning and social outcomes, Project Outcome, and other community indicator research in Australia and overseas.

The use of standardised measures means that libraries can learn from direct comparisons with their peers, or from wider sector trends and insights. The results help the library to learn where they are generating the greatest impact, where they can improve, and whether certain outcome areas are more relevant or impactful to specific demographics or community groups.

The first chart below shows the percentage of respondents across the whole Public Libraries Evaluation Network who agreed with the associated statement regarding their library experience in 2023-24. The second chart includes the percentage of respondents who strongly disagree, disagree, or are neutral about the outcome statement. The third chart shows the percentage of respondents who agreed with the statement in each year of the project, identifying where the network libraries have seen improvement and how library outcomes have changed over time.

Loading...
Loading...

Year on year

Loading...

Insights

The research shows that communities overwhelmingly agree that libraries play an important role and are felt to be safe and welcoming places. Libraries are also succeeding strongly in their more traditional literacy and learning roles, encouraging users to read more and enjoy learning. Over two thirds of respondents also agreed that their library is changing and becoming more relevant to them and their needs, indicating that greater outcomes may follow in newer library focus areas, such as digital connection and enterprise.

Year-on-year comparisons indicate that libraries participating in the network have increased their impact from 2022-23 across six library dimensions and recorded the same levels of agreement for two dimensions. Three dimensions have seen lower levels of agreement in 2023-24 following a spike in 2022-23, and only two dimensions have decreased slightly overall since the project started in 2019-20.

A small selection of insights derived from filtering the dynamic dashboard by age, identity, status and location include:

  • Respondents of Aboriginal or Torres Strait Islander ancestry recorded higher than average scores for all outcome areas except for Role, Safe and Trusted and Literacy

  • Respondents who speak a language other than English recorded higher than average outcomes for all dimensions

  • Respondents across all age cohorts highly agree that they feel safe and welcome when using the library service and that the library is an important part of the place where they live

  • Respondents aged over 80 are most likely to find that the library meets their informational and reading needs. They also agree that the library encourages them to read more, plays an important role and is a safe and trusted space, but have lower outcomes across other areas

  • There were no significant differences in outcomes experienced by male and female respondents, however, respondents identifying as an alternative gender recorded below average scores for five of the recorded dimensions

  • Non-members scored above average in all but three dimensions, being less likely to agree with Role, Safe and Trusted and Literacy than members. The dimensions they were most likely to agree with were Enterprise, Connection and Time with Children, indicating they were most likely to value the library for increasing their connection with the community, spending quality time with their children and helping to improve the success of their business.

  • Respondents who had used the library within the last week scored slightly higher than average results for most dimensions, particularly Connection

Photo: Canva

ALIA/APLA Outcomes Alignment

To ensure that all data collected can be clearly reported against the achievement of important sector objectives, Culture Counts aligned outcome metrics used in the project with Australian Library and Information Association (ALIA) and Australian Public Library Alliance (APLA) outcome areas, and the UK Inspiring Learning for All (ILFA) social and learning outcomes. This enables the library sector to build on significant research already carried out by peak bodies in Australia and internationally.

This page contains a matrix aligning project outcome metrics with ALIA and APLA outcome areas (as described in their published Guidelines, Standards and Outcome Measures for Australian Public Libraries, July 2016).

Underneath the matrix, the dials illustrate the percentage level of agreement recorded by respondents across the project network for each of the six ALIA/APLA key outcome areas. This is followed by year-on-year comparisons for the five years of the project.

Alignment with ALIA/APLA Outcomes
ALIA/APLA OutcomesDimension NameLibrary Outcome Measure
Community EngagementConnectionThe library has encouraged me to become more engaged in the community
RoleThe library is an important part of the place where I live
RelevanceThe library is changing in ways that increase its relevance for me
Digital InclusionDigital ConnectionThe library helps me to be more digitally connected to others
Economic and Workforce DevelopmentEnterpriseThe library has helped me to improve the success of my business
Literacy and Lifelong LearningTime with ChildrenThe library has helped me to spend more quality time with my children
SkillsThe library has helped me to learn and gain new skills
LiteracyThe library has encouraged me to read more
Personal Development and WellbeingLearningThe library has helped me to enjoy learning
Stronger and Creative CommunitiesSafe and TrustedThe library makes me feel safe and welcome
CreativityThe library has helped me be more creative in my own life and work
Loading...

Year on year

Loading...

Insights

Strong levels of agreement - greater than 75% of respondents across the network - were recorded for three of the six ALIA/APLA outcome areas, with libraries felt to contribute most to the development of Stronger and Creative Communities (82%) and Personal Development and Wellbeing (76%) and Community Engagement (76%).

Year-on-year data shows that two out of the six outcome areas increased in 2023-24 compared with the previous year, whilst Stronger and Creative Communities and Personal Development and Wellbeing remained the same. Literacy and Lifelong Learning saw a minor decrease of 1% from 2022-23, while Economic and Workforce Development fell 6% from from a jump in 2022-23. Digital Inclusion saw the most significant positive change, increasing to 50% agreement from 42% in 2022-23.

Results recorded by libraries across all ALIA/APLA outcome areas were higher in 2023-24 than when the project began. Economic & Workforce Development saw the greatest variation in results across the year-on-year data.

Photo: Canva

ILFA Learning Outcomes

This page contains a matrix aligning project outcome metrics with ILFA Learning outcome areas.

Underneath the matrix, the dials illustrate the percentage levels of agreement recorded by respondents across the project network for each of the five ILFA Learning outcome areas. This is followed by year-on-year comparisons for the five years of the project.

Alignment with ILFA Learning Outcomes
ILFA Learning OutcomesDimension NameLibrary Outcome Measure
Activity, Behaviour and ProgressionConnectionThe library has encouraged me to become more engaged in the community
Digital ConnectionThe library helps me to be more digitally connected to others
Time with ChildrenThe library has helped me to spend more quality time with my children
Attitudes and ValuesRoleThe library is an important part of the place where I live
RelevanceThe library is changing in ways that increase its relevance for me
Enjoyment, Inspiration and CreativitySafe and TrustedThe library makes me feel safe and welcome
CreativityThe library has helped me be more creative in my own life and work
Knowledge and UnderstandingLearningThe library has helped me to enjoy learning
LiteracyThe library has encouraged me to read more
SkillsEnterpriseThe library has helped me to improve the success of my business
SkillsThe library has helped me to learn and gain new skills
Loading...

Year on year

Loading...

Insights

Strong levels of agreement - greater than 80% of respondents across the network - were recorded for three of the ILFA Learning outcome areas, with libraries felt to contribute significantly to Enjoyment, Inspiration and Creativity (82%); Attitudes and Values (83%); and Knowledge and Understanding (80%).

Year-on-year data shows that results for Attitudes and Values have improved from 2022-23. Results for Enjoyment, Inspiration & Creativity; Knowledge & Understanding; and Activity, Behaviour & Progress have remained the same in 2023-24 as the previous year. Skills dropped slightly when compared with the 2022-23 outcomes. Attitudes and Values recorded the highest levels of agreement every year, except for 2022-23 where it fell one percentage point below Enjoyment, Inspiration and Creativity.

Photo: Canva

ILFA Social Outcomes

This page contains a matrix aligning project outcome metrics with ILFA Social outcome areas.

Underneath the matrix, the dials illustrate the percentage level of agreement recorded by respondents across the project network for each of the three ILFA Social outcome areas. This is followed by year-on-year comparisons for the five years of the project.

Alignment with ILFA Social Outcomes
ILFA Social OutcomesDimension NameLibrary Outcome Measure
Stronger and Safer CommunitiesConnectionThe library has encouraged me to become more engaged in the community
Safe and TrustedThe library makes me feel safe and welcome
Digital ConnectionThe library helps me to be more digitally connected to others
Time with ChildrenThe library has helped me to spend more quality time with my children
Health and WellbeingEnterpriseThe library has helped me to improve the success of my business
LearningThe library has helped me to enjoy learning
SkillsThe library has helped me to learn and gain new skills
LiteracyThe library has encouraged me to read more
CreativityThe library has helped me be more creative in my own life and work
Strengthening Public LifeRoleThe library is an important part of the place where I live
RelevanceThe library is changing in ways that increase its relevance for me
Loading...

Year on year

Loading...

Insights

Strong levels of agreement - greater than 80% of respondents across the network - were recorded for the ILFA Social outcome area related to Strengthening Public Life (83%).

Year-on-year data shows that results recorded by libraries in the network increased since 2022-23 in Strengthening Public Life, remained the same for Health and Wellbeing but decreased by just 1% for Stronger and Safer Communities. Despite recording the highest scores, Strengthening Public Life fell slightly short of its peak in the 2020-21 results. Both Health and Wellbeing and Stronger, and Safer Communities have increased overall since the project started in 2019-20.

Photo: Canva

Library Awareness

Respondents were asked whether they were aware of various library resources and services, and whether the library helps them to learn, apply learnings and gain confidence across these service areas. These four stages are expected to be sequential, with library users initially gaining awareness, followed by learning something new, application of learnings and increased confidence.

Awareness: The library has helped me be more aware of applicable resources and services it provides in the following areas

Learning: The library has helped me learn something new in the following areas

Application: I intend to apply what I’ve learnt at the library in the following areas

Confidence: The library has helped me feel more confident

The chart below shows the proportion of respondents who indicated that the library helped their awareness, learning and application across seven resource areas, and gives insight into their progression through each stage. This is followed by a set of charts showing the year-on-year comparisons for awareness, learning and application. Confidence is reported separately, as the areas of interest are worded differently.

Awareness, Learning, and Application

Loading...
The question statements for each category were as follows: Awareness: The library has helped me be more aware of applicable resources and services it provides in the following areas; Learning: The library helped me learn something new in the following areas; and Application: I intend to apply what I've learnt at the library in the following areas.
Loading...
Loading...
Loading...

Confidence

Loading...
Loading...

Insights

As illustrated by the dimension results, libraries appear to be succeeding in raising awareness and facilitating learning in the traditional areas of reading and education, while also playing an important role as a safe civic space for their communities to connect. Increasing awareness of the changing role of libraries in developing business opportunities and job skills may lead to improvements in learning, application and confidence in these areas.

Year-on-year data shows that awareness, learning and application have increased over 2023-24 for early childhood literacy. The other outcome areas showed varied results. Reading and literacy awareness and learning increased but its application decreased slightly. While awareness was lower for civic/community engagement, job skills and economic/business development, learning results were the same as for 2022-23 and application results were either the same or higher.

Confidence surrounding community involvement, digital resources and education saw a sharp increase in 2022-23. In 2023-24, confidence levels in each of these areas dropped slightly while still remaining above 2021-22 results. Confidence levels for reading also dropped slightly, with just under half of the sample indicating the library helped them feel more confident in this area. Confidence around helping children to learn increased for the first time since 2020-21.

A small selection of insights derived from filtering the dynamic dashboard by age and gender include:

  • Respondents aged under 20 recorded much higher awareness, learning and application associated with reading/literacy and education; and higher confidence with reading, education and the learning process as a result of their library experience

  • Respondents aged 20-29 demonstrated much higher awareness in job skills and economic/business development and greater confidence about the job search process and starting a new business

  • Respondents aged 30-39 and 40-49 demonstrated much higher awareness, learning and application associated with early childhood literacy; and greater confidence with helping children learn

  • Respondents aged 50-59 had higher than average awareness, learning and application in education and lifelong learning and community engagement. This cohort also showed higher than average confidence with their education and the process of learning, and community involvement

  • Respondents aged 70-79 had greater than average awareness of digital learning services, and lower than average awareness of childhood literacy, job skills and economic/business development

  • Respondents aged over 80 years reported a higher than average confidence when using digital resources

  • Respondents who identified as female demonstrated higher awareness, learning and application associated with reading and literacy, and civic/community engagement and a greater confidence in helping their children learn than other genders

Photo: Canva

Library Use

Respondents were asked their frequency of library use and whether they engaged with library facilities, services and events. This helps libraries to understand usage by demographics and identify links between use and outcomes.

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...

Insights

The data shows that survey respondents are most likely to be engaged users of the library, with just under half having accessed the library service within the last week. This figure has decreased slightly over the five years of the project, with the percentage of respondents who haven't used the library in longer than six months slightly increasing.

83% used the facilities or services at the library (up 3% from 2022-23), while 46% used library services online from home (down from 53% in 2022-23). Just over one-quarter (26%) attended an event or program at the library, a slight drop from 2022-23.

In 2023-24, 6% of respondents were not library members. This was slightly up from 3% in 2022-23, and of significant difference from 2020-21 when 20% of respondents were not library members. This is believed to reflect the increased use of online programs, services and activities provided by libraries during the Covid lockdowns, which encouraged the use of the library by people who were not traditional users.

A small selection of insights derived from filtering the dynamic dashboard by age, gender and identity include:

  • Respondents aged 20-29 years are more likely to access library services online from home, and less likely to attend an event or program at the library

  • Respondents aged 30-39 years are much more likely than average to attend an event or program, and more likely to identify as female

  • Respondents aged 60-69 were less likely than average to attend an event or program. Over half of this sample indicated they had visited their library within the last week

  • Respondents who identified as born overseas were more likely to use the facilities or services at the library, but less likely to attend an event

  • Respondents of Aboriginal or Torres Strait Islander ancestry are less likely to access library services online from home

Photo: Canva

Demographics

Demographic information is collected to enable participating libraries and the network as a whole to understand the communities that they service, the impact of services for different groups, and gaps and opportunities for broader and deeper engagement. The 8,100 survey respondents across the network in 2023-24 represent a mix of ages, genders and identities, ensuring that the opinions of a broad range of community members are reflected.

Loading...
Loading...
Loading...
Loading...
Loading...
Loading...

Insights

The data shows that survey respondents are most likely to be female (75%, up from 74% in 2022-23), and in the 60-79 age group (48% in 2023-24, increasing from 42% in 2022-23). The largest percentage of respondents identified as being born overseas (14% in 2023-24, up from 9% in 2022-23). The percentage of Aboriginal or Torres Strait Islander respondents remained the same from 2022-23, but saw an overall decrease from 2020-21. Those identifying as LGBTIQA+ decreased from 8% in 2022-23 to 5% in 2023-24, which was same as 2021-22. The percentage of respondents living with disability decreased slightly to 7% in 2023-24.

Photo: Canva

Outcomes by Demographics

The charts below apply the age and gender filters to the dimension results to identify where there are differences in outcomes experienced by respondents based on their age or gender.

Loading...
Loading...

Insights

The data shows that the differences in dimension results by age group are not significant for seven of the 11 dimensions, with larger differences occurring for Skills (outcomes falling as age increases), Time with Children (lower outcomes for respondents over 60 years), and Enterprise (lower outcomes for respondents over 60 years). The most consistent dimension among age groups is Safe and Trusted, with average scores ranging from 87-89%.

The data shows that there were not significant differences in the outcomes experienced by male and female respondents, with females recording marginally higher outcomes for nine of the 11 dimensions and equal outcomes for one dimension (Enterprise). The one significant difference was for the Time with Children outcome, in which females recorded average scores 9% higher than male respondents. Respondents who identified as an alternative gender recorded slightly higher averages for seven dimensions, when compared to males. This cohort also recorded the highest average for Creativity.

Photo: Canva

Open Text Analysis

Qualitative feedback was provided in the form of responses to two open-ended questions contained in the Library Use and Outcomes Survey:

  • "What do you like most about your library?", and

  • "What could the library do to improve?"

While open text questions provide a wealth of information for libraries, it can be time-consuming to review all responses, interpret the general themes and issues, and then use them to make meaningful change that appeals to a significant proportion of respondents.

In order to assist libraries in quickly understanding the key topics of interest for respondents, Culture Counts carried out a thematic analysis of the open text responses (more than 10,000 responses collected for each question across the network) to identify recurring themes in the text responses.

The charts below show the percentage of responses that align with each of a selection of key topics identified through the analysis. Note that each response can mention multiple themes, while others may not mention any of the key themes identified. This means that the proportions will not necessarily sum to 100%.

Loading...
Loading...
Photo: Unsplash - Karsten Winegeart

Talk to us


We would love to partner with you on your evaluation journey. Please complete the enquiry form and we will be in touch! Or download our free Library Evaluation Guide to help you get started.

Data and Insights by

This report has been prepared by Culture Counts.

We respectfully acknowledge the Traditional Owners of Country throughout Australia and recognise the continuing connection to lands, waters and communities. We pay our respect to Aboriginal and Torres Strait Islander cultures, and to Elders past and present.