Tag Archives: assessment

Campus Perspectives: Key Takeaways from the UT Libraries 2024 Survey

In fall of 2024, UT Libraries assessment team administered a campus wide survey to understand the perceptions, experiences, and needs of users across the campus.

A random sample of undergraduates, graduates, faculty and staff were invited to participate in the survey, which was designed on Qualtrics and sent via email.

The results were drawn from 1878 respondents who completed at least half of the survey. The breakdown of respondents included 43% undergraduate students, 18% graduate students, 14% faculty, and 24% staff.

The data from the survey were analyzed using SPSS for the quantitative part and NVivo for the qualitative part (open ended questions). The final results are available to the public through an interactive Tableau dashboard.

Here is an infographic capturing some of the 2024 UTL campus survey highlights.

An Infographic showing 2024 UT Libraries Campus Survey Highlights

We are delighted to report that the overall satisfaction with the libraries has remained consistently high since the last campus survey administered in 2022. The majority of all respondents felt that UT libraries is a welcoming place (88%) and that the staff is friendly and approachable (83%).

The results indicated that quiet (whispers) was the most preferred noise level. UT libraries offers access to multiple quiet study or work spaces across various branches around the campus.

Battle Hall Reading Room

This year, we also asked our participants about the new and evolving spaces within the Perry-Castañeda Library (PCL). 42% of respondents who had been to PCL, visited the new Scholars Lab (the digital scholarship center at entryway) since it opened in fall 2023.

The new space is timely, given that survey results showed a growth in the perceived importance of scholarly communication, research data, digital scholarship, GIS, and geospatial data since the 2022 survey administration.

Data Lab in the Scholars Lab

We also asked the participants about their primary reasons for visiting the libraries. The top reason for students to visit the libraries was to access a quiet study/work space. Undergraduate students rated access to study/work space as very important.

The Hall of Noble Words Reading Room

In contrast, faculty and staff, most often visited the libraries to borrow physical material from the libraries’ comprehensive physical collection. Additionally, online library resources were rated as very important for graduate students, faculty and staff.

Respondents were asked to share a time that UT Libraries staff, services, resources or spaces had a positive impact on them.

Here are some impact stories, in their own words:

“It would not be an understatement to say my research has depended almost entirely on the library’s incredible resources and accessibility!” – Graduate student from the College of Liberal Arts.

“I’m able to request research articles from 50 years ago and get a scan sent to me in a week!” – Graduate student from the Cockrell School of Engineering.

“The UT library has offered private rooms for studying which has helped my academic success.” – Undergraduate student from the College of Natural Sciences.

“I’ve pinged subject experts last minute for help and they were very responsive to my needs.” – Staff member form the College of Liberal Arts.

These stories serve as vivid reminders of how central the libraries are to success at UT. We are excited to see the impact of UT Libraries on patrons’ academic and professional growth.

While the feedback was largely positive, the survey also highlighted some areas for improvement. Results indicated that some participants find physical library spaces challenging to navigate. In response, we are actively working on a signage improvement project aimed at improving wayfinding and making it easier for users to find their way through our spaces.

We thank all of the library users that participated in the survey. We value the feedback and appreciate the continued engagement as we work to improve the library experience for everyone.

Climate Watch

Library work involves simultaneously preserving the past, meeting needs in the present and trying to predict the future. Since there is no crystal ball, libraries rely on tools like surveys to help us monitor needs and make predictions. As previously noted, the Libraries conducted a campus-wide survey of students, faculty and staff in spring 2022. The results have now been analyzed, and largely reaffirm that we are serving campus needs while pointing us toward areas where we can do even better.

Link to full-size PDF.

Following trends from the past decade, faculty and staff rated access to online materials as their top library priority and undergraduates ranked library spaces as most important. Grad students have continued to prioritize online materials throughout the past decade, while library space has emerged as a secondary priority over the past 5 years. Throughout the past 10+ years, students and faculty have continued to display a shift in preferences toward digital materials. This shift, however, is not complete. While ranking online materials as being more important than physical materials, 48.5% of respondents still reported that they prefer print materials to electronic resources. This is despite the fact that 96% of faculty reported that online materials are “very important,” compared to only 50% who rated physical materials as “very important.” These somewhat contradictory results, combined with usage statistics, paint a complex picture in which users value physical materials, but are more and more likely to use digital materials to fulfill their information needs.

I use UT Libraries all the time to access materials for my work, it is invaluable. I could not do my work without UT Libraries, including the on-campus collections and materials available through Interlibrary loan. -College of Liberal Arts Graduate Student

Happily, since collections are of high importance to every user group, results show that users are largely satisfied with our library collections. In fact, about a quarter of the responses to an open-ended “What are we doing well?” question focused on collections and resources, the highest percentage of any topic areas mentioned. 87% of respondents agreed that “UT Libraries gives me access to the resources I need to achieve my academic goals.” A student from the College of Natural Sciences stated, “As a graduate student I am constantly searching for articles on my research topic. With so few journals being open access, I literally could not do my work without UT Libraries!” The Get a Scan service and Interlibrary Loan are also highly appreciated, ranking in the top three priorities for faculty, staff, and graduate students.

“They provided me with the space and kindhearted welcomes to come into the library and study for a huge test.” -Moody School of Communications Undergraduate Student

We were pleased to see that 87% of respondents agreed that they “feel safe from discrimination, harassment or harm in library spaces and when interacting with library staff.” This continues a trend of decreasing worries about safety following concerns seen in the 2012 campus survey. An undergraduate business student noted, “During finals season I needed a safe space to study when I could in my dorm room. The only place open closest to me was the PCL which was perfect that night.” Additionally, 86% of respondents agreed that UT Libraries is a welcoming place. Demographic breakdowns, however, show us that those who identify as black or African American, or nonbinary in gender identity, were slightly less likely to agree that they feel safe than the overall group. With the Libraries’ focus on IDEA (Inclusion, Diversity, Equity and Accessibility) including a recently adapted IDEA Action Plan, we hope to close that gap so that everyone feels safe and welcome in library spaces.

“My classes that I take make access to technology a must. The libraries on campus provide me with access to tools I would never have to opportunity to own. Tools such as 3D printers, book scanners, adobe software, and much more. Without the library I would either had to have dropped out of college and be thousands of dollars in debt.” – College of Liberal Arts Undergraduate Student

            Results also showed how much library users value the expertise, kindness, and labor of library staff. Library staff are seen as friendly, approachable, and knowledgeable by all user groups. In fact, staff comprised the second largest category of “What are we doing well?” responses. “In my UGS, a librarian came to explain to us how to use the library website nad how to find the sources we would need to conduct academic research,” shared an undergraduate from the College of Communication. “It was extremely helpful and I have since used these tips and skills in all of my classes!” Faculty especially value staff expertise – research support from a librarian is ranked as the third most important service by faculty respondents. Library web pages (research guides) for a subject area or course, which are designed and curated by librarians, were ranked within the top five priorities by every user group.

“Our librarian helped us research resources to unpack racial bias in grading and writing and coordinated with us and the writing center and writing flag staff to hold faculty meetings around this topic, The resources our librarian found were immensely helpful as were their contributions to our conversations.” -School of Social Work Faculty Member

While it’s nice to receive confirmation of what we’re doing well, it’s also important to look for ways we can better serve the campus community. In an open-answer “What can we do better?” question, navigation and wayfinding were often mentioned as areas that the Libraries can improve. One example of a task that some users currently find difficult is the process of finding a book on our website and then locating it in the stacks. Under the guidance of our UX Designer, we’re working on a project to improve signage on the entry level of PCL and will eventually move toward improving navigation and wayfinding at large. We also noted that the increase in remote learning and work brought on by the pandemic has possibly introduced a new need, as 20% of undergraduates who reported visiting a UTL space did so in order to attend a Zoom meeting or class. Individual space to attend online meetings is consistently being mentioned as a recent desire both anecdotally and through more formal assessments.

“Essential in a chronic sort of way. No single event represents it. ” -College of Natural Sciences Faculty Member

            While survey results are useful for confirming suspicions, tracking trends, and uncovering areas of interest, they also raise further questions. Respondents frequently expressed a lack of awareness of the Libraries’ communication channels, and undergraduate responses showed that there is room for improvement in outreach. We will follow up on these findings by doing further research to untangle where the disconnects are and what we can do to better reach all users. The results will continue to provide rich fodder for ongoing planning, and rather than being satisfied with the positive findings, the Libraries will continue to strive toward continual improvement so that everyone on campus can succeed. An undergraduate student from the College of Liberal Arts summed up why we do what we do, stating that “UT Libraries are essential to the accomplishment of my academic work.”

Heath Talks Assessment in Austere Times

 

Before Dr. Fred Heath joined the University of Texas Libraries as Vice Provost and Director, he had spent several years at Texas A&M with a team of faculty and research professionals developing and honing an assessment tool called LibQUAL+™. With a certain degree of prescience, his earlier work has given the Libraries a leg up in dealing with the economic downturn.

Dr. Heath took some time to discuss his experience and perspective on the vital role of assessment in building a library.

So, why do assessment?

Fred Heath: I think this pressure for accountability has always been part of the public sector where it’s really hard to measure bottom lines. If you’re going to succeed in advancing your program then you are going to have to have some structure that relates investments to outcomes, and there aren’t many tools to measure our “profits and losses” in the public sector. For several years we’d been searching and we found a tool called SERVQUAL that was used with great success in the private sector, and we also had a great relationship with the developers of that tool. We started noodling there, and it grew.

There were three young professors in the College of Business at Texas A&M – assistant professors at the time they started developing SERVQUAL – who needed a research protocol, and grew it into, perhaps, the most significant user satisfaction survey in that sector. It applied to everything from aircraft companies, to insurance, to restaurants. And one day we visited with the professor who was still there – the other two are now employed elsewhere around the world in higher education – and asked, “Do you think we can redirect SERVQUAL to the not-for-profit sector, specifically to education, and then even more specifically to libraries?” And we were really cautious, because it was a shameless emulation of what those three researchers were trying to do, but he was hugely supportive, open to the idea, and, in fact, all three of those developers have lent time to us over and again to help us build the tool that LibQUAL+™ became. Without them, without that beginning, I doubt we would’ve had the perspective and background ever to get it launched.

How important was it for the development of LibQUAL+™ to have faculty members as part of the development team?

FH: We could never have done this without the methodologists and the economists and the statisticians that we had on our side. And we, ourselves, were faculty in our own specialties, but not those skill sets. It was bringing all of those tools, all of that commitment, an emerging awareness of survey protocols in a nascent Web environment…we’d had no clue how we’d plan to do this on paper, and one of the methodologists said, “You know, I think we can do this on the Web pretty soon.” So, it took a village to build it; it took many different types of faculty to make it happen. Continue reading Heath Talks Assessment in Austere Times