University Libraries’ Annual Program Assessment

2024/2025 Academic Year Assessment Plan

Methods:

For the 2024/2025 assessment cycle, the University Libraries assessed Learning and Performance Outcomes. The requirements for annual assessment are for two methods with results. This cycle, the University Libraries completed four methods with results. These are:

  1. Research Guides

  2. Technology Equipment Circulation

  3. Faculty Satisfaction with Library Services and Resources Survey

Stakeholders:

Assessment Method 1: Research Guides

Assessment Method: Research Guides

The WSU Libraries and librarians develop, curate, and maintain web pages, organized as research guides, that provide research assistance and information resources for subjects and individual courses. Research Guides serve as a set of supplemental materials for a class/workshop, an instruction session, or the subject librarian's liaison area. Course Guides, primarily, are often developed in consultation with WSU faculty.

There are currently 372 guides published (107 subject guides, 103 course guides, 47 topic guides, and 115 general purpose guides). These online resources utilize a content management system with built-in statistical capabilities that provide insight into usage. Statistics are also available for links from Canvas courses to associated guides.

During the Winter 2025 semester, a working group of Subject Librarians and Assessment Committee members will harvest and analyze usage data for Fall 2024 to assess how well patron needs were met, especially the needs of students and faculty, as may be interpreted using pageview and link resolver statistics. This inquiry will identify guides with the highest use to inform ongoing and future developments. Further, the working group will analyze course guide pageviews for the Fall 2024 semester in comparison with the number of students enrolled in relevant or directly targeted courses. Success will be measured by an approximation of uses per capita with a goal of 50% of students enrolled in courses with a Course Guide are accessing their guides. 

 

Method History: 

This is a NEW or REVISED assessment method that has not been used before in its current form.

This method will supply data for Outcomes 3 and 4. 

Results: Research Guides

Though we regularly examine usage statistics for individual Research Guides, this was our first collective assessment of them, and our first assessment examining how their use supports student learning in courses with library/librarian developed Course Guides. 

Our initial comparison of enrollment data and page views for Fall 2024 courses with Course Guides indicates that we exceeded our goal of Course Guides usage by 50% of students. 

Courses, Enrollment, & Course Guides Usage per Capita, FA 2024 

FA 24 Guides & Courses Pairings 

53 

Page Views 

10,500 

Enrollment 

9,912 

Page Views per Student 

1.06 

 

We examined the numbers of Course Guides for each course level, 1000 – 9000, to establish context. They are distributed across all levels but have a larger representation for 1000 and 3000 level courses. 

Pie chart of number of course guides for each course level for Fall 2024.

Next, we examined enrollment and Course Guide pageviews at the course level to measure performance more granularly. We learned that of the 53 pairings of courses with Course Guides, 36 of them met or exceeded our goal for student use, while 17 fell short. Our analysis compares page views to student enrollment across all sections of courses. Due to reporting limitations, we are unable to confirm that Course Guide page views are the result of enrolled student activity.  

Pie chart of Fall 2024 course guide pageviews and enrollment percentage.

A handful of Course Guides, including those developed for an online program and those developed with significant faculty input or collaboration, were particularly heavily used.  (A chart and table of high use Course Guides follows the report.)

A chart of page views by LibGuide type and count for Fall 2024.

This analysis was a learning experience to identify and establish assessment methods that can be used for future inquiries to measure use and identify opportunities for improvements. Overall, we are encouraged that our findings indicate that Course Guides are generally useful to students to support learning and faculty to support teaching. 

Program Action Plan: Research Guides

The results of this initial assessment will be presented to the Subject Librarians who develop and maintain LibGuides so they may provide insight into individual and overall Research Guide effectiveness. The usage and enrollment data, as proxy for student and faculty need, will help inform development of a development and maintenance strategy that will improve availability, quality, and efficiencies for these Library resources and services. The results will also be provided to the Research Guides software administrators to inform infrastructural updates that will improve the data accuracy for future assessments, e.g., assigned categories and Canvas links. In consultation with the Subject Librarians, we will revise our initial goal of Course Guides usage by 50% of students to a higher percentage. 

Timeline for Action Plan Implementation: 

We will begin the action plan in June 2025 so that further analyses and strategies may be formulated over the summer months in preparation for the next academic year, AY 2025/2026.  

Assessment Method 2: Technology Equipment Circulation

Assessment Method: Technology Equipment Circulation

The University Libraries has long provided a limited variety of technology and multimedia equipment available for checkout to WSU patrons. The scope of this service was greatly expanded in November 2017 to include all five libraries and the Applebaum LRC.

Circulation reports generated from the library catalog reflect an aggregated total for all equipment loans. While the data supports the general belief among library staff that equipment circulation is an important service, the data provide limited insight into which items are in demand and if there are differences in demand across library locations. Further, the aggregate circulation reports do not provide insight into who is borrowing equipment.

A working group of Assessment Committee members, comprised of three administrators who set up and facilitate this service, and two librarians, will harvest and analyze additional circulation data for the Fall 2024 semester to evaluate which and how often equipment items circulate and whose needs are being met by this service. This inquiry will be useful to inform future equipment investments and distribution. Success will be measured via the percentage of equipment borrowed by students with a target goal of 65%. 

This method will supply data for Outcome 9. 

 

Method History: 

This is a NEW or REVISED assessment method that has not been used before in its current form. 

Results: Technology Equipment Circulation

As this was our first assessment of this service, we set a cautiously optimistic goal of 65% for technology equipment circulation initiated by WSU students. A report was generated from the library catalog that reflects circulation activity by item and patron type for the Fall 2024 semester, September 1 – December 31. Analysis indicates that there were 3,595 technology equipment items circulated and that 3,552 checkouts (98.8%) were initiated by graduate and undergraduate students. Most of the student checkouts were initiated by undergraduate students – 3,212 (97.7%). Only 1.2% of circulation was initiated by faculty, librarians, and library staff. The findings confirmed that this library service, implemented to support student success, is almost exclusively used by students.  

The working group gained a better understanding of the aggregated circulation activity and inventory levels for types of equipment by library location using an item record report. We learned that multi-use chargers, Chromebooks, and calculators are the most frequently borrowed items from the library equipment collections. The WSU Libraries also facilitate and report circulation activity for C&IT’s laptops accessed via lockers within the Undergraduate Library, STEM Innovation Center, and State Hall. The report used for this analysis cannot be limited to a date range, so the findings will provide a benchmark for a point in time by which future activity can be measured. 

Chart and table of technology equipment categories and checkouts by patron type. 

Chart of all technology equipment checkouts and renewals by item type (date not specified)

Program Action Plan: Technology Equipment Circulation

During our analysis, members of the working group discovered opportunities to improve equipment type identifiers in the catalog that will improve our ability to generate more granular data for future assessment. Future circulation reports will provide greater insight into patron needs and inform investments in equipment by library location. 

We will continue to monitor circulation activity by patron and equipment type. We anticipate patron needs and technology equipmentwill evolve over time as does technology equipment. We anticipate adjusting equipment type and availability by library locations in response to the current and future data analyses. We will immediately increase our target goal for technology equipment circulation initiated by students from 65% to 95%. 

 

Timeline for Action Plan Implementation: 

The action plan was initiated during the assessment period and will continue through, at minimum, the next academic year, AY 2025/2026. 

Assessment Method 3: Faculty Satisfaction Survey

Assessment Method: Faculty Satisfaction with Library Services & Resources Survey

WSU Librarian Subject Specialists deliver instruction to support coursework developed in response to faculty requests that reflect the subject, assignment, and/or instructional needs that faculty express for a particular course or discipline, as well as for their own research. 

Methods of instruction delivery includes librarian visits during scheduled course meetings, asynchronous recordings, interactive tutorials, series of brief videos or research guide content, and Individual consultations with each student or faculty/instructor. 

A pilot survey administered using Qualtrics during the Winter Semester will gather information on Faculty use of and satisfaction with library resources and services for teaching and for their own research during the AY 2024/2025. It will also invite faculty suggestions on needs for additional library resources and services. Faculty from a small sample of programs and departments will be invited to respond with the added intent of gathering feedback from those not currently incorporating library resources and services in their course(s) and/or utilizing them for their own research. College/department affiliation and course(s) taught may provide insight into discipline-specific library needs and librarian outreach opportunities. The pilot will provide immediate potentially actionable insights and will be used to test the effectiveness of the survey instrument and gaps that should be addressed for future survey iterations.  

A working group of Assessment Committee members will analyze survey data during Spring 2025. 

Faculty satisfaction levels for library resources and services for teaching (in the classroom) will be measured using a Likert scale of 1- 6 (with a NA (not applicable) checkbox). The goal for acceptable performance is 90% of responses indicate scores of 4 or higher. 
 
Aggregate data will be reviewed by members of the Libraries Assessment Committee and presented to the Subject Librarians. Subject specific results will be reviewed and shared directly with the appropriate subject specialist. 

This method will supply data for Learning Outcomes 1, 2, and 3 and Performance Outcome 4. 

 

Method History: 

This is a NEW or REVISED assessment method that has not been used before in its current form. 

Results : Faculty Satisfaction with Library Services & Resources

The survey was administered for four sets of Faculty from the School of Social Work, the Department of Biological Sciences, and the College of Education. The survey was sent to 111 faculty; 36 responses were received, though just 28 were usable for a 26.7% response rate.  

School or Department  

  

  

  

  

  

  

  

Recorded Responses 

Total Recipients 

Valid Responses 

Incomplete Valid Responses 

Complete Valid Responses 

Response Rate 

Biological Sciences 

27 

14.81 

Counseling & Educational Psychology CoE 

14 

28.57 

Educational Leadership & Policy Studies CoE 

12 

41.67 

Health, Exercise, & Sports CoE 

24 

20.83 

Learning Design & Technology CoE 

100.00 

Social Work 

28 

28.57 

Unknown 

14 

  

NA 

Totals 

46 

107 

36 

28 

26.17 

For faculty that utilize library resources and services in the classroom, satisfaction ratings for 6 of 11 were scored above the 90% goal and 5 were scored below it. There were a significant number of “not applicable” responses for each category. These merit further examination, though may be due to differences in resources needs by discipline. 

Faculty were asked to rate the level of ease in locating library materials for teaching and requesting librarian support for teaching. Responses were positive but fell below our 90% goal. 

(A table and graph of response analyses follows)

Approximately half of the respondents answered the open text questions asking for feedback on how the libraries can better support their teaching and research. Responses were received from across all the departments surveyed.  

Open Text Responses by Department 

Total Responses 

Textual Responses 

Biological Sciences 

Counseling & Ed Psych 

Ed Leadership & Pol Studies 

Health Exercise & Sports 

Learning Design & Tech 

Social Work 

Total: 

28 

15 

 

One member of the Libraries Assessment Committee analyzed these by type, function, potential responses or actions, and by library staff most able to respond. While a variety of actionable needs and suggestions (eTextbooks, permalinks, etc.) were received, many responses centered on the need for better communication from librarians about available services. The textual results will be conveyed to library individuals and departments, so they may consider taking immediate action. 

Program Action Plan: Faculty Satisfaction with Library Services & Resources Survey

Members of the Libraries’ Assessment Committee will present aggregated findings to the Subject Librarians and other key stakeholders for feedback. Subject specific results will be shared directly with the appropriate subject specialist or library unit.   

During analysis, opportunities for further investigation were noted. Many respondents indicated that library resources and/or services were not applicable to their teaching or research. Further, a larger than expected number of respondents reported satisfaction with less commonly used resources and services such as archival and digital collections. We will consult the Subject Librarians for additional insights. Also, we will further evaluate the survey instrument to identify opportunities to clarify language, include definitions and/or examples, and revise or remove questions accordingly.  

 

Timeline for Action Plan Implementation: 

The action plan was initiated during the assessment period and will continue through, at minimum, the next academic year, AY 2025/2026. We will continue to refine the survey questions in preparation for launch to the full faculty at a future date to be determined, but likely during the AY 2026/2027. 

Stakeholders

The WSU Libraries stakeholders include: Students, Program colleagues (e.g., faculty, staff, immediate supervisor), WSU colleagues beyond the Libraries, non-WSU stakeholders (e.g., community or industry partners, advisory groups, employers, accrediting bodies) 

Stakeholder Engagement

The University Libraries maintains a website (this LibGuide) that describes the annual program assessment initiative.  It includes pages for each year's assessment plan and results, and is publicly available. This year's assessment activities and results will be added in early June. Stakeholders will be encouraged to view the website via announcements in meetings and on the library website. Key stakeholders will be identified for each assessment method to communicate results and solicit feedback via individual and group meetings.    

Stakeholder Feedback

Stakeholder feedback is actively being sought. Results will be added by August 31, 2025.

University Libraries Mission Statement

The Wayne State University Libraries advance scholarship, student learning and faculty innovation through continuous development of a library that serves as a national model for a research University with an urban teaching and service mission.  

  • ACCESS SERVICES: MISSION  

The Access Services Area advances student success by providing access to physical and digital collections from internal and external sources. The Access Services Area helps provide study space and technology resources that contribute to achievement in academic success for students.   

  • DISCOVERY SERVICES: MISSION  

The Library online environments and tools advance the academic success and personal growth of undergraduate, graduate, and professional students by providing them with a website containing information about library services and resources; tools for identifying information sources across all disciplines studied at the university; tools for retrieving digital books, articles, and other resources; and the means to request resources and services from the University Libraries.   

  • LEARNING AND RESEARCH SUPPORT: MISSION  

Our public services librarians provide our undergraduate, graduate, and professional students with guidance and instruction, through its own initiatives and faculty collaborations, to support development of the information literacy skills needed to traverse a complex information ecosystem as student and career professionals.

The Reference/Research Consultation Area, through in-person and virtual interactions, advances the academic success and intellectual growth of undergraduate, graduate, and professional students through quality answers to their research questions and by offering guidance in developing their information-finding skills.  

  • LIBRARY COLLECTION DEVELOPMENT: MISSION  

The Library Collections Area Libraries advances the academic success and personal growth of undergraduate, graduate, and professional students by providing them with information resources serials, journals, books, and media in physical and digital formats necessary for such advancement.  

  • LIBRARY PUBLISHING AREA: MISSION  

The Library Publishing Area promotes open scholarly communication through the production, delivery, and preservation of digital research projects, and provides undergraduate, graduate, and professional students with a platform for presenting their scholarly research.  

  • REUTHER LIBRARY & ARCHIVE OF LABOR AND URBAN AFFAIRS: MISSION 

The Walter P. Reuther Library collects and facilitates access to historical documentary evidence in order to inspire academic research, serve the information needs of the community, and build knowledge at Wayne State University. 

University Libraries Learning & Performance Outcomes

University Library System Performance & Learning Outcomes (Updated May 2023)

  1. Learning and Research Support: Use of Library Tools (LO)

Students will be able to locate books and journal articles on a given topic through tools (e.g., catalog, QuickSearch, databases) on the Libraries’ website.

  1. Learning and Research Support: Evaluate Information Sources (LO)

Students who receive library instruction will be able to evaluate information sources for reliability and relevance. 

  1. Learning and Research Support: Locating Information for Assignments (LO)

Students who receive library instruction will be able to locate information for their assignments and studies. 

  1. Learning and Research Support: Instructor Assistance (PO)

Provide instructors with the assistance necessary to compose “library assignments” that will encourage students to explore information resources and develop library research skills.

  1. Learning and Research Support: Reference Services (PO)

Provide reference services and research consultations to assist students with their projects and research needs.

  1. Library Collection Development: Books for Learning and Growth (PO)

Provide students with books that contribute to learning and growth.

  1. Library Collection Development: Streaming Media for Learning and Growth (PO)

Provide students with the streaming media that contribute to learning and growth.

  1. Library Collection Development: Online Articles for Learning and Growth (PO)

Provide students with the Online Articles and Databases (digital journals/articles) that contribute to learning and growth.

  1. Access Services: Circulation Services for Learning and Growth (PO)

Provide students with circulation services that contribute to learning and growth.

  1. Access Services: Reserve Services for Learning and Growth (PO)

Provide students with reserve services that contribute to learning and growth.

  1. Access Services: Interlibrary Loan for Learning and Growth (PO)

Provide Interlibrary Loan services (articles, book chapters and books in print or PDF) that contribute to learning and growth. 

  1. Discovery Services: Library Website (PO)

Provide a website that students use easily and efficiently to meet their study and research needs.

  1. Access Services: Reservable Study Rooms (PO)

Provide reservable study rooms that students find conducive to study and academic work.