This document summarizes a presentation on assessing the integration of library services into course management systems. Several librarians from different institutions discussed their experiences embedding library resources and services into platforms like Blackboard and Moodle. They described customizing library modules for specific courses and programs, collaborating with faculty, and piloting assessments of student learning and usage of integrated materials. Presenters emphasized the importance of obtaining usage data and finding better ways to promote library resources to faculty and students.
1. Assessing Integration of Library
Services into Course Management
Systems
Where we stand now
RUSA MERS Co-Chairs:
Lily Todorinova, Rutgers University
Lindsay Johnston, University of Alberta
3. LMS Integration
“...LMS embedded librarianship is becoming the primary and most
productive method for connecting with college and university
students, who are increasingly mobile and concerned with course
materials and requirements delivered in the LMS.”
(Tumbleson & Burke, 2013)
6. Liberal arts college with three
distinct campuses:
Traditional residential campus
with 1600 FTE
Nursing campus with 350 FTE
Online programs with 550 FTE
Online programs taught through
Blackboard,
CMS is not widely used in traditional
classes
7. Focus on online classes
Emphasis on individual,
personal service
Link to LibGuide in shell
course
Expansion of integrated
information literacy course
modules
8. •Customized assessment for instructors
depending on level of library involvement
•Collaboration with online instructors and
continuing education administration is key
•Assessing student learning over the course of a
program
•Piloting in RN to BSN Program
10. 39,000+ FTE
Canada's second largest Research Library, 3
campuses, 10 library facilities, 9 service desks
50,000 service desk interactions September-
December 2014, 2900+ chat reference
interactions
Fall 2013: 2200 unique courses in Moodle, 190
included a library block
Winter 2015: 598 courses include library block
18. The University of South Florida (USF) is an urban research
institution with 48,000+ students and 2,000+ faculty
52 Subject Guides and 73 Course Guides automatically
mapped (opt-out required) for all courses at USF
21. USF - Our Assessment Plans
Plans to do in-depth evaluation of hits on LibGuides following
integration into BlackBoard/Canvas
Already up over 8% based on early returns
Need to find better ways to get faculty to emphasize the guides and
other library resources
23. How many of you are actively involved with
working in the CMS?
24. •Does your institution assess the role of the CMS and its
impact on student learning?
•Do you have an Assessment Librarian at your
institution? Is s/he involved in assessing the library’s
role in the CMS?
• Do you have access to data of the usage of the CMS by
students (number of clicks to library links and
resources)? Was it easy/difficult to obtain this data?
25. • Is the role of the library in the CMS worth assessing?
• In what ways can it contribute to showing the effectiveness
of the library?
• Have you studied or correlated the use of the CMS library
resources to student performance, GPA, and/or retention?
In Tumbleson and Burke‘s 2013 book, Embedding librarianship in learning management systems: a how-to-do-it manual for librarians , this quote strikes home: “...LMS embedded librarianship is becoming the primary and most productive method for connecting with college and university students, who are increasingly mobile and concerned with course materials and requirements delivered in the LMS.”
[Tumbleson, B. E., & Burke, J. (2013). Embedding librarianship in learning management systems: a how-to-do-it manual for librarians / Beth E. Tumbleson and John J. Burke. Chicago: Neal-Schuman, an imprint of the American Library Association, 2013.
● The authors look at collaborating with faculty and engaging with students in their learning management system (LMS) classroom.
● Chapter titles describe book’s content, such as “A survey of LMS embedded librarians; LMS embedded librarianship makes information literacy accessible”, “Feature Capabilities”, “Marketing”, and “Assessing the Impact of Embedded Librarians”]
U of Alberta is a large research university…
Library block is opt-in. It’s a hard-coded block that is included on a list of many different types of blocks that instructors can include on their Moodle pages. Instructors need to know that it exists and take the time to add it to their courses. We are still lobbying for it to be included by default in all courses, giving instructors the option to remove it: opt-out if they don’t want there.
-- Improvement in uptake over time -- 190 cof 2200 unique classes included the block when we first asked for stats in 2013, but it’s up to 598 classes as of this month
Throughout this process, we surveyed students who had the library block included in their courses.
Their responses varied, but were fairly consistent on what elements they used the most often:
1. The search box
2. A library course guide (we use Libguides to create subject and course guides -- providing customized selections of resources and contextual information for students and researchers)
3. Our online reference tools
These responses give us useful information as we now consider updates to the Library Block.
The Moodle developers hard-coded this version of the block, based on planning conversations with us. We wanted the basic block to be small and concise, based on the elements that the students reported using most [CLICK FOR RED OUTLINE].
When we proposed the campus-wide Library Block to the Centre for Teaching and Learning, we knew the service had to be scalable. We wanted it to link in to our existing public services infrastructure.
The part outlined in red is the default content, and these links in the yellow bubble at the top link directly to our reference staff (including our chat reference service), who are already scheduled and prepared to respond to questions.
Customization is possible, but we’re no longer just talking about individual librarians working alone -- it’s not possible for them to be embedded in every single class. CTL was eager to create a customizable section for us, so that individual librarians and instructors would have the option to customize the block for their courses [CLICK FOR CIRCLE AROUND COURSE RESOURCES].
When an instructor chooses to include the library block and customize it, the Moodle course looks like this, with library resources embedded at point of need [CLICK FOR CIRCLE]
Even though we’re comparing different response rates (105 students responded to the General Survey and 25 to the History Survey), you can see that use of the Moodle block more than doubles based on the responses of those whose class included a library instruction session where the Moodle block was introduced and used in the class.
We see a similar difference when comparing whether students thought it would be useful to see the Moodle block in their other course. 50% said yes in the General Survey, compared to 95% in the History survey.
This fall, I became the liaison to the Philosophy department. One of the Philosophy 101 profs added the block to Moodle, so I surveyed those students. Even though they didn’t have to do a research assignment, almost 25% of the respondents used the block, and more than 50% of them agreed with the General Survey results from 2013: they would find it useful to have a Library Resources Block in their other courses – so, a year later, we see the same numbers for a class that wasn’t visited by a librarian.
These comparisons suggest that a combined approach of embedding library services in Moodle and course instruction is ideal. [blended learning.]
The guides work better in some browsers than others and we have statistics for assessment from both Canvas and LibGuides (and Google Analytics)
Need two librarians to maintain the database and to add new guides. Involves working with IT and taking some of their time