Assessment in Action: Academic Libraries and Student Success

AiA Overview

In September 2012, ACRL was awarded a National Leadership Demonstration Grant of $249,330 by the Institute of Museum and Library Services (IMLS) for the program “Assessment in Action: Academic Libraries and Student Success” (AiA). Part of ACRL's Value of Academic Libraries initiative, AiA was undertaken in partnership with the Association for Institutional Research (AIR) and the Association of Public and Land-grant Universities (APLU). The grant supported the design, implementation and evaluation of a program to strengthen the competencies of librarians in campus leadership and data-informed advocacy.

In 2017, a new day-long traveling ACRL workshop builds on the AiA curriculum with a focus on strategic and sustainable assessment. Learn more about how to bring this and other ACRL licensed workshops to your institution, chapter, or consortia.

Program Summaries and Reports
Application Cycle for 2015-2016
The Genesis of the AiA Program
About the Program
About the Curriculum
Participating Institutions

Program Summaries and Reports
To learn more about the progress and results of the AiA program, please see the following:

  • A searchable online collection of individual AiA team project reports, poster abstracts and images.
  • report synthesizing third year projects, the executive summary to share broadly with campus stakeholders (April 2017).
  • report synthesizing second year projects, the executive summary to share broadly with campus stakeholders (April 2016).
  • The recording / presentation slides from an online open forum to report on the assessment work of the 120+ institutions to date (May 2016).
  • A report synthesizing the first year projects, the executive summary to share broadly with campus stakeholders (January 2015).
  • Poster abstracts from the first year and second year of AiA campus project posters presented at the ALA Annual Conference (June 2014 and June 2015).
  • A final narrative report submitted to IMLS describes completion of the project (10/01/14-09/30/15 (December 2015).
  • An interim narrative report submitted to IMLS describes the second year of grant activities, 10/01/13-09/30/14 (December 2014).
  • An  interim narrative report submitted to IMLS describes the first year of grant activities, 10/01/12-09/30/13 (October 2013).
  • The recording from an online open forum to provide background on AiA, report on the assessment work of the first 75 institutions, and give details on how institutions could apply for the second year of the program (December 2013).
  • The presentation slides from an online open forum for prospective applicants with background on AiA and details on how to apply for the third year. It featured two AiA librarian team leaders who talked about their experiences participating in the first year of the program. (February 2015).

Find more in the Assessment in Action Bibliography listing dozens of journal articles, conference presentations, and other public reports related to the AiA initiative by staff, facilitators, and participants.

Application Cycle for 2015-2016
The third year of the 14-month long program is running from April 2015 – June 2016 and the applications were due by Wednesday, March 25, 2015. ACRL used this third year of the AiA grant to inform how it can best support the community in developing and carrying out assessment projects going forward. A grant from the Institute of Museum and Library Services covered the majority of the costs for developing the AiA program and for delivering it the first two years. The third year of the grant marks a transition year to determine if this program is sustainable or if other models better address the needs of the community. ACRL remains committed to supporting academic librarians as they work to document and communicate the value of their academic libraries. However, at this time there is not a commitment to offer the specific AiA cohort-based 14-month long program in the future. While we will continue to support the community, the format for doing so has changed, based on community needs. In 2017, a new day-long traveling ACRL workshop builds on the AiA curriculum with a focus on strategic and sustainable assessment. Learn more about how to bring this and other ACRL licensed workshops to your institution, chapter, or consortia.

The Genesis of the AiA Program
This program is based on ACRL's 2011 IMLS Collaborative Planning Grant which convened two national summits in partnership with AIR, APLU, and the Council of Independent Colleges. The summits assembled representatives from twenty-two postsecondary institutions, including senior librarians, chief academic administrators, and institutional researchers, for discussions about library impact. Fifteen representatives from higher education organizations and associations also participated in the summits. During the presentations, discussions, and collaborative work, the following four broad themes emerged about the dynamic nature of assessment in higher education:

  • Accountability drives higher education discussions.
  • A unified approach to institutional assessment is essential.
  • Student learning and success are the primary focus of higher education assessment.
  • Academic administrators and accreditors seek evidence-based reports of measurable impact.

Given this intensified attention to assessment and accountability issues in the higher education sector, five overarching recommendations for the academic library profession emerged, each followed by proposed action steps. The AiA project design is based on those recommendations. Learn more about the summits in white paper “Connect, Collaborate, and Communicate: A Report from the Value of Academic Libraries Summits.”

About the Program
We intended to select three hundred institutions of all types to participate in the AiA learning community (Year 1: 75 institutions; Year 2: 100 institutions; Year 3: 125 institutions). Each participating institution will identify a team consisting of a librarian and at least two additional team members as determined by the campus (e.g., faculty member, student affairs representative, institutional researchers, or academic administrator). The librarian team leaders will participate in a 14-month professional development program that includes a cohort-based learning community and team-based activities carried out on their campuses.

Partner, partner, partner; be visible and demonstrate value of libraries as campus partners in the student and faculty learning process. – Academic administrator at ACRL’s 2011 summits

Librarians who participate in the AiA program, supported by a blended learning environment and a peer-to-peer network, will lead their campus teams in the development and implementation of an action learning project examining the impact of the library on student success and contributing to assessment activities on their campus. The projects will result in a variety of approaches to assessing library impact on student learning which will be documented and disseminated for use by the wider academic library and higher education communities. The different perspectives and experiences represented by the institutional team members will foster a collaborative approach to assessing the library’s impact on student learning and success on the campus of each participating institution.

Reports of assessment efforts are often a stumbling block. It usually works better to get people together in conversation with basic data (not a report). It’s the process of reflecting on the data that’s important. – Charles Blaich, Director, Center of Inquiry at Wabash College and the Higher Education Data Sharing Consortium, at ACRL’s 2011 summits

The AiA program has three broad goals:
GOAL 1: Develop the professional competencies of librarians to document and communicate the value of their academic libraries primarily in relation to their institution’s goals for student learning and success.
GOAL 2: Build and strengthen collaborative relationships with higher education stakeholders around the issue of library value.
GOAL 3: Contribute to higher education assessment work by creating approaches, strategies, and practices that document the contribution of academic libraries to the overall goals and missions of their institutions.

We need to reinforce that one size does not fit all. Students succeed for many different reasons. – April Mason, Provost and Senior Vice President, Kansas State University, at ACRL’s 2011 summits

AiA will result in training for approximately 300 librarians, along with instructional engagement and resources for an additional 600-900 campus representatives on the teams. The design of this professional development program and the results of the collaborative campus projects have the potential for significant impact in the profession. The institutional teams will participate in peer review and provide feedback about the library value projects developed by other participating teams. An online collection of library value approaches, practices, and tools replicable to a variety of higher education settings will be documented and articulated for use by the wider academic library and higher education community.

About the Curriculum
Unlike traditional educational models that spotlight an instructor’s central role as the “sage on the stage” with primary authority and content expertise, blended learning emphasizes the facilitative role of instructors (i.e., “guide on the side”). Learners work collaboratively in face-to-face sessions, webcasts, and asynchronous online environments to create, share, and build content and products. In addition to cognitive learning outcomes which focus on building skills and enhancing knowledge, the program will include affective learning outcomes achieved by creating a peer-to-peer collegial network among the librarians in each cohort. This network will support collective learning, shared competence, sustained interaction, and a climate of mutuality and trust. In the process, a “community of practice” will develop. As Etienne Wenger explains, “Communities of practice are groups of people who share a concern or a passion for something they do and learn how to do it better as they interact regularly.”[1]  The AiA program design includes a sequenced set of experiences to promote and support the creation of a community of practice. The learning activities will also encourage action learning, a critical aspect of the professional development program. As the librarians work with their team members on the design and implementation of an assessment project, the knowledge and skills they acquire will be tested in authentic learning environments.

The webinars in particular have helped me revise and refine my project so that we are asking more specific questions, setting better outcomes, and specifying the types of data we need in order for the project to make sense. – AiA librarian team leader

To create a dynamic, authentic learning experience, the AiA program will use blended learning, peer-to-peer collegial relationships, and action learning projects, an enhancement to ACRL’s existing models. The AiA professional development program offers an opportunity to create and evaluate emerging instructional models as they relate to professional practice. The focus on action learning will also lead to a deeper understanding of what happens when knowledge and skills are applied in practice.

My primary take away is a combination of increased confidence in my abilities and an assessment worldview. There are a number of smaller skills that I developed over the course of the 14 months, but this shift in the way I look at the work I do and the knowledge that I can do it will stay with me into future projects.” – AiA librarian team leader

The design/facilitation team is led by Debra Gilchrist, Vice President for Learning and Student Success, Pierce College, WA; Lisa Janicke Hinchliffe, Coordinator for Information Literacy and Professor, University of Illinois at Urbana-Champaign; and Kara Malenfant, Senior Strategist for Special Initiatives, Association of College and Research Libraries. Additional designers/facilitators are participating throughout the length of the project: April Cunningham, Library Instruction Coordinator at Saddleback College in Mission Viejo, CA; Carrie Donovan, Head of Teaching & Learning for the Indiana University Libraries in Bloomington, IN; Eric Resnis, who serves in a dual appointment as Assessment Coordinator in the Center for Teaching, Learning, and University Assessment and as Organizational Effectiveness Specialist in the Libraries at Miami University in Oxford, OH; and John Watts, ‎Undergraduate Learning Librarian at University of Nevada Las Vegas. A community of practice expert advised the team during the early design process and Libby Miles, Associate Professor of Writing & Rhetoric in the Harrington School of Communication and Media at the University of Rhode Island in Kingston, RI, was part of the facilitation team for the first 18 months of the program. Project analyst Karen Brown, Professor at the Graduate School of Library and Information Science at Dominican University, IL, is working with the team to document replicable action learning projects undertaken by the institutional teams. Expert speakers, selected to augment the program, will present briefly at key junctures.

While the bulk of the support for the AiA learning community will take place virtually through an online asynchronous classroom and webcasts, the librarian team leaders in each cohort will attend three in person events, which are held in conjunction with the ALA Midwinter Meeting and Annual Conferences on the following cycle:

  • June 27- July 2, 2013: Chicago, IL. Cohort 1, first full-day meeting.
  • January 24-28, 2014: Philadelphia, PA. Cohort 1, second full-day meeting.
  • June 26-July 1, 2014: Las Vegas, NV. Cohort 1, poster session.
  • June 26-July 1, 2014: Las Vegas, NV. Cohort 2, first full-day meeting.
  • January 30-Feb 3, 2015: Chicago, IL. Cohort 2, second full-day meeting.
  • June 25-30, 2015: San Francisco, CA. Cohort 2, poster session.
  • June 25-30, 2015: San Francisco, CA. Cohort 3, first full-day meeting.
  • January 8-12, 2016: Boston, MA. Cohort 3, second full-day meeting.
  • June 23-28, 2016: Orlando, FL. Cohort 3, poster session.

ACRL will use the third year of the AiA grant to inform how it can best support the community in developing and carrying out assessment projects going forward. A grant from the Institute of Museum and Library Services covered the majority of the costs for developing the AiA program and for delivering it the first two years. The third year of the grant marks a transition year to determine if this program is sustainable or if other models better address the needs of the community.

Participating Institutions
THIRD YEAR TEAMS: In April 2015, ACRL selected 55 additional institutional teams to participate in the third year of the program. The selected teams, representing all types of institutions from 24 states, the District of Columbia and Australia, were:

  • Arcadia University (Glenside, PA)
  • Bentley University (Waltham, MA)
  • Blue Mountain Community College (Pendleton, OR)
  • Boston University (Boston, MA)
  • Brandeis University (Waltham, MA)
  • Brigham Young University-Provo (Provo, UT)
  • California State University-East Bay (Hayward, CA)
  • California State University-Fullerton (Fullerton, CA)
  • California State University-San Marcos (San Marcos, CA)
  • Catawba College (Salisbury, NC)
  • College of DuPage (Glen Ellyn, IL)
  • College of the Holy Cross (Worcester, MA)
  • CUNY Hunter College (New York, NY)
  • Davidson College (Davidson, NC)
  • DeSales University (Center Valley, PA)
  • Drexel University (Philadelphia, PA)
  • Edward Via College of Osteopathic Medicine (Blacksburg, VA)
  • Elmhurst College (Elmhurst, IL)
  • Emerson College (Boston, MA)
  • Franklin University (Columbus, OH)
  • Georgetown University (Washington, DC)
  • Georgia Regents University (Augusta, GA)
  • Gettysburg College (Gettysburg, PA)
  • Guilford College (Greensboro, NC)
  • Hawaii Pacific University (Honolulu, HI)
  • John Carroll University (Cleveland, OH)
  • Lincoln University (Jefferson City, MO)
  • Midwestern State University (Wichita Falls, TX)
  • Nevada State College (Henderson, NV)
  • Northeastern State University (Tahlequah, OK)
  • Northern Michigan University (Marquette, MI)
  • Queensland University of Technology (Brisbane, Queensland)
  • Seattle University (Seattle, WA)
  • Southern Illinois University-Carbondale (Carbondale, IL)
  • St. Catherine University (St. Paul, MN)
  • SUNY at Fredonia (Fredonia, NY)
  • Swarthmore College (Swarthmore, PA)
  • The University of Texas at San Antonio (San Antonio, TX)
  • Tulsa Community College (Tulsa, OK)
  • University of California-Santa Cruz (Santa Cruz, CA)
  • University of Illinois at Urbana-Champaign (Urbana, IL)
  • University of Iowa (Iowa City, IA)
  • University of Kansas (Lawrence, KS)
  • University of Massachusetts-Boston (Boston, MA)
  • University of Miami (Coral Gables, FL)
  • University of Minnesota-Duluth (Duluth, MN)
  • University of Nevada-Las Vegas (Las Vegas, NV)
  • University of New Mexico (Albuquerque, NM)
  • University of New Mexico-Main Campus (Albuquerque, NM)
  • University of North Carolina at Greensboro (Greensboro, NC)
  • University of Pittsburgh-Greensburg (Greensburg, PA)
  • University of Southern California (Los Angeles, CA)
  • University of St Thomas (St. Paul, MN)
  • University of Wyoming (Laramie, WY)
  • Virginia Polytechnic Institute and State University (Blacksburg, VA)

SECOND YEAR TEAMS: In April 2014, ACRL selected 73 additional institutional teams to participate in the second year of the program. The selected teams, representing all types of institutions from 34 states and 1 Canadian province, were:

  • A.T. Still University (Mesa, AZ)
  • Arkansas Tech University (Russellville, AR)
  • Becker College (Worcester, MA)
  • Benedictine College (Atchison, KS)
  • Champlain College (Burlington, VT)
  • City University of Seattle (Seattle, WA)
  • College of Southern Nevada (Las Vegas, NV)
  • Colorado Mesa University (Grand Junction, CO)
  • Culinary Institute of America (Hyde Park, NY)
  • CUNY Borough of Manhattan Community College (New York, NY)
  • Defiance College (Defiance, OH)
  • Des Moines Area Community College (Des Moines, IA)
  • Eastern Kentucky University (Richmond, KY)
  • Eastern Mennonite University (Harrisonburg, VA)
  • Florida International University (Miami, FL)
  • Fulton-Montgomery Community College (Johnstown, NY)
  • Georgia College and State University (Milledgeville, GA)
  • Georgia Institute of Technology-Main Campus (Atlanta, GA)
  • Georgia Southern University (Statesboro, GA)
  • Illinois of Institute of Technology (Chicago, IL)
  • Joliet Junior College (Joliet, IL)
  • Kalamazoo College (Kalamazoo, MI)
  • Knox College (Galesburg, IL)
  • Kutztown University of Pennsylvania (Kutztown, PA)
  • Lone Star College System (Houston, TX)
  • Luther Seminary (St. Paul, MN)
  • Macalester College (St. Paul, MN)
  • Marquette University (Milwaukee, WI)
  • Massachusetts College of Liberal Arts (North Adams, MA)
  • McDaniel College (Westminster, MD)
  • Michigan State University (East Lansing, MI)
  • Montclair State University (Montclair, NJ)
  • Naugatuck Valley Community College (Waterbury, CT)
  • Northwest Arkansas Community College (Bentonville, AR)
  • Northwest Vista College (San Antonio, TX)
  • Nova Southeastern University (Fort Lauderdale, FL)
  • Otero Junior College (La Junta, CO)
  • Our Lady of the Lake University (San Antonio, TX)
  • Peninsula College (Port Angeles, WA)
  • Pierce College at Fort Steilacoom (Lakewood, WA)
  • Point Park University (Pittsburgh, PA)
  • Purdue University (West Lafayette, IN)
  • Rutgers, The State University of New Jersey (Piscataway, NJ)
  • Samuel Merritt University (Oakland, CA)
  • South Dakota State University (Brookings, SD)
  • Southern Methodist University (Dallas, TX)
  • Southwestern Indian Polytechnic Institute (Albuquerque, NM)
  • Temple University (Philadelphia, PA)
  • The College of Saint Scholastica (Duluth, MN)
  • The University of Akron-Main Campus (Akron, OH)
  • University of Alberta (Edmonton and Camrose, AB)
  • University of California, Merced (Merced, CA)
  • University of California-San Francisco (San Francisco, CA)
  • University of Iowa (Iowa City, IA)
  • University of Minnesota-Morris (Morris, MN)
  • University of Mississippi (University, MS)
  • University of Mississippi Medical Center (Jackson, MS)
  • University of Nebraska Omaha (Omaha, NE)
  • University of North Carolina Wilmington (Wilmington, NC)
  • University of Pittsburgh-Pittsburgh Campus (Pittsburgh, PA)
  • University of South Dakota (Vermillion, SD)
  • University of West Georgia (Carrollton, GA)
  • University of Wisconsin-Stevens Point (Stevens Point, WI)
  • Utah State University (Logan, UT)
  • Utah Valley University (Orem, UT)
  • Virginia Wesleyan College (Norfolk, VA)
  • Wake Forest University (Winston-Salem, NC)
  • Wake Technical Community College (Raleigh, NC)
  • Washington University in St. Louis (St. Louis, MO)
  • Wayne State University (Detroit, MI)
  • West Virginia State University (Institute, WV)
  • Western Michigan University (Kalamazoo, MI)
  • Yeshiva University (New York, NY)

FIRST YEAR TEAMS: In April 2013, ACRL selected 75 institutional teams to participate in the first year of the AiA program. The selected teams, representing all types of institutions from 29 states and 3 Canadian provinces, were:

  • Alverno College (Milwaukee, WI)
  • Anne Arundel Community College (Arnold, MD)
  • Appalachian State University (Boone, NC)
  • Arizona State University (Tempe, AZ)
  • Augustana College (Rock Island, IL)
  • Brown University (Providence, RI)
  • Bucks County Community College (Newtown, PA)
  • California Lutheran University (Thousand Oaks, CA)
  • Central Washington University (Ellensburg, WA)
  • Claremont Colleges (Claremont, CA)
  • Dakota State University (Madison, SD)
  • Dalhousie University (Halifax, NS)
  • DePaul University (Chicago, IL)
  • Elizabethtown College (Elizabethtown, PA)
  • Fairfield University (Fairfield, CT)
  • George Mason University (Fairfax, VA)
  • Grand Valley State University (Allendale, MI)
  • Greenfield Community College (Greenfield, MA)
  • Grinnell College (Grinnell, IA)
  • Hofstra University (Hempstead, NY)
  • Howard University (Washington, DC)
  • Illinois Central College (East Peoria, IL)
  • Indiana University of Pennsylvania (Indiana, PA)
  • Institute of American Indian Arts (Santa Fe, NM)
  • Kapi‘olani Community College (Honolulu, HI)
  • Lakeland Community College (Kirtland, OH)
  • Lasell College (Newton, MA)
  • Le Moyne College (Syracuse, NY)
  • Los Angeles Trade Technical College (Los Angeles, CA)
  • Medaille College (Buffalo, NY)
  • Mercy College (Dobbs Ferry, NY)
  • Miami University (Oxford, OH)
  • Michigan Technological University (Houghton, MI)
  • Middlesex Community College (Bedford, MA)
  • Montana State University (Bozeman, MT)
  • Muhlenberg College (Allentown, PA)
  • Murray State University (Murray, KY)
  • North Carolina Central University (Durham, NC)
  • Northeastern Illinois University (Chicago, IL)
  • Pacific Lutheran University (Tacoma, WA)
  • Radford University (Radford, VA)
  • Rockhurst University (Kansas City, MO)
  • Rollins College (Winter Park, FL)
  • Saint Mary's College of California (Moraga, CA)
  • Salem State University (Salem, MA)
  • Santa Barbara City College (Santa Barbara, CA)
  • South Texas College (McAllen, TX)
  • Southern Connecticut State University (New Haven, CT)
  • St. Mary's College of Maryland (St. Mary's City, MD)
  • Stonehill College (Easton, MA)
  • The Citadel (Charleston, SC)
  • The College at Brockport, State University of New York (Brockport, NY)
  • The Ohio State University (Columbus, OH)
  • Towson University (Towson, MD)
  • UNC Charlotte (Charlotte, NC)
  • University of Baltimore (Baltimore, MD)
  • University of Connecticut Health Center (Farmington, CT)
  • University of Guelph (Guelph, ON)
  • University of Idaho (Moscow, ID)
  • University of Manitoba (Winnipeg, MB)
  • University of Maryland University College (Adelphi, MD)
  • University of Massachusetts Dartmouth (North Dartmouth, MA)
  • University of Michigan (Ann Arbor, MI)
  • University of Nebraska Kearney (Kearney, NE)
  • University of Northern Colorado (Greeley, CO)
  • University of Redlands (Redlands, CA)
  • University of South Florida (Tampa, FL)
  • University of Texas at El Paso (El Paso, TX)
  • University of Wisconsin-Eau Claire (Eau Claire, WI)
  • University of Wisconsin-Green Bay (Green Bay, WI)
  • University of Wisconsin-Milwaukee (Milwaukee, WI)
  • Virginia Tech (Blacksburg, VA)
  • Webster University (St. Louis, MO)
  • Western University of Health Sciences (Pomona, CA)
  • York University (Toronto, ON)

If you have questions about the Assessment in Action program or ACRL’s Value of Academic Libraries initiative, please contact Kara Malenfant, ACRL Senior Strategist for Special Initiatives, at kmalenfant@ala.org or (312) 280-2510.

 


[1] Wenger, E. Communities of Practice. (June 2006). http://www.ewenger.com/theory/