Assessment in Action Team Applications

Assessment in Action

ACRL will be seeking applications from all types of higher education institutions for 125 teams to participate in the third year of “Assessment in Action: Academic Libraries and Student Success (AiA),” made possible by the Institute of Museum and Library Services (IMLS) and described on the program homepage. Librarians will each lead a campus team in developing and implementing an action learning project which examines the impact of the library on student success and contributes to assessment activities on campus. They will be supported in this work by a professional development program with sequenced learning events and activities at key junctures.

The online application to participate in the second year of “Assessment in Action: Academic Libraries and Student Success,” made possible by the Institute of Museum and Library Services, was due 5 p.m. Central, Friday, March 21, 2014. Stay tuned for more information in late 2014 about the third year of the program. The information, below, describes how applicants were instructed to apply or the second year.

The AiA program, part of ACRL’s Value of Academic Libraries initiative, employs a blended learning environment and a peer-to-peer network over the course of the 14-month long program, which -- during the second year -- runs from April 2014-June 2015. In order to apply, each prospective institution must identify a team consisting of a librarian and at least two additional team members from other campus units (e.g., faculty member, student affairs representative, institutional researcher, assessment officer, or academic administrator). The application requires two essays – the first describes the team’s project goals and the second describes the goals of the librarian team leader – and statements of support from the library dean/director and campus chief academic officer.

Learn more about the AiA program from an open online forum, held Monday, December 9, 2013. Listen to the one-hour recording or download a PDF of the presentation slides.

Selection
Program Goals
About the Action Learning Projects
Expectations of Librarians as Team Leaders
Expectations of Librarians as Members of a Community of Practice
Expectations of Campus Team Members
Timeline
Costs
Preparing Applications
Application Instructions and Deadline
Application FAQs

Selection
An important component of the AiA program, part of ACRL’s Value of Academic Libraries initiative, is to establish a learning community in which all team members contribute to the success of the program through active engagement. Participation is limited to 100 teams to ensure an environment that fosters group interaction and active participation.

The institutional teams for AiA will be selected through a competitive application process designed to ensure representation from an array of geographic regions and postsecondary institutions (i.e., community colleges, colleges, and universities). Other criteria considered are demonstrated need, evidence of team readiness, and institutional support for a library-led assessment project. The review team consists of ACRL member leaders, grant partner organizations, and representatives of higher education organizations who serve on the grant advisory panel. AiA program design team members are excluded from the review process. All the applications will be reviewed at once after the application deadline.

Application reviewers will seek evidence that:

  • The team and proposed project topic have the potential to contribute to the greater library and higher education community.
  • The team and institution demonstrate the commitment of resources and support to enthusiastically sustain the project to completion.
  • The librarian team leader, as an individual, demonstrates potential for sustained growth as a campus leader and shows evidence of positive skills and attitude to contribute to a collaborative learning experience.

Program Goals
The AiA program has three broad goals:

  • GOAL 1: Develop the professional competencies of librarians to document and communicate the value of their academic libraries primarily in relation to their institution’s goals for student learning and success.
  • GOAL 2: Build and strengthen collaborative relationships with higher education stakeholders around the issue of library value.
  • GOAL 3: Contribute to higher education assessment work by creating approaches, strategies, and practices that document the contribution of academic libraries to the overall goals and missions of their institutions.

About the Action Learning Projects
The AiA program focuses on assessment, which we believe is rooted in identifying important questions about student learning/success, designing assessments that yield information about library contributions, and taking action based on what has been uncovered. All action learning projects should go beyond use and satisfaction and examine questions of impact and outcomes. For some teams the projects may be a first step in examining what impact the library may have on student learning and success. Work will represent an initial step or pilot project through which teams will learn more, move to action, and take a deeper look at a particular area of interest. Teams undertaking “seed” projects of this type will begin an effort that will result in a longer term commitment on campus in the future. For other teams, a previous assessment activity may have raised questions for further exploration. Therefore, some projects will move beyond describing what type of impact is occurring (or not occurring) and take a deeper look into how the library creates an impact on students. Not all projects will demonstrate that there is in fact a library impact, and key criteria for “success” will be different. Developing and implementing a project as part of the AiA program will engender learning, spur action, and build capacity for continued work in this area.

Action learning projects should be realistic, and applications should propose the best project for the team in the context of campus priorities and available resources. Ideally this project will fit into current planning and goals, and data gathering processes (if existing data from surveys, swipe cards, database logins, instruction sessions, etc. will not be used) will be part of the regular workflow of students. To increase the likelihood of successful completion, it is important that this is project be intrinsic to day-to-day work. It should be integrated into the work of the team leader, library, or institution in order to maintain commitment to this type of work into the future. Finding a topic that truly piques interest and satisfies a need on campus will allow sustainability for the length of the AiA program.

Projects can consider any aspect of the library (e.g., collections, space, instruction, reference, etc.) but must ultimately be tied to student learning (e.g., course, program, degree) or success (e.g., retention, completion, persistence). The project organizers do not expect that all projects will be designed to yield generalizable results as you would expect of findings from social science research conducted from a positivist perspective or determine meaning or relevance as in qualitative social science research methods. However, many projects will be replicable at other libraries or contain elements which will be transferable to other settings. Two ACRL resources may help stimulate thinking about potential project topics: Standards for Libraries in Higher Education (see principle 3, Educational Role) and Value of Academic Libraries: A Comprehensive Research Review and Report (see research agenda, beginning on p. 101).

When applying to the AiA program, some of the successful applicants for the first year of the program stated their central inquiry questions as:

  • Do students who attend information or media literacy sessions attain higher grades than students who did not?
  • How does students’ work with special collections materials affect their ability to think critically and develop intellectual curiosity?
  • Do re-admitted students (who have appealed dismissal) improve their academic performance and persist at a higher rate due to mandatory meetings with a librarian for research assistance?
  • Does our new library/learning resource center facility have an impact on the student community, contributing to student enrollment and excitement about completing skills sessions and library orientations?

Other potential action learning project topics that applicants may propose could include:

  • What is the relationship between use of library-provided electronic journals and the rate/speed of degree completion for chemistry graduate students?
  • Do students in selected presentation-intensive courses who practice in library presentation rooms have better learning outcomes, as measured by course grade?
  • Our optional library instruction sessions are well-attended by those students who have some of the lowest GPAs on campus. Why is that? What could this suggest about better supporting these students?
  • On our campus, transfer students taking a course with an assigned reference librarian consultant during their first semester have a much higher retention rate. What factors are contributing? What can we learn about continuing to help transfer students succeed?
  • History majors at our college who use primary sources from our campus special collections during their junior year persist at a higher rate than those who use primary source materials from other archives and collections. To what extent is this attributed to qualities of faculty members who are more likely to partner with the library? To what extent can we claim an impact due to student use of materials and interactions with staff members in our library special collections?
  • We have a grant program for faculty and librarians to collaborate on the redesign of courses that incorporate the research process as a central element. What is the impact of this program on student learning?

Librarian team leaders in the 2013-14 AiA program shared their advice on how to define a project:

  • “We came up with a project for AiA; I think things would have worked out better if we had already had a project, or at least a research question that we wanted answered.”
  • “I would have created a SWOT analysis ahead of time in an effort to identify my problem areas before starting the (application) process.”
  • “Don't worry about not knowing much about assessment…the program guides you through getting some sort-of assessment off the ground. Have a project (topic) really thought out so you aren't scrambling to implement.”
  • “It's important to get a big picture of the overall planning and implementation before rushing into designing a project. Learning to be a leader is definitely part of the process.”
  • “Use ACRL and AiA to leverage resources you need for your project on campus. We have been able to use the national aspects of this project to generate interest among some faculty members and get things moving that would have never gotten moving without the leverage.”

Expectations of Librarians as Team Leaders
Being a librarian team leader in the AiA program will help develop professional skills by applying the program learning outcomes in the real-world context, building more effective campus collaborations in the process. Librarians who participate will improve their skills as effective leaders when they facilitate their campus team in completing an action learning project. Furthermore, librarian team leaders will dedicate themselves to engaging with each other as a learning community, as described in the following section on being members of a community of practice.

Participants should understand that being part of the AiA learning community is a continuous year-round commitment, including the summer. During the middle phase of gathering and analyzing evidence, an intensive effort is expected. At other points during the program, approximately 2-5 hours per week are anticipated. Librarians who participate in the program will both actively contribute to a community of practice by providing peer support to each other and lead their campus teams to facilitate the execution of an action learning project.

Librarian team leaders will participate in a 14-month long professional development program, with sequenced learning events and activities at key junctures. The AiA program includes team-based activities carried out on participant’s campuses. Librarian participants will submit a final project report at the conclusion of the program and prepare and deliver a poster and brief report describing their projects and their learning. Team leaders will engage in activities on campus such as:

  • Creating a project timeline and goals, monitoring progress, and adjusting as needed.
  • Facilitating the team’s work by drafting agendas and scheduling regular meetings with team members and allies.
  • Securing funding, if any, for project activities (e.g., incentives for survey completion, printing of poster).
  • Assuming responsibility for ensuring application to institutional review board, if necessary.
  • Enlisting others to provide specific skills/expertise if the team needs additional support to complete the project.
  • Effectively communicating about the project, its goals and accomplishments to library leaders, the campus community, and possibly external stakeholders.
  • Serving as the main point of contact for the institution to ACRL design team and staff for the duration of the program.

While the bulk of the support for the AiA learning community will take place virtually through an online asynchronous classroom, live online meetings, and webcasts, librarian team leaders are expected to attend three in-person events and must secure funding as the terms of the IMLS grant to ACRL do not include participant travel. The three events are scheduled in conjunction with the ALA Midwinter Meeting and Annual Conferences as follows:

  • Thursday, June 26, 2014, 1 p.m. - 5 p.m., and Friday, June 27, 2014, 8:30 a.m. - 12:30 p.m.: Las Vegas, NV. Year 2, first meeting.
  • During January 22-27, 2015: Chicago, IL. Year 2, second meeting (full day, date TBD).
  • June 25-30, 2015: San Francisco, CA. Year 2, poster session (two slots to choose from, dates TBD).

By submitting an application, librarian team leaders agree to meet these expectations to the best of their ability if the application is accepted. New or substitute team leaders may be identified only in extreme cases.

Librarians in the 2013-14 AiA program shared their advice on leading team projects:

  • “It's a lot more work than you think...Pick something small to start.”
  • “Be flexible and [have] patience with the process. If you are not currently working at a campus where libraries drive assessment campus wide be prepared for the struggle of trying to break the barriers of inclusion and providing your relevance to faculty.”
  • “While there is support, a majority of the work and responsibility rests on the team leader. Applicants should sincerely be enthusiastic about the project and receive administration support...Do you have the time to work on your project? Are you comfortable in creating a team and asking for help?”
  • “The AiA experience is great; however it is a significant time commitment, which is important for supervisors/directors to know.  If possible, secure ‘release time’ from supervisors before embarking on this project.”

Expectations of Librarians as Members of a Community of Practice
The AiA program is designed so that librarian team leaders learn together and actively support each other, providing insight and perspective. Through a peer-to-peer collegial network, the librarian team leaders will support collective learning, shared competence, sustained interaction, and a climate of mutuality and trust. In the process, a “community of practice” will develop. As Etienne Wenger explains, “Communities of practice are groups of people who share a concern or a passion for something they do and learn how to do it better as they interact regularly.”[1]. Find out more about the AiA approach to developing a peer-to-peer collegial network and community of practice on the program homepage.

Librarian team leaders in the 2013-14 AiA program stressed the importance of their active roles in supporting each other:

  • “Think of this program as truly about developing a community of practice with your AiA cohort and on your campuses. The AiA facilitators provide excellent learning opportunities but cohort members need to be self-directed and responsible to each other for learning and developing their projects.”
  • “Expect to be active participants in the learning community – i.e., participation in the project not only results in a campus-specific assessment project but also the creation of a professional community of practice. (Your) participation in the learning activities is critical to the development of this community of practice.”
  • “You need to devote time to (regular online) work every week because others (librarian team leaders) are depending on you, even if your campus is very busy that week… The online environment is where (you) will interact the most.”

Expectations of Campus Team Members
Being part of the AiA learning community is a continuous year-round commitment. The involvement of team members will vary depending on project role.

All team members will engage in a peer review process, providing feedback about projects being developed by other participating teams. The projects will be documented and disseminated, via poster session and in online project reports via the ACRL website, for use by the wider academic library and higher education communities.

Librarian team leaders in the 2013-14 AiA program shared their advice on finding team members who can commit to being involved:

  • Make sure to have campus buy-in and teammates who are focused on assessment. Having an Institutional Researcher or someone from the Assessment Office on the team would be a good idea.”
  • “It is imperative to choose campus partners wisely; those individuals who can make significant contributions to a team project.”
  • “Mak(e) sure your campus partners have a good understanding of time commitment going in, and recogniz(e) how much work and planning there will be on your part to keep the campus partners engaged.”
  • “Make sure that others on your team are committed to helping out with work, rather than seeing themselves in only an advisory role.”
  • “Be very clear with those you invite to be part of your campus team that it will require some level of work/communication over the summer. As someone in a 12-month position, it can be easy to overlook the fact that teaching faculty may be away and less likely to engage during the summer months.  Strategically planning for this would have been helpful – creating designated 'email check in' dates or something like that.

Timeline
As a general guide, librarian team leaders who are selected for the second year of the AiA program can expect to participate in a range of activities as follows:

This timeline is just one way of illustrating a team leader’s involvement in the AiA learning community and how a project could be executed. Because individual action learning projects vary greatly according to institutional needs and priorities, the AiA program offers flexibility. For example, some teams may gather and analyze evidence at a later time than others.

Costs
There is no registration fee for participating in the second year of the AiA program. For the first two years, the IMLS grant covers the majority of the costs for developing and delivering the AiA program. Librarian team leaders need to secure their own funding for travel to three in-person events: June 2014 (full day meeting), January 2015 (full day meeting), and June 2015 (poster session). Librarian team leaders who are only attending AiA meetings in June 2014 and January 2015 do not have to register for the full ALA conference. In order to present their posters, librarian team leaders must register and pay for attending the 2015 ALA Annual Conference.

Other costs to develop and implement projects will be carried by the institution (e.g., incentives for survey completion, printing of poster, etc.). In the third year, the IMLS grant will subsidize only part of the costs and ACRL will implement a registration fee as the program transitions to a cost-recovery model.

Preparing Applications
Begin the application process early and prepare and submit materials as soon as possible. It takes time to consult with colleagues in the library, meet with prospective team members across campus, secure commitment, scope out an area of interest for the team’s project, write the essays, arrange for travel funding, and request statements of support. The application requires two essays – the first describes the team’s project goals and the second describes the goals of the librarian team leader – and statements of support from the library dean/director and campus chief academic officer. Each piece is described in detail, below.

Essay #1 on the team’s project goals may be up to 300 words long. The essay should clearly explain the central question which would be investigated through this project, the goals the college/university has established for carrying out a project as part of the AiA program, and how the central question and the contributions of the library align with those goals. If the team has a particular method in mind for collecting data, include that briefly. Explain the ways in which the proposed project has the potential to make a contribution to assessment work in other libraries or higher education. Given what you know about existing assessment endeavors in other academic libraries, what is distinctive or unique about your proposed project? What could others learn? The essay could address questions such as: What aspects of student learning or student success are most important at the institution? Has your college of university developed student learning outcomes/goals across the institution that the library has potential to impact? What aspect of the library (e.g., collections, space, instruction, reference, etc.) are related to the project? What connections would be explored as the basis for the action learning project? How has the library been involved in past assessment efforts? Why is this the right time for the institution to take on this project? Why are the chosen team members the right mix of people given the team’s area of interest? What do their positions and experience bring to this project? (Campus team members are identified fully by name and title/position elsewhere in the application.)

Essay #2 on the goals of the librarian team leader may be up to 300 words long. The essay should briefly explain the team leader’s professional background for undertaking the work described in essay #1 (i.e., attended conferences, webinars, presented papers, etc.) and length of time in the profession (newer and less experienced librarians will not be penalized). Explain the strengths, skills and attitude the team leader will bring to the collaborative learning community and to the role as team leader on campus. The essay should briefly state personal goals for professional growth in assessment competency and leadership acumen.

Statement of Support #1 from the library dean or director may be up to 500 words long and should address the commitment of the library to assessment, the dean or director’s role in that process, and indicate how the institution will support the team’s project over the course of the AiA program. The statement does not need to be uploaded or faxed on formal letterhead. Simply copy and paste the final text of the statement provided by the dean/director into the online application form.

Statement of Support #2 from the campus chief academic officer (i.e., provost or vice president for academic affairs) may be up to 500 words and should address how the team’s project goals are connected to institutional priorities. The statement does not need to be uploaded or faxed on formal letterhead. Simply copy and paste the final text of the statement provided by the chief academic officer into the online application form.

Application Instructions and Deadline

  1. Each application must identify a librarian team leader who will receive notification of the team's acceptance or rejection. If the team's application is accepted, the librarian team leader will serve as the main point of contact for the ACRL design team and staff for the duration of the program.
  2. Once the online application process has begun, statements can be revised as many times as needed until they are complete and ready to submit. No deadline exceptions will be granted.
  3. Have the following information prepared before beginning the online application form:
  1. Names, titles, affiliations (i.e. department, office, or school), and contact information for all team members.
  2. Two essays.
  3. Two statements of support.
  1. The online application for the second year was due 5 p.m. Central, Friday, March 21, 2014. Incomplete applications can be saved and edited or additional information can be added before the submission deadline date. An ID number and password will be assigned when the proposal is submitted. Be sure to print the ID number and password and keep them in a safe place; these will be needed in order to edit the proposal at a future time.
  2. Please note that this is a team application process and acceptance into the program is based, in part, on who is identified as members of the team.

Application Deadline
The deadline has passed. It was Friday, March 21, 2014, 5 p.m. Central. Stay tuned for more information in late 2014 about the third year of the program.

Notifications
The librarian team leader listed on the application will be ACRL’s primary contact. All applicants will be notified of their status via e-mail by 5 pm Central on Tuesday, April 22, 2014.

See the application frequently asked questions for more details about applying.

Questions may be directed to ACRL Senior Strategist for Special Initiatives Kara Malenfant at kmalenfant@ala.org or 312-280-2510.