Task Force on Academic Library Outcomes Assessment Report

June 27, 1998

I. Context and Background

Some fifteen to twenty years ago higher education began to focus on measuring the outcomes of its programs as the primary indicator of quality. The forces that impelled this focus included a restructuring of the criteria of the regional accrediting agencies to emphasize assessment, the interest of state legislatures and federal agencies in requiring accountability of the institutions they that fund, and the desire of the institutions themselves to market their product as "high quality" to a (then) shrinking population of college-bound students. Virtually every state higher education coordinating board now requires public institutions to annually provide accountability data in terms of output measures. Recently, a broad coalition of six associations of colleges and universities, representing a majority of the nation's institutions of higher education issued a statement explicitly rejecting accrediting agencies' requiring specific inputs, rather than examining outputs (NASULGC, 1997).

The formation of the Task Force was a response to the ACRL Board's perception that the association has no statement on outcomes assessment, and that its standards, largely written as input measures, are out of step with the practices and philosophy of regional and professional accrediting agencies and state higher education agencies. Appointment of this Task Force was approved by the ACRL Board of Directors at its 1996 Annual Meeting in New York (Board Document 11.0, ACRL Board of Directors, June 1996.)

The issue of standards and higher education accrediting agencies is not a new one for ACRL. An Initiatives Fund request came from the University Libraries Section in the Spring of 1994 as part of the routine programmatic funding of ACRL section activities. The proposal was "to conduct a study of how university library standards are used by accrediting agencies." (Memo from Althea Jenkins to Susan Campbell et al., July 22, 1994.) This request was considered at the Spring 1996 meeting of the Executive Committee, which recommended the original proposal be expanded to cover all types of libraries.

As a result the ACRL Board at its summer 1994 meeting approved the formation of a Standards Study Task Force. This body was chaired by Edward D. Garten, University of Dayton and was charged to develop "a plan for looking at how accreditation agencies view libraries and in particular how they use the ACRL Standards as part of their accreditation process." (Task Force Report, May 30, 1996.) Continuing, the Task Force Report says: "The plan was to identify methodology, costs and time line for such a study and was to be submitted to the Board at Annual Conference 1996."

The Standards Study Task Force reached several conclusions (Task Force Report, May 30, 1996):

  1. The current climate in which accreditation agencies operate is considerably problematic and that issues related to academic libraries may well be, at this time, on a lower priority level with these agencies;
  2. The current ACRL Standards do not address well many of the contemporary concerns being discussed by both professional and regional accreditation bodies, e.g., outcomes and assessment measures, support for distance delivery of education, and rapidly emerging and changing instructional and information technologies; and
  3. Within their criteria, few accreditation agencies have begun to address the radically changed academic library environment.

Based on these conclusions the Task Force felt that its charge was inappropriate and instead made two recommendations:

  1. The Executive Director of ACRL send a copy of the Standards, once revised, to the executive directors of all professional and regional accreditation associations. A letter should accompany the standards expressing the hope that these Standards might be made available, as a reference, to the associations' pools of consultant-evaluators.
  2. In lieu of a study, that ACRL consider sponsoring a forum on "Accreditation Issues and Academic Libraries," to which would be invited the executive directors of the six regional accreditation agencies, representative from selected professional accreditation agencies and a group of academic librarians with proper accreditation experience. The goal of such a forum would be to identify and reach consensus on those contemporary information technology and library developments which may be useful in informing the development of new or revised accreditation criteria or standards.

With this as background the Board noted that the ACRL Standards had remained largely focused on inputs and were out of step with the regional and professional accrediting agencies' philosophies and standards. The Board also noted its strategic plan called for ACRL to be more influential in the environment of higher education associations. 1995/96 ACRL President Patricia Breivik had been deeply involved in working with regional accrediting agencies regarding information literacy, and had personally observed how the lack of an outcomes assessment position left ACRL in a difficult position. She therefore drafted a motion to create and charge the current Task Force on Academic Library Outcomes Assessment.

Although the new Task Force was initially also called a Standards Task Force (due to a confusion between two separate Board agenda items unfortunately given the same document number), the charge was much broader than standards and the name was soon corrected to the present Task Force on Academic Library Outcomes Assessment.

The Task Force has been given three charges:

  1. Develop a philosophical framework for assessing libraries in terms of desired campus outcomes;
  2. Develop prototypes for such assessment; and
  3. Develop a recommendation for one or more processes for implementation of the former (#2) with a time frame for completion.

The Task Force has held meetings at three ALA conferences and between meetings has had access to the works listed in the bibliography in section VI of this report for study and research. The first of these meetings was designed to help the Task Force better understand the accreditation process and its use of outcomes measures. The Task Force held a forum at the Midwinter '97 meeting in Washington with Larry Braskamp, Executive Director of the Council on Higher Education Accreditation (CHEA) and Barbara Brittingham, who is active in both the National Council for Accreditation of Teacher Education (NCATE) and the New England Association of Schools and Colleges. At the ALA annual conference in San Francisco '97 the Task Force discussed the shape of the report as well as key issues and perspectives to be included. Task Force members were assigned responsibilities for drafting sections of the report. At Midwinter '98 in New Orleans the Task Force held a public forum attended by some 28 people at which many aspects of the issue were discussed. The Task Force held additional meetings to discuss drafts of the report and made plans for hearings at ALA Summer Conference '98 in Washington, D.C. The Task Force is now ready to present its findings and recommendations to the Association.

The apparent conflict between input standards on the one hand and the trends towards greater attention to outcomes as a method of assessment has been a profession-wide concern as evidenced by the many articles in the literature. (See bibliography in section VI of this report.) However, none of the literature has developed the kind of philosophical statement about input standards and outcome assessment that creates a new synthetic paradigm or clearly articulates a relationship between ACRL's current Standards, and the outcomes assessment approach used by regional accrediting agencies. Even though ACRL's Performance Measures for Academic Libraries Project (VanHouse, 1990) led to useful methodologies of output measures, this did not have any impact on the revision of the College Standards in 1995. This Task Force report therefore includes suggestions for incorporating outcomes assessment into ACRL standards, as well as for using them in other contexts.

II. Definitions

The usefulness of this report is contingent on the clarity of the terminology it employs. "Outcomes," "inputs," and "standards" are key terms in this document. They are, in fact, frequently used in any discussion of library assessment. The meanings commonly attached to them are sufficiently varied, however, to warrant preferred definitions for the purposes of this report.

Outcomes , as viewed by the Task Force are the ways in which library users are changed as a result of their contact with the library's resources and programs. Satisfaction on the part of a user is an outcome. So is dissatisfaction. The Task Force considers simple satisfaction a facile outcome, however, too often unrelated to more substantial outcomes that hew more closely to the missions of libraries and the institutions they serve. The important outcomes of an academic library program involve the answers to questions like these:

  • Is the academic performance of students improved through their contact with the library?
  • By using the library, do students improve their chances of having a successful career?
  • Are undergraduates who used the library more likely to succeed in graduate school?
  • Does the library's bibliographic instruction program result in a high level of "information literacy" among students?
  • As a result of collaboration with the library's staff, are faculty members more likely to view use of the library as an integral part of their courses?
  • Are students who use the library more likely to lead fuller and more satisfying lives?

Questions like these are difficult to answer. That is to say, empirically rigorous measurement of academic library outcomes is hard to do. This Task Force firmly posits, however, that it is changes in library users such as the ones addressed in these questions that comprise the outcomes with which academic librarians should be concerned. It may be that these outcomes cannot be demonstrated rigorously, or in a short period of time, or even by very many institutions. The Task Force believes that they can be measured, however, and their relationship to resource inputs and program inputs can be meaningfully determined, through careful and lengthy research. However, the work of Cameron and others has shown that, for the purposes of accrediting agencies and state education authorities' accountability requirements, such rigor is not necessary to produce meaningful results. Nevertheless, it is the considered opinion of the Task Force that information resulting from such research would allow the crafting of the next generation of standards for academic libraries.

A distinction is to be made between "outcomes" and "outputs." "Outputs" serve to quantify the work done, i.e., number of books circulated, number of reference questions answered. They are valuable measures for making decisions about staffing levels, setting library hours of operation, and so forth. However, they do not relate these factors to the overall effectiveness of the library in affecting user outcomes. It is important to track the library's outputs, but insufficient for assessing outcomes.

Inputs are generally regarded as the raw materials of a library program--the money, space, collection, equipment, and staff out of which a program can arise. As such, the measurement of inputs, or the specification of quantities of them by standards, is viewed by some as a primitive, or at leastinsufficient, way of handling library assessment. A common argument is that it is not so important to determine how much is put into a library in terms of collection and staff, but, rather, what is done with those inputs in terms of, say, faculty/librarian collaboration or bibliographic instruction programs. Some observers are even inclined to term these latter activities the "outputs" or "outcomes" of a library program. This task force does not agree with that interpretation.

Instead, the Task Force holds that all raw materials and activities alike, are "inputs." A distinction may usefully be made between a "resource input," such as a database subscription or a staff member, and a "program input," such as a bibliographic instruction session or any interlibrary loan service. It is not so useful, however, to automatically assign a higher level of importance to one category of input or the other. A large collection of books may contain many items that go unread, and are essentially worthless. On the other hand, an ineffective bibliographic instruction project is also of little value, regardless of the number of students it involves. Carrying the argument further, a thoughtfully-conducted expansion of a staff's size may result in a more effective collection and a better bibliographic instruction program, and a budget increase might make it all possible. In sum, the purpose of all inputs--whether of the resource or program variety--is to achieve outcomes.

The term standards is used to refer to formal documents, such as the ACRL's Standards for College Libraries , or to refer to the actual or proposed provisions of those documents. It is particularly when new standards are being considered that questions arise regarding the nature of standards. Considerable guidance in the formulation of standards is provided by the definition adopted by ACRL:

"Standards are policies which describe shared values and principles of performance for a library serving a Carnegie-classified institution. In order for a document to be classified as a standard it must:

  1. Present goals for programs, services, and staffing toward which the profession aspires.
  2. Serve as a rule or model for quantity, quality, extent, or level of suitability.
  3. Support representations that are qualitative and/or quantitative both of which are in the process of continuing review.
  4. Act as a criterion for decision and actions in the academic community, confirming the planning and administration of library service with regard to value, quality, and suitability.
  5. Include statements expressed in relative terms, relating performance to norms derived from a reference population."

This Task Force accepts the ACRL definition of "standards," and interprets it to mean that standards should directly address the quantity, quality, extent, and level of suitability of programs, services (which include the availability, in a variety of formats, of a collection), and staffing in academic libraries. The Task Force also holds that standards should be reviewed regularly to ensure that the programs, services, and staffing practices they treat are germane to the current state of the profession. The Task Force further believes that standards should be based on evidence of normative practice or (and on this point it goes beyond the ACRL definition) programmatic success as determined by the measurement of outcomes.

III. Principles for Applying Outcomes Assessment to Academic Libraries

Outcomes assessment is an integral part of the institutional effectiveness cycle of planning, implementation, assessment, and improvement of the plan. While libraries have traditionally maintained myriad output data (e.g., number of books circulated, number of items cataloged, number of reference questions answered), these data alone do not demonstrate whether the library's mission is being accomplished, and with what degree of quality. The purpose of outcomes assessment of academic libraries is to measure their quality and effectiveness, focusing on an organizational analysis of the library as a whole, and of its constituent activities and services, and the contributions they make to accomplishing the purposes of the university or college of which it is a part. It follows from this purpose that outcomes assessment must begin with an analysis of the parent organization's mission, goals, and objectives, and an identification of the elements of them that the library supports. Assessments should include all such elements: learning/teaching, research, service, administrative processes, and whatever other purposes the institution pursues. All constituencies the library serves should be included: students, faculty, staff, alumni, and possibly other external constituencies. There can be no one set of universally standard desirable outcomes for all academic libraries, as the outcomes must depend on the institution's nature and mission. However, the processes of assessment can be generalized among institutions.

Assessments should be client centered rather than institution centered; that is, they should assess changes in the library user resulting from library services or resources. However, outcomes should be related back to inputs wherever possible, in order to identify and establish "best practices." For example, if an institutional purpose is to confer doctoral degrees, the library's effectiveness in contributing to high quality dissertation research could be shown to be related to the size and quality of its collections in the relevant disciplines, or to the efficiency of its interlibrary loan service.

Assessments of library outcomes should be integrated with the campus' overall assessment efforts. If there is a campus institutional effectiveness officer, s/he can work with the library to coordinate efforts between units. For example, if the institution conducts exit interviews or surveys, questions about library use and satisfaction can be incorporated into such existing assessments. However, if there is no institution-wide assessment program, the library can nevertheless conduct its own stand-alone program.

Outcomes assessments should include a variety of methodologies so that conclusions may be corroborated. For example, Cameron (1978) demonstrated that a survey of administrators' perceptions of organizational effectiveness, compared with verifiable data (e.g., graduation rates) showed that the perceptions tended to be accurate. Therefore, properly conducted surveys of perceptions can accurately serve as proxies for analytical data. In general, outcomes assessments of other parts of the university include both perceptual surveys (e.g., student satisfaction) and objective data (e.g., retention rates).

Assessment of outcomes need not address every possible aspect of each library service. Cameron and others recommend selecting a small number, no more than half a dozen, of key outcomes for the area to be assessed, with relevant criteria of quality. The assessment measures themselves need not demonstrate scientific rigor, but should be easily administered and reasonably reliable. Because assessment is strongly linked to planning, both in accreditation requirements and in practical usefulness, assessments should be designed to provide information that can be used to improve services. Finally, outcomes assessment should be a continuous, adaptive process.

IV. Samples of Outcomes Assessment

The literature search conducted for this report revealed that there has already been considerable work done by librarians in this area. Pritchard's (1996) literature review "Determining quality in academic libraries," identifies over seventy citations to writings on the subject, although by no means a majority of them concerned specifically with outcomes assessment. Specifically germane is the work of Bonnie Gratch Lindauer (1997), which will be used (with permission) to provide an example. In the following chart, the standard process of outcomes assessment is illustrated: 1) determination of desired outcomes, in this case following from the objectives of a specific course; 2) establishment of indicators that the outcomes have been met; and 3) methods of collecting the data that reveal whether the outcome was achieved.

 

Selected Information Literacy Outcomes
Outcome Indicator Data Collection Method
Student recognizes when information is needed, can clarify aspects of the information, and can formulate clear questions based on the information need. Student self-assessment indicates rating of "good" or better. Self-assessment
Satisfactory performance on topic formulation assignment. Assignment
Student matches information needs to information resources and can organize an effective search strategy. Rating of search log shows evidence of an effective search strategy. Analysis of search log
Scores on test/assignment that measures ability to formulate research questions and devise a search strategy based on simulated information needs scenarios. Test/assignment
Student self-assessment indicates rating of "good" or better. Self-assessment
Student interprets bibliographic citations and the internet equivalents and knows how to locate/retrieve cited items. Scores show acceptable performance decoding citations and how to retrieve. Test/assignment
Research paper/other products show evidence of retrieval of items. Rating of bibliography or other products
Student seeks various sources of evidence to provide support for a research question or conclusion. Scores of research paper/other products' references/bibliographies show variety of appropriate sources. Rating of references or bibliographies; portfolio analysis

The forgoing examples are of very small, specific outcomes, as they relate to a specific course in library use. Assessing outcomes for entire library programs will of necessity be much more global and general. Nevertheless, the foregoing exemplifies the general methodology of focusing on the user and the changes in her/his knowledge, abilities, and actions occasioned by interaction with the library's collections, services, and programs. Following [again from Lindauer (1997)] is an example of outcomes assessment for promotion of a program of library literacy. It demonstrates an assessment of work with internal clients, the teaching faculty.

Selected Good Practice Outcomes
Outcome Indicator Data Collection Method
Disciplinary faculty-librarian relationship is formalized, and tangible results of it are demonstrated by assignments using library/information resources across the curriculum. Descriptive report about number, type, extent of library research and information literacy-related assignments. Syllabi analysis; library use/instruction statistics analysis.
Syllabi and course assignments include information literacy skills development through various learning activities and use of library/learning resources Descriptive report summarizing number, type, extent of library research information literacy-related assignments Course assignments and syllabi analysis.
Active learning strategies (i.e., problem-solving assignments, group work; hands-on assignments) using a variety of information resources are used. Descriptive report summarizing number, type, purpose and student opinion about effects of various teaching methods. Syllabi analysis; peer observation; student survey/self-assessment.

In the foregoing example, the desired changes are in the skills and attitudes of the faculty, not their students, and shows that it is possible for libraries to apply this regimen to all segments of their clientele, not confined to student outcomes.

V. Implications for ACRL

The Task Force envisions next steps in several areas that might be undertaken by the Association to promote the development and use of outcomes assessment for academic libraries. They fall under the general rubrics of policy, accreditation, and standards.

A) Policy
It is recommended that the ACRL Board adopt an explicit policy of endorsing the development and use of outcomes assessment among academic libraries. Having such a policy in place will demonstrate that our interests coincide with those of the federal and state education agencies, other higher education associations, accrediting bodies, and the planning/evaluation mechanisms of the colleges and universities we serve. A proposed resolution accompanies this report.

B) Accreditation
The Task Force recommends that ACRL foster continued cooperation with the regional and specialized accrediting agencies. Once accepted, this report and the policy resolution should be distributed to each of the regional and CHEA-member associations. ACRL members have in the past been speakers at the annual meetings of the regional associations, principally to discuss information literacy, and give tips on the library-related accreditation criteria. ACRL should sponsor speakers and seek speaking opportunities at accreditors' meetings on the subject of outcomes assessment of libraries. The level of interest the Task Force found in the accreditors invited to our January 1997 forum suggests that such presentations would be welcomed with enthusiasm.

C) Standards and Guidelines
ACRL does not promulgate standards at the division level; rather, each type-of-library section writes separate standards that are then approved by the ACRL Board. This has led to a set of standards that demonstrates no consistency of approach or methodology. This multiplicity of approaches to standard writing can appear baffling to groups outside the association, such as the campus leaders to whom our libraries report. The Task Force recommends that the Board charge the ACRL Standards and Accreditation Committee to develop "Standards for ACRL Standards," which require the standards-writing committees to follow similar formats and approaches in their efforts. This document will require Board review and approval. Such directions will include a requirement that future revisions incorporate methodologies for establishing outcomes and their assessment. Standards writers should not prescribe a set of universally desirable outcomes, bearing in mind that each library's desired outcomes must flow from its parent institution's own unique mission and vision. Wherever possible, inputs should be related to and support desired outcomes, rather than vice-versa.

Guidelines are not of the same nature as standards, and it seems that not all of them are amenable to incorporating outcomes, e.g., "Guidelines Regarding Thefts in Libraries." The ACRL Standards and Accreditation Committee (SAC) will work with each committee charged with revising standards and guidelines to determine which ones should be recast to incorporate outcomes assessment.

SAC will also be responsible for re-establishing the cycle of standards and guidelines review and revision (list appended). In general, SAC should be delegated the necessary authority to implement the Board's philosophy on the content of standards, not just to review their format and technical aspects. Appointees to this committee should have demonstrated experience with standards writing or application, or with work on accreditation issues or visiting committees. The ACRL Board itself should be more exacting in requiring the standards and guidelines that bear the Association's name to meet its requirements and expectations for outcomes assessment as well as other established requirements. The timeline for implementing these recommendations is best set by SAC, which will be mainly responsible for implementation.

VI. Bibliography

  1. [ACRL] Guidelines for university undergraduate libraries. (1997). College & Research Libraries News, 1997 no. 5, 330-333.*
  2. ACRL guidelines for extended campus library services. (1990). College & Research Libraries News, 1990 no. 4, 353-355.*
  3. [ACRL] Standards for college libraries, 1995 edition. (1995). College & Research Libraries News, 1995 no. 4, 245-57.*
  4. [ACRL] Standards for community, junior, and technical college learning resources program. (1994). College & Research Libraries News, 1994 no. 9, 572-85.*
  5. [ACRL] Standards for university libraries: evaluation of performance. (1989). College & Research Libraries News, 1989 no 8, 679-691.*
  6. American Association of University Professors. Committee C on College and University Teaching, Research and Publication. (1990). Mandated assessment of educational outcomes: a report of Committee C on College and University Teaching, Research, and Publication. Academe, 76, 34-40.
  7. Cameron, Kim. (1978). Measuring organizational-effectiveness in institutions of higher-education. Administrative Science Quarterly, 23, 604-632.
  8. Cameron, Kim. (1980). Critical questions in assessing organizational effectiveness. Organizational Dynamics, 9, 66-80.
  9. Cameron, Kim. (1986). A study of organizational effectiveness and its predictors. Management Science, 32, 87-112.
  10. Carpenter, Ray L. (1981). College libraries: a comparative analysis in terms of the ACRL standards. College and Research Libraries, 42, 7-18.
  11. *Asterisked items appear to the Task Force to meet the criteria for "standards" quoted on page 5 of this report.
  12. Coleman, Paul, Jarred, Ada (1994). Regional association criteria and the standards for college libraries: the informal role of quantitative input measures for libraries in accreditation. The Journal of Academic Librarianship, 20, 273-84.
  13. Cox J.R.W., Mann L., Samson D. (1997). Benchmarking as a mixed metaphor: disentangling assumptions of competition and collaboration. Journal of Management Studies, 34, 285-314.
  14. Cullen, R.J., Calvert, P.J. (1995). Stakeholder perceptions of university library effectiveness. Journal of Academic Librarianship, 21, 438-48.
  15. Cummins, T.R. Developing Personnel and Staffing Standards. (1992). Library Administration & Management, 6, 182-86.
  16. Dill, D.D., Massy, W.F., Williams, P.R., Cook, C.M. (1996). Accreditation and academic quality assurance: can we get there from here? Change, 28, 16-24.
  17. Fitch, D.K. (Ed.) (1995). Libraries and Accreditation: Proceedings of the Annual Conference, Alabama Library Association, College, University, and Special Libraries Division (Huntsville, AL, April 13, 1993). Alabama Librarian, 46, 13-24.
  18. Folger, R., Konovsky, M.A., Cropanzano, R. (1992). A due-process metaphor for performance-appraisal. Research in Organizational Behavior, 14, 129-177.
  19. Frazer, S. (1994). Specialized accreditation: college library responses. College and Undergraduate Libraries, 1, 105-25.
  20. Garten, E.D. (1994). Challenge and practice of academic accreditation: a source book for library administrators. Westport, Conn: Greenwood.
  21. Goudy, F.W. (1993). Academic libraries and the six percent solution: a twenty-year financial overview. Journal of Academic and Librarianship, 19, 212-15.
  22. Gratch, B. (1997). Defining and measuring the library's effect on educational outcomes, CARL [California Academic and Research Libraries] Newsletter, 20, 2-5.
  23. Hernon, P., Altman, E. (1996). Service quality in academic libraries. Norwood, N.J.: Ablex.
  24. Hirsch, F.E. (1975). Library standards. In A. Kent et al. (Eds.) Encyclopedia of library and information science. (Vol.16, pp. 42-62). New York: Dekker.
  25. Humphreys, K.W. (1970). Standards in university libraries. Libri, 20, 144-155.
  26. Kania, A.M. (1988). Academic library standards and performance measures. College and Research Libraries, 49, 16-23.
  27. Kania, A.M. (1990). Self-study methods for the library and the LRC. New Directions for Community Colleges, 18, 81-90.
  28. Kaser, D. (1982). Standards for college libraries. Library Trends, 31, 7-19.
  29. Leach, R.G. (1992). Academic library change: the role of regional accreditation. Journal of Academic Librarianship, 18, 288-291.
  30. Lindauer, Bonnie Gratch. (1997). Assessing library learning to improve teaching and outcomes. Presented at ACRL 8th National Conference, Nashville, April 12, 1997.
  31. Lindauer, Bonnie Gratch. (1998). Compilation of core information literacy competency/outcomes for undergraduates. College & Research Libraries News, 59, 350.
  32. Lindauer, Bonnie Gratch. (1998) Defining and measuring the teaching-learning library's impact on valued institutional outcomes. Manuscript submitted to College and Research Libraries.
  33. Lynch, Beverly. (1987). Standards for university libraries. IFLA Journal, 13, 120-125.
  34. Madison, O. et al. (1994). A model for reviewing academic branch libraries based on ACRL guidelines and standards. College and Research Libraries, 55, 342-54.
  35. Measuring quality: international guidelines for performance measurement in academic libraries. (1996). (IFLA Publications, v. 76). New Providence, N.J.: Bowker-Sauer.
  36. Moran, M.(1978). The concept of adequacy in university libraries. College and Research Libraries, 39, 85-93.
  37. Morgan, S. (1996). Performance assessment in academic libraries. Australian Library Review, 13, 408.
  38. NASULGC board approves resolution on accreditation. (1997, November). NASULGC [National Association of State Universities and Land-Grant Colleges] Newsline, p. 8.
  39. Nichols, J.O. (1989). Institutional effectiveness and outcomes assessment implementation on campus. Agathon Press.
  40. Nordvall, R.C., Braxton, John M. (1996). An alternative definition of quality of undergraduate college education: toward usable knowledge for improvement. Journal of Higher Education, 67, 483.
  41. O'Neil, J. (1994). Aiming for new outcomes: the promise and the reality. Educational Leadership, 51, 6-10.
  42. Palmer, J.C. (1993). Institutional accreditation, student outcomes assessment, and the open-ended institution. New Directions for Community Colleges, 83, 49-59.
  43. Parker, D.C. (1995). "Standards for college libraries": foundations. College and Research Libraries News, 1995 no. 5, 330-1.
  44. Peters, R. (1994). Accountability and the end(s) of higher education. Change, 26, 16-23.
  45. Powell, R.R. (1992). Impact assessment of university libraries: A consideration of issues and research methodologies. Library and Information Science Research, 14, 245-257.
  46. Pritchard, S.M. (1996). Determining quality in academic libraries. Library Trends, 44, 572-594.
  47. Quinn, R.E., Cameron, K. (1983). Organizational life cycles and shifting criteria of effectiveness: some preliminary evidence. Management Science, 29, 33-51.
  48. Qureshi, N. (1980). "Standards for Libraries," In A. Kent et. al (Eds.) Encyclopedia of library and information science (Vol. 28, pp. 470-496). New York: Dekker.
  49. Sellen, M.K. (1991). Specialized accreditation and the library. (with summaries of standards from 25 agencies). Collection Building, 11, 2-8.
  50. Smart J.C. (1993). Organizational-effectiveness and mission orientations of 2-year colleges. Research in Higher Education, 34, 489-502.
  51. Tompkins, P. (1996). Quality in community college libraries. Library Trends, 44, 506-25.
  52. Van House, N. (1990). Measuring academic library performance . Chicago: American Library Association.
  53. Walch, D.B. (1993). The 1986 college library standards: application and utilization. (survey of 215 academic libraries). College and Research Libraries, 54, 217-26.
  54. Wallace, J.O. (1972). Two-year college library standards. Library Trends, 21, 219-232.
  55. Watkins, D.R. (1972). Standards for university libraries. Library Trends, 21, 190-203.
  56. Williams, D.E. (1993). Accreditation and the academic library. Library Administration & Management: 7, 31-37.
  57. Winston, R.B.; Moore, W.S. (1991). Standards and outcomes assessment: strategies and tools. New Directions for Student Services, 53, 63-82.
  58. Wolff, R.A. (1995). Using the accreditation process to transform the mission of the library. New Directions for Higher Education, 90, 77-91.


APPENDICES

A)Task Force membership
B) Task Force charge
C) Resolution recommended to the ACRL Board
D) Schedule for review of standards and guidelines: reset cycle

   

Appendix A
Academic Library Outcomes Assessment Task Force Committee Composition


Listserv: acrlstds-l@uno.edu

Chair

Jill B. Fatzer
1419 Burbank Dr.
New Orleans, LA 70122-2033
(504) 280-6556
Fax: (504) 280-7277
E-mail: jblfs@uno.edu

Members

Susan M. Anderson (CJCLS)
Director of Libraries
Saint Petersburg Junior College
P.O. Box 13489
St. Petersburg, FL 33733
(813) 341-3719
Fax: (813) 341-3658
E-mail: andersons@email: spjc.cc.fl.us 

Michael R. Blake (ULS)
61 Hancock St.
Somerville, MA 02144-3140
(617) 495-5353
Fax: (617) 495-5324
E-mail: blake@fas.harvard.edu

Willis E. Bridegam (CLS)
52 High Point Drive
Amherst, MA 01002
(413) 542-2212
Fax: (413) 542-2662
E-mail: webridegman@amherst.edu

Paul Coleman
Box 2225 WT Station
Canyon, TX 79016
(806) 656-2225
Fax: (806) 656-2213
E-mail: paulcol@wtamu.edu

Thomas Kirk
Lilly Library
Earlham College
Richmond, IN 47374
(765) 983-1360
Fax: (765) 983-1303
E-mail: kirkto@earlham.edu

Barton M. Lessin (ECLSS)
5048 Gullen Mall
Detroit, MI 48202
(313) 577-4373
Fax: (313) 577-3613
E-mail: b_lessin@wayne.edu

William Nelson
3317 Sugar Mill Road
Augusta, GA 30907-3628
(706) 737-1745
Fax: (706) 667-4415
E-mail: wnelson@aug.edu

Virginia S. O'Herron (Ex-officio)
152-203 Nina Dr.
Virginia Beach, VA 23462
(804) 683-4141
Fax: (804) 683-5767
E-mail: voherron@odu.edu



   

Appendix B


It is recommended that the ACRL Board establish a short-term task force to develop:

(1) a philosophical framework for assessing libraries in terms of desired campus outcomes;
(2) prototypes for such assessment; and
(3) a recommendation for one or more processes for implementation of the former (#2) with a time frame for completion.

This process should be developed in conversation with appropriate ACRL units in terms of their undertaking in this area and their ability to respond in a timely fashion. The outcomes of the task force's work---once approved by the Board---would then be referred to those existing ACRL units or, if need be, to a group established to provide direction for their efforts. The task force should consist of 5 members, one member each from the following sections: CLS, CJCLS, ULS, and ECLSS; one member-at-large and one Board member. The chair of the Standards Committee should be ex-officio.




   

Appendix C
A Resolution Adopting a Policy on Outcomes Assessment


WHEREAS the ACRL strategic plan emphasizes the importance of our association influencing the larger higher education environment, and

WHEREAS organizations prominent in that environment, such as accrediting agencies, higher education associations, and state boards of higher education have adopted the assessment of educational outcomes as their principal indicator of achievement and quality, and

WHEREAS cooperative projects between ACRL and such agencies show promise of producing new avenues for improving our libraries' support and status on their campuses, and

WHEREAS, such projects would be furthered by ACRL's policies and practices becoming congruent with national assessment trends,

NOW THEREFORE BE IT RESOLVED that ACRL adopt the following policy:
The Association of College and Research Libraries recognizes the assessment of outcomes as an integral means of determining the adequacy and quality of libraries and their programs. The association directs its constituent bodies to incorporate this concept into their various activities and policies, including the drafting of ACRL standards and guidelines.




Appendix D
ACRL Standards and Accreditation Committee
Schedule of Review: Reset Cycle

June 9, 1998

Standards
Committee Year of Review New Review Cycle SAC Liaison
1. Standards for Faculty Status for College and University Librarians (1992) Committee on the Status of Academic Librarians
Chair: Rush Miller
1997/98 B. Nelson
2. Standards for Ethical Conduct for Rare Book, Manuscript, & Special Collections, with Guidelines for Institutional Practice in Support of Standards (1993) RBMS
Chair: Laura Stalker
1998/99 B. Landesman
D. McCool assigned liaison after 7/1/98
3. Standards for Community, Junior and Technical College Learning Resources Programs (1994) CJCLS
Chair: Wanda Johnston
1999/2000 A. Dalwood
4. Standards for College Libraries (1995) CLS
Chair: Larry Oberg
2000/2001 C. Sheehy
5. Standards for University Libraries (1989; 1994; 1997) ULS
Chair Lori Goetsch
2001/2002 B. Lessin


Guidelines
Committee Year of Review New Review Cycle SAC Liaison
1. Guidelines for Media Services in Academic Libraries (1987) Media Resources Committee
Chair: Kristine Brancolini
1992 B. Lessin
2. Guidelines for Borrowing Special Collections Materials for Exhibition (1990) RBMS
Chair: Laura Stalker
1995/96 B. Landesman
D. McCool assigned liaison 7/1/98
3. Guidelines for the Security of Rare Books, Manuscript and Other Special Collections (1990) RBMS
Chair: Laura Stalker
1995/96 B. Landesman
D. McCool assigned liaison 7/1/98
4. Guidelines for Branch Libraries in College and Universities (1991) ULS
Chair: Lori Goetsch
note: CLS chair: Larry Oberg
1996/97 C. Sheehy
5. Guidelines on Collective Bargaining (1993) Committee on the Status of Academic Librarians
Chair: Rush Miller
1998/99 B. Nelson
6. ALA-SAA Joint Statement on Access to Original Research Materials (1994) RBMS
Chair: Laura Stalker
1999/2000 B. Landesman
Assign new liaison 7/1/98
7. Guidelines for the Loan of Rare Materials (1998) RBMS
Chair: Laura Stalker
1999/2000 B. Landesman
Assign new liaison 7/1/98
8. Guidelines for Distance Learning Library Services (1998) DLS
Chair: Nancy J. Burich
2000/2001 2000/2001 add outcomes component
9. Guidelines on the Selection of General Collection Materials for Transfer to Special Collections (1994) RBMS
Chair: Laura Stalker
1999/2000 D. Racine
10. Guidelines Regarding Thefts in Libraries (1994) RBMS
Chair: Laura Stalker
1999/2000 D. Racine
11. Guidelines for Academic Status for College and University Libraries (1990); 1996--no formal revision required Committee on the Status of Academic Librarians
Chair: Rush Miller
2000/2001 D. McCool
12. Guidelines for Instruction Programs in Academic Libraries (1997) Instruction Section
Chair: Randy Burke Hensley
2001/2002 C. Oberman
13. Guideline for Undergraduate Libraries (1997) ULS
Chair: Lori Goetsch
2001/2002 B. Lessin