ACRL OnPoint Chat Archive January 14, 2009: Student learning outcomes, the culture of assessment, and accrediting agencies

(12:00 p.m Pacific | 1:00 p.m. Mountain | 2:00 p.m. Central | 3:00 p.m. Eastern)

The next installment of the ACRL OnPoint chat series, “What Really are Student Outcomes,” will take place at 2:00pm CST on Wednesday, January 14.  Peter Hernon, Graduate School of Library and Information Science, Simmons College, will convene this month’s chat.

At the upcoming ACRL 14th National Conference in Seattle, Hernon will address student learning outcomes, which reflect changes in students (e.g., knowledge, skills, abilities) over the duration of a program of study. The
focus is on moving beyond course evaluation and assessment and developing a picture at the program level and institutional levels. Both regional and program accreditation organizations support (demand) this broader view of outcomes assessment, while still encouraging the application of student outcomes (for accountability purposes).  This focus on accountability, combined with using the results to improve the educational experience, has implications for creating a culture of assessment in libraries.

Transcript archive:

margotconahan Hi all from cold Illinois! This is Margot from ACRL. We'll be starting in a few minutes. Thanks for joining us this afternoon.

page2page here in South Dakota we have actual temp of -5, don't know the wind chill

Amy_Gustavson Greetings from East Carolina University!

CMK09 Hi All

lmaddengsu Greetings from Atlanta, GA, where it's actually quite cold today.

rshuff Hey Amy Gustavson! It's Ru

guest7601925 Hello from upstate NY - COLD!

sbrasley Greetings from So.Cal - great topic today!

aq8554 Hi from Detroit, MI. BBBRRRR!

kmcrowe Even pretty cold in NC but far better than our NE and Midwest friends

Simmons_Hernon A nice turn out. In Bosto, like upstate NY, COLD. Peter Hernon

amurrell Hi from San Diego, where it is warm!

InfoLitGal Are we supposed to be hearing anything?

nmurillo1 Hello from Chicago. At least it's warm in the library.

margotconahan OnPoint Chats are just text based, no audio.

jam_asulib It's 72 degrees and sunny in Phoenix!

Simmons_Hernon At 3pm Margot Conahan of ALA will kick this off. Peter

InfoLitGal shut up phoenix!

kmcrowe I agree

jam_asulib Hee!

catbark 55 in Norman, OK

Laurel Littrell I am in Kansas where it is cold but going to Phoenix next week so that is great!

cohenarl Signing on: Arlene Cohen in Nevada

amurrell does anyone know why my chat display keeps jumping to the top of the thread?

InfoLitGal it's 22 in NY NY with a wind chill in the single digits

colbysawyer It's 14 with a wind chill of 0 in central NH

InfoLitGal Are we suppose to see and/hear something - how do I get this?

Amy_Gustavson Hi rshuff! What a small world!

Simmons_Hernon I can see why someone in cold weather would spend time today chatting--but those of you in warm weather?

catbark Gotta work, man

amurrell lol broken ankle, so I;m stuck in doors and on my bottom

rshuff Hey All, Amy Gustavson is my mentee with the ACRL IS Mentoring program. Think this counts as our Jan. chat?? HA!

Amy_Gustavson Oh, I think so. :-D

margotconahan InfoLitGal, there is no audio, should should just see the chat thread.

InfoLitGal okey dokey thanks

rshuff I'm on board with that Amy

jammers146 signing on

ECalderon hi

cilibertia Hi everyone-there are a few of us in our group

pwatkins1 ERAU Prescott here

lareeves Is this the student outcomes chat?

pwatkins1 yep

margotconahan Sorry, all, I got a message that my post didn't make it through. Here I go again!

lareeves Yes, it is an hour later now, right?

cohenarl how do you remove that media item; I clicked x and remove but it didn't go away?

BobPh_ftw there is a litte arrow on the border (just found it myself)

margotconahan Can you confirm if my message was posted?

Amy_Gustavson On the divider, click between the triangles. It should minimize the media.

BobPh_ftw yes margo

cilibertia Hi Margot

keris2103 Thanks Amy - it worked!

cohenarl Yes, thanks; got rid of it.

margotconahan Peter, whenever you are ready, you can kick this off. Thanks again for joining us!

Amy_Gustavson You're welcome.

kathy.labadorf Is there supposed to be sound?

pwatkins1 no sound

pwatkins1 just chat

Simmons_Hernon Are my messages getting through?

pwatkins1 yes

eakidwell Yes

kmcrowe not to me

pwatkins1 peter?

jhenning not to me

margotconahan Hi Peter,

amurrell just the one asking if your messages are gettign through

margotconahan we can see your first message now.

PMKINNEY Hi Peter

Simmons_Hernon Are any of you engaged in assessment--stuent learning otucomes--at your place?

eakidwell Yes

BobPh_ftw yes

sbrasley yes

lrichel yes

ECalderon yes

jhenning not yet

Laurel Littrell Yes, Kansas State Univ

Simmons_Hernon If yes, doing what?

South7th No

Amy_Gustavson yes

jammers146 yes

PMKINNEY yes

eakidwell The Library and the core curriculum

nmurillo1 What do you mean by "engaged"?

kmcrowe no but will be doing it in the next year

InfoLitGal oh yeah

Laurel Littrell We have 5 learning outcomes and partner with teaching units to assess them.

lmaddengsu I've been charged with developing a plan for my university, but just getting started.

page2page yes pre/post tests

keris2103 Trying to design student and faculty survey tools.

lrichel giving student learning outcomes at beginning of class, then teaching them in the session, then testing the slo

sbrasley informal - using classroom assessment techniques; and formal - the iSkills test for diagnostic purposes

kmcrowe we've done pre/post test, too

Simmons_Hernon By engaged I mean doing student learning outcomes at PROGRAM level?

kathy.labadorf Yes, but want to do more.

lisalibrarian yes

Laurel Littrell Yes with the teaching departments.

nmurillo1 I've also been charged with developing an assessment program for IL in our library.

pwatkins1 pre/post testing of info literacy class students

InfoLitGal pre/post test - soon to be changed with new info lit librarian

kmcrowe I went to the Infolit Immersion and it has inspired us to move forward with program goals

aq8554 Not at my current institution; but I've done them previously

lisalibrarian some specific in disciplines with accrediting standards that make explicit 21st century literacies

Amy_Gustavson We're piloting our program this semester. It's classroom assessment.

nmurillo1 No. Not at the program level.

kmcrowe Immersion Assessment

lisalibrarian others in general education program level

pwatkins1 what is immersion assessment?

Simmons_Hernon By program level I mean yo work with programs and advacne student learning trhough a formal set of otucomes and rubircs. Involves all courses

page2page IL goals are a part our our BOR system wide general education goals

lisalibrarian as a goal - peter - yes

pwatkins1 what is BOR

lisalibrarian as an accomplished approach - not yet

lisalibrarian :)

page2page board of regents

kmcrowe ACRL Infor Lit Immerssion Assessment - 1st one was in Dec 08

kmcrowe Margot was there!

sbrasley just a few are involved with programs; most of what is done is at the classroom level

Simmons_Hernon Do you do information literacy or somethingelse?

lrichel me too - classroom level, not program

barbieuva We've experimented on a limited basis with pre and post testing. Nothing at the program level.

lrichel information literacy

nmurillo1 infolit

lareeves Nothing at the program level yet--want to get there.

Simmons_Hernon My theme is that it is time to move beyond course level and do what accreditation bodies want--assessment at the program level

catbark info lit in pieces depending on the class

lisalibrarian both info lit and how we contribute to other learning outcomes

graycath at the classroom level, is it part of their grade, or simply a marker for their level of information literacy

pwatkins1 how many classes are most people doing per semeser?

LuLibrarians catbark: hello from langston

lisalibrarian immersion assessment:

http://www.ala.org/ala/newspresscenter/news/pressr…

Laurel Littrell Yes, our accrediting body told our Univ we had to do this.

amurrell we only have grad students, so we do pre/post testing of a required course that includes critial thinking and info lit

lisalibrarian we are driven not my accrediting standards

jonesphi What do you mean by something else--critical inquiry, for instance--a phrase we're using.

eakidwell With the Library, our direct assessment has been primarily with our IL program, we've been using surveys and LibQual in addition for assessment of a wide variety of areas in the Library.

kmcrowe AT UNCG we're revising our Gen Ed and hope to tie in porogram assesssment of IL with that

Simmons_Hernon Program levlel ignores grades and looks at student learning over duration of program--their growth

InfoLitGal Per semester, 11-19 classes. I'm one of 7-10 teaching info lit

lrichel i teach 75/ semester

cilibertia We've worked primarily with our first year experience program, looking to expand

graycath what is included in this "assessment"?

kmcrowe I agree with Pete - program assessment "proves" our impact on the curriculum

Simmons_Hernon Assessment occurs at course, program and institutional level, What questions do you have about program level

amurrell would like to assess over entire time in grad prob

Amy_Gustavson Is program assessment for multiple sessions? Or will program assessment review the one-shot sessions as well?

South7th Do you ha ve any estimate of how many programs--genral education programs--actually address "information literacy" or whatever we are talking about as a specific educational outcome?

Laurel Littrell We are trying to assess at the program level but it is hard because we are set up around the teaching curriculum and it is hard for the library to fit into that.

jonesphi How can class level assessments show up in program level assessements?

Simmons_Hernon What have students learned trhoughout program o study. Learning = knowledge, habits, skills, etcv

InfoLitGal who should be asessing? us? in-class profs? students? administration?

Simmons_Hernon Clss level assessmentis different from program level. Apples to oranges

InfoLitGal true, I'm at a community college

page2page assessment should be done by a designated office on campus

lrichel How do you assess a program level when you only do one-shot instruction and IL is not required by any programs...?

cilibertia Our GenEd program is undergoing revision and key info lit outcomes are included in the draft

amurrell are there standards of testing for prog level?

ECalderon outcome assessments in various levels to me produce different outcomes at program, insti. etc... right?

lisalibrarian we use our classroom assessments to "wrap up" to the program level

Simmons_Hernon Librarians and faculty together shoukld build an asessment plan. Yu are assessing student learning over time

Amy_Gustavson I agree with lrichel's question.

graycath anyone that teaches shoudl at least assess their instruction for the particular session, but how much applies to the whole semester when you just do a one-time presentation?

South7th The question about the development of information literacy that interests me is whether librarians can be demonstrated to have any impact on its development. I don't believe there has been a well controlled study that has done so.

InfoLitGal How do you assess a program level when you only do one-shot instruction and IL is not required by any programs...? --THAT"S why I asked who is to assess?

Simmons_Hernon How do you wrap up class assesment to program level?

deeter11 Yes, Irichel's last question most applies to us here as well

lisalibrarian programs are made up of classes + other out of class experiences/requirements

Simmons_Hernon Program assessment involves a new culture drivne by accreditation and others

lisalibrarian so, just like our campus faculty take assessments from across student courses and experiences to "wrap up into" program level, we do too

lrichel Program level assessment needs buy in from administration -- what can we do, in the meantime, if we don't have that?

Simmons_Hernon Program ooks at courses collectively not individually

keris2103 Our IL instruction is to fulfill nursing board requirements and we're starting WASC applicaton process.

InfoLitGal Our program is one-shot & NOT required BUT info lit is a Middle States criteria

page2page how do you determine how anything is learned? Is is class, is it a discussion with faculty out side of class, is it simple growth and life experience.

Laurel Littrell Our five learning outcomes are Knowledge, Critical Thinking, Communication, Diversity, and Academic Integrity. We are focusing on Critical Thinking and Academic Integrity.

lisalibrarian yes - collectively but through pulling things from throughout student experience

Simmons_Hernon Yes, iformatin literacy is required by Middle States and they ahve two wonderful textbooks on topic

keris2103 Same here - nursing board and then WASC but not other program requirements.

kmcrowe I would say that 1 shot is the method/means that the program is implemented

pwatkins1 what are the textooks?

Simmons_Hernon Do any of you engaged at program level use a "scoring rubric?

lisalibrarian why does it have to be driven by accreditation and others though?

South7th Middle States is the only accreditting body that I'm aware of that articulates an "information literacy" goal are there others?

lareeves My community college has core outcomes. I'm trying to show how library instruction contributes to them.

Laurel Littrell We are working with the classes that ask for the one shot sessions to see how our sessions impact the learning in that class. Yes, we use a scoring rubric.

cilibertia We use a rubric to grade our first year seminar assignments

keris2103 No scoring rubric.

aq8554 No; can you tell us more about what a scoring rubric is?

Simmons_Hernon Textbooks: 1. student learning outcomes and (2) developng researh skills--both available online at the Mddle States homeage

ECalderon does anyone have an example to share scoring rubric?

page2page igher education is a fickle beast, try to get anything done without making it a requirement for acrediation

lrichel example at the VALE nj conference of a scoring rubric -- NJIT

InfoLitGal can't get our eng dept or speech dept very interested- don't know why

cilibertia Hi Lynee-It's Anne and Nancy from WPUNJ-we thought it was you ;-)

Laurel Littrell That's why it takes accrediation requirements to get people to do it!

kmcrowe check out the LEAP report

http://www.aacu.org/press_room/press_releases/2007…

Higher ed is usinging this for gen ed and it includes IL

lrichel Hello Northern NJ!

Simmons_Hernon Sure, I'll be discussing this at ACRL in March. Any way yiout translate an outcome into steps of what you want people to accomplish over time: novice, etc. The key is that you develop therubirc with faculty.

lisalibrarian interesting, we dont have an accreditation mandate but we're finding other ways

LuLibrarians is info lit defined by the accrediation agencies? do they all use the same definition?

cohenarl I think focusing on critical thinking is crucial, it goes beyond the library and the programs and focuses on future success

Laurel Littrell It is embedded in critical thinking.

Simmons_Hernon Checuk Google for scoring rubirc or see publciations from publisher--Stylus in VA

ECalderon thanks

InfoLitGal Our VP aof academic affairs says there's NO room for one measly credit for an info lit course - we need to look into embedding in another course

znewell Right now we are doing self-assessment and trying to make a case with core curriculum committees to look at a larger role for assessment. Assessment is now in the hands of separate accreditations by various departments

Simmons_Hernon I have a lsit of about 14 outcome areas: as critical thinking and communciation skills. You can also connect outcomesx

lucretiamcculley our science librarian is working with the biology dept to use the iSKILLS test from ETS and add "biology-specific" IL questions to the test.

graycath i think IL is taught best when embedded in other courses

InfoLitGal yup

LuLibrarians I agree.

aq8554 So, it's a discrete set of skills that can each be isolated into steps -- how do you assess their skill level on this?

sbrasley some of our campuses engage in curriculum mapping at the department level to help with creating rubrics for courses within the department

keris2103 Agree - IL has to be incorporated in the course

InfoLitGal continuity of learning & linking skills with education

znewell Yes, but can still be assessed even as part of a larger course

Simmons_Hernon I am not king about a course. The key is integration of outcomers--with librarians participating--throughout the whole curriculumf a program-usng scoring rubirc

kmcrowe another good site for rubrics;

http://openedpractices.org/resources

Laurel Littrell This is what we are trying to do, Peter, but it is sure difficult!

kathy.labadorf Peter said: I am not king about a course. The key is integration of outcomers--with librarians participating--throughout the whole curriculumf a program-usng scoring rubirc

mollyanswers Does ACRL have a info lit rubric?

kathy.labadorf Yes!!!

Simmons_Hernon I do not t plug my writings., OH well, I hasve two books on outcomes assessment published by Libraries Unlimited that addresses our questions

aq8554 So, a student's "score" on the rubric would increase as they went along, being explosed to and learning specific skills.

aq8554 Would various prof's score each student on the rubric over time?

page2page isn't the use of rubrics often time consuming if done for an entire program?

cilibertia you could do just a sample

Simmons_Hernon You can use the information literacy guidelines of ACRL to refin th outcomes an then to think about a scoring rubirc. In my book Outcomes asessement in higher educatin, there is a set of outcome and rubrcs used at one university in NJ

pwatkins1 how do you measure the results demonstrated evidence of what students have learnd?

kathy.labadorf Would you develop one rubric for the entire program? Or are there stages of development with different rubric measures

Simmons_Hernon o can reduce rubircs as time consuming by working with existing ones and collectively modifying them

graycath assessment of any kind is time-consuming, but rubrics take less time than many others, and they are easy to write and grade objectively

page2page are you applying the rubric to one assignment

breitena Is anyone familiar with an assessment management system such as TracDat where each dept on campus including the library lists their learning outcomes?

Simmons_Hernon You might have one outcome but different programs could have different rubircs

ECalderon exactly

cohenarl what is the title of your books?

Simmons_Hernon Trac Data does not work in the context of progams--where faculty and librarians develop0 rubircs..

lisalibrarian I think you can record the data from the rubric in TracDat

kmcrowe WE use WEAVE for program assessment

Simmons_Hernon See iSills, Project Sails, etc. they need a scoring rubric for them to be truly useful

LuLibrarians Sails is very advanced for some.... we had issues using it.

pwatkins1 info literacy @ erau is creeping into Gen Ed program

page2page we are looking at developing rubrics and portfolios in our campus assessment, but there seems to be trouble in getting faculty to see the importance of having the students create a portfolio

Simmons_Hernon Again what is (are) the outcomes settled on by faculty, where does libraries fit in, and what are the rubrcis. The key then is how are the dfata gathered used to improve the educational experience

kathy.labadorf InfoLit is a competnecy in our GenEd program here

Simmons_Hernon A portfolio s a good source for outcomes and again liink it to a rubric

kathy.labadorf We've used SAILS and find it is more a bibliographic test than an infolit test.

page2page that is a big issue. we gather so much data but then it MUST be used to improve instruction, programs, learning

kmcrowe This isn't a program level but I'm working on a pilot with a class this semester using a rubric. The faculty member & I are developing it together

cohenarl Simmons_Hernon: What are the titles of your books?

Laurel Littrell Any advice about how to gather the data to be the most useful and efficient?

breitena I am thinking about TracDat as a place for all learning outcomes together, then faculty and librarians together working on the rubrics.

Simmons_Hernon Right with Project SAILS. I only mentin it as an exaple of on of the many instruments ou there. The key is how do you relate uch instruments tomeet your needs

lrichel New Jersey Inst of Technology has a rubric to assess portfolios from their Humanities program...

South7th Having information literacy listed as a competency in Gen Ed to be taken care of by taking one course or another is not the same as measuring sophomores and seniors to see if they have appreciably different levels of information literacy.

pwatkins1 we use Survey Monkey for pre/post tests in info literacy classes

lmaddengsu We're thinking about targeting our critical thinking through writing and writing across the curriculum programs for developing our IL program. Any advice on getting buy in from them?

Simmons_Hernon Data gathering: direct and indirect methods. Right now accreditation does care. Start with soemthing and use it to improve the eudcaitonal experience. You can build

rouxlibrary Here's the link to the Libraries Unlimited page, with a search for Hernon: http://lu.com/search.cfm

Simmons_Hernon Have conversations with faculty about critical thinking. I like the student learning outcomes (Mddle States 2007). Share it with faculty and organize an dscussion to move forward

sbrasley Dr. Hernon's books: Amazon search with his name and assessment: http://www.amazon.com/s/ref=nb_ss_gw?url=search-alias%3Daps&field-keywords=peter+hernon+assessment&x=0&y=0

Simmons_Hernon Thaks for looking up my books.

rouxlibrary My mistake - you'll have to perform the search for Hernon yourself, but it pulls up all of his books

ECalderon great thx

Simmons_Hernon I have been so buy typing (thrying to avoid typoss), what hav eI failed to touch on?

cohenarl I have used active learning to test critical thinking with pre and post tests showing that it does improve

kmcrowe the fculty member I worked with really liked having the ACRL def of IL

pwatkins1 what is active learning?

Simmons_Hernon Outcomes assessment focus on active learning--see Peggy Maki and er book on student learning outcomes 9Stylus, 2006?)

cohenarl Active learning can take many forms, including partner brainstorming: discussing with a partner, helps to focus thinking and searching

sbrasley Pwatkins - many good gen ed books on active learning as well as lib-related ones. I would check the ACRL Instruction Section website for their bibliographies.

Simmons_Hernon Again with pre and post test, the focus is on course level.

pwatkins1 thanks!

Laurel Littrell What about pre and post test with the pre as incoming freshmen and the post as outgoing seniors?

cohenarl could you have progressive pre and post tests?

pwatkins1 anyone using Clickers for learning?

Simmons_Hernon Outcomes assesment involves active learning and moving from teaching to true learning. Still, we need to use the results to improve learning. So hat changes emerge?

Simmons_Hernon Clickers is at the course level and does nto really focus on ___

lrichel pbwatkins -- we've used clickers for 4 years... turning point

Laurel Littrell What we want to see is integration of knowledge and critical thinking into the other outcomes... diversity, communication, integrity.

suzettes We've tried to incorporate Clickers in our instruction sessions but it's difflicult to do in a 45 minute timeframe.

Simmons_Hernon You all have some great ideas. You av the basis for meaningful dfisucssion ith faculty at the program level

pwatkins1 lrichel - whats been yr experience w/clickers?

nefrazier3 yes--same experience w/clickers and time frame. also need to get in to the classroom first for setup

Simmons_Hernon The challenge is for faculty (and librarians) to move byond the couse level

nmurillo1 Sounds very vague. I don't understand how we can measure student outcomes over time without using some sort of assessment tool like a post-test.

Laurel Littrell Our first task was to get someone appointed to the assessment committee! It really helped after we got that done.

InfoLitGal sounds like ask the audience for "Who wants to be a Millionaire" gameshow

kathy.labadorf I've heard that the best way to improve learning is to improve teaching. Would you agree?

lrichel pbwatkins I love clickers -- immediate assessment, at the moment, throught the 75 min class

pwatkins1 wow - 75 minutes

mollyanswers Clickers have worked great for us. But pretest posttest model is a challenge

nefrazier3 and nice to use the clickers in the beginning of class to guage students' experience w/particular databases, etc

Simmons_Hernon At the course level I ony use the minute assessment. I do not focus much at the course level,. Ican read students and learning witout ore involvment. So more pre and post testing to prgam level (and advancing rubrcis)

cohenarl When will the transcription of this discussion be available; I'm getting alot of new info?

page2page i think we may be caught up in the course level because it seems like the most imediate way to prove our usefulness

lisalibrarian you can get out of the pre-post trap by not thinking so much about how does the student change from where they were to what level has the student attained

South7th You know I don't think clicking during classes or post-tests conducted immediately after classes actually mewasure learning.

nefrazier3 at course level, it seems our greatest successes may come thru good relationships we've built w/faculty

page2page however the stories of true learning in the program level would be more powerful

lisalibrarian then, it doesn't matter so much where they started from as much as how many students attain successful levels

ECalderon where does one suggest to start do we want to leave out pre-post assessments pre assessments r vip

lisalibrarian my 2 cents :)

ECresdesk cohenarl, it's logging as we speak at: http://chatlogs.meebo.com/room/onpoint/logs/today/

mollyanswers I agree. About moving beyond the class specific assessment. I missed some of the earlier postings. But where to START to get beyond the classroom.

Simmons_Hernon I attended the Assessent conference last summer in Seattle-to hung p on course leve. With accreditators deamnding progam level, here isa great opportunity

aq8554 Actually co-developing the rubric with faculty would level their expectations somewhat about what their students should know.

South7th I would be more interested in knowing the degree to which a skill or knowledge is retained at the end or beyond the end of an undergraduaute program.

sbrasley We need to educate ourselves more about activities associated with course-level assessment, program and institutional. I'm glad the the ACRL Immersion program now has an assessment track, so we can be up to speed.

kmcrowe working with faculty and also with key administrators on campus e.g. assessment peopel, curriculum people,

aq8554 It would also help faculty look to the library to improve discrete areas of their rubric?

Simmons_Hernon I agree ... My books are editied ones and invlve a numer of players. Will gie you something to think aobot

nefrazier3 co-developing rubrics w/faculty sounds ideal. working and interacting w/faculty on campus committees helps promote our abilities to help in this area

mollyanswers Do multiple classes assessed coupled with "customer service" type feedback from instructors = Program Level assessment.

kmcrowe assessment immersion focuses on program assessment I highly recommend it

Simmons_Hernon Yes, work collaboratively with faculy on outcomes and rubrics

nefrazier3 it sure helps to have a place at the table on assessment and/or curriculum committees

pwatkins1 easier said than done

Simmons_Hernon Customer service (as satisaction) is an output. Accrediators would be interested. Butths is not outcomes assessment

meganoakleaf Ditto Peter. Working with faculty on rubrics is great fun! And really illuminating for both parties. Great too to include students in the process.

Simmons_Hernon Easiersaid than done. Well, a lot s being ne. Dive in

rouxlibrary Yes, I have to admit that I still don't quite understand what constitutes program level assessment

pwatkins1 how do studnets get involved?

Laurel Littrell Getting to the table is the first challenge and sure helps.

aq8554 In fact, isn't "assessment" basically the technique here. In other words, you're not focusing so much on the outcome of the assessment itself, but on where the holes int he rubric would tell you to address first?

Simmons_Hernon program level-look at te courses from ore to eective. Look t the progression of student learning. What shoudl they knwo and be able to do t this stge, next stage, etc

aq8554 Then if you try something else to incrase their info literacy to address X box in the rubric, you could assess the effectiveness of that 'improvement' by whether the score in that particular box went up?

Laurel Littrell Program level is seeing how the learning in all the classes fit together.

Simmons_Hernon Outcomes has different parts--your goal (outcome), whih one

Simmons_Hernon Then what is the corespndign rubirc,.the how use the information to mprove

kmcrowe and fits into the whole curriculum (program level)

Simmons_Hernon Rigt, the ooutcome and rubirc are accepted by the whole progam .. You are goind beyond whatis learned at ocurse levl

jonesphi Does program level mean for an institution? A major?

Simmons_Hernon major

Laurel Littrell That is why there is such pressure on the teaching departments, to have a rubric and plan for every single degree program.

Laurel Littrell They seem to be grateful for whatever partnership we can do with them!

Simmons_Hernon To compicate matters som places have institutonal outcvomes. Simmons has sai it is leadershp. So here beocme an area to developoutcme

cohenarl I guess this is like a prerequiste?

nefrazier3 do you think that suggested outcomes for basic vs. advanced levels would work? or would you recommend say, all 4 yrs of a 4-yr program?

Simmons_Hernon theree would still be program outcomes as criticla thinking and better communication skills

Simmons_Hernon rubric factors in basic and advanced--you are progressing studentd

ECalderon info lit skills are imprt

c_hammer How wide/extensive is program level? Post-graduation assessments?

BobPh_ftw have you discussed course mapping of program outcomes? if so, I will find it in the transcript.

Simmons_Hernon So for an undergraduate in their major, wat are the desired outcomes and programs may have different rubirics

Simmons_Hernon The mistake I see is that to many people try to do too mcuh

ECresdesk Esp when administrators are pushing for assessment

jonesphi What are they doing that they shouldn't?

cohenarl about prerequisites; does this create a progressive learning path?

Laurel Littrell Some try to do too much and some completely ignore the requirements! :-)

Simmons_Hernon The prblem also is the literature. there is a lot of fiocus on LibQUAL, which is an output not anoutcome

nmurillo1 I don't think our faculty see us as legitimate players in the development of learning outcomes in their departments.

Laurel Littrell LibQual is service assessment, not student learning outcomes assessment.

Simmons_Hernon No, in doing too much I am saying be selctive in getting stted with outcomes and rubrcs. You can build lter

breitena some programs offer capstone course at the end. this would a natural place to perform an assessment of info lit learning.

margotconahan **This is a fast and furious conversation, everyone! We told Peter to plan on about 45 minutes so I just wanted to chime in with a 5 minute warning. You are all welcome to continue the chat, but wanted to give a heads up on the time.***

Simmons_Hernon Rght, LibQUAL is that. BUT a lot of the literature moves it to the other side

Laurel Littrell Getting faculty to accept us as partners is critical to our participation.

kmcrowe absolutely!

nefrazier3 have others impelemented the Research Practices Survey? HEDs/NITLE, originated I think w/St. Olaf's and other midwestrn. colleges?

InfoLitGal amen

Laurel Littrell We get on better with some departments than others!

Simmons_Hernon I am having a hard time keeping up wih all of the exchanges I am delighted to introduce the topic. If Marogt wans m back, happy to advance our chat

South7th LibQUAL seems built on the assumption that libraries are service/support organizations and not educative.

lisalibrarian LibQual does have questions though about how users perceive the library's impact on their info lit skills

guest7601925 At Binghamton University we are currently doing our second round of a Research Practices survey

Simmons_Hernon Again start by reading the Middle States text and ahve a chat within your libraries about what we are discussing.

InfoLitGal it always boils down to the politics of your inst. How well your chair gets on with the other chairs & admin

lisalibrarian it isn't student learning assessment but is good data for then using to say librarians have something to contribute

kmcrowe I'l like more info on Research Practices

page2page but perception is well perception

nefrazier3 we just did our first round--to FY students and seniors

pwatkins1 true

guest7496612 I am fuzzy what is the diffrence between an outcome and an out put?

Simmons_Hernon A urvey may have program use, I'd need to know more.

InfoLitGal Ours has a rodney dangerfield approach with all other chairs

lisalibrarian yes, but if students perceive the library as helping them develop info lit skills - then that can help in saying why librarians should be part of the conversation

nefrazier3 Link to more info about development of the Research Practices survey:

http://www.stolaf.edu/offices/ea/Assessment/ResPra…

Link to the sample survey:

http://www.stolaf.edu/offices/ea/RPS_SurveyInstrum…

aq8554 Thanks so much -- gotta run!

InfoLitGal ciao

Simmons_Hernon Stduent learning outcoes tests our desire to e effective teachers focus on active learning

ECalderon bi

margotconahan Whew, Peter, you may need a breather, so I'd like to thank you for facilitating this chat and invite other to stay and continue the conversation.

Laurel Littrell Thank you!

pwatkins1 thx, peter

nefrazier3 Thanks for the good info!

meganoakleaf Thanks, Peter.

catbark thanks, learned a lot!

margotconahan We'll post the transcript on the ACRL OnPoint page so you can reference today's discussion.

nmurillo1 Thank you.

Simmons_Hernon Margot, i am happy to stay for a few more minutes, You are all wearing me out Ber time

guest7601925 Thank you!

kathy.labadorf Thank you. See you in Seattle

ECalderon great books !

breitena thanks...This is great information!

ECalderon bye

cohenarl Thank you; so interesting.

sbrasley Thank you Dr. Hernon - I look forward to your talk at ACRL

margotconahan Great, any last questions or comments for Peter?

Simmons_Hernon I enjoyed taling with you.Peter

Ailya Thank you

Simmons_Hernon No, I am set. Just: hereis a great opportunity to collaborate with faculty. Enjoy

Simmons_Hernon I lerned from all of yu as well. Bye

Amy_Gustavson Thank you!

guest7496612 Thank you!

millerja Great tips - thanks!

margotconahan If you're attending the Seattle conference, Peter's session is scheduled for Friday afternoon.