ACRL OnPoint Chat Archive January 14, 2009: Student learning outcomes, the culture of assessment, and accrediting agencies
(12:00 p.m Pacific | 1:00 p.m. Mountain | 2:00 p.m. Central | 3:00 p.m. Eastern)
The next installment of the ACRL OnPoint chat series, “What Really are Student Outcomes,” will take place at 2:00pm CST on Wednesday, January 14. Peter Hernon, Graduate School of Library and Information Science, Simmons College, will convene this month’s chat.
At the upcoming ACRL 14th National Conference in Seattle, Hernon will address student learning outcomes, which reflect changes in students (e.g., knowledge, skills, abilities) over the duration of a program of study. The
focus is on moving beyond course evaluation and assessment and developing a picture at the program level and institutional levels. Both regional and program accreditation organizations support (demand) this broader view of outcomes assessment, while still encouraging the application of student outcomes (for accountability purposes). This focus on accountability, combined with using the results to improve the educational experience, has implications for creating a culture of assessment in libraries.
Transcript archive:
margotconahan Hi all from cold Illinois! This is Margot from ACRL. We'll be starting in a few minutes. Thanks for joining us this afternoon.
page2page here in South Dakota we have actual temp of -5, don't know the wind chill
Amy_Gustavson Greetings from East Carolina University!
CMK09 Hi All
lmaddengsu Greetings from Atlanta, GA, where it's actually quite cold today.
rshuff Hey Amy Gustavson! It's Ru
guest7601925 Hello from upstate NY - COLD!
sbrasley Greetings from So.Cal - great topic today!
aq8554 Hi from Detroit, MI. BBBRRRR!
kmcrowe Even pretty cold in NC but far better than our NE and Midwest friends
Simmons_Hernon A nice turn out. In Bosto, like upstate NY, COLD. Peter Hernon
amurrell Hi from San Diego, where it is warm!
InfoLitGal Are we supposed to be hearing anything?
nmurillo1 Hello from Chicago. At least it's warm in the library.
margotconahan OnPoint Chats are just text based, no audio.
jam_asulib It's 72 degrees and sunny in Phoenix!
Simmons_Hernon At 3pm Margot Conahan of ALA will kick this off. Peter
InfoLitGal shut up phoenix!
kmcrowe I agree
jam_asulib Hee!
catbark 55 in Norman, OK
Laurel Littrell I am in Kansas where it is cold but going to Phoenix next week so that is great!
cohenarl Signing on: Arlene Cohen in Nevada
amurrell does anyone know why my chat display keeps jumping to the top of the thread?
InfoLitGal it's 22 in NY NY with a wind chill in the single digits
colbysawyer It's 14 with a wind chill of 0 in central NH
InfoLitGal Are we suppose to see and/hear something - how do I get this?
Amy_Gustavson Hi rshuff! What a small world!
Simmons_Hernon I can see why someone in cold weather would spend time today chatting--but those of you in warm weather?
catbark Gotta work, man
amurrell lol broken ankle, so I;m stuck in doors and on my bottom
rshuff Hey All, Amy Gustavson is my mentee with the ACRL IS Mentoring program. Think this counts as our Jan. chat?? HA!
Amy_Gustavson Oh, I think so. :-D
margotconahan InfoLitGal, there is no audio, should should just see the chat thread.
InfoLitGal okey dokey thanks
rshuff I'm on board with that Amy
jammers146 signing on
ECalderon hi
cilibertia Hi everyone-there are a few of us in our group
pwatkins1 ERAU Prescott here
lareeves Is this the student outcomes chat?
pwatkins1 yep
margotconahan Sorry, all, I got a message that my post didn't make it through. Here I go again!
lareeves Yes, it is an hour later now, right?
cohenarl how do you remove that media item; I clicked x and remove but it didn't go away?
BobPh_ftw there is a litte arrow on the border (just found it myself)
margotconahan Can you confirm if my message was posted?
Amy_Gustavson On the divider, click between the triangles. It should minimize the media.
BobPh_ftw yes margo
cilibertia Hi Margot
keris2103 Thanks Amy - it worked!
cohenarl Yes, thanks; got rid of it.
margotconahan Peter, whenever you are ready, you can kick this off. Thanks again for joining us!
Amy_Gustavson You're welcome.
kathy.labadorf Is there supposed to be sound?
pwatkins1 no sound
pwatkins1 just chat
Simmons_Hernon Are my messages getting through?
pwatkins1 yes
eakidwell Yes
kmcrowe not to me
pwatkins1 peter?
jhenning not to me
margotconahan Hi Peter,
amurrell just the one asking if your messages are gettign through
margotconahan we can see your first message now.
PMKINNEY Hi Peter
Simmons_Hernon Are any of you engaged in assessment--stuent learning otucomes--at your place?
eakidwell Yes
BobPh_ftw yes
sbrasley yes
lrichel yes
ECalderon yes
jhenning not yet
Laurel Littrell Yes, Kansas State Univ
Simmons_Hernon If yes, doing what?
South7th No
Amy_Gustavson yes
jammers146 yes
PMKINNEY yes
eakidwell The Library and the core curriculum
nmurillo1 What do you mean by "engaged"?
kmcrowe no but will be doing it in the next year
InfoLitGal oh yeah
Laurel Littrell We have 5 learning outcomes and partner with teaching units to assess them.
lmaddengsu I've been charged with developing a plan for my university, but just getting started.
page2page yes pre/post tests
keris2103 Trying to design student and faculty survey tools.
lrichel giving student learning outcomes at beginning of class, then teaching them in the session, then testing the slo
sbrasley informal - using classroom assessment techniques; and formal - the iSkills test for diagnostic purposes
kmcrowe we've done pre/post test, too
Simmons_Hernon By engaged I mean doing student learning outcomes at PROGRAM level?
kathy.labadorf Yes, but want to do more.
lisalibrarian yes
Laurel Littrell Yes with the teaching departments.
nmurillo1 I've also been charged with developing an assessment program for IL in our library.
pwatkins1 pre/post testing of info literacy class students
InfoLitGal pre/post test - soon to be changed with new info lit librarian
kmcrowe I went to the Infolit Immersion and it has inspired us to move forward with program goals
aq8554 Not at my current institution; but I've done them previously
lisalibrarian some specific in disciplines with accrediting standards that make explicit 21st century literacies
Amy_Gustavson We're piloting our program this semester. It's classroom assessment.
nmurillo1 No. Not at the program level.
kmcrowe Immersion Assessment
lisalibrarian others in general education program level
pwatkins1 what is immersion assessment?
Simmons_Hernon By program level I mean yo work with programs and advacne student learning trhough a formal set of otucomes and rubircs. Involves all courses
page2page IL goals are a part our our BOR system wide general education goals
lisalibrarian as a goal - peter - yes
pwatkins1 what is BOR
lisalibrarian as an accomplished approach - not yet
lisalibrarian :)
page2page board of regents
kmcrowe ACRL Infor Lit Immerssion Assessment - 1st one was in Dec 08
kmcrowe Margot was there!
sbrasley just a few are involved with programs; most of what is done is at the classroom level
Simmons_Hernon Do you do information literacy or somethingelse?
lrichel me too - classroom level, not program
barbieuva We've experimented on a limited basis with pre and post testing. Nothing at the program level.
lrichel information literacy
nmurillo1 infolit
lareeves Nothing at the program level yet--want to get there.
Simmons_Hernon My theme is that it is time to move beyond course level and do what accreditation bodies want--assessment at the program level
catbark info lit in pieces depending on the class
lisalibrarian both info lit and how we contribute to other learning outcomes
graycath at the classroom level, is it part of their grade, or simply a marker for their level of information literacy
pwatkins1 how many classes are most people doing per semeser?
LuLibrarians catbark: hello from langston
lisalibrarian immersion assessment:
http://www.ala.org/ala/newspresscenter/news/pressr…
Laurel Littrell Yes, our accrediting body told our Univ we had to do this.
amurrell we only have grad students, so we do pre/post testing of a required course that includes critial thinking and info lit
lisalibrarian we are driven not my accrediting standards
jonesphi What do you mean by something else--critical inquiry, for instance--a phrase we're using.
eakidwell With the Library, our direct assessment has been primarily with our IL program, we've been using surveys and LibQual in addition for assessment of a wide variety of areas in the Library.
kmcrowe AT UNCG we're revising our Gen Ed and hope to tie in porogram assesssment of IL with that
Simmons_Hernon Program levlel ignores grades and looks at student learning over duration of program--their growth
InfoLitGal Per semester, 11-19 classes. I'm one of 7-10 teaching info lit
lrichel i teach 75/ semester
cilibertia We've worked primarily with our first year experience program, looking to expand
graycath what is included in this "assessment"?
kmcrowe I agree with Pete - program assessment "proves" our impact on the curriculum
Simmons_Hernon Assessment occurs at course, program and institutional level, What questions do you have about program level
amurrell would like to assess over entire time in grad prob
Amy_Gustavson Is program assessment for multiple sessions? Or will program assessment review the one-shot sessions as well?
South7th Do you ha ve any estimate of how many programs--genral education programs--actually address "information literacy" or whatever we are talking about as a specific educational outcome?
Laurel Littrell We are trying to assess at the program level but it is hard because we are set up around the teaching curriculum and it is hard for the library to fit into that.
jonesphi How can class level assessments show up in program level assessements?
Simmons_Hernon What have students learned trhoughout program o study. Learning = knowledge, habits, skills, etcv
InfoLitGal who should be asessing? us? in-class profs? students? administration?
Simmons_Hernon Clss level assessmentis different from program level. Apples to oranges
InfoLitGal true, I'm at a community college
page2page assessment should be done by a designated office on campus
lrichel How do you assess a program level when you only do one-shot instruction and IL is not required by any programs...?
cilibertia Our GenEd program is undergoing revision and key info lit outcomes are included in the draft
amurrell are there standards of testing for prog level?
ECalderon outcome assessments in various levels to me produce different outcomes at program, insti. etc... right?
lisalibrarian we use our classroom assessments to "wrap up" to the program level
Simmons_Hernon Librarians and faculty together shoukld build an asessment plan. Yu are assessing student learning over time
Amy_Gustavson I agree with lrichel's question.
graycath anyone that teaches shoudl at least assess their instruction for the particular session, but how much applies to the whole semester when you just do a one-time presentation?
South7th The question about the development of information literacy that interests me is whether librarians can be demonstrated to have any impact on its development. I don't believe there has been a well controlled study that has done so.
InfoLitGal How do you assess a program level when you only do one-shot instruction and IL is not required by any programs...? --THAT"S why I asked who is to assess?
Simmons_Hernon How do you wrap up class assesment to program level?
deeter11 Yes, Irichel's last question most applies to us here as well
lisalibrarian programs are made up of classes + other out of class experiences/requirements
Simmons_Hernon Program assessment involves a new culture drivne by accreditation and others
lisalibrarian so, just like our campus faculty take assessments from across student courses and experiences to "wrap up into" program level, we do too
lrichel Program level assessment needs buy in from administration -- what can we do, in the meantime, if we don't have that?
Simmons_Hernon Program ooks at courses collectively not individually
keris2103 Our IL instruction is to fulfill nursing board requirements and we're starting WASC applicaton process.
InfoLitGal Our program is one-shot & NOT required BUT info lit is a Middle States criteria
page2page how do you determine how anything is learned? Is is class, is it a discussion with faculty out side of class, is it simple growth and life experience.
Laurel Littrell Our five learning outcomes are Knowledge, Critical Thinking, Communication, Diversity, and Academic Integrity. We are focusing on Critical Thinking and Academic Integrity.
lisalibrarian yes - collectively but through pulling things from throughout student experience
Simmons_Hernon Yes, iformatin literacy is required by Middle States and they ahve two wonderful textbooks on topic
keris2103 Same here - nursing board and then WASC but not other program requirements.
kmcrowe I would say that 1 shot is the method/means that the program is implemented
pwatkins1 what are the textooks?
Simmons_Hernon Do any of you engaged at program level use a "scoring rubric?
lisalibrarian why does it have to be driven by accreditation and others though?
South7th Middle States is the only accreditting body that I'm aware of that articulates an "information literacy" goal are there others?
lareeves My community college has core outcomes. I'm trying to show how library instruction contributes to them.
Laurel Littrell We are working with the classes that ask for the one shot sessions to see how our sessions impact the learning in that class. Yes, we use a scoring rubric.
cilibertia We use a rubric to grade our first year seminar assignments
keris2103 No scoring rubric.
aq8554 No; can you tell us more about what a scoring rubric is?
Simmons_Hernon Textbooks: 1. student learning outcomes and (2) developng researh skills--both available online at the Mddle States homeage
ECalderon does anyone have an example to share scoring rubric?
page2page igher education is a fickle beast, try to get anything done without making it a requirement for acrediation
lrichel example at the VALE nj conference of a scoring rubric -- NJIT
InfoLitGal can't get our eng dept or speech dept very interested- don't know why
cilibertia Hi Lynee-It's Anne and Nancy from WPUNJ-we thought it was you ;-)
Laurel Littrell That's why it takes accrediation requirements to get people to do it!
kmcrowe check out the LEAP report
http://www.aacu.org/press_room/press_releases/2007…
Higher ed is usinging this for gen ed and it includes IL
lrichel Hello Northern NJ!
Simmons_Hernon Sure, I'll be discussing this at ACRL in March. Any way yiout translate an outcome into steps of what you want people to accomplish over time: novice, etc. The key is that you develop therubirc with faculty.
lisalibrarian interesting, we dont have an accreditation mandate but we're finding other ways
LuLibrarians is info lit defined by the accrediation agencies? do they all use the same definition?
cohenarl I think focusing on critical thinking is crucial, it goes beyond the library and the programs and focuses on future success
Laurel Littrell It is embedded in critical thinking.
Simmons_Hernon Checuk Google for scoring rubirc or see publciations from publisher--Stylus in VA
ECalderon thanks
InfoLitGal Our VP aof academic affairs says there's NO room for one measly credit for an info lit course - we need to look into embedding in another course
znewell Right now we are doing self-assessment and trying to make a case with core curriculum committees to look at a larger role for assessment. Assessment is now in the hands of separate accreditations by various departments
Simmons_Hernon I have a lsit of about 14 outcome areas: as critical thinking and communciation skills. You can also connect outcomesx
lucretiamcculley our science librarian is working with the biology dept to use the iSKILLS test from ETS and add "biology-specific" IL questions to the test.
graycath i think IL is taught best when embedded in other courses
InfoLitGal yup
LuLibrarians I agree.
aq8554 So, it's a discrete set of skills that can each be isolated into steps -- how do you assess their skill level on this?
sbrasley some of our campuses engage in curriculum mapping at the department level to help with creating rubrics for courses within the department
keris2103 Agree - IL has to be incorporated in the course
InfoLitGal continuity of learning & linking skills with education
znewell Yes, but can still be assessed even as part of a larger course
Simmons_Hernon I am not king about a course. The key is integration of outcomers--with librarians participating--throughout the whole curriculumf a program-usng scoring rubirc
kmcrowe another good site for rubrics;
http://openedpractices.org/resources
Laurel Littrell This is what we are trying to do, Peter, but it is sure difficult!
kathy.labadorf Peter said: I am not king about a course. The key is integration of outcomers--with librarians participating--throughout the whole curriculumf a program-usng scoring rubirc
mollyanswers Does ACRL have a info lit rubric?
kathy.labadorf Yes!!!
Simmons_Hernon I do not t plug my writings., OH well, I hasve two books on outcomes assessment published by Libraries Unlimited that addresses our questions
aq8554 So, a student's "score" on the rubric would increase as they went along, being explosed to and learning specific skills.
aq8554 Would various prof's score each student on the rubric over time?
page2page isn't the use of rubrics often time consuming if done for an entire program?
cilibertia you could do just a sample
Simmons_Hernon You can use the information literacy guidelines of ACRL to refin th outcomes an then to think about a scoring rubirc. In my book Outcomes asessement in higher educatin, there is a set of outcome and rubrcs used at one university in NJ
pwatkins1 how do you measure the results demonstrated evidence of what students have learnd?
kathy.labadorf Would you develop one rubric for the entire program? Or are there stages of development with different rubric measures
Simmons_Hernon o can reduce rubircs as time consuming by working with existing ones and collectively modifying them
graycath assessment of any kind is time-consuming, but rubrics take less time than many others, and they are easy to write and grade objectively
page2page are you applying the rubric to one assignment
breitena Is anyone familiar with an assessment management system such as TracDat where each dept on campus including the library lists their learning outcomes?
Simmons_Hernon You might have one outcome but different programs could have different rubircs
ECalderon exactly
cohenarl what is the title of your books?
Simmons_Hernon Trac Data does not work in the context of progams--where faculty and librarians develop0 rubircs..
lisalibrarian I think you can record the data from the rubric in TracDat
kmcrowe WE use WEAVE for program assessment
Simmons_Hernon See iSills, Project Sails, etc. they need a scoring rubric for them to be truly useful
LuLibrarians Sails is very advanced for some.... we had issues using it.
pwatkins1 info literacy @ erau is creeping into Gen Ed program
page2page we are looking at developing rubrics and portfolios in our campus assessment, but there seems to be trouble in getting faculty to see the importance of having the students create a portfolio
Simmons_Hernon Again what is (are) the outcomes settled on by faculty, where does libraries fit in, and what are the rubrcis. The key then is how are the dfata gathered used to improve the educational experience
kathy.labadorf InfoLit is a competnecy in our GenEd program here
Simmons_Hernon A portfolio s a good source for outcomes and again liink it to a rubric
kathy.labadorf We've used SAILS and find it is more a bibliographic test than an infolit test.
page2page that is a big issue. we gather so much data but then it MUST be used to improve instruction, programs, learning
kmcrowe This isn't a program level but I'm working on a pilot with a class this semester using a rubric. The faculty member & I are developing it together
cohenarl Simmons_Hernon: What are the titles of your books?
Laurel Littrell Any advice about how to gather the data to be the most useful and efficient?
breitena I am thinking about TracDat as a place for all learning outcomes together, then faculty and librarians together working on the rubrics.
Simmons_Hernon Right with Project SAILS. I only mentin it as an exaple of on of the many instruments ou there. The key is how do you relate uch instruments tomeet your needs
lrichel New Jersey Inst of Technology has a rubric to assess portfolios from their Humanities program...
South7th Having information literacy listed as a competency in Gen Ed to be taken care of by taking one course or another is not the same as measuring sophomores and seniors to see if they have appreciably different levels of information literacy.
pwatkins1 we use Survey Monkey for pre/post tests in info literacy classes
lmaddengsu We're thinking about targeting our critical thinking through writing and writing across the curriculum programs for developing our IL program. Any advice on getting buy in from them?
Simmons_Hernon Data gathering: direct and indirect methods. Right now accreditation does care. Start with soemthing and use it to improve the eudcaitonal experience. You can build
rouxlibrary Here's the link to the Libraries Unlimited page, with a search for Hernon: http://lu.com/search.cfm
Simmons_Hernon Have conversations with faculty about critical thinking. I like the student learning outcomes (Mddle States 2007). Share it with faculty and organize an dscussion to move forward
sbrasley Dr. Hernon's books: Amazon search with his name and assessment: http://www.amazon.com/s/ref=nb_ss_gw?url=search-alias%3Daps&field-keywords=peter+hernon+assessment&x=0&y=0
Simmons_Hernon Thaks for looking up my books.
rouxlibrary My mistake - you'll have to perform the search for Hernon yourself, but it pulls up all of his books
ECalderon great thx
Simmons_Hernon I have been so buy typing (thrying to avoid typoss), what hav eI failed to touch on?
cohenarl I have used active learning to test critical thinking with pre and post tests showing that it does improve
kmcrowe the fculty member I worked with really liked having the ACRL def of IL
pwatkins1 what is active learning?
Simmons_Hernon Outcomes assessment focus on active learning--see Peggy Maki and er book on student learning outcomes 9Stylus, 2006?)
cohenarl Active learning can take many forms, including partner brainstorming: discussing with a partner, helps to focus thinking and searching
sbrasley Pwatkins - many good gen ed books on active learning as well as lib-related ones. I would check the ACRL Instruction Section website for their bibliographies.
Simmons_Hernon Again with pre and post test, the focus is on course level.
pwatkins1 thanks!
Laurel Littrell What about pre and post test with the pre as incoming freshmen and the post as outgoing seniors?
cohenarl could you have progressive pre and post tests?
pwatkins1 anyone using Clickers for learning?
Simmons_Hernon Outcomes assesment involves active learning and moving from teaching to true learning. Still, we need to use the results to improve learning. So hat changes emerge?
Simmons_Hernon Clickers is at the course level and does nto really focus on ___
lrichel pbwatkins -- we've used clickers for 4 years... turning point
Laurel Littrell What we want to see is integration of knowledge and critical thinking into the other outcomes... diversity, communication, integrity.
suzettes We've tried to incorporate Clickers in our instruction sessions but it's difflicult to do in a 45 minute timeframe.
Simmons_Hernon You all have some great ideas. You av the basis for meaningful dfisucssion ith faculty at the program level
pwatkins1 lrichel - whats been yr experience w/clickers?
nefrazier3 yes--same experience w/clickers and time frame. also need to get in to the classroom first for setup
Simmons_Hernon The challenge is for faculty (and librarians) to move byond the couse level
nmurillo1 Sounds very vague. I don't understand how we can measure student outcomes over time without using some sort of assessment tool like a post-test.
Laurel Littrell Our first task was to get someone appointed to the assessment committee! It really helped after we got that done.
InfoLitGal sounds like ask the audience for "Who wants to be a Millionaire" gameshow
kathy.labadorf I've heard that the best way to improve learning is to improve teaching. Would you agree?
lrichel pbwatkins I love clickers -- immediate assessment, at the moment, throught the 75 min class
pwatkins1 wow - 75 minutes
mollyanswers Clickers have worked great for us. But pretest posttest model is a challenge
nefrazier3 and nice to use the clickers in the beginning of class to guage students' experience w/particular databases, etc
Simmons_Hernon At the course level I ony use the minute assessment. I do not focus much at the course level,. Ican read students and learning witout ore involvment. So more pre and post testing to prgam level (and advancing rubrcis)
cohenarl When will the transcription of this discussion be available; I'm getting alot of new info?
page2page i think we may be caught up in the course level because it seems like the most imediate way to prove our usefulness
lisalibrarian you can get out of the pre-post trap by not thinking so much about how does the student change from where they were to what level has the student attained
South7th You know I don't think clicking during classes or post-tests conducted immediately after classes actually mewasure learning.
nefrazier3 at course level, it seems our greatest successes may come thru good relationships we've built w/faculty
page2page however the stories of true learning in the program level would be more powerful
lisalibrarian then, it doesn't matter so much where they started from as much as how many students attain successful levels
ECalderon where does one suggest to start do we want to leave out pre-post assessments pre assessments r vip
lisalibrarian my 2 cents :)
ECresdesk cohenarl, it's logging as we speak at: http://chatlogs.meebo.com/room/onpoint/logs/today/
mollyanswers I agree. About moving beyond the class specific assessment. I missed some of the earlier postings. But where to START to get beyond the classroom.
Simmons_Hernon I attended the Assessent conference last summer in Seattle-to hung p on course leve. With accreditators deamnding progam level, here isa great opportunity
aq8554 Actually co-developing the rubric with faculty would level their expectations somewhat about what their students should know.
South7th I would be more interested in knowing the degree to which a skill or knowledge is retained at the end or beyond the end of an undergraduaute program.
sbrasley We need to educate ourselves more about activities associated with course-level assessment, program and institutional. I'm glad the the ACRL Immersion program now has an assessment track, so we can be up to speed.
kmcrowe working with faculty and also with key administrators on campus e.g. assessment peopel, curriculum people,
aq8554 It would also help faculty look to the library to improve discrete areas of their rubric?
Simmons_Hernon I agree ... My books are editied ones and invlve a numer of players. Will gie you something to think aobot
nefrazier3 co-developing rubrics w/faculty sounds ideal. working and interacting w/faculty on campus committees helps promote our abilities to help in this area
mollyanswers Do multiple classes assessed coupled with "customer service" type feedback from instructors = Program Level assessment.
kmcrowe assessment immersion focuses on program assessment I highly recommend it
Simmons_Hernon Yes, work collaboratively with faculy on outcomes and rubrics
nefrazier3 it sure helps to have a place at the table on assessment and/or curriculum committees
pwatkins1 easier said than done
Simmons_Hernon Customer service (as satisaction) is an output. Accrediators would be interested. Butths is not outcomes assessment
meganoakleaf Ditto Peter. Working with faculty on rubrics is great fun! And really illuminating for both parties. Great too to include students in the process.
Simmons_Hernon Easiersaid than done. Well, a lot s being ne. Dive in
rouxlibrary Yes, I have to admit that I still don't quite understand what constitutes program level assessment
pwatkins1 how do studnets get involved?
Laurel Littrell Getting to the table is the first challenge and sure helps.
aq8554 In fact, isn't "assessment" basically the technique here. In other words, you're not focusing so much on the outcome of the assessment itself, but on where the holes int he rubric would tell you to address first?
Simmons_Hernon program level-look at te courses from ore to eective. Look t the progression of student learning. What shoudl they knwo and be able to do t this stge, next stage, etc
aq8554 Then if you try something else to incrase their info literacy to address X box in the rubric, you could assess the effectiveness of that 'improvement' by whether the score in that particular box went up?
Laurel Littrell Program level is seeing how the learning in all the classes fit together.
Simmons_Hernon Outcomes has different parts--your goal (outcome), whih one
Simmons_Hernon Then what is the corespndign rubirc,.the how use the information to mprove
kmcrowe and fits into the whole curriculum (program level)
Simmons_Hernon Rigt, the ooutcome and rubirc are accepted by the whole progam .. You are goind beyond whatis learned at ocurse levl
jonesphi Does program level mean for an institution? A major?
Simmons_Hernon major
Laurel Littrell That is why there is such pressure on the teaching departments, to have a rubric and plan for every single degree program.
Laurel Littrell They seem to be grateful for whatever partnership we can do with them!
Simmons_Hernon To compicate matters som places have institutonal outcvomes. Simmons has sai it is leadershp. So here beocme an area to developoutcme
cohenarl I guess this is like a prerequiste?
nefrazier3 do you think that suggested outcomes for basic vs. advanced levels would work? or would you recommend say, all 4 yrs of a 4-yr program?
Simmons_Hernon theree would still be program outcomes as criticla thinking and better communication skills
Simmons_Hernon rubric factors in basic and advanced--you are progressing studentd
ECalderon info lit skills are imprt
c_hammer How wide/extensive is program level? Post-graduation assessments?
BobPh_ftw have you discussed course mapping of program outcomes? if so, I will find it in the transcript.
Simmons_Hernon So for an undergraduate in their major, wat are the desired outcomes and programs may have different rubirics
Simmons_Hernon The mistake I see is that to many people try to do too mcuh
ECresdesk Esp when administrators are pushing for assessment
jonesphi What are they doing that they shouldn't?
cohenarl about prerequisites; does this create a progressive learning path?
Laurel Littrell Some try to do too much and some completely ignore the requirements! :-)
Simmons_Hernon The prblem also is the literature. there is a lot of fiocus on LibQUAL, which is an output not anoutcome
nmurillo1 I don't think our faculty see us as legitimate players in the development of learning outcomes in their departments.
Laurel Littrell LibQual is service assessment, not student learning outcomes assessment.
Simmons_Hernon No, in doing too much I am saying be selctive in getting stted with outcomes and rubrcs. You can build lter
breitena some programs offer capstone course at the end. this would a natural place to perform an assessment of info lit learning.
margotconahan **This is a fast and furious conversation, everyone! We told Peter to plan on about 45 minutes so I just wanted to chime in with a 5 minute warning. You are all welcome to continue the chat, but wanted to give a heads up on the time.***
Simmons_Hernon Rght, LibQUAL is that. BUT a lot of the literature moves it to the other side
Laurel Littrell Getting faculty to accept us as partners is critical to our participation.
kmcrowe absolutely!
nefrazier3 have others impelemented the Research Practices Survey? HEDs/NITLE, originated I think w/St. Olaf's and other midwestrn. colleges?
InfoLitGal amen
Laurel Littrell We get on better with some departments than others!
Simmons_Hernon I am having a hard time keeping up wih all of the exchanges I am delighted to introduce the topic. If Marogt wans m back, happy to advance our chat
South7th LibQUAL seems built on the assumption that libraries are service/support organizations and not educative.
lisalibrarian LibQual does have questions though about how users perceive the library's impact on their info lit skills
guest7601925 At Binghamton University we are currently doing our second round of a Research Practices survey
Simmons_Hernon Again start by reading the Middle States text and ahve a chat within your libraries about what we are discussing.
InfoLitGal it always boils down to the politics of your inst. How well your chair gets on with the other chairs & admin
lisalibrarian it isn't student learning assessment but is good data for then using to say librarians have something to contribute
kmcrowe I'l like more info on Research Practices
page2page but perception is well perception
nefrazier3 we just did our first round--to FY students and seniors
pwatkins1 true
guest7496612 I am fuzzy what is the diffrence between an outcome and an out put?
Simmons_Hernon A urvey may have program use, I'd need to know more.
InfoLitGal Ours has a rodney dangerfield approach with all other chairs
lisalibrarian yes, but if students perceive the library as helping them develop info lit skills - then that can help in saying why librarians should be part of the conversation
nefrazier3 Link to more info about development of the Research Practices survey:
http://www.stolaf.edu/offices/ea/Assessment/ResPra…
Link to the sample survey:
http://www.stolaf.edu/offices/ea/RPS_SurveyInstrum…
aq8554 Thanks so much -- gotta run!
InfoLitGal ciao
Simmons_Hernon Stduent learning outcoes tests our desire to e effective teachers focus on active learning
ECalderon bi
margotconahan Whew, Peter, you may need a breather, so I'd like to thank you for facilitating this chat and invite other to stay and continue the conversation.
Laurel Littrell Thank you!
pwatkins1 thx, peter
nefrazier3 Thanks for the good info!
meganoakleaf Thanks, Peter.
catbark thanks, learned a lot!
margotconahan We'll post the transcript on the ACRL OnPoint page so you can reference today's discussion.
nmurillo1 Thank you.
Simmons_Hernon Margot, i am happy to stay for a few more minutes, You are all wearing me out Ber time
guest7601925 Thank you!
kathy.labadorf Thank you. See you in Seattle
ECalderon great books !
breitena thanks...This is great information!
ECalderon bye
cohenarl Thank you; so interesting.
sbrasley Thank you Dr. Hernon - I look forward to your talk at ACRL
margotconahan Great, any last questions or comments for Peter?
Simmons_Hernon I enjoyed taling with you.Peter
Ailya Thank you
Simmons_Hernon No, I am set. Just: hereis a great opportunity to collaborate with faculty. Enjoy
Simmons_Hernon I lerned from all of yu as well. Bye
Amy_Gustavson Thank you!
guest7496612 Thank you!
millerja Great tips - thanks!
margotconahan If you're attending the Seattle conference, Peter's session is scheduled for Friday afternoon.
