PRIMO: Peer-Reviewed Instructional Materials Online
Selection Criteria
Members of the PRIMO Committee
review and evaluate instructional materials submitted for inclusion
into the
PRIMO database according to the following criteria:
| Criterion #1 The
instructional design is pedagogically effective, i.e. it
teaches well according to the scope and learning objectives
stated by the submitter.
- Purpose and objectives are clearly stated.
- The resource's organization supports the objectives.
- The resource's content supports the objectives.
- Offers opportunities to utilize higher order
thinking skills (think, reflect, discuss, hypothesize,
compare, classify, etc.).
- Allows for different learning styles, e.g. kinetic,
visual, auditory.
- Uses assessment technique(s).
|
| Criterion #2
The technology used to create the material enhances
the learning experience, i.e. is appropriate and effective.
- The technology enhances and does not distract from
the learning experience.
- The technology chosen is stable and able to operate
as an effective mode of delivery.
- The technology is cross-browser/cross-platform compatible, or clear
guidelines and instructions are provided.
- Required plug-ins or downloads are easily obtained
and easy to install.
|
| Criterion #3
This material provides instruction using technology
in an innovative manner.
The technology used has not yet been extensively used to
create instructional material, or has been implemented in an
unusual and/or creative manner.
|
| Criterion #4
The content and language of the material are clear
and effective.
- Instructions and explanations are easy to follow.
- Language is appropriate to the goal(s) of the
project.
- Language is appropriate to the audience of the
project.
- Content is appropriate to the goal(s) of the
project.
- Content is appropriate to the audience of the
project.
|
| Criterion #5
All information included within the material is
accurate.
- The site does not contain significant typographical
errors.
- There are no apparent factual errors.
- The site provides indications of maintenance, e.g.
information about when it was last updated.
- The site offers some type of contact information
(email, phone, or postal address) for author and
Webmaster if questions or technical problems arise.
|
| Criterion #6
Organization of the material is clear and easy to use.
- There is an index, table of contents, or site map to
facilitate navigation.
- Users can easily find their way back to the home
page and/or to other sections.
- Has a visible and logical sequence or structure.
- The text is easy to read and graphics are easy to
understand.
|
| Criterion #7
This material demonstrates unique or creative use of
graphics, examples, interactive elements such as programmed
feedback and flexible learning paths, and other supporting
elements.
- The material incorporates design elements such as
graphics, multimedia, flexible learning paths, and/or
interactivity.
- The design elements show evidence of creativity;
they are not tired copies of material from other
learning objects. (A Venn diagram isn't creative, but a
Venn diagram of singing grapes is unusual.)
- The design elements are appropriate to the target
audience.
- The design elements contribute to the coherence of
the material.
- The design elements are well-executed and
professional (i.e. graphics don't look like scribbles,
animations aren't jerky, sound and video have been
edited to flow smoothly, text within graphics is visible
and legible, spoken words are comprehensible,
interactive elements are easy to use, flexible learning
paths don't turn into mazes).
|
| Criterion #8
This material is relevant to those outside of the
developer’s institution because it presents a model for
other developers.
- It is possible for people outside of the developer’s
institution to gain access to the material. If access to
some elements is restricted, this does not significantly
detract from an outsider’s opportunity to investigate
the material.
- The structure of the material (e.g. chunking,
sequencing, transitions, connections, reinforcement,
assessment, feedback) can be adapted to teaching other
skills, resources, or ideas.
- The method of presentation (e.g. use of text, sound,
graphics, animation, video, language, layout, pacing,
examples) can be adapted to teaching other skills,
resources, or ideas.
- The technology used to develop the material is
available outside of the developer’s institution.
- Information about the system requirements for
effective use of the material is readily available.
- The developer’s approach to teaching or to the use
of technology is thought provoking; it stimulates ideas
about ways to communicate with learners.
|
How submissions are evaluated:
Reviewers assign each of the criteria statements an agreement
value using the following scale:
5 = Meets all the components covered in the description.
4 = Meets all but one of the components covered in the
description. The missing component does not affect the working of
the resource.
3 = Meets many (missing more than one) of the components covered
in the description. The missing components do not
significantly affect the project overall on this criterion.
2 = Meets many (missing more than one) of the components covered
in the description. The missing components do significantly
affect the project overall on this criterion.
1 = Meets only one component for the criteria and is lacking
enough components that the resource is affected.
0 = Does not satisfy any components described.
After scoring each of the eight criteria, the values are totaled.
Review scores from all reviewers are averaged. Submissions receiving
an average score of 32 or higher are added to the PRIMO database.
A note on the project scope...
For PRIMO, quality is a greater goal than is comprehensiveness. However,
materials may be refused because the technology that they teach and the
methodology that they use are already well represented on the site.
A note on legal matters...
The IS PRIMO Committee does not make any claims or guarantees whatsoever
as to the accuracy or currency of the data represented on this site.
Go to
PRIMO Submission Form
Return to PRIMO Home Page
Return to IS Home Page
Send us your comments and questions
