PRIMO Selection Criteria
Members of the PRIMO Committee review and evaluate instructional materials submitted for inclusion into the PRIMO database according to the following criteria:
The instructional design is pedagogically effective, i.e. it teaches well according to the scope and learning objectives stated by the submitter.
- Purpose and objectives are clearly stated.
- The resource's organization supports the objectives.
- The resource's content supports the objectives.
- Offers opportunities to utilize higher order thinking skills (think, reflect, discuss, hypothesize, compare, classify, etc.).
- Allows for different learning styles, e.g. kinetic, visual, auditory.
- Uses assessment technique(s).
The technology used to create the material enhances the learning experience, i.e. is appropriate and effective.
- The technology enhances and does not distract from the learning experience.
- The technology chosen is stable and able to operate as an effective mode of delivery.
- The technology is cross-browser/cross-platform compatible, or clear guidelines and instructions are provided.
- Required plug-ins or downloads are easily obtained and easy to install.
This material provides instruction using technology in an innovative manner.
The technology used has not yet been extensively used to create instructional material, or has been implemented in an unusual and/or creative manner.
- Score 5: yes
- Score 3: no
The content and language of the material are clear and effective.
- Instructions and explanations are easy to follow.
- Language is appropriate to the goal(s) of the project.
- Language is appropriate to the audience of the project.
- Content is appropriate to the goal(s) of the project.
- Content is appropriate to the audience of the project.
All information included within the material is accurate.
- The site does not contain significant typographical errors.
- There are no apparent factual errors.
- The site provides indications of maintenance, e.g. information about when it was last updated.
- The site offers some type of contact information (email, phone, or postal address) for author and Webmaster if questions or technical problems arise.
Organization of the material is clear and easy to use.
- There is an index, table of contents, or site map to facilitate navigation.
- Users can easily find their way back to the home page and/or to other sections.
- Has a visible and logical sequence or structure.
- The text is easy to read and graphics are easy to understand.
This material demonstrates unique or creative use of graphics, examples, interactive elements such as programmed feedback and flexible learning paths, and other supporting elements.
- The material incorporates design elements such as graphics, multimedia, flexible learning paths, and/or interactivity.
- The design elements show evidence of creativity; they are not tired copies of material from other learning objects. (A Venn diagram isn't creative, but a Venn diagram of singing grapes is unusual.)
- The design elements are appropriate to the target audience.
- The design elements contribute to the coherence of the material.
- The design elements are well-executed and professional (i.e. graphics don't look like scribbles, animations aren't jerky, sound and video have been edited to flow smoothly, text within graphics is visible and legible, spoken words are comprehensible, interactive elements are easy to use, flexible learning paths don't turn into mazes).
This material is relevant to those outside of the developer’s institution because it presents a model for other developers.
- It is possible for people outside of the developer’s institution to gain access to the material. If access to some elements is restricted, this does not significantly detract from an outsider’s opportunity to investigate the material.
- The structure of the material (e.g. chunking, sequencing, transitions, connections, reinforcement, assessment, feedback) can be adapted to teaching other skills, resources, or ideas.
- The method of presentation (e.g. use of text, sound, graphics, animation, video, language, layout, pacing, examples) can be adapted to teaching other skills, resources, or ideas.
- The technology used to develop the material is available outside of the developer’s institution.
- Information about the system requirements for effective use of the material is readily available.
- The developer’s approach to teaching or to the use of technology is thought provoking; it stimulates ideas about ways to communicate with learners.
How submissions are evaluated:
Reviewers assign each of the criteria statements an agreement value using the following scale:
5 = Meets all the components covered in the description.
4 = Meets all but one of the components covered in the description. The missing component does not affect the working of the resource.
3 = Meets many (missing more than one) of the components covered in the description. The missing components do not significantly affect the project overall on this criterion.
2 = Meets many (missing more than one) of the components covered in the description. The missing components do significantly affect the project overall on this criterion.
1 = Meets only one component for the criteria and is lacking enough components that the resource is affected.
0 = Does not satisfy any components described.
After scoring each of the eight criteria, the values are totaled. Review scores from all reviewers are averaged. Submissions receiving an average score of 32 or higher are added to the PRIMO database.
A note on the project scope...
For PRIMO, quality is a greater goal than is comprehensiveness. However, materials may be refused because the technology that they teach and the methodology that they use are already well represented on the site.
A note on legal matters...
The IS PRIMO Committee does not make any claims or guarantees whatsoever as to the accuracy or currency of the data represented on this site.