assessment

We have uploaded the following Sakai/OSP data structures as a resource in Open Ed Practices:

1. An AAC&U Learning Outcomes Matrix with VALUE Rubric Evaluation Forms. The matrix has a row for each VALUE Rubric and columns for General Education, Coursework, Co-Curricular Activities, and Internships and Employment.
2. The VALUE Rubric Evalution Forms and their customized renderers as separate OSP data structures (for use in other matrices or wizards).
3. A Glossary defining the 15 AAC&U Essential Learning Outcomes for mouse-over and pop-up definitions in the matrix.
4. A Read Me file with instructions for installation.

One way to implement these data structures in a Sakai/OSP version 2.6 portfolio workflow is as follows:

1. The system admin sets osp.experimental.assignments = true in the institutional instance of Sakai/OSP.
2. The system admin or instructor sets up a portfolio site with the Resources, Matrices, Forms, Glossary, Evaluations, and Assignment tools and imports the data structures we have provided.
3. The instructor adds and posts assignments in the Assignments tool indicating to students in the assignment instructions which VALUE Rubrics will be used to evaluate each assignment once submitted.
4. The instructor adds the appropriate assignments to each matrix cell according to the VALUE Rubrics that will be used to evaluate the assignment.
5. The student completes one or more assignments and submits them for evaluation.
6. The matrix automatically posts the assignment to appropriate matrix cells for evaluation using the rubrics specified by the instructor.
7. The student reviews the assignments to be evaluated by each rubric (within the context of general education, coursework, co-curricular activities, and/or internships and
   employment).
8. The student completes a reflection indicating his/her progress on the relevant skill
   or understanding and submits the cell for evaluation.
9. The instructor may access the matrix of any student at any time by using the drop-down menu at the top of the matrix to view the matrix of a particular student.
10. The instructor may use the drop-down menu in the matrix to fill out a (formative) feedback form for any matrix cell of any student at any time.
11. When the student submits a matrix cell for evaluation, the instructor responsible for evaluating the cell will be able to access that cell through the Evaluations tool or via the drop-down menu in the matrix.
12. The instructor assigned to each particular cell uses the Evaluations or Matrix tools to access the student submission and review the evidence and reflection in each submitted matrix cell.
13. The instructor evaluates the evidence using the clickable evaluation rubric form in each submitted matrix cell. The evaluation form records the scores and calculates the average, assuming that all criteria receive equal weight.
14. The instructor saves the evaluation form and decides whether to complete the cell (lock it from any further change), leave it as pending evaluation, or return it to ready status for more work by the student.
15. The student reviews the instructor's evaluation via his/her copy of the matrix.

A second way to use the data structures would be to use the guidance features in each matrix cell to suggest to students what evidence to supply for evaluation with each VALUE Rubric. A drawback (or possible advantage) of this method is that students would have to think more analytically about how their available evidence fits each educational context and each essential learning outcome. Students would also have to take the initiative in associating evidence with multiple matrix cells in order to address all the learning outcomes. The matrix could be modified to have only one or two columns as a means of simplifying the process.