NJMS - Educational Evaluation

All evaluation activities are largely based on a structure-process-outcome model, and include a detailed action plan for responding to the information obtained through the evaluation.

  • Structure represents an evaluation of the content of the educational program (i.e., a course or clerkship). The content of educational programs may be reviewed by internal and external content experts. For example, external reviews may seek out expert opinion of the appropriateness of the depth and breadth of educational program's content. On the other hand, internal review focuses on the extent to which the explicit objectives of the educational program align with and support the overall NJMS goals and objectives. The Division carefully monitors and tracks this information in order to ensure curriculum coverage.

  • Process represents an evaluation of the administrative component of the educational program, such as scheduling, grades, policy compliance, and tracking of faculty effort and roles. This information is essential for recognizing departmental contributions toward the educational mission at NJMS, and is reflected in the mission-based funding decisions. The teaching methods of the educational program are also carefully assessed in this phase of evaluation.

  • Outcome represents an evaluation of the various sources of evidence that can be used to ascribe value to the educational program. Evaluation activities rely heavily on the Kirkpatrick four levels of delivery: Reaction, Learning, Behavior, and Results. Examples of each of these are listed below:

    • Reaction Level Outcomes
      • Student evaluations of the educational program
      • AAMC Graduation Questionnaire results
    • Learning Level Outcomes
      • Grades
      • NBME "shelf" exam scores
      • USMLE exam scores (and trends in subject specific content)
    • Behavior Level Outcomes
      • Objective Structured Clinical Examination (OSCE) grades
      • Clinical performance grades
    • Results Level Outcomes
      • The number and types of physicians graduating from NJMS
      • The location of graduate training

The Division of Educational Evaluation & Research encourages early collaboration with program planners (i.e., course and clerkship directors) to develop an evaluation approach that will provide information that can be used to plan and adapt current programs, as well as to prepare for subsequent program offerings.