Learn@Illinois Moodle - Using Quiz Statistics to Identify Problematic Questions

You may want to review your quizzes shortly after students have completed them to look for questions that were missed by a significantly large number of students. This information can help you address a relevant topic in a weekly announcement, revise the quiz question(s) for subsequent iterations of the course, or decide to drop the question from the quiz.

For a permanent link to this information, please use: http://go.illinois.edu/MoodleQuizStatistics

To view quiz question statistics, follow the instructions below.

  1. From your main source page, click on the Quiz you would like to review.
  2. In the Administration block on the left, click on the arrow to the left of Results.
    Click the arrow to the left of Results
  3. Below Results, a submenu will appear. Click on Statistics.
    Click on Statistics
  4. Scroll down to see a list of your quiz questions. Note the following key indicators in the table header:
    • The "Facility index" indicates how easy your question is and ranges from 0% to 100% (i.e., a facility index of 100% means that every student answered correctly).
    • The "Discrimination index" indicates how well a question is able to distinguish between knowledgeable and non-knowledgeable students and ranges from 0% to 100% (i.e., a discrimination index of 100% means that all students with high quiz scores did well on this question and all students with low quiz scores did poorly on this question).
    Quiz Statistics Table Header

  5. Determine whether any of the quiz questions are highlighted in red like the example below. Red highlighting indicates that there may be a problem with the question, such as a very low discrimination index.
    Flagged quiz question
    Note: Statistics for randomized question sets (questions with "Random" in the title) are meaningless because they are aggregate statistics for all of the questions in that set. You must examine the statistics for the question itself.
  6. If you are using randomized questions, you must click on the last question(s) that is pooled from the same question category (e.g., see Unit III, Week 8 in the screenshot below) to see a list of all questions in the category.
     Click on the last question in the set
  7. A list of all questions in that category will appear. Click on a question to see more information.
    Click on a question for more details
  8. When you click on a question, you will see statistics on the question and a break-down of responses.
    Analysis of Responses

Related Topics

Moodle.org Documentation

Keywords:quiz statistics, quizzes   Doc ID:79614
Owner:ATLAS-TLT .Group:University of Illinois Liberal Arts and Sciences
Created:2018-01-24 11:12 CDTUpdated:2019-04-02 16:52 CDT
Sites:University of Illinois Liberal Arts and Sciences
Feedback:  0   0