View Assessment Quality Dashboard Details
The Insights Portal is available in D2L Fall 2024.
Quiz Details Table
The Quiz Details area contains a dynamic table of quizzes that meet the criteria applied to the dashboard. An “!” icon appears next to quizzes that have one or more flagged questions. Click on any of the quizzes in this table to navigate to the Quiz Item Analysis page for that quiz.
The Quiz Details table includes the following:
| Quiz Details | Quiz Detail Description |
|---|---|
| Quiz | Name of the quiz. |
| Average Score | Calculated as a percentage using the score for each user’s first attempt at the quiz. |
| Reliability Coefficient | Reliability is calculated for all questions whether the quiz questions are all dichotomous or not. Reliability will usually range from 0 to 1, but negative values are possible. |
| Number of Quiz Items | Total number of questions in the quiz. |
| Flagged Quiz Items | Number of questions that are outside the set threshold for acceptable values in the quiz. |
| Number of Learner Answers | Number of distinct users who have attempted the quiz. |
Select a quiz to get more details on a specific quiz.
Quiz Items Table
The Quiz Items table displays statistics and details about each question in the quiz, including:
| Question Items | Question Item Description |
|---|---|
| Question | Question text. Truncated to 70 characters. |
| Mean | Calculated as a percentage to two decimal places using the score for each user’s first attempt at the question. |
| Top Incorrect Answer | Most frequently reported incorrect answer. Note: Only populated for multiple choice and true or false questions. |
| Top Incorrect Answer Rate | Response rate between 0 and 1 for those who selected the most common incorrect answer. Note: Only populated for multiple choice and true or false questions. |
| In Question Pool | Indicates if the question is part of a question pool. |
| Standard Deviation | The standard deviation of the grade of the question using each user’s first attempt. |
| Correlation | This calculates any possible correlation between the question score and the total quiz score. Displays N/A when all users answer the question correctly. |
| Discrimination Index | This calculates any possible discrimination in the question between the higher and lower-performing learners by subtracting the question’s lower 27% from its upper 27%. The higher the difference, the better the question discriminates between high and low-performing learners. A negative value indicates that more low-performing learners are correctly answering the question than high-performing learners. This would most likely indicate a flawed quiz question. |
| Upper 27% | Average question grade of the users with quiz grades in the top 27%. Note: When there are 10 or fewer question attempts, the upper and lower 50% is considered instead of 27%. This makes the statistic relevant with smaller sample sizes. |
| Lower 27% | Average question grade of the users with quiz grades in the lowest 27%. |