Activity Report

Any user with access to Explore (Global Admins, Area Admins, and some Users) can edit an Activity Report. All users can view an Activity Report.

Pricing

Available on paid plans (Analyst, CLO, and Enterprise).

Expertise

Anybody (both beginners and experts) can use this feature.

What is an Activity Report?

The Activity Report provides in-depth analysis of an activity (such as a course, video, or assessment). Beyond providing insights on how learners perform, this report can perform advanced question analysis to make sure organizations are asking the right questions in their assessments.

Creating and Editing an Activity Report

Use Explore to create new Activity Reports and to configure existing Activity Reports.

Activities Filter

Required: You must select at least one activity for the Activity Report to show data.

Once you've selected an activity, the report will begin to populate with data. If you select more than one activity the report will include all data associated with every selected activity.

Hint: If your data includes questions, be sure to leave the 'Include Related Activities' checkbox unchecked to avoid question data appearing in the top level reports.

Advanced Configuration

Advanced configuration is designed to be used by expert users who understand JSON and the properties of xAPI statements.

Certain settings are only configurable in Advanced Configuration.

Property

Explanation

Example value

surveyMode

If true, the report assumes that data represents survey data and hides any information relating to scores, success or answering questions correctly/incorrectly. Multiple choice options are displayed as multicolored bar charts instead of the grey normally used for incorrect answers.

false

displaySection

A collection of properties that determines which of the Activity Report's sections are displayed.

Interpreting an Activity Report

Completions, Incompletes, Successes, and Failures

The Completions, Incompletes, Successes, and Failures chart shows participation data for an activity:

Completions are people that have completed the activity.

Incompletes are people that have started the activity but not finished.

Successes are people that have completed and been successful at the activity.

Failures are people that have completed but failed the activity.

If your organization is sorted in different groups, you’ll be able to navigate your organization by clicking on group names within the chart. This way, you’ll be able to see how participation data differs across your organization. You can also use the search box at the top of the report to isolate certain parts of your organization.

Key questions answered: How many people completed the activity? How many people failed the activity? Which part of my organization is performing the best?

Leaderboard

The Leaderboard shows data for each person that completes your activity. You can see how many times a person completed your activity, if the person was successful, and how long the person spent with your activity, and the average of all the times a the person completed the activity.

The time range shows the last 28 weeks of activity. Blue circles represent activities made by this person related directly to the activity, and grey circles represent activities made by the person that are not related to this activity.

Key questions answered: Who did the best on the activity? Who did the worst? How long did certain people take to complete the activity? How many times did certain people take the activity? How active have people been recently?

Scores

The Scores chart shows the breakdown of how all of your people are performing. Your people are grouped into score ranges, and the chart displays the percentage of your users that fall into each range. Using the Attempt filters, you can choose whether you want to see all attempts, best attempts, first attempts, or last attempts of the activity.

Key questions answered: How did most of my people score on this activity? Should I have my people attempt this activity again?

Average Score

Use this graph to see how the average activity score changes over time. Using the Attempt filters, you can choose whether you want to see all attempts, best attempts, first attempts, or last attempts of the activity. You can also change the size of groupings using the dropdown in the top right corner of the chart.

Key questions answered: Are my people getting better? When are most people finishing the activity?

Completions & Successes

Use this graph to compare completions and successes of your activity over time. Using the Attempt filters, you can choose whether you want to see all attempts, best attempts, first attempts, or last attempts of the activity. You can also change the size of groupings using the dropdown in the top right corner of the chart.

Key questions answered: Are most people passing the activity? How many times did people attempt the activity? Does it get better over time?

Average Time to Complete per Month

Use this graph to see how the average time spent on your activity changes over time. Using the Attempt filters, you can choose whether you want to see all attempts, best attempts, first attempts, or last attempts of the activity. You can also change the size of groupings using the dropdown in the top right corner of the chart.

Key questions answered: How long is it taking for people to take the activity? Are people getting faster?

Questions

In this section, the Activity Report gives you detailed information and insights about each question. Sometimes performance on individual questions is predictive of overall activity performance. Sometimes questions are too easy and everyone gets them correct. This information is surfaced for you so you can improve your activities.

For each question, you’ll be able to see the average time it took people to answer, how people answered, and even view individual answers. If a question has notable insights, they’ll be surfaced with the question results and at the bottom in a section called Question Analysis.

The Activity Report can visualize different types of questions, and depending on the type of question asked, your results will be displayed in a different chart or graph:

Multiple choice

In this multiple choice question, the correct answers are highlighted in blue (Golf Example and Tetris Example). Below the chart, you can see that this question is poor at predicting who will do well on the activity. The bubble on the left shows the average time it took to answer the question (57 seconds) and you can view how specific people answered the question with the View Individual Answers link.

True/False

In this true/false question, true is the correct answer and most people answered correctly. According to the insights below the chart, this question is poor at predicting who will do well on the activity (probably because it’s an easy question).

Likert scale

Likert scales ask people to choose one answer on a scale. On this Likert scale, most people answered “It’s Gonna Change the World.” You can hover over different sections of this chart to see numbers of people that answered each way, or click View Individual Answers to see how everyone answered this question.

Sequence

Sequence questions ask users to place items in order. Results are displayed in a grid where the x-axis represents order and the y-axis represents the items being asked to sequence. Each square in the grid contains the number of people that placed the y-axis item in the x-axis number place. In this example, 8 people placed “Tim” first. As the number in a square increases, the square itself becomes darker. The items are placed on the y-axis in correct order, so the diagonal squares will ideally be the darkest. This would mean most people sequenced your items correctly. You can hover over each square with your mouse to get more information.

Matching

For matching questions, the correct answers are identified with blue lines and text. The chart to the right of the answers shows the percentage of people that answered each way.

Question Analysis

The Question Analysis collects the insights surfaced from each question and shows additional insights:

Key questions answered: How are people performing on each question? How are people answering a particular question? How long are people taking on each question? Which questions are easy? Which question is indicative of someone that will do well on the activity?