Outstanding known issues awaiting resolution are distinguished by PENDING.

7.1810 Release

Title (Internal #)

Description

Work Around (if known)

Fixed in Release

Unable to retrieve and view cases and case questions. (D-32196)

Users have reported the inability to view cases on the cases page and retrieve questions tied to specific cases. This is a result of deleting a draft case exhibit from the draft/return tab on the project writing summary page.

There is no workaround to remedy the issue after a case exhibit has been deleted; it is advised to avoid deleting case exhibits from the draft/rejected tab and rather delete the case itself from the cases page.

PENDING

Excel Custom report failing with Compound item type (D-31932)

It was discovered that custom reports are currently failing if compound items are included.

No workaround to export this item type at this time; remove the compound items from the query to generate the remaining items on a report.

PENDING

Initial review decision is not removed if user goes back to a previously reviewed item (D-32331)

When a reviewer chooses to advance an item during a review assignment the item will show that the user has advanced it. If that user then uses the "Previous" button to navigate back to the item and then chooses to Modify the item and then Advance, instead of the modification counting as the first Advance vote, it's actually counted as a SECOND vote to advance.

Instruct users to not use the previous button during review until system is corrected.

PENDING

7.1809 Release

Title (Internal #)

Description

Work Around (if known)

Fixed in Release

Clicking Save on an Enhanced Matching item not working (D-32077)

It was found that if a Reviewer was modifying an Enhanced Matching item and edits the Targets, Tokens or Labels, and they click the "Save" button, the system will show the user that changes have been saved, but they have not.

The Reviewer cam make changes and then click the "Advance" button. That will save the changes made as well as Submit the item.

It was discovered that user tracking information (Advances and Returns) for review states is being removed on the latest item revision when a PM batch edits items to move them to a previous review state. For example say we have four review states: Review 1, Review 2, Review 3, and Review 4. Items pass though the workflow to either a validate or completed state, user tracking is captured on each review state. The project manager decides that the items must be moved to Review state 3 for re-review, the expected behavior is that the user tracking data is retained for Review 1 and Review 2 as these states present before Review 3, the actual behavior is that the user tracking information across all 4 states is removed on the latest revision. Please note that the data is still retained in the history of the items.

This issue is only related to batch edit. Users can move items from a completed state to a previous state from the Examine Questions page without issue.

PENDING

7.1807 Release

Title (Internal #)

Description

Work Around (if known)

Fixed in Release

Metadata removed on Items (D-31138)

It was discovered that items are losing all metadata in the system after modifications are made. At this time we have not isolated the root cause of the defect but are working on this with the highest priority. Organizations with affected items have been contacted about the issue and we will provide daily reports of any newly affected items so metadata can be restored.

When project managers move items back in the review workflow via batch edit the previous reviews in that particular state are not being removed as expected. Users with a review assignment that previously reviewed that item in that state are unable to review those items.

Project manager would need to manually move the items to a different review state and then back from the examine questions page. Reviewers could also be instructed to select the check box to "Include previously reviewed questions" on the Project Review summary page, but this would return all items assigned to be reviewed whether a re-review is intentional or not.

PENDING

Item Retrieval Issue (D-30540)

After returning items from a search if you were to select all items after the query executed and removed 5 (for example) from the first page only the items from that page would be examined/observed minus the 5 that you unselected.

Further filter you query to remove the unneeded items or navigate to another page link after running the query and back before examining/observing the questions.

PENDING

Adding a comment to items can update the User Tracking incorrectly (D-31280)

When a user edits an item to just add a comment (either through the modify page or batch edit) the user tracking for the previous version will get updated with an incorrect user name. If a comment is made while making an edit to an item the user tracking is correctly showing.

When you search for a question that belongs on a case and then try to edit the case from the question, the application just hangs when you try to save the case and you are unable to navigate away from the modal. You need to close the browser tab and reopen and navigate back to the application. No change is made to the case either.

In order to edit the case you need to edit the case directly by searching for the case and editing it.

A published exam form with subsequent published sections or an unpublished form with published sectionsAND

Export Revision Code must be enabled on the Exam form

After publishing the sections and form if a user were to modify one of the questions belonging to the exam form in question, the revision code would update upon export to the latest revision code. This only occurs in the section XML whereas the itempool XML shows the correct version based on when the form/section was published.

Clone the exam, republishe and re-export so the latest revision exports on the exam

or

Modify the QTI in the section.xml file to reflect the appropriate revision code

When a user searches for items to add to a section, selects the items and then clicks the "Add Contents" button, the items are added to the section but in a random order and not by Question ID order as expected.

After adding the items to the section, use the "Sort" dropdown list to sort the items by Question ID (or any other option) before saving the section.

For new and existing Point and Click items. When viewing a point and click item on the examine questions page the system will show the appropriately designated response type for a Point and click item, either Hot Spot or Hot Area. For items listed as Hot Areas if you were to open the item for modification the system will select the response type Hot Spot by default. If users aren't aware and submit the item it will then become a Hot Spot response type.

Ensure when modifying Point and Click items that the appropriate Response Type is selected before submitting an item. Existing items that have not been modified will export with the appropriate QTI settings.

When a project manager deletes metadata values from the manage metadata page they are prompted if they want to retain statistics. Even after selecting "Yes" to retain statistics the statistics are removed from all revisions of a question.

Remove the metadata from the items individually before fully deleting the metadata from the system.

When an item type is changed and that item is on a published exam, if you use the Prometric XML export, the item type will be changed on the XML export. This should now happen since the exam is published.

Do not change an item type for items on published exam or wait to publish it until all changes are made.

When exporting block text metadata as part of the Form Level Item statistics report html entities are being converted to characters.

Generate a custom report to return relevant metadata for questions on exam forms.

PENDING

Draft items not moving to correct state when batch editing (D-30290)

If a user chooses to Batch Edit items that are in Draft state to a review state passed the first one (without having the item submitted from the author first) the items that are in Draft state do not go to the correct Review State, they instead save as whatever the first Review state is in the project.

Have the Author Submit the item to get it out of Draft state or batch edit to the first review state and then batch edit again to the desired review state

PENDING

Users able to delete/modify blueprint nodes with published exams (D-30611)

When a project has exams that have been published, the blueprint document associated with the project should not be allowed to be edited. Currently edits are being allowed on the blueprint which in turn will show the incorrect blueprint classification to be showing on any exam exports. This will affect reporting groups as well as loft settings if used.

Before editing a blueprint document, please check your project to see if there are published exams.

Previously when an exam was made editable in a new project, the items were made viewable in that project automatically. The system will not share the items automatically now and the user will have to share the items manually.

After making the exam editable, go to the "Add Questions" are and use the search for "On Exam" and then select the items to be shared to the new project.

PENDING

Review states showing out of order on Dashboard (D-30451)

When a reviewer looks at their dashboard and there are multiple review states in the project, the states are not showing on the dashboard in the same sequence as they are set to be in the project.

This is existing behavior not a defect.

Equations used in Metadata fields do not load (D-30807)

When an item has an equation that is used in a block text metadata field, it will not load in the equation editor.

PENDING

Custom report fails when including "associations" (D-30482)

When a user runs a Custom Report and chooses "Associations" to be included in the report, the report can sometimes fail. It is found to happen more often when there are large numbers of items included in the report.

Run the report on a smaller group of items (50 or less) if associations are needed

PENDING

7.1804 Release

Title (Internal #)

Description

Work Around (if known)

Fixed in Release

Items changing Review states after removing review states from project (D-29423) STILL ANALYZING IF THIS HAPPENS IN A PREVIOUS RELEASE

When a user removes a review state from a project, even if there are no items in that state, the system can move items to a different state in the workflow.

Please run a custom report prior to removing any review states from a workflow so that the item states can be reviewed after removing it.

Write Question Link is showing when "Restrict Users to only write assigned questions" is checked.(D-29237)

The setting "Restrict Users to only write assigned questions" checkbox when checked is not working properly, allowing users to write any questions they would like.

PENDING

Min Max settings on Point and Click Items in QTI (D-29321)

Before 1803 when authoring Point and Click items (Hot Spot/Hot Area) when exporting items in QTI Min/Max settings were automatically coded in the QTI based on the number of correct responses. In version 1803 this setting has been removed giving the candidate the ability to specify more responses than the number of correct responses.

Enable Min/Max configuration from the Manage-->Settings–>Configuration page. Set the Min max for Point and click items to # correct for each property.

If a user has no current writing assignments, the Draft/Reject count in their Writer dashboard will show as 0, even if that user has items in the Draft/Reject state on the Project Writing Summary page.

When editing Enhanced Matching items, if a user sizes the target or token boxes smaller than the size of the text in the box, the application will become unresponsive and the user will have to force stop the page in order to proceed.

When a user completes their review assignment, it no longer shows on the Summary page since it is complete. Clicking the "Include Previously Reviewed" checkbox will bring back items that the user has reviewed before if there are still items in the assignment. Checking that box will not bring back items if the assignment has been completed.

PENDING

(Exam/Section) Clone and Translate failing

When translating a form or section to a targeted language the process is failing. Users will noticed when attempting to clone and translate an exam form the process appears to complete immediately but the form is never created. For sections the process continues to run and the system eventually times out with no section created.

For some users the counts showing on their dashboards and the summary screens are not showing the correct counts of items. When the user clicks the button to complete the assignment the correct numbers does show in the queue.

Deleting the assignment and reassigning it does correct the count for the user

When a user has reviewer permissions in one project and logs into the application, they are able to see all of the project names under an itembank. The user is not able to click on the project or see any content within the project, just able to see the names of the projects on the dashboard.

Projects load slower in some itembanks when switching between projects. Also the list of projects showing on the Writer, Reviewer and Validator tabs on the Dashboard are no longer in alphabetical order.

Create an External Item with Valid QTI containing an &iacute; or &oacute; or &aacute; or &iquest; or &ntilde; or &eacute; character

Submit the item without saving (if you save the item the characters are converted to their respective HTML entities and thus cannot be saved)

Add the item to an exam form and export

Actual Result: Error is returned

"You are seeing this because an error occurred servicing the current request. Please quote the error described below when reporting the problem. An unspecified error has occurred. It is possible you may have been logged out of the system."

Side Note:You cannot actually add these HTML entities in the External Item QTI Editor, when you paste in QTI containing the physical em-dash or en-dash character the system automatically converts them to HTML entities after saving the item.

When running the Choose your Own Configuration report from the Custom reports page, the report is generated, however when the user tries to download the report, it is saved without the correct file extension (.xls or .xlsx) This is found only when using Firefox

Use a different browser or after saving the file, rename it to add the correct file extension before opening

External Items with a &mdash; or &ndash; entity fail to export. This is valid QTI and should be allowed.

Side Note:You cannot actually add these HTML entities in the External Item QTI Editor, when you paste in QTI containing the physical em-dash or en-dash character the system automatically converts them to HTML entities after saving the item.

When examining items and viewing the membership window details, the system will return to last modified item (D-25580)

When selecting and examining a grouping of items, when the initial item's membership details window is viewed via the questions metadata and then closed upon review with no modifications made. Proceeding to the next item, either through the 'Next' button or drop-down list and selecting the 'Modify' button, the initial item displays rather than the next item selected. This occurs when selecting an item ID from the membership window of a given item.

7.1706 Release

Title (Internal #)

Description

Work Around (if known)

Fixed in Release

Issue with Matching items scoring (D-24578)

Issue with Matching Items scoring correctly. When the items have been created and exported the scoring action is adding 0 to the score variable upon selecting the correct responses, with both Default or Item scoring selected. Item scoring can be set for any number and it still outputs 0.

On the Manage Itembank > Users area, there are settings to allow a user to View the Items in the Itembank and View the Assets in the Itembank. These settings are not able to be edited from this area any longer.

To give users access to view the items, you can give them the Observe permission in all of the projects in the itembank.

When items are removed from a project the blueprint classification disappears on the items. This results is the items not being searchable and/or when sorting from the Project Bank, the items with not appear listed.

At the ItemBank level, the inability to export any items in the custom report "Set my own configuration" regardless of question count. The file generated does not have an extension, therefore you are not able to open the file.

Issue is related to the name of the Item Bank containing a semicolon (";")

When attempting to add the reference to a new item or when modifying an item, the existing reference does not populate in the select reference box and the following message appears "Many more than 50 references were found. Continue to refine the search."

ErrorAutoLogEmailAddress moved to appsettings.config file in 7.1704 release. Pre-1704 remote clients will have this issue and solution is a Hot Fix patch for the hard coded email (rackspace). Remote clients should escalate to their Application Consultant.

When navigating to Manage > Reports > Additional Reports and selecting either the Exam Item Stats report or the Item Stats Report. The Analysis group and Analysis set drop downs are unexpectedly auto set and a validation error occurs, resulting in the report unable to be generated.

Change Analysis set preselection to 'Default' in the project config, then go back to Additional Reports and manually select the analysis group and analysis set desired.

Users received emails for assignments that had not been completed. Some of the emails were over a year old. It was found that the mail job was timing out and not actually sending the assignments previously.

Users can go through and delete any assignments that are still outstanding in the system or turn off the email notifications for the project.

When users are frequently inactivated and activated that users have active assignments assigned to these users, the following message is displayed:

"By choosing to retire the selected user(s), any write, review or validate assignments will be deleted and they will no longer have access to the system. Are you sure you want to retire the selected user(s)?"

The assignments are not being deleted from the user(s), which is the expected behavior. Therefore, the verbiage needs to be corrected.

Question with Exhibit is displayed twice on Add Exam page, when same question is added to different sections and sections in Exam (D-21481)

With the Configuration setting for "The same item can be added to multiple sections within the same exam form" set to "ON". When adding a item containing and exhibit to multiple sections to an Exam Form, the item will appear correctly in the first section, however will appear twice in the other section. Click HERE for an example.

Unable to export exam when question type is changed while modifying the question (D-21210)

When a question type is changed to an item contained on an Exam form, the QTI package will not export and an error message occurs:

"You are seeing this because an error occurred servicing the current request. Please quote the error described below when reporting the problem: An unspecified error has occurred. It is possible you may have been logged out of the system.

Cases containing tables that a header column that is merged across multiple columns causes the expansion/contraction of columns occurring in all cells below the merged header when spilt screen divider is adjusted in TSS.(D-20473)

When split screen divider is adjusted in the case stem containing a table that has a header column that is merged across multiple columns, it causes the cells to expand/contract. Click here for a before screenshot of table with no adjusted made to the split screen divider. Click here for a after screenshot of table after split screen divider is adjusted.

y default QTI creates only one <colgroup> tag containing the width attribute for the 1st column under the merged header, not for remaining columns, resulting in a dynamic width. For resolution, add to each remaining columns the <colgroup> tag and setting the width attribute value accordingly within the QTI.

When using Test driver scoring on a spreadsheet item if you were to specify an unscored cell by unselecting the "Apply Scoring" check box the QTI generates a null condition statement for that unscored cell, thus not allowing the item to score properly.

Draft state Spreadsheet item is moved to review state or completed state from examine page when max row or max columns are beyond the limit (D-20228)

Create a Spreadsheet type question with a Maximum row > 500 or Maximum columns > 100 and save as a draft. When a manager examines the question from Manage > Project Bank, the state is changed to a review state or Completed.

PENDING

Exhibit QTI exported in wrong order (D-18874)

Sometimes QTI does not compile when using exhibits as the Compiler expects exhibits to appear in the itempool file before the items that refer to them.