James Austin
Ohio State University
Center on Education and Training for Employment

This is the coolest item analysis ever! Easy to run, clear results that are easy to understand, and (more importantly) easy to explain to the item writers and reviewers.

Anonymous user

The updated version is fantastic and the new statistics are wonderful.

Charalambos Kollias, Greece

Itemanâ¢ 4 is a software program designed to provide detailed item and test analysis reports using classical test theory (CTT). The purpose of these reports is to help testing programs evaluate the quality of test items, and tests as a whole, by examining their psychometric characteristics. Output is RTF format, allowing you to type/paste in item texts and comments and deliver a comprehensive report to stakeholders or content experts.

Itemanâ¢ 4 is distinguished by its user-friendly interface that makes it easy to run the program, even if you are not an expert in psychometrics. Teachers, school administrators, certification managers, training coordinators, and instructional designers can all use Itemanâ¢ 4 to produce professional psychometric reports. A number of large testing companies use Itemanâ¢ 4 to produce reports for clients, charging up to $4,000 each time - you can now produce these reports yourself for a fraction of the cost! Click here to see an example report as a PDF.

Important features

Output is full-featured reports in Word, not ASCII or many separate images you have to cut and paste

What's New in Itemanâ¢ 4

The most important advantage is the addition of graphics. It is now possible to produce an item quantile plot for each item.

Itemanâ¢ 4 is able to handle pretest (trial or unscored) items, items that are not included in the final score but where statistics are still desired.

More statistics are calculated, including the alpha (KR-20) reliability coefficient with each item deleted, and subgroup P (proportion correct) statistics.

Instead of simple ASCII text files, the output is now rich text file (RTF) format laid out as a formal report, and also in a comma-separated value (CSV) format that is able to be manipulated (sorted, highlighted, etc.) in spreadsheet software. It additionally produces a CSV file of examinee scores and subscores.

Scaled scoring can be applied, so that Iteman 4 can be used to score sets of examinees in more testing programs and provide scores on any linearly transformed scale.

Items can be analyzed relative to an external score rather than the total score on a test.

The maximum number of items that can be analyzed has been increased to 10,000, with no limit on the number of examinees.

A âbatchâ type of capability, using a âmultiple runs fileâ has been added to allow you to run multiple data sets without having to use the graphic user interface for each run.

Iteman 4 can analyze both dichotomous (correct/incorrect) and polytomous (rating scale or partial credit) data, including tests that are a mix of both item types.

What does Itemanâ¢ 4 look like?

Using Iteman 4 is straightforward: simply name the relevant files and then utilize the friendly interface to specify options for your results. One tab of the options is devoted to scoring...

...while another is devoted to output options.

The program produces summary output regarding the examinee scores, including reliability analysis, analysis of domains (content areas), and frequency distributions.

However, the majority of the report is item-by-item results, presented in detailed tables and a quantile plot for each item. Simply paste in item texts, and you have a comprensive report ready for item reviewers!

Iteman has been the worldâs most used item and test analysis software since its release in the early 1980s. Iteman 4 sets a new standard for analyzing test data.

Licenses

Iteman 4 licenses are determined by the use of the program:

Student research license -
Grants are provided to cover costs of our software, allowing students to purchase a full academic license; click here for more information and an application.. Note that the demo version (downloaded below) can also be used as a free student version.Academic ($495 one-time cost) - The program will be used at an accredited college or university for research or teaching purposes only.Government ($695 per year, or $1390 for 3 years) - The program will be used at a governmental organization, or by a school district or college or university for analyzing the data from its testing programs. Commercial or Non-profit (contact us for price) - Please let us know how you intend to use the software.

Upgrades - For upgrades from ITEMAN 3.6 or the Item and Test Analysis Package (2010 or earlier), you will receive $100 credit towards the new version. Please order the appropriate license below and then contact us with information regarding the previous purchase, so we can validate the existing license. This is on an individual license basis: one previous license provides one discount on one new license. For non-academic annual licenses of Iteman 4, the upgrade price is applicable for the first year.

Support

Initial support is provided by the detailed manual that is included with the software. Additionally, we have provided free training videos here. Please check the manual and videos before contacting us; in-person support for Iteman 4 is available at our normal consultant billing rates.

Purchasing Iteman 4

Iteman 4 is available via download from the link below. It includes all the same files that would be sent on a physical CD, so CD shipping is not necessary. If you wish, you are free put the ZIP file onto a CD or USB drive as a backup, which saves expensive shipping costs if ASC were to produce a CD and send it to you.

Iteman 4 is downloaded as a demonstration version limited to 50 items and 50 examinees. This allows you to get familiar with the program immediately. The program is then "unlocked" to the full version once the payment process is completed. Please follow these steps to purchase Iteman 4:

Select the appropriate license/quantity from the lists at the bottom of this page, and click "Add to Cart." Then complete your purchase.

After payment is completed (that is, we receive your check/wire or run your credit card), please open the program (again, if you have Windows 7, 8 or Vista, you will need to right-click and "Run as administrator"), and click the "Unlock" button. You will then be presented with two unlock codes. Send those to ASC (contact us with the unlock codes or call 651-647-9220), along with your name and Invoice number. We will send back a key code that will unlock the program into the full version.

The demonstration version of Iteman 4 is available for evaluation of the program with no cost and no obligation to purchase. While limited to 50 items and 50 examinees, there is no limit on time. This makes it useful as a completely free student version. If you wish to purchase the full version at any time, simply complete Steps 2 and 3 in the list above or contact us for more information.