Sample Spreadsheet |
---|
Six item answer key for Scantron |
Remember when analyzing Scantron data, you need to read two files,
a Scantron data file and the answer key file that you create.
Using a Moodle File. Moodle or Modular Object-Oriented Dynamic Learning Environment is
a free open-source e-learning server-based environment. Moodle is also known as a Course Management
System, Learning Management System, or Virtual Learning Environment. Because Moodle is often
used as a course management system, it has a testing module within it that permits participants
to test online. Further, these testing results can be easily exported from Moodle as test summary results
in CSV file format. As a function of the export, the participants responses and correct answers can,
and should be, included in the exported file. Hence, most of the work involves assuring that the
participants have indeed tested online and then assuring that you have a test results export file
that includes the participants responses and the correct responses. CatTrax will read the Moodle test
summary file and provide the analysis in a format that can displays participant name and id, as well
as Moodle's full item responses when performing item analysis.
2. Analysis
Analysis requires selecting the data source, selecting desired results, and
submitting.
1. Select the source of your input data as either CSV (default), Moodle, or
Scantron. Select the location of your data file using the Data File Browse; you will want to "find" or path
to the physical location where your data file is located, e.g. your computer desktop or folder.
Remember, if you intend to use Scantron data,
you MUST select the location of your data file using the Data File Browse AND
select the location of your answer key file using the Key File - Scantron Only Browse.
2. Submit.
3. Interpreting Results
CatTrax Test Primary Key Summary Date | File | Participants | Items | Test Mean | Test Standard Deviation |
---|
4/8/2013 | Inputdesktopomit.csv | 11 | 20 | 12.8 | 3.2 |
CatTrax Test Summary. The summary statistics include the date the analysis occurred,
input data file name, number of participants and items, test mean score in number of items, and test
standard deviation (SD) in number of items. The standard deviation measures the
extent the scores of the class
tend to spread or cluster about the average or mean of the class. Tests with small
standard deviations show the class is responding similarly or in a homogenous manner.
Conversely, large standard deviations show greater diversity or more heterogeneous
responses.
Take notice of the following participants (listed highest to lowest ranking)Id | Name | | Issue |
---|
24 | Elbow | Grease | is responding inconsistently to the test items when compared to similarly ranked participants |
39 | Tom | Cat | is responding inconsistently to the test items when compared to similarly ranked participants |
17 | Roscoe | Rabbit | is in the lower 15% of test scores and responding inconsistently when compared to similarly ranked participants |
9 | Anny | Albatross | is in the lower 15% ranking of test scores |
19 | Buster | Bilgewater | is in the lower 15% of test scores and responding inconsistently when compared to similarly ranked participants |
Take Notice Participants. Take notice of the following participants listing provides a quick
reference for identifying problematic participant related issues. Students who score in the lower 15%
of the class, or, from a statistical perspective, score -2 standard deviations from the mean score, are
identified. Additionally, students who exhibit a Caution Index (CI) value exceeding 30 are identified
as responding inconsistently when compared to similarly ranked participants.
The caution index, established by Sato, Harnish and Linn, assigns a numeric value based on the observed
versus the expected consistency of test item responses.
These cautionary participants display patterns of test responses that are atypical of their group
receiving similar scores. A high CI occurs when, for example, a
higher ranking participant answers easier items incorrectly; this is inconsistent with expectations
as we would expect this participant to have answered these items correctly. Or, a high CI could
occur when a lower ranking participant answers the hardest items correctly; again, this is
inconsistent with
expectations as we would expect this participant to have answered the hardest items incorrectly.
Unusual participant response patterns and a resulting high caution index may be caused by
guessing, confusion, unusual instructional or experiential history, copying, high
anxiety, or carelessness. Questioning these low ranking and cautionary participants about potential confusion
may improve the participants' potential for success in the class -- this is an opportunity to
address a potentially at-risk learner at an early stage when remediation is viable.
Take notice of the following test items (listed easiest to hardest ranking)Item | Issue |
---|
5 | is confusing or poorly written |
17 | is confusing and not distinguishing between higher and lower ranking participants |
9 | is confusing or poorly written |
12 | is confusing or poorly written |
6 | is confusing and not distinguishing between higher and lower ranking participants |
10 | is difficult with more than half of the group responding incorrectly |
15 | is difficult with more than half of the group responding incorrectly |
4 | is difficult with more than half of the group responding incorrectly |
7 | is difficult with more than half of the group responding incorrectly |
14 | is difficult with more than half of the group responding incorrectly |
13 | is difficult, confusing, and not distinguishing between higher and lower ranking participants |
20 | is difficult with more than half of the group responding incorrectly |
Take Notice Test Items. Take notice of the following items listing provides a
quick reference for identifying problematic test item related issues. Test items, identified
as having a Caution Index (CI) exceeding 30, display atypical response
patterns when, for example, an easier item is answered incorrectly by higher ranking participants.
These items are identified as confusing or poorly written. High CI values
occurring within item responses may be the result of a poorly written test item, ethnic,
experiential, gender, or
instructional bias or where a potential mismatch between instructional practices and
content occurs and results in learner confusion. These cautionary items deserve
special attention when reviewing the test items with the group.
The discrimination index (Disc) can be used to determine how well a test item differentiates
between high-scoring and low-scoring participants.
A negative discrimination index shows the item was answered correctly more often by the low-
scoring participants than by the high-scoring participants. These items are identified as
not distinguishing between higher and lower ranking participants and should
be examined to determine if the item is poorly written or if there is real confusion
within the group regarding the learning concept the test item is attempting to measure.
Additionally, test items that are particularly difficult are identified as
difficult with more than half of the group responding incorrectly. Difficult
items are not necessarily bad items and there are times when it is important to introduce
items that are challenging. So, these items are identified to provide recognition
and the possible need for group review.
Participants listed highest to lowest ranking and Items listed easiest to hardest rankingId | Name | | CI | Tot | SEM | Range | Z | 11 | 2 | 18 | 19 | 5 | 1 | 8 | 17 | 3 | 9 | 16 | 12 | 6 | 10 | 15 | 4 | 7 | 14 | 13 | 20 |
---|
34 | Fresh | Fish | 0 | 19 | 1 | 18 - 20 | 1.94 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 |
24 | Elbow | Grease | 33 | 16 | 1.8 | 14 - 18 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 0 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 0 | 1 |
14 | Deputy | Dog | 20 | 15 | 2 | 13 - 17 | 0.68 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 1 |
36 | Ferocious | Feline | 12 | 15 | 2 | 13 - 17 | 0.68 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 1 | 1 | 0 | 1 | 1 | 0 |
3 | Candy | Apple | 18 | 13 | 2.2 | 11 - 15 | 0.06 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 0 | 1 | 1 | 0 | 1 | 0 | 1 | 1 | 0 | 0 | 0 |
39 | Tom | Cat | 33 | 13 | 2.2 | 11 - 15 | 0.06 | 1 | 1 | 1 | 0 | 0 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 1 | 0 | 0 |
40 | Ground | Squirrel | 14 | 12 | 2.3 | 10 - 14 | -0.26 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 |
29 | Waldo | Whale | 20 | 12 | 2.3 | 10 - 14 | -0.26 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 1 | 0 | 0 | 1 |
17 | Roscoe | Rabbit | 32 | 9 | 2.3 | 7 - 11 | -1.2 | 1 | 0 | 1 | 1 | 1 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 1 | 0 |
9 | Anny | Albatross | 10 | 9 | 2.3 | 7 - 11 | -1.2 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | . | 1 | 0 | 0 | 1 | . | . | . | 0 | 0 | . | . |
19 | Buster | Bilgewater | 42 | 8 | 2.3 | 6 - 10 | -1.51 | 0 | 1 | 0 | 0 | 1 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 1 | 0 | 1 | 0 | 0 |
| | | | | | | Tot: | 10 | 10 | 10 | 9 | 9 | 9 | 9 | 8 | 8 | 7 | 7 | 6 | 6 | 5 | 5 | 5 | 5 | 5 | 4 | 4 |
---|
| | | | | | | Diff: | 0.91 | 0.91 | 0.91 | 0.82 | 0.82 | 0.82 | 0.82 | 0.73 | 0.73 | 0.64 | 0.64 | 0.55 | 0.55 | 0.45 | 0.45 | 0.45 | 0.45 | 0.45 | 0.36 | 0.36 |
---|
| | | | | | | CI: | 0 | 9 | 0 | 22 | 44 | 5 | 16 | 66 | 0 | 44 | 11 | 35 | 50 | 28 | 0 | 25 | 10 | 25 | 51 | 11 |
---|
| | | | | | | Disc: | 0.2 | 0.2 | 0.2 | 0.03 | 0.03 | 0.4 | 0.4 | -0.5 | 0.6 | 0.07 | 0.43 | 0.27 | -0.1 | 0.47 | 0.83 | 0.47 | 0.47 | 0.47 | -0.07 | 0.3 |
---|
Participant and Item Table. In the context of the table, the
participant summary information appears to the left and the test item information to the
right of the participant information. Participants are rank ordered from highest scorer to
lowest scorer on the test (Tot). Similarly,
the test item information ranks the items from easiest to hardest.
For example, the first participant with the identification code (ID) of 34 correctly
answered 19 items (Tot) of the items and was the highest ranking
participant on this test. This participant's score of 19 is the measured score, but the
participant's true ability likely falls within the RANGE of 18 to 20 as determined by adding
and subtracting the participant's SEM of 1 with the measured score of 19.
The standard error of measurement (SEM) is the standard deviation of the "errors" of
measuring the test score for an individual. Thus, the SEM provides
a range and serves as a reminder that a score should not be interpreted as an absolute.
The Z or linear z-score converts the participants scores to a standard deviation format whereby
positive z-scores are those above the mean, a zero (0) z-score is the mean, and negative
z-scores are those falling below the mean.
The participant Caution Index (CI) provides a measure to the consistency of the participant's
items responses. Since the participant's CI of zero (0) is below the 30 that is used as
a threshold, the individual appears to responding consistently within the context of
this group. We can see this consistency by looking at the participant's item responses. A one
(1) indicates the item was answered correctly, a zero (0) and red cell indicates an item was answered
incorrectly, and a period (.) and red cell indicates the participant did not answer an item. Thus, participant 34
correctly answered all but item 13, one of the hardest items on the test. This response is
consistent with the item difficulties and the participant's rank in the class.
The item summary information shows that item 11 was the easiest with 10 of the 11
participants in the class answering the item correctly (Tot). Item 11 shows a
difficulty (Diff) of .91 or 91 percent of the class responding correctly. Item 20
was the most difficult item on the test with only 4 participants or 36 percent of the
class responding correctly. Thus, the easiest items appear to the left with more difficult
items appearing to the right.
A caution index is developed for both the items and participants (CI). The caution
index, established by Sato, Harnish and Linn, assigns a numeric value based on the observed
versus the expected consistency of test item responses. Participants
24, 39, 17, and 19 display a CI exceeding 30, the cutoff value, and are highlighted in red.
These cautionary participants display patterns of responses that are atypical of their group
receiving similar scores. A high CI occurs when, for example, a
higher ranking participant answers easier items incorrectly; this is inconsistent with expectations
as we would expect this participant to have answered these items correctly. Or, a high CI could
occur when a lower ranking participant answers the hardest items correctly; again, this is
inconsistent with
expectations as we would expect this participant to have answered the hardest items incorrectly.
Thus, to best interpret the CI, the participants' item responses must to viewed in the context
of the table. For example, scanning the responses to participant 19 suggests that this person
is likely guessing based on the inconsistency of correctness that ranges from easy to hard items.
Unusual participant response patterns and a resulting high caution index may be caused by
guessing, confusion, unusual instructional or experiential history, copying, high
anxiety, or carelessness. Questioning cautionary participants about potential confusion
may improve the participants' potential for success in the class -- this is an opportunity to
address a potentially at-risk learner at an early stage when remediation is viable.
Items 5, 17, 9, 12, 6,
and 13, display a CI exceeding 30. These cautionary items display atypical response
patterns when, for example, an easier item is answered incorrectly by higher ranking participants.
High CI values (exceeding 30)
occurring within item responses may be the result of a poorly written test item, ethnic,
experiential, gender, or
instructional bias or where a potential mismatch between instructional practices and
content occurs and results in learner confusion. These cautionary items deserve
special attention when reviewing the test items with the group.
The discrimination index (Disc) can be used to determine how well a test item differentiates
between high-scoring and low-scoring participants. The higher the positive value of the
discrimination index the better the test item discriminates between high-
scoring and low-scoring participants. A discrimination index of zero
shows the item does not discriminate between high-scoring and low-scoring participants.
And, a negative value shows the item was answered correctly more often by the low-
scoring participants than by the high-scoring participants. Items showing negative values should
be examined to determine if the item is poorly written or if there is real confusion
within the group regarding the learning concept the test item is attempting to measure.
Item Analysis. CatTrax provides two types of item analysis.
Although the statistics are
performed in the same manner for each type of item analysis, the physical grouping of the
participants changes. Split-half item analysis divides the testing group into two groups. Split-half
is particularly useful when the group size is less than thirty. In the following example,
showing item 11 on the test, the testing group of 11 participants has been divided into two
groups of six participants in the higher group and five in the lower group. Reference the
participant and Item table to see where a faint line bisects the list of participants and
thus describes the boundary of the higher and lower ranking groups. The middle group
is used when dividing the test group has resulted in several tied scores occurring at the
division. These tied scores will then appear as the middle group and not be used
into the item analysis calculations. Item 11 shows that
all six participants in the higher group selected 3, the correct (*keyed), response and four of
the lower group selected the correct response with one participant selecting response 1. This
was an easy test item, with a Difficulty of 0.91 or 91 percent of the group scoring correctly,
but it does weakly distinguish between the high and low ranking groups with a Discrimination value
of 0.2. This scoring is consistent within the context of the group as the CI is 0.
Item: 11 |
---|
Diff: 0.91 Disc: 0.2 CI: 0 |
Group | N | 1 | *3 |
High | 6 | 0 | 6 |
Low | 5 | 1 | 4 |
Total | 11 | 1 | 10 |
What more can be determined from this item? Notice that within the lower ranking group, one
participant answered incorrectly and selected response 1. If this was a multiple choice item, and
the response representing 1 was linked to the strategy the participant was using to solve the
problem, then we would have insight into that strategy. For example, if the test item asked:
3 + 4 = ? and response 1 showed 12, then the instructor would be able to surmise that the
participant was misinterpreting the + (addition) for x (multiplication). Using good distractors
when designing tests can provide enormous insight into incorrect strategies learners are using
to solve a problem.
Split-thirds item analysis divides the testing group into three groups. Split-thirds is
applicable when the test group is larger than thirty. CatTrax attempts to divide the test group
into three smaller equal sized groups consisting of high scoring, middle, and low scoring
participants. But, should the borders describing these divisions between groups show tied scores
on either side of the border, then tied scored participants will appear in the middle scoring group
so as to make each group uniquely scoring from the other two groups.
In the following example,
showing item 19 on the test, the testing group of 33 participants has been divided into three
groups. Split-thirds item analysis would be reflected in the
participant and Item table where two faint lines would divide the list of participants to
describe the boundaries of the higher, middle, and lower ranking groups. Item 19 shows that
all 6 participants in the higher group selected 1, the correct (*keyed), response, 15 participants
in the middle group selected the correct response with three participant selecting the distractor response 4,
and six of the lower group selected the correct response with three participants selecting response 3.
This was a relatively easy test item, with a Difficulty of 0.82
or 82 percent of the group scoring correctly,
but it does distinguish between the high and low ranking groups with a Discrimination value
of 0.33. This scoring is consistent within the context of the group as the CI caution index
of 22 is less than the 30 cautionary cutoff.
Item: 19 |
---|
Diff: 0.82 Disc: 0.33 CI: 22 |
Group | N | *1 | 3 | 4 |
High | 6 | 6 | 0 | 0 |
Middle | 18 | 15 | 0 | 3 |
Low | 9 | 6 | 3 | 0 |
Total | 33 | 27 | 3 | 3 |
Participants listed alphabetically and Items listed numericallyId | Name | | CI | Tot | SEM | ~Range | Z | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 |
---|
| Key: 1 | | | | | | | 3 | 3 | 4 | 4 | 4 | 1 | 3 | 2 | 2 | 3 | 3 | 4 | 3 | 4 | 3 | 1 | 1 | 3 | 1 | 5 |
9 | Anny | Albatross | 10 | 9 | 2.3 | 7--9--11 | -1.2 | 5 | 3 | . | . | 4 | 1 | 4 | 2 | 2 | . | 3 | 1 | . | 1 | . | 4 | 1 | 3 | 1 | . |
19 | Buster | Bilgewater | 42 | 8 | 2.3 | 6--8--10 | -1.51 | 3 | 3 | 3 | 4 | 4 | 2 | 1 | 3 | 2 | 5 | 1 | 4 | 2 | 4 | 4 | 2 | 1 | 2 | 3 | 3 |
3 | Candy | Apple | 18 | 13 | 2.2 | 11--13--15 | 0.06 | 3 | 3 | 4 | 4 | 4 | 4 | 3 | 2 | 1 | 3 | 3 | 4 | 2 | 2 | 2 | 1 | 3 | 3 | 1 | 3 |
14 | Deputy | Dog | 20 | 15 | 2 | 13--15--17 | 0.68 | 3 | 3 | 4 | 3 | 4 | 1 | 3 | 2 | 2 | 5 | 3 | 2 | 3 | 3 | 3 | 3 | 1 | 3 | 1 | 5 |
24 | Elbow | Grease | 33 | 16 | 1.8 | 14--16--18 | 1 | 3 | 3 | 4 | 4 | 4 | 4 | 3 | 2 | 1 | 3 | 3 | 4 | 1 | 4 | 3 | 1 | 2 | 3 | 1 | 5 |
36 | Ferocious | Feline | 12 | 15 | 2 | 13--15--17 | 0.68 | 3 | 3 | 4 | 4 | 4 | 4 | 4 | 2 | 2 | 5 | 3 | 2 | 3 | 4 | 3 | 1 | 1 | 3 | 1 | 2 |
34 | Fresh | Fish | 0 | 19 | 1 | 18--19--20 | 1.94 | 3 | 3 | 4 | 4 | 4 | 1 | 3 | 2 | 2 | 3 | 3 | 4 | 2 | 4 | 3 | 1 | 1 | 3 | 1 | 5 |
40 | Ground | Squirrel | 14 | 12 | 2.3 | 10--12--14 | -0.26 | 3 | 3 | 4 | 3 | 3 | 2 | 4 | 2 | 2 | 5 | 3 | 4 | 3 | 3 | 2 | 1 | 1 | 3 | 1 | 2 |
17 | Roscoe | Rabbit | 32 | 9 | 2.3 | 7--9--11 | -1.2 | 4 | 2 | 2 | 3 | 4 | 1 | 1 | 2 | 1 | 3 | 3 | 1 | 3 | 2 | 1 | 3 | 1 | 3 | 1 | 3 |
39 | Tom | Cat | 33 | 13 | 2.2 | 11--13--15 | 0.06 | 3 | 3 | 4 | 1 | 1 | 1 | 1 | 2 | 2 | 3 | 3 | 4 | 2 | 4 | 3 | 1 | 2 | 3 | 4 | 2 |
29 | Waldo | Whale | 20 | 12 | 2.3 | 10--12--14 | -0.26 | 3 | 3 | 4 | 1 | 4 | 1 | 3 | 1 | 3 | 5 | 3 | 3 | 1 | 2 | 1 | 1 | 1 | 3 | 1 | 5 |
| | | | | | | Tot: | 9 | 10 | 8 | 5 | 9 | 6 | 5 | 9 | 7 | 5 | 10 | 6 | 4 | 5 | 5 | 7 | 8 | 10 | 9 | 4 |
---|
| | | | | | | Diff: | 0.82 | 0.91 | 0.73 | 0.45 | 0.82 | 0.55 | 0.45 | 0.82 | 0.64 | 0.45 | 0.91 | 0.55 | 0.36 | 0.45 | 0.45 | 0.64 | 0.73 | 0.91 | 0.82 | 0.36 |
---|
| | | | | | | CI: | 0 | 9 | 0 | 22 | 44 | 5 | 16 | 66 | 0 | 44 | 11 | 35 | 50 | 28 | 0 | 25 | 10 | 25 | 51 | 11 |
---|
| | | | | | | Disc: | 0.2 | 0.2 | 0.2 | 0.03 | 0.03 | 0.4 | 0.4 | -0.5 | 0.6 | 0.07 | 0.43 | 0.27 | -0.1 | 0.47 | 0.83 | 0.47 | 0.47 | 0.47 | -0.07 | 0.3 |
---|
Participant and Item Table. In the context of the table, the
participant summary information appears to the left and the test item information to the
right of the participant information. Participants are sorted alphabetically using the second bolded column or name field.
The columns that display a light green refer to the participants test score correct and show the total score (Tot)
correct with the participant's true ability likely falling within the approximate range as determined by adding
and subtracting the participant's SEM.
The test item information appearing to the right of the participant information is listed from first to last item.
The test key appears as the first row in the item table followed by the examinees responses in the following rows.
A gray cell indicates a correct response with the participants item response appearing within the cell.
A red cell indicates an incorrect response with the participants item response appearing within the cell.
A caution index is developed for both the items and participants (CI). The caution
index assigns a numeric value based on the observed versus the expected consistency of test item responses.
A CI exceeding 30, the cutoff value, and are highlighted in red.
CatTrax Multiple Keys Summary -- Current + Preceding KeysKEY | Date | File | Participants | Items | Test Mean | Test Standard Deviation |
---|
2 | 4/17/2013 | Inputdesktopomit.csv | 11 | 20 | 13.1 | 3 |
Participants listed highest to lowest ranking and Items listed easiest to hardest rankingId | Name | | CI | Tot | SEM | Range | Z | 11 | 2 | 18 | 19 | 5 | 1 | 8 | 17 | 3 | 20 | 9 | 16 | 12 | 6 | 15 | 4 | 7 | 10 | 14 | 13 |
---|
34 | Fresh | Fish | 0 | 19 | 1 | 18 - 20 | 1.99 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 |
24 | Elbow | Grease | 30 | 16 | 1.8 | 14 - 18 | 0.98 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 0 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 0 |
36 | Ferocious | Feline | 20 | 15 | 2 | 13 - 17 | 0.64 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 0 | 0 | 1 | 1 | 0 | 0 | 1 | 1 |
14 | Deputy | Dog | 16 | 15 | 2 | 13 - 17 | 0.64 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 1 | 1 | 0 | 1 | 0 | 0 | 1 |
3 | Candy | Apple | 21 | 14 | 2.1 | 12 - 16 | 0.31 | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 0 | 1 | 1 | 0 | 0 | 1 | 1 | 1 | 0 | 0 |
39 | Tom | Cat | 38 | 13 | 2.2 | 11 - 15 | -0.03 | 1 | 1 | 1 | 0 | 0 | 1 | 1 | 0 | 1 | 0 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 1 | 1 | 0 |
29 | Waldo | Whale | 15 | 12 | 2.3 | 10 - 14 | -0.37 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 0 | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 0 |
40 | Ground | Squirrel | 18 | 12 | 2.3 | 10 - 14 | -0.37 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1 |
17 | Roscoe | Rabbit | 35 | 10 | 2.3 | 8 - 12 | -1.04 | 1 | 0 | 1 | 1 | 1 | 0 | 1 | 1 | 0 | 1 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 1 | 0 | 1 |
19 | Buster | Bilgewater | 47 | 9 | 2.3 | 7 - 11 | -1.38 | 0 | 1 | 0 | 0 | 1 | 1 | 0 | 1 | 0 | 1 | 1 | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 1 | 0 |
9 | Anny | Albatross | 11 | 9 | 2.3 | 7 - 11 | -1.38 | 1 | 1 | 1 | 1 | 1 | 0 | 1 | 1 | . | . | 1 | 0 | 0 | 1 | . | . | 0 | . | 0 | . |
| | | | | | | Tot: | 10 | 10 | 10 | 9 | 9 | 9 | 9 | 8 | 8 | 7 | 7 | 7 | 6 | 6 | 5 | 5 | 5 | 5 | 5 | 4 |
---|
| | | | | | | Diff: | 0.91 | 0.91 | 0.91 | 0.82 | 0.82 | 0.82 | 0.82 | 0.73 | 0.73 | 0.64 | 0.64 | 0.64 | 0.55 | 0.55 | 0.45 | 0.45 | 0.45 | 0.45 | 0.45 | 0.36 |
---|
| | | | | | | CI: | 0 | 10 | 0 | 23 | 41 | 5 | 17 | 68 | 0 | 36 | 48 | 12 | 33 | 51 | 3 | 22 | 11 | 25 | 25 | 52 |
---|
| | | | | | | Disc: | 0.17 | 0.17 | 0.17 | 0.17 | 0.17 | 0.33 | 0.33 | -0.33 | 0.5 | 0.17 | 0 | 0.33 | 0.17 | -0.17 | 0.67 | 0.5 | 0.5 | 0.33 | 0.33 | 0 |
---|
Participant and Item Tables for Multiple Answer Keys. Adding additional answer keys
to the primary answer key produces additional participant and item tables. Each successive
table incorporates the prior answer keys in evaluating participant responses. For example, having
two answer keys results in the first answer key being compared to the participant
responses and production of the test results. When the next answer key is encountered, it
is combined with the preceding key such that participant responses are compared
across both keys. This means an participant getting a correct response in the first key is sustained
as a correctly responding participant in the succeeding keys. Thus, the diagnostics are
always showing cumulative results allowing better identification of extreme results.
Additional Analysis
CatTrax creates a CSV file that can be saved to your desktop. A
link: Get your cattrax input data and results as a CSV file appears at the end of the results.
Clicking the link will provide a prompt to open the file. Selecting Save File will save the file on
your computer.
The CSV
file contains your input data, regardless of the source, reformatted into CSV and the CatTrax
results data also formatted into CSV. The CSV format allows a spreadsheet program to easily
access the data for further analysis, graphing, and manipulation without the need for conversion.
By providing the reformatted input data in CSV format, this data can be manipulated and resaved as a
new CSV data file that may reanalyzed by CatTrax directly from your desktop. Data manipulation might
include doing "what-if" item deletions or combining multiple classes that took the same test.