Item Development and Analysis Worksheet
Student Name: Section: PSYC421-
PART 1: Writing Multiple Choice Test Items
Develop one multiple choice question that covers content from each of the four chapters listed below. When writing your sample questions, please keep in mind the specifications regarding item construction discussed in the textbook. Also, remember the importance of carefully crafted distractor options. Finally, please limit the number of response options to 4 (1 correct response and 3 distractors), and avoid the options of “all of the above,” none of the above,” or the like. Be sure to indicate which of the response options is the correct one.
Chapter 3 Multiple Choice Question (2.5 points)
An estimate of the relaibility of a speed test is a measure of ?
A) the consistancy of flood
B) the consistancy of response
C) the consistancy of the response speed
D) the consistancy of the response of intensity
Chapter 4 Multiple Choice Question (2.5 points)
Chapter 5 Multiple Choice Question (2.5 points)
Chapter 6 Multiple Choice Question (2.5 points)
PART 2: Item Analysis: Item Difficulty Index(Cohen et al., 2013, pg. 263)
A test is only as good as its questions! When researchers, test constructors, and educators create items for ability or achievement tests, we have a responsibility to evaluate the items and make sure that they are useful and high-quality. The process that we use to evaluate test items is known as Item Analysis. When bad items are identified and eliminated from a test, that increases the efficiency, reliability and validity of the entire test! One way that we can distinguish among good and bad items is with the Item Difficulty Index.
Part 2A: Calculating Item Difficulty
Using the data below, calculate the Item Difficulty Index for the first 6 items onQuiz 1 from a recent section of PSYC101. For each item, “1” means the item was answered correctly and “0” means it was answered incorrectly. Type your answers in the spaces provided at the bottom of the table. (1 pt. each)
|PSYC101 Quiz 1 Item Distribution and Total Scores|
|Examinee||Item 1||Item 2||Item 3||Item 4||Item 5||Item 6||Total Score|
Part 2B: Calculating Optimal Item Difficulty (.5 pt. each)
1. For a test item with two response options (e.g., true/false), what is the probability of selecting the correct answer by chance?
2. Calculate the optimum level of difficulty for a test questions with two response options.
3. For a test item with three response options, what is the probability of selecting the correct answer by chance?
4. Calculate the optimum level of difficulty for a test questions with three response options.
5. For a test item with four response options, what is the probability of selecting the correct answer by chance?
6. Calculate the optimum level of difficulty for a test questions with four response options.
7. For a test item with five response options, what is the probability of selecting the correct answer by chance?
8. Calculate the optimum level of difficulty for a test questions with five response options.
PART 3: Item Analysis: Item Discrimination Index(Cohen et al., 2013, pg. 265–266)
Another way that test creators can distinguish between good and bad items is with an analysis called the Discrimination Index. The discrimination index measures how well an individual test item distinguishes between high scorers and low scores on the test. An item is considered to be “good” if most of the high scorers get it right, and most of the low scorers get it wrong.
Interpreting the Discrimination Index (d)
· The discrimination index can range from -1.0 to 1.0.
· The closer d is to 1.0, the better the item discriminates between high and low scorers
· The closer d is to 0, the more poorly the item discriminates between high and low scorers.
· An item with a negative discrimination index is considered a “negative discriminator” because more low scorers get the item correct than high scorers.
· A discrimination index of 1.0 means all the high scorers got the item correct and all of the low scorers got it incorrect.
· A discrimination index of -1.0 means all of the low scorers got the item correct and all of the high scorers got it incorrect.
· Items with d’s close to 0 or with negative d’s ought to be eliminated from the test!
Calculating the Item Discrimination Index (d)
Calculate the item discrimination index (d) for the 7 hypothetical test items presented below. Type your answers in the spaces provided at the right of the table (1 pt. each).
Based on your calculations above, answer the following questions (1 pt. each).
1. Which item discriminates the best?
2. Which item discriminates most poorly?
3. Based on your analysis, identify which two items would you choose to eliminate from this test and explain why you would eliminate each.
Part 4: Item Characteristic Curves (Cohen et al., pg. 268–270)
Another method that test creators can use to assess the usefulness of test items is with Item Characteristic Curves. Item characteristic curves provide a graphical depiction of examinees’ performance on individual test items. As indicated in the figure below, Total Test Score is plotted on the x-axis of the curve, while proportion of examinees who got the item correct is plotted on the y-axis
Using the figure above, provide a written description of how test items A–D discriminate among examinees at various levels of performance. In your responses, discuss why each item would be considered a “good” or a “bad” item. EXAMPLE: “This item discriminates well among high scores, but doesn’t discriminate well among low scorers. So this item would be considered a good item because it discriminates at the highest levels of performance.” (2 pt. each)
Part 5: Qualitative Item Analysis (Cohen et al., pg. 272–274)
Qualitative item analysis refers to a set of non-statistical procedures used to gather information about the usefulness of test items. These analyses typically involve interviews, panel discussions, questionnaires and other forms of verbal exchange with test-takers to explore how individual test items work.
As an online student, you have a very different test-taking experience than residential students. Based on your readings from Chapter 8, identify 4 topics related to online test taking, and create 4 qualitative questions that you could ask online test-takers to gain an understanding of their experiences with test-taking. Also, as students at a Christian institution of higher education, course assignments/assessments are supposed to give students an opportunity to integrate course content with their Christian worldview. Given the topic of faith and learning, create one qualitative question that you could ask test-takers.
|Qualitative Item Analysis|
|Topic (1 pt. each)||Sample Question for Test-Takers (1 pt. each)|
Part 1 Subtotal:
Part 2 Subtotal:
Part 3 Subtotal:
Part 4 Subtotal:
Part 5 Subtotal:
Exemplary Academic Writing Service
At TheQuizlet.com, you are guaranteed of quality service from our professional writers. We maintain consistent communication with customers after placing an order to avoid missing anything that may compromise the quality of delivered work.
Our hiring process is rigorous to maintain the desired quality that has become the core of our business. We expose potential writers to an uncompromising selection process that enables TheQuizlet to pick the best out of the rest. TheQuizlet boasts of a competent team of writers, editors, and professors who work towards accomplishing your goals.
TheQuizlet has an in-house plagiarism software that lowers the probability of delivering plagiarized papers to our clients. Referencing is guided by the format specified by a customer when placing an order. Our writers are conversant with all referencing formats that include APA, MLA, Chicago, Harvard, and Vancouver among others.
24/7 Customer Support
We understand the importance of effective communication and as such, TheQuizlet has a dedicated customer support department that responds to all client needs. You can easily contact our team through a chat window at the bottom left corner. Additionally, clients can reach us through support’s email or a telephone number available on our contact page. Feel free to contact us at any time and our team of experts will solve all your problems.
Swift Delivery and 100% Money-back Guarantee
When placing an order, ensure that you specify the correct deadline to help our writers work around the provided timeline. At TheQuizlet, we deliver our tasks before the projected deadline to give time for the customer to proofread the work before submission. In the event we cannot deliver a paper on time, we initiate contact with the client to renegotiate a new deadline.
Unlimited and Free Revisions
We urge all our customers to request for a revision whenever they identify a need to amend the paper. Since we understand your concerns, TheQuizlet.com does not charge for revisions. Nonetheless, we encourage customers to be genuine when requesting for revisions.
Try it now!
How it works?
Follow these simple steps to get your paper done
Place your order
Fill in the order form and provide all details of your assignment.
Proceed with the payment
Choose the payment system that suits you most.
Receive the final file
Once your paper is ready, we will email it to you.
TheQuizlet is a one-stop shop for all your writing needs. We tackle each customer’s needs differently to improve the quality of outcomes and meet your expectations.
TheQuizlet is committed to delivering quality work on time to ensure our clients get the value for their money.
Admission Essays and Professional Writing
Admission essays are personal, as opposed to other papers. For this reason, our team will request for any information that will enable them to deliver quality work, which allows you to convince the admissions board on why you should be granted the application.
Editing and Proofreading
Our team comprises of qualified researchers, writers, and editors who go through the different papers before delivering them to our clients. Whether your paper is being written from scratch or you want it to be edited, you can trust TheQuizlet for all your needs.
After receiving the final draft, you can request for a revision to incorporate various changes that are aligned with your expectations. All our papers are written in line with the latest writing standards.