Development of a Reading Comprehension Test for EFL Learners

Abstract

Reading comprehension is a fundamental skill in language learning, essential for understanding, interpreting, and critically analyzing written texts. This study focuses on the development and evaluation of a reading comprehension test for eleventh-grade students, specifically targeting analytic and hortatory exposition texts. The objectives of this study are to describe the item difficulty, item discrimination, determine the test’s reliability, and identify the number of items included in the test. The study employed a quantitative descriptive design, involving 200 students from a senior high school in Sukoharjo, Central Java, Indonesia. The initial test consisted of 30 multiple-choice items with five answer options each, validated by experts and analyzed using the QUEST program based on the Rasch model. Results: (1) Item Difficulty: Analysis of item difficulty showed that 18 items were categorized as easy (P > 0.70) and 11 items were categorized as medium (0.30 < P < 0.70). There were no difficult items (P < 0.30). This distribution indicates that the test provided a balanced range of items suitable for assessing students’ reading comprehension. (2) Item Discrimination: The item discrimination analysis using Point Biserial values revealed that 28 out of 29 items (items 1–26, 28, and 29) were classified as “very good” (0.40–1.00), while one item (item 27) was classified as “reasonably good” (0.30–0.39). There were no items in the categories of “acceptable with revision,” “poor discrimination,” or “negative discrimination.” These results indicate that all items effectively distinguished between high- and low-performing students and were therefore considered acceptable for inclusion in the test. (3) Reliability: The test demonstrated a high level of reliability, with a reliability coefficient of 0.960, indicating that the test was highly consistent and dependable for measuring students’ reading comprehension skills. (4) Overall Conclusion: The 29-item reading comprehension test is a reliable, valid, and well-constructed instrument, with appropriate item difficulty and strong discrimination power. The test is suitable for assessing eleventh-grade students’ reading comprehension skills, and all items were retained for the final test.