Dynamic Multistage Testing: A Highly Efficient and Regulated Adaptive Testing Method

References

• Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores (pp. 397–479). Reading, MA: Addison-Wesley.
   Google Scholar
• Chang, H. H., Qian, J., & Ying, Z. (2001). a-stratified multistage computerized adaptive testing with b blocking. Applied Psychological Measurement, 25(4), 333–341. doi: 10.1177/01466210122032181
   Web of Science ®Google Scholar
• Cheng, Y., & Chang, H. H. (2009). The maximum priority index method for severely constrained item selection in computerized adaptive testing. British Journal of Mathematical and Statistical Psychology, 62(2), 369–383. doi: 10.1348/000711008X304376
   PubMedGoogle Scholar
• Choi, S. W., Grady, M. W., & Dodd, B. G. (2011). A new stopping rule for computerized adaptive testing. Educational and Psychological Measurement, 71(1), 37–53. doi: 10.1177/0013164410387338
   Web of Science ®Google Scholar
• Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46. doi: 10.1177/001316446002000104
   Web of Science ®Google Scholar
• Dallas, A., Furter, R., & Luecht, R. M. (2012). Conditional exposure and comparative accuracy of IRT vs. number-correct routing strategies for ca-MST. Paper presented at the annual meeting of the National Council on Measurement in Education, Vancouver, BC, Canada
   Google Scholar
• Edwards, M. C., Flora, D. B., & Thissen, D. (2012). Multistage computerized adaptive testing with uniform item exposure. Applied Measurement in Education, 25(2), 118–141. doi: 10.1080/08957347.2012.660363
   Web of Science ®Google Scholar
• Fan, Z., Wang, C., Chang, H. H., & Douglas, J. (2012). Utilizing response time distributions for item selection in CAT. Journal of Educational and Behavioral Statistics, 37(5), 655–670. doi: 10.3102/1076998611422912
   Web of Science ®Google Scholar
• Georgiadou, E. G., Triantafillou, E., & Economides, A. A. (2007). A review of item exposure control strategies for computerized adaptive testing developed from 1983 to 2005. The Journal of Technology, Learning and Assessment, 5(8). Retrieved from https://ejournals.bc.edu/ojs/index.php/jtla/article/viewFile/1647/1482
   Google Scholar
• Han, K. T. (2013). Item pocket method to allow response review and change in computerized adaptive testing. Applied Psychological Measurement, 37(4), 259–275. doi: 10.1177/0146621612473638
   Web of Science ®Google Scholar
• He, W., Diao, Q., & Hauser, C. (2014). A comparison of four item-selection methods for severely constrained CATs. Educational and Psychological Measurement, 74(4), 677–696. doi: 10.1177/0013164413517503
   Web of Science ®Google Scholar
• Hendrickson, A. (2007). An NCME instructional module on multistage testing. Educational Measurement: Issues and Practice, 26(2), 44–52. doi: 10.1111/j.1745-3992.2007.00093.x
   Google Scholar
• Kingsbury, C. G., & Zara, A. R. (1989). Procedures for selecting items for computerized adaptive tests. Applied Measurement in Education, 2(4), 359–375. doi: 10.1207/s15324818ame0204_6
   Google Scholar
• Kingsbury, C. G., & Zara, A. R. (1991). A comparison of procedures for content-sensitive item selection in computerized adaptive tests. Applied Measurement in Education, 4(3), 241–261. doi: 10.1207/s15324818ame0403_4
   Google Scholar
• Lord, F. M. (1971). A theoretical study of two-stage testing. Psychometrika, 36(3), 227–242. doi: 10.1007/BF02297844
   Web of Science ®Google Scholar
• Luecht, R. M., & Nungester, R. J. (1998). Some practical examples of computer adaptive sequential testing. Journal of Educational Measurement, 35(3), 229–249. doi: 10.1111/j.1745-3984.1998.tb00537.x
   Web of Science ®Google Scholar
• Luo, X. (2018). xxIRT: Item response theory and computer-based testing in R [Software]. Retrieved from https://cran.r-project.org/package=xxIRT
   Google Scholar
• Luo, X., & Kim, D. (2018). A top-down approach to designing the computerized adaptive multistage test. Journal of Educational Measurement, 55(2), 243–263. doi: 10.1111/jedm.12174
   Web of Science ®Google Scholar
• Luo, X., Kim, D., & Dickison, P. (2018). Projection-based stopping rules for computerized adaptive testing in licensure testing. Applied Psychological Measurement, 42(4), 275–290. doi: 10.1177/0146621617726790
   PubMed Web of Science ®Google Scholar
• McBride, J. R., & Martin, J. T. (1983). Reliability and validity of adaptive ability tests in a military setting. In D. J. Weiss (Eds.), New horizons in testing: Latent trait test theory and computerized adaptive testing (pp. 223–236). Cambridge, MA: Academic Press.
   Google Scholar
• Melican, G. J., Breithaupt, K., & Zhang, Y. (2009). Designing and implementing a multistage adaptive test: The Uniform CPA exam. In W. J. van der Linden & C. A. W. Glas (Eds.), Elements of adaptive testing (pp. 167–189). New York, NY: Springer.
   Google Scholar
• Owen, R. J. (1975). A Bayesian sequential procedure for quantal response in the context of adaptive mental testing. Journal of the American Statistical Association, 70(350), 351–356. doi: 10.1080/01621459.1975.10479871
   Web of Science ®Google Scholar
• R Core Team (2017). R: A language and environment for statistical computing [Software]. Retrieved from https://www.R-project.org/
   Google Scholar
• Stocking, M. L., & Swanson, L. (1993). A method for severely constrained item selection in adaptive testing. Applied Psychological Measurement, 17(3), 277–292. doi: 10.1177/014662169301700308
   Web of Science ®Google Scholar
• van der Linden, W. J. (2000). Constrained adaptive testing with shadow tests. In W. J. van der Linden & C. A. W. Glas (Eds.), Computerized adaptive testing: Theory and practice (pp. 27–52). Dordrecht, The Netherlands: Springer.
   Google Scholar
• Wainer, H., & Kiely, G. L. (1987). Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24(3), 185–201. doi: 10.1111/j.1745-3984.1987.tb00274.x
   Web of Science ®Google Scholar
• Wang, S., Fellouris, G., & Chang, H. H. (2017). Computerized adaptive testing that allows for response revision: Design and asymptotic theory. Statistica Sinica, 27, 1987–2010.
   Web of Science ®Google Scholar
• Wang, S., Lin, H., Chang, H. H., & Douglas, J. (2016). Hybrid computerized adaptive testing: From group sequential design to fully sequential design. Journal of Educational Measurement, 53(1), 45–62. doi: 10.1111/jedm.12100
   Web of Science ®Google Scholar
• Willse, J. T., Ackerman, T. A., & Luecht, R. M. (2012). An overview of ca-MST: From panel configurations to test assembly. Paper presented at the annual meeting of the National Council on Measurement in Education, Vancouver, BC, Canada.
   Google Scholar
• Weiss, D. J. (1982). Improving measurement quality and efficiency with adaptive testing. Applied Psychological Measurement, 6(4), 473–492. doi: 10.1177/014662168200600408
   Web of Science ®Google Scholar
• Weiss, D. J., & Kingsbury, G. (1984). Application of computerized adaptive testing to educational problems. Journal of Educational Measurement, 21(4), 361–375. doi: 10.1111/j.1745-3984.1984.tb01040.x
   Web of Science ®Google Scholar
• Zheng, Y., & Chang, H. H. (2015). On-the-fly assembled multistage adaptive testing. Applied Psychological Measurement, 39(2), 104–118. doi: 10.1177/0146621614544519
   PubMed Web of Science ®Google Scholar