Validitas Isi Instrumen TPACK pada Calon Guru Kimia menggunakan Aplikasi Model Rasch
DOI:
https://doi.org/10.61404/jimad.v1i2.87Keywords:
Content validity, Rasch model, Item, ValidatorAbstract
This research aims to assess the content validity of the instrument used to measure Technological Pedagogical Content Knowledge (TPACK) in prospective chemistry teachers. The evaluation encompasses a thorough analysis of the instrument's alignment with the knowledge domains being measured, ensuring that the instrument covers key aspects of TPACK that are relevant to the context of teaching chemistry. Content validity reflects the representation and relevance of a set of items used to measure a concept carried out through rational analysis of the contents of the test through an expert panel assessment. This validity refers to the accuracy of the measurement based on the contents of the instrument to ensure that the scale of the items used has fulfilled the entire concept of the item or the suitability of the item. The instrument used in this study was assessed by nine validators consisting of two chemistry education experts and seven chemistry teachers. The assessment is done by determining the appropriateness or relevance of the test contents to be used through rational analysis by a competent panel or through expert judgment. The instrument validations in this study were 20 multiple choice questions. The assessment is done by giving a score of 1-4 on each item. This research is a quantitative descriptive study using Rasch model analysis. The analysis showed that the exact agreement was 71.4% and the expected agreement was 73.8%. Based on measurements showing relevant items in this research instrument, there are 17, among others number 1, 10, 11, 14, 5, 8, 19, 20, 18, 3, 6, 12, 13, 15, 17, 4 and 9. While there are 3 items that are irrelevant and need to be corrected, including number 16, 2 and 7.
Downloads
References
Aiken, Lewis R. “Content Validity and Reliability of Single Items or Questionnaires.” Sage Journals Home 40, no. 4 (December 1, 1980): 955–959. Accessed November 29, 2023. https://journals.sagepub.com/doi/10.1177/001316448004000419.
Azwar, S. Dasar-Dasar Psikometri. Yogyakarta: Pustaka Pelajar, 2005.
Baghaei, Purya, and Nazila Amrahi. “Validation of a Multiple Choice English Vocabulary Test with the Rasch Model.” Journal of Language Teaching and Research 2, no. 5 (2011): 1052–1060.
Benešová, Andrea, and Jiří Tupa. “Requirements for Education and Qualification of People in Industry 4.0.” Procedia Manufacturing 11 (January 1, 2017): 2195–2202.
Clark, Lee Anna, and David Watson. “Constructing Validity: Basic Issues in Objective Scale Development.” Psychological Assessment 7, no. 3 (1995): 309–319. https://psycnet.apa.org/record/1996-93318-001.
Coaley, Keith. An Introduction to Psychological Assessment and Psychometrics. London: SAGE, 2010. https://uk.sagepub.com/en-gb/eur/an-introduction-to-psychological-assessment-and-psychometrics/book240294.
DeVellis, Robert F., and Carolyn T. Thorpe. Scale Development. London: Sage Publications, 2003.
Devon, Holli A., Michelle E. Block, Patricia Moyle-Wright, Diane M. Ernst, Susan J. Hayden, Deborah J. Lazzara, Suzanne M. Savoy, and Elizabeth Kostas-Polston. “A Psychometric Toolbox for Testing Validity and Reliability.” Journal of nursing scholarship 39, no. 2 (June 2007): 155–164. Accessed November 29, 2023. https://pubmed.ncbi.nlm.nih.gov/17535316/.
Goodwin, Laura D., and Nancy L. Leech. “The Meaning of Validity in the New Standards for Educational and Psychological Testing:” Measurement and Evaluation in Counseling and Development 36, no. 3 (2003): 181–191. Accessed November 29, 2023. https://www.tandfonline.com/doi/abs/10.1080/07481756.2003.11909741.
Goodwin, Sarah. “A Many-Facet Rasch Analysis Comparing Essay Rater Behavior on an Academic English Reading/Writing Test Used for Two Purposes.” Assessing Writing 30 (October 1, 2016): 21–31.
Groth-Marnat, Gary, and A. Jordan Wright. Handbook of Psychological Assessment. Terj. Soet. Yogyakarta: Pustaka Pelajar, 2010.
Hadinugrahaningsih, Tritiyatma, Yuli Rahmawati, and Achmad Ridwan. “Developing 21st Century Skills in Chemistry Classrooms: Opportunities and Challenges of STEAM Integration.” AIP Conference Proceedings 1868, no. 1 (August 4, 2017): 30008. /aip/acp/article/1868/1/030008/641094/Developing-21st-century-skills-in-chemistry.
Haynes, Stephen N., David C.S. Richard, and Edward S. Kubany. “Content Validity in Psychological Assessment: A Functional Approach to Concepts and Methods.” Psychological Assessment 7, no. 3 (1995): 238–247. Accessed November 29, 2023. https://psycnet.apa.org/doiLanding?doi=10.1037%2F1040-3590.7.3.238.
Kudiya, Komarudin, Bambang Sumintono, Setiawan Sabana, and Agus Sachari. “Batik Artisans’ Judgment of Batik Wax Quality and Its Criteria: An Application of the Many-Facets Rasch Model.” Pacific Rim Objective Measurement Symposium (PROMS) 2016 Conference Proceedings (2018): 27–37. https://link.springer.com/chapter/10.1007/978-981-10-8138-5_3.
Lane, Suzanne. “Validity of High-Stakes Assessment: Are Students Engaged in Complex Thinking?” Educational Measurement: Issues and Practice 23, no. 3 (September 1, 2004): 6–14. https://onlinelibrary.wiley.com/doi/abs/10.1111/j.1745-3992.2004.tb00160.x.
Linacre, J. M. FACETS Version 3.82.3 [Computer Software and Manual]. Chicago: Winsteps.com, 2013.
Nguyen, Thanh Dong, and David Ng Foo Seong. “Applying the Rasch Model to Investigate Singapore Principals’ Instructional Leadership Practices.” Leading and Managing 20, no. 2 (2014): 1–26. Accessed November 29, 2023. https://search.informit.org/doi/abs/10.3316/aeipt.206326.
Révész, Andrea. “Working Memory and the Observed Effectiveness of Recasts on Different L2 Outcome Measures.” Language Learning 62, no. 1 (March 1, 2012): 93–132. Accessed November 29, 2023. https://onlinelibrary.wiley.com/doi/full/10.1111/j.1467-9922.2011.00690.x.
S., Azwar. Reliabiltas Dan Validitas. 4th ed. Yogyakarta: Pustaka Pelajar, 2012.
Sekaran, U. “Metode Penelitian Bisnis.” Jakarta: Salemba Empat, 2006.
Sudweeks, Richard R., Suzanne Reeve, and William S. Bradshaw. “A Comparison of Generalizability Theory and Many-Facet Rasch Measurement in an Analysis of College Sophomore Writing.” Assessing Writing 9, no. 3 (January 1, 2004): 239–261.
Sumintono, B., and W. Widhiarso. Aplikasi Model Rasch Untuk Penelitian Ilmu-Ilmu Sosial. Cimahi: Trim Komunikata Publishing House, 2014.
Suryabrata, S. Pengembangan Alat Ukur Psikologis. Yogjakarta: Penerbit Andi, 2005.
Susan E. Embretson. “Construct Validity: A Universal Validity System or Just Another Test Evaluation Procedure?” Educational Researcher 36, no. 8 (2007): 449–455. https://www.jstor.org/stable/4621099.
Umintono, B., and W. Widhiarso. Aplikasi Pemodelan Rasch Pada Assessment Pendidikan. Cimahi: Trim Komunikata Publishing House, 2015.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Wahyuni Tri Lestari, Dwi Maryani Rispatiningsih
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.