All Issue

2025 Vol.31, Issue 4 Preview Page
An Analysis of the Validity and Reliability of the Critical Consciousness Inventory (CCI) for Korean High School Students
- Focusing on the Rasch Model -

한국 고등학생을 대상으로 한 ‘비판적 의식 척도(CCI)’의 타당도와 신뢰도 분석
- Rasch 모형을 중심으로 -

김효정1 · 조대헌2 · 조철기3

Kim, Hyojung1 · Cho, Daeheon2 · Cho, Chul-Ki3

1제1저자, 경북대학교 대학원 지리교육과 박사과정
2교신저자, 경북대학교 사범대학 지리교육과 부교수
3공동저자, 경북대학교 사범대학 지리교육과 교수
1First Author, Ph. D. Student, Department of Geography Education, Kyungpook National University
2Corresponding Author, Associate Professor, Department of Geography Education, Kyungpook National University
3Co-Author, Professor, Department of Geography Education, Kyungpook National University
30 November 2025. pp. 779-808
PDF Citation
Abstract
The development of students’ critical consciousness regarding social inequality and social justice is a key concern in social studies and geography education; however, objective measurement and analysis of this construct remain limited. In particular, research on the critical consciousness of secondary school students in Korea is scarce, for which the lack of appropriate assessment instruments is a major contributing factor. This study aims to validate the Critical Consciousness Inventory (CCI), originally develped for youth and young adults in the U.S., with Korean high school students by examining its reliability and validity. The CCI, a Guttman-type scale designed to assess developmental stages of critical consciousness, was translated into Korean and administered to a sample of 150 high school students. The responses were analyzed using the Rasch model, a form of item response theory. The results showed that the overall structure of the inventory and the fit of individual items had no significant deviations from established psychometric standards, suggesting the CCI's applicability for measuring critical consciousness in Korean high school students. However, the results indicated insufficient item separation in terms of difficulty, and some items appeared to show potential differential responses by gender. These findings underscore the need for further testing and refinement of the instrument. Based on these results, we discuss the academic significance and practical implications of using the CCI with Korean high school students.
Keywords
critical consciousness
Critical Consciousness Inventory (CCI)
social inequality
social justice
Rasch model
사회과 및 지리교육에서 사회적 불평등 및 사회정의와 관련한 학생들의 비판적 의식의 발달은 매우 중요한 관심사이지만 이에 대한 객관적인 측정과 분석은 아직 부족한 실정이다. 특히 국내에서는 중등학교 학생들의 비판적 의식에 대한 연구 사례가 거의 없는데, 검사 도구의 부족이 주요한 요인의 하나로 판단된다. 이 연구의 주된 목적은 미국의 청소년 및 청년을 대상으로 개발된 비판적 의식 척도(CCI: Critical Consciousness Inventory)를 한국 고등학교 학생에게 적용하여 척도로서의 타당도와 신뢰도를 분석하는 것이다. CCI는 비판적 의식의 발달 단계를 검사할 수 있는 거트만 척도 형식의 도구이다. 본 연구는 이를 한국어 버전으로 번역한 후 사례 고등학교 학생 150명을 대상으로 검사를 수행하였다. 학생들의 응답 결과는 문항반응이론의 일종인 Rasch 모형을 통해 분석하였으며, 그 결과는 다음과 같다. 검사 도구의 전체 구조와 개별 문항의 적합도를 살펴본 결과 요구되는 수준에서 크게 벗어나는 문제점은 나타나지 않았다. 따라서 CCI는 국내 고등학생의 비판적 의식 측정에도 적용될 수 있는 것으로 판단되었다. 하지만 난이도 면에서 문항 간의 분리 정도가 불충분했고, 일부 문항의 경우 성별에 따라 차별적인 응답 가능성이 파악되었다. 이와 관련해 추가적인 검사와 검사 문항 개선에 대한 면밀한 분석과 검토가 필요할 것으로 생각된다. 본 연구 결과를 바탕으로 한국 고등학생을 대상으로 한 CCI의 학문적 의의와 실천적 활용 방안에 대해 논의하였다.
키워드
비판적 의식
비판적 의식 척도(CCI)
사회적 불평등
사회정의
Rasch 모형
References
  1. 김경리, 2021, 비교과 교육의 대학생 인식검사에서 학년과 캠퍼스에 따른 차별기능문항 분석, 교양교육연구, 15(3), 239-252.
  2. _______, 2023, Rasch 측정모형을 이용한 대학 전공능력 진단도구의 타당화: 경제학과 사례를 중심으로, 대학 교수-학습 연구, 16(2), 23-44.
  3. 김세형, 2023, Rasch 모형 기반 FACETS: WINSTEPS 프로그램을 활용하여 논문 결과 작성하기, 서울: 황소걸음 아카데미.
  4. 김세형·최재일·이준우, 2013, 아마추어 골프 선수를 위한 코치-선수 관계 척도의 타당화: Rasch 평정척도 모형 적용, 한국데이터정보과학회지, 24(6), 1319-1329.10.7465/jkdi.2013.24.6.1319
  5. 김신영, 1993, 멘텔-헨젤 방법(Mantel-Haenszel Procedure)의 타당성에 대한 경험적 연구, 교육평가연구, 6, 59-90.
  6. 김태선·정애경·신주연, 2024, 교사의 비판적 의식 척도 개발 및 타당화, 열린교육연구, 32(1), 107-131.10.18230/tjye.2024.32.1.107
  7. 맹승호·성연선·장신호, 2013, 학습 발달과정 연구의 현황, 방법론적 특징 및 연구 사례, 한국과학교육학회지, 33(1), 161-180.10.14697/jkase.2013.33.1.161
  8. 맹승호·이기영·박영신·이정아·오현석, 2014, 순위 선다형 문항을 이용한 천문 시스템 학습 발달과정 개발 및 타당화 연구, 한국과학교육학회지, 34(8), 703-718.10.14697/jkase.2014.34.8.0703
  9. 문대근·설현수, 2024, Rasch 측정모형을 이용한 KARS-5 ADHD 평가척도의 타당도 분석, 한국교육문제연구, 42(4), 79-101.10.22327/kei.2024.42.4.079
  10. 박상은·김선미·오영수, 2016, 고전검사이론과 문항반응이론으로 살펴본 경제이해도 평가 문항 분석, 경제교육연구, 23(3), 23-53.
  11. 박정수·조완현, 1994, 문항반응이론에서의 추정방법과 대입학력고사의 문항분석, 한국통계학회논문집, 1(1), 192-205.
  12. 배병훈·이동귀·함경애, 2015, Rasch 모형을 이용한 한국판 사회적 바람직성 척도 단축형(SDS-9)의 타당화, 상담학연구, 16(6), 177-197.10.15703/kjc.16.6.201512.177
  13. 설현수, 2007, Messick의 타당도 관점에서Rasch 측정모형 적용을 통한 대학 강의평가 도구개발의 타당화, 교육평가연구, 20(4), 31-51.
  14. 설현수·유은경, 2015, Rasch 측정 모형을 이용한 청소년 인터넷 중독 척도의 타당화, 교육평가연구, 28(3), 779-802.
  15. 안선영, 2022, Rasch 모형을 적용한 문항분석 및 차별기능문항 탐색: 2021학년도 물리인증제1-2급을 바탕으로, 문화와융합, 44(10), 147-159.10.33645/cnc.2022.10.44.10.147
  16. 염동문, 2025, 문항반응이론을 적용한 장애수용 척도의 타당도 검증, 장애와 고용, 35(1), 5-26.
  17. 이경원, 2021, 빈곤원인 인식 척도 타당화 연구: 고전검사이론과 문항반응이론 적용, 사회보장연구, 37(2), 1-27.
  18. 이종성, 1986, 고전검사이론과 문항반응이론, 교육평가연구, 1(1), 149-177.10.1524/zkri.1986.177.1-2.149
  19. 조철기, 2012, 비판교육학의 공간적 관심과 지리교육의 재개념화, 대한지리학회지, 47(5), 775-790.
  20. 조철기, 2020, 시민성의 공간과 지리교육, 푸른길.
  21. 조철기·송원섭·이종호, 2025, 도전기반 학습(CBL)의 도전과제로서 난제의 특성과 지리교육의 함의, 한국지역지리학회지, 31(2), 444-464.10.26863/JKARG.2025.5.31.2.444
  22. Adams, M., Griffin, P., and Bell, L.A., 2007, Teaching for diversity and social justice, Vol. 1. New York, NY: Routledge.10.4324/9780203940822
  23. Arjana, I.M., Parmiti, D.P., Candiasa, I.M., and Widiartini, N.K., 2025, Unlocking the predictive power of the Rasch model: A systematic literature review on educational instrument calibration and assessment accuracy, Edelweiss Applied Science and Technology, 9(6), 2003-2022.10.55214/25768484.v9i6.8310
  24. Arnett, J.J., 2000, Emerging adulthood: A theory of development from the late teens through the twenties, American Psychologist, 55, 469-480. 10.1037/0003-066X.55.5.469
  25. Aryadoust, V., Ng, L.Y., and Sayama, H., 2021, A comprehensive review of Rasch measurement in language assessment: Recommendations and guidelines for research, Language Testing, 38(1), 6-40.10.1177/0265532220927487
  26. Baker, F.B. and Kim, S.H., 2004, Item Response Theory: Parameter Estimation Techniques, CRC press.
  27. Barr A. and Hashagen, S., 2007, ABCD handbook: A framework for evaluating community development, London: Community Development Foundation.
  28. Bichi, A.A., Embong, R., Mamat, M., and Maiwada, D.A., 2015, Comparison of classical test theory and item response theory: A review of empirical studies, Australian Journal of Basic and Applied Sciences, 9(7), 549-556.
  29. Board of Studies NSW, 2003, Syllabus: Geography Years 7-10, Board of Studies NSW.
  30. Bond, T.G. and Fox, C.M., 2013, Applying the Rasch model: Fundamental measurement in the human sciences, Psychology Press.
  31. Bond, T., Yan, Z., and Heene, M., 2020, Applying the Rasch Model, New York: Routledge.10.4324/9780429030499
  32. Boone, W.J. and Noltemeyer, A., 2017, Rasch analysis: A primer for school psychology researchers and practitioners, Cogent Education, 4(1), 1416898.10.1080/2331186X.2017.1416898
  33. Boone, W.J., 2016, Rasch analysis for instrument development: why, when, and how?, CBE—Life Sciences Education, 15(4), rm4.10.1187/cbe.16-04-014827856555PMC5132390
  34. Carlson, E.D., Engbretson, J., and Chamberlain, R.M., 2006, Photovoice as a social process of critical consciousness, Qualitative Health Research, 16(6), 836-852.10.1177/1049732306287525
  35. Chao, R.C.L., Vidacovich, C., and Green, K.E., 2017, Rasch analysis of the rosenberg self-esteem scale with African Americans, Psychological Assessment, 29(3), 329.10.1037/pas0000347
  36. Chi, E., 2001, Comparing holistic and analytic scoring for performance assessment with many facet Rasch model, Journal of Applied Measurement, 2(4), 379-388.
  37. Chong, J., Mokshein, S.E., and Mustapha, R., 2023, Instrument validation based on the six aspects of Messick validity framework using the Rasch Rating Scale Model, Jurnal Penyelidikan Pendidikan, 23.
  38. Crocker, J. and Major, B., 1989, Social stigma and selfesteem: The self-protective properties of stigma, Psychological Review, 96, 608-630. 10.1037//0033-295X.96.4.608
  39. Cross, J.R. and Fletcher, K.L., 2011, Associations of parental and peer characteristics with adolescents’ social dominance orientation, Journal of Youth and Adolescence, 40, 694-706. 10.1007/s10964-010-9585-7
  40. De Champlain, A.F., 2010, A primer on classical test theory and item response theory for assessments in medical education, Medical education, 44(1), 109-117.10.1111/j.1365-2923.2009.03425.x
  41. Diemer, M.A., Frisby, M.B., Pinedo, A., Bardelli, E., Elliot, E., Harris, E.M., McAlister, S., and Voight, A.M., 2022, Development of the short critical consciousness scale (ShoCCS), Applied Developmental Science, 26(3), 409-425.10.1080/10888691.2020.1834394
  42. Diemer, M.A., Kauffman, A., Koenig, N., Trahan, E., and Hsieh, C., 2006, Challenging racism, sexism, and social injustice: Support for urban adolescents’ critical consciousness development, Cultural Diversity and Ethnic Minority Psychology, 12, 444-460. 10.1037/1099-9809.12.3.444
  43. Diemer, M.A., McWhirter, E.H., Ozer, E.J., and Rapa, L.J. 2015, Advances in the conceptualization and measurement of critical consciousness, The Urban Review, 47(5), 809-823.10.1007/s11256-015-0336-7
  44. Diemer, M.A., Rapa, L.J., Park, C.J., and Perry, J.C., 2017, Development and validation of the critical consciousness scale, Youth & Society, 49(4), 461-483.10.1177/0044118X14538289
  45. Eaton, P., Johnson, K., Frank, B., and Willoughby, S., 2019, Classical test theory and item response theory comparison of the brief electricity and magnetism assessment and the conceptual survey of electricity and magnetism, Physical Review Physics Education Research, 15(1), 010102.10.1103/PhysRevPhysEducRes.15.010102
  46. Fisher, W.P., 1992, Reliability statistics: Rasch measurement transactions, Chicago, USA: MESA Press, 6, 238.
  47. Flanagan, C.A. and Faison, N., 2001, Youth civic development: Implications of research for social policy and programs, Ann Arbor, MI: Society for Research in Child Development.10.1037/e640322011-002
  48. Freire, P., 1970, Pedagogy of the oppressed, Harmondsworth: Penguin.
  49. _______, 1974, Education for critical consciousness, New York: Continuum.
  50. Gallagher, S.E. and Savage, T., 2023, Challenge-based learning in higher education, Journal of Geography in Higher Education, 42(4), 498-514.
  51. Hardouin, J.B., 2007, Rasch analysis: Estimation and tests with raschtest, The Stata Journal, 7(1), 22-44.10.1177/1536867X0700700102
  52. Harvey, R.D., 2001, Individual differences in the phenomological impact of social stigma, Journal of Social Psychology, 141, 174-189. 10.1080/00224540109600545
  53. IGU (International Geography Union), 1992, International Charter on Geographical Education, Brisbane: IGU.
  54. Isom, D., 2002, “Me, I got a lot of parts”; Tainted by, struggling against, striving for: Racialized gender identity constructs in African American children. Doctoral Dissertation, Loyola University Chicago.
  55. Latz, A.O., 2017, Photovoice Research in Education and Beyond, New York: Routledge.10.4324/9781315724089
  56. Linacre, J.M., 2018, Winsteps® Rasch measurement computer program user’s guide, winsteps. com.
  57. McWhirter, E.H. and McWhirter, B.T., 2016, Critical consciousness and vocational development among Latino/a high school youth: Initial development and testing of a measure, Journal of Career Assessment, 24, 543-558.10.1177/1069072715599535
  58. Morgan, J. and Lambert, D., 2005, Geography: Teaching School Subjects 11-19, London: Routledge.10.4324/9780203478165
  59. Orsini, M.M., Ewald, D.R., and Strack, R.W., 2022, Development and validation of the 4-Factor Critical Consciousness Scale, SSM - Population Health, 19, 101202.10.1016/j.ssmph.2022.10120236052157PMC9425060
  60. Packham, C., 2008, Active Citizenship and Community Learning(Empowering Youth and Community Work PracticeýLM Series), Learning Matters.
  61. Petrillo, J., Cano, S.J., McLeod, L.D., and Coon, C.D., 2015, Using classical test theory, item response theory, and Rasch measurement theory to evaluate patient-reported outcome measures: a comparison of worked examples, Value in Health, 18(1), 25-34.10.1016/j.jval.2014.10.005
  62. Pinel, E.C., 1999, Stigma consciousness: The psychological legacy of social stereotypes, Journal of Personality and Social Psychology, 76, 114. 10.1037//0022-3514.76.1.114
  63. Planinic, M., Boone, W.J., Susac, A., and Ivanjek, L., 2019, Rasch analysis in physics education research: Why measurement matters, Physical Review Physics Education Research, 15(2), 020111.10.1103/PhysRevPhysEducRes.15.020111
  64. Pratto, F., Sidanius, J., Stallworth, L.M., and Malle, B.F., 1994, Social dominance orientation: A personality variable predicting social and political attitudes, Journal of Personality and Social Psychology, 67, 741-763. 10.1037//0022-3514.67.4.741
  65. QCA, 2007a, Geography: Programme of Study for key stage 3 and attainment target, London: QCA.
  66. _______, 2007b, Geography: The national curriculum 2007, QCA, England.
  67. Quintana, S.M. and Segura-Herrera, T.A., 2003, Developmental transformations of self and identity in the context of oppression, Self and Identity, 2, 269-285. 10.1080/714050248
  68. Quintana, S.M., Castaneda-English, P., and Ybarra, V.C., 1999, Role of perspective-taking abilities and ethnic socialization in development of adolescent ethnic identity, Journal of Research on Adolescence, 9, 161-184. 10.1207/s15327795jra0902_3
  69. Reckase, M.D., 1979, Unifactor latent trait models applied to multifactor tests: Results and implications, Journal of Educational Statistics, 4, 207-230.10.3102/10769986004003207
  70. Seol, H., 2007, A psychometric investigation of the Marlowe-Crowne social desirability scale using Raschmeasurement, Measurement and Evaluation in Counseling an Development, 40, 155-168.10.1080/07481756.2007.11909812
  71. Shin, R.Q., Ashai, S., Hernandez, M.T., Lu, Y., Keum, B., and Essner, S., 2023, The development of the contemporary critical consciousness measure-Short, Critical consciousness: Expanding theory and measurement, 287-308.10.1017/9781009153751.012
  72. Shin, R.Q., Ezeofor, I., Smith, L.C., Welch, J.C., and Goodrich, K.M., 2016, The development and validation of the Contemporary Critical Consciousness Measure, Journal of Counseling Psychology, 63, 210-223.10.1037/cou0000137
  73. Shin, R.Q., Smith, L.C., Lu,Y., Welch, J.C., Sharma, R., Vernay, C.N., and Yee, S., 2018, The development and validation of the Contemporary Critical Consciousness Measure II, Journal of counseling psychology, 65(5), 539.10.1037/cou0000302
  74. Smith, E. V., 2002, Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals, Journal of Applied Measurement, 3(2), 205-231.
  75. Stemler, S.E. and Naples, A., 2021, Rasch measurement v. item response theory: Knowing when to cross the line, Practical Assessment, Research & Evaluation, 26, 11.
  76. Supriyadi, S., Haenilah, E.Y., and Maulina, D., 2025, Development and validation of the critical consciousness scale of environmental issues (CCS-EI): A RASCH model analysis, Biosfer: Jurnal Pendidikan Biologi, 18(1), 183-198.10.21009/biosferjpb.49559
  77. Tesio, L., Caronni, A., Kumbhare, D., and Scarano, S., 2024a, Interpreting results from Rasch analysis 1: The “most likely” measures coming from the model, Disability and Rehabilitation, 46(3), 591-603.10.1080/09638288.2023.2169771
  78. Tesio, L., Caronni, A., Simone, A., Kumbhare, D., and Scarano, S., 2024b, Interpreting results from Rasch analysis 2: Advanced model applications and the data-model fit assessment, Disability and Rehabilitation, 46(3), 604-617.10.1080/09638288.2023.2169772
  79. Thomas, A.J., Barrie, R., Brunner, J., Clawson, A., Hewitt, A., Jeremie-Brink, G., and Rowe-Johnson, M., 2014, Assessing critical consciousness in youth and young adults, Journal of Research on Adolescence, 24(3), 485-496.10.1111/jora.12132
  80. Tilbury, D., 2002, Active Citizenship: Empowering People as Cultural Agents Through Geography, in Gerber, R. and Williams, M., (eds.), Geography, Culture, and Education, Boston: Kluwer Academic Publishers, 105-113.10.1007/978-94-017-1679-6_9
  81. Tuncer Teksoz, G., Boone, J.W., Tuzun, O.Y., and Oztekin, C., 2014, An evaluation of the environmental literacy of preservice teachers in Turkey through Rasch analysis, Environmental Education Research, 20(2), 202-227.10.1080/13504622.2013.768604
  82. Watts, R.J. and Flanagan, C., 2007, Pushing the envelope on youth civic engagement: A developmental and liberation psychology perspective, Journal of Community Psychology, 35, 779-792. 10.1002/jcop.20178
  83. Watts, R.J., Diemer, M.A., and Voight, A.M., 2011, Critical consciousness: Current status and future directions, New directions for child and adolescent development, 2011(134), 43-57.10.1002/cd.310
  84. Watts, R.J., Griffith, D.M., and Abdul-Adil, J., 1999, Sociopolitical development as an antidote for oppression theory and action, American Journal of Community Psychology, 27, 255-271.10.1023/A:1022839818873
  85. Waugh, R.F. and Chapman, E.S., 2005, An analysis of dimensionality using factor analysis (true-score theory) and Rasch measurement: what is the difference? Which method is better?, Journal of Applied Measurement, 6(1), 80-99.
  86. Wolfe, E.W. and Smith, E.V., Jr., 2007a, Instrument development tools and activities for measure validation using Rasch models: Part I—Instrument development tools, Journal of Applied Measurement, 8(1), 97-123.
  87. _______, 2007b, Instrument development tools and activities for measure validation using Rasch models: Part II—Validation activities, Journal of Applied Measurement, 8(2), 204-234.
  88. Wright, B.A., 1994, Reasonable mean-square fit values. Rasch Meas Trans, 8, 370.
  89. Wright, B.D. and Masters, G.N., 1982, Rating Scale Analysis, MESA press.
  90. Zaff, J., Boyd, M., Li, Y., Lerner, J.V., and Lerner, R.M., 2010, Active and engaged citizenship: Multi-group and longitudinal factorial analysis of an integrated construct of civic engagement, Journal of Youth and Adolescence, 39, 736-750. 10.1007/s10964-010-9541-6
  91. Zwick, R., Thayer, D.T., and Lewis, C., 1999, An empirical Bayes approach to Mantel‐Haenszel DIF analysis, Journal of Educational Measurement, 36(1), 1-28.10.1111/j.1745-3984.1999.tb00543.x
Information
  • Publisher :The Korean Association of Regional Geographers
  • Publisher(Ko) :한국지역지리학회
  • Journal Title :REGION AND GEOGRAPHY
  • Journal Title(Ko) :지역과 지리
  • Volume : 31
  • No :4
  • Pages :779-808
  • DOI :https://doi.org/10.26863/JKARG.2025.11.31.4.779
Journal Informaiton REGION AND GEOGRAPHY REGION AND GEOGRAPHY
Journal Informaiton Journal Informaiton - close