HLM등의 툴을 활용한 다수준 분석을 돌리려면 rwg, icc 등의 값을 계산해야 합니다. 이는 개인 수준의 데이터를 집단 수준으로 aggregate해서 분석하는 이유가 됩니다. 이러한 계산을 쉽게할 수 있는 엑셀파일을 소개합니다. 데이터를 불러와서 입력하면 해당 값을 구할 수 있습니다.
| Title | IRA and IRR for Consensus Composition Constructs | ||||||||||||||
| Version | 1.5 | ||||||||||||||
| Date | 03/17/2014 | ||||||||||||||
| Prepared by | Torsten Biemann & Michael S. Cole | ||||||||||||||
| Purpose | To compute rwg-based estimates for determining interrater (within-team) agreement and complementary interrater reliability estimates based on ANOVA. | ||||||||||||||
| Requirements | To function properly, this tool requires Excel 2007. Macros must be enabled. | ||||||||||||||
| Relevant Citations | (1) Bliese, P. D. (2000). Within group agreement, non-independence and reliability: Implications for data and analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research and methods in organizations: Foundations, extensions, and new directions (pp. 349-381). San Francisco: Jossey-Bass. | ||||||||||||||
| (2) James, D. L., Demaree, R. G., & Wolf, G. (1984). Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, 69, 85-98. | |||||||||||||||
| (3) LeBreton, J. M., & Senter, J. L. (2008). Answers to 20 questions about interrater reliability and interrater agreement. Organizational Research Methods, 11, 815-852. | |||||||||||||||
| Other | You will need the
individual-level data for each item of a measure prior to using this
spreadsheet. Simply input Team Identification (IDs) and individual members'
ratings for each item in the appropriate yellow boxes. This worksheet is set up to correspond to Biemann,
Cole, and Voelpel's (2012) article published in The
Leadership Quarterly. If you have any questions,
we suggest referring back to this article. We have tested this spreadsheet
many times and it appears to be bug free. If you find otherwise, please let
us know (contact information is provided below). Please feel free to pass this worksheet along to your colleagues. |
||||||||||||||
| Citation Info | This is a tool designed to accompany: Biemann, T., Cole, M. S., & Voelpel, S. (2012). Within-group agreement: On the use (and misuse) of rwg and rwg(j) in leadership research and some best practice guidelines. The Leadership Quarterly, 23, 66-80. | ||||||||||||||
| If a user chooses to reference this tool, please refer to the published article. | |||||||||||||||
| Contact Info | If you have questions or comments, e-mail us at: | ||||||||||||||
| biemann@bwl.uni-mannheim.de | |||||||||||||||
| m.s.cole@tcu.edu | |||||||||||||||
| Version | Version 1.1 Statistical Tool for Computing rwg and ICCs | ||||||||||||||
| Version 1.2 Corrected error in macro for missing data | |||||||||||||||
| Version 1.3 Revised IRR formulas according to Bliese (2000). | |||||||||||||||
| Version 1.4 Increased sample size limits for IRR calculations. | |||||||||||||||
| Version 1.5 Increased sample size limits for IRR calculations. | |||||||||||||||