Using of Generalizability Theory in management research, with an emphasis on job analysis

Alizadeh, Ebrahim; Falsafinezhad, Mohammadreza; Delavar, Ali; Farrokhi, Noor Ali; Abbaspour, Abbas

doi:10.22054/jrlat.2016.1054

Document Type : Research Paper

Authors

¹ Corresponding Author: Ph.D. in Assessment and Measurement, AllameTabataba´i University: email: ebalizade@gmail.com

² .Associate Professor of Assessment and Measurement Department, AllameTabataba´i University

³ Professor of Assessment and Measurement Department ,AllameTabataba´i University

⁴ Associate Professor of Assessment and Measurement Department ,AllameTabataba´i University

⁵ Associate Professor of Educational Administration Department, AllameTabataba´i University

https://doi.org/10.22054/jrlat.2016.1054

Abstract

Studies on the topic of managing employee performance evaluation, assessing competencies of job analysis and job evaluation as a source of data collection used. The results of this research can be used when the reliability of the data is acceptable. Researchers to estimate the reliability of these data are the means of inter-rater reliability of Cronbach's alpha is used. The formula for errors in the data are considered as random error, while systematic errors exist in many of the conditions that must be considered when estimating their reliability. For this reason, these formulas can not properly estimate the reliability assessment. This article attempts to application generalizability theory to predict the reliability of the assessment will be presented. The weaknesses of classical test theory and the ability to estimate the reliability generalizability theory described. Then explained the steps to applying generalizibility theory with crossed and nested measurement models with an example that researchers using them can make job analysis, reliability of data more accurately to estimate.

Keywords

References

علیزاده، ابراهیم؛ فلسفینژاد، محمدرضا؛ دلاور،علی؛ فرخی، نورعلی و عباسپور، عباس. (1392). برآورد پایایی دادههای تحلیل شغل با استفاده از نظریه تعمیمپذیری. فصلنامه اندازه گیری تربیتی، 11(4)،2-23.

علیزاده، ابراهیم. (1393). کاربرد نظریههای تعمیمپذیری و خصیصه مکنون برای افزایش دقت نتایج تحلیل شغل. رساله دکتری منتشر نشده. دانشگاه علامه طباطبائی، دانشکده روان شناسی و علوم تربیتی، گروه سنجش و اندازه گیری.

Baranowski, L. E., & Anderson, L. E. (2005). Examining rating source variation in work behavior to KSA linkages. Personnel Psychology, 58(4), 1041-1054.

Brannick, M.T., & Levine, E.L., &Morgeson, F.P. (2007). Job and work analysis (2^nded.). Thousand Oaks: Sage.

Brennan,R.L.(2011). Generalizability Theory and classical test theory. Applied Measurement in Education. 24(1), 1–21.

Brennan,R.L.(2001a). Generalizability Theory. New York: Springer-Verlag.

Brennan,R.L.(2001b). Manual for urGENOVA. Iowa City, IA: Iowa Testing Programs, University of Iowa.

Cardinet,J.,Johnson,S.,Pini,G.(2010). Applying generalizability theory using EduG.Published by Routledge.

Dierdorff,E.C.,Morgeson,F.P.(2009). Effects of descriptor specificity and observability on incumbent work analysis ratings. Personnel Psychology,3(62), 601–628.

Hollander,E.,Harvey,R.(2002). Generalizability Theory Analysis of Item-LevelO*NET Database Ratings. In M. A. Wilson (Chair), The O*NET: Mend it, or end it? Symposium presented at the Annual Conference of the Society for Industrial and Organizational Psychology, Toronto.

Johnson,P., Duberley,J.(2000). Understanding Management Research: An Introduction to Epistemology. Thousand Oaks: Sage.

Ghin Hee Wee,S.(2007). Application of multivariate generalizability theory to assessment to center data. Thesis: (Unpublished Thesis). University of Illinois at Urbana-Champaign.

Lancaster.G.(2005).Research Methods in Management: A concise introduction to research in management and business consultancy. Oxford: Elsevier/Butterworth Heinemann.

Morgeson,F.P., Dierdorff,E.C.(2011). Work analysis: From technique to theory. In S. Zedeck (Ed.), APA Handbook of industrial and organizational psychology (Vol 2, pp. 3-41). Washington, DC: APA.

Morgeson, F. P., & Campion, M. A. (2000). Accuracy in job analysis: Toward an inference-based model. Journal of Organizational Behavior, 21(7), 819-827.

Morgeson, F. P., & Campion, M. A. (1997). Social and cognitive sources of potential inaccuracy in job analysis. Journal of Applied Psychology, 82(5), 627.

Peterson, N. G., Mumford, M. D., Borman, W. C., Jeanneret, P. R., Fleishman, E. A., Levin, K. Y., ... & Dye, D. M. (2001). Understanding work using the Occupational Information Network (O* NET): Implications for practice and research. Personnel Psychology, 54(2), 451-492.

Prien,K.O., Prien,E.P., Wooten,W.(2003). Interrater reliability in job analysis: differences in strategy and perspective. Public Personnel Management , 32(1), 125-142.

Shavelson,R.J .,Webb,N.M .,Rowley.G.L.(1989). Generalizability Theory. American Psychological Association, 44(6), 922-932.

Van Iddekinge, C.H.; Putka, D.J.; Raymark,P.H.; Eidson Jr., Carl.E.(2005). Modeling error variance in job specification ratings: The influence of rater, job, and organization-level factors. Journal of Applied Psychology,90(2), 323-334.

Whetzel,D.L; Wheaton,G.R.(2007).Applied measurement: Industrial psychology in human resource management. Lawrence Erlbaum Associates.

Yelboga.A.(2012). Dependability of Job Performance Ratings According to Generalizability Theory. Education and Science, 37(163), 157-164.

Research on Educational Leadership and Management

Using of Generalizability Theory in management research, with an emphasis on job analysis

References

References

Volume 1, Issue 2 - Serial Number 2
April 2015
Pages 43-62

Using of Generalizability Theory in management research, with an emphasis on job analysis

References

References

Volume 1, Issue 2 - Serial Number 2April 2015Pages 43-62

Volume 1, Issue 2 - Serial Number 2
April 2015
Pages 43-62