An Acceptable Criterion For Interobserver Agreement Data

J. Cohen: Cohen. A coefficient of agreement for nominal scales. Educational and psychological measure, 20, 37-46. Fiss, J. L. (1971). Measure of the scale rated correspondence between many advisors. Psychological Bulletin, 76, 378-382. Wasik, B. H., Loven, M.

D. (1980). Classroom observational data: sources of inaccuracy and proposed solutions. Behavioral Assessment, 2, 211-227. Suen, H. K., Lee, P.S. (1985). Impact of the use of a percentage agreement on behavioural observation: a reassessment. Journal of Psychopathology and Behavioral Assessment, 7, 221-234.

Reliable data is data that gives the same results to each measurement. Behaviouralists have developed a sophisticated method for assessing changes in behaviour that depend on accurate measurement of behaviour. Direct observation of behaviour is traditionally one of the carriers of behavioural measurement. Therefore, researchers need to address psychometric properties, such as the .B the Interobserver Agreement, of observational measures to ensure a reliable and valid measurement. Of the many indices of the Interobserver agreement, the percentage of the agreement is the most popular. Its use persists despite repeated reminders and empirical evidence that suggests that it is not the most psychometric statistic that determines interobserver agreement because of its inability to take into account chance. Cohens Kappa (1960) has long been proposed as a more psychometric statistic for the evaluation of the Interobserver agreement. Kappa is described and calculation methods are presented. Shrout, P. E., Spitzer, R. L., Fleiss, J.

L. (1987). Comment: Quantification of compliance in the resumed psychiatric diagnosis. Archives of General Psychiatry, 44, 172-178. Reliable data is not always accurate, but accurate data are always reliable. Langenbucher, J., Labouvie, E., Morgenstern, J. (1996). Methodological evolution: measurement of the diagnostic agreement. Journal of Consulting and Clinical Psychology, 64, 1285-1289. Berk, R. A. (1979).

Generalization of behavioural observations: a clarification of the Interobserver agreement and the reliability of the inter-observer. American Journal of Mental Deficiency, 83, 460-472. Hartmann, D. P. (1977, Spring). Reflections in the choice of the reliability estimates of inter-observers. Journal of Applied Behavior Analysis, 10, 103-116. Landis, J.

R., Koch, G. G. (1977). The measure of the compliance agreement for categorical data. Biometrics, 33, 159-174. Journal of Behavioral Education Band 10, pages205-212 (2000)Cite this article . Johnson, J.M., Pennypacker, H.S. (1993). Strategies and tactics of research on human behaviour (2nd edition). NJ Hillsdale: Erlbaum.

Dunn, G., Everitt, B. (1995). Clinical Biostatistics: An Introduction to Evidence-Based Medicine. Edward Arnold in London. Everitt, B.S. (1994). Statistical methods for medical examinations (2nd edition). NY: Halsted Press. Ciminero, A. R., Calhoun, K.

S., Adams, H. E. (Eds.). (1986). Behavioural Assessment Manual (2. New York: Wiley. Instant online access to all topics from 2019. The subscription is automatically renewed each year.

Fiss, J. L. (1981). Statistical methods for rates and proportions. Ny: Wiley. Professor, Department of Educational and School Psychology, The Pennsylvania State University, University Park, PA Cicchetti, D. V. (1994). Guidelines, criteria and ground rules for evaluating standardized and standardized assessment instruments in psychology. Psychological assessment, 6, 284-290. Watkins, M. W.

(1988). MacKappa . Pennsylvania State University: author. J. D. Cone: 1977. The relevance of reliability and validity to behavioural assessment. Behavioural Therapy, 8, 411-426.

Hops, H., Davis, B., Longoria, N. (1995). Methodological questions in direct observation: illustrations with life in family environments (LIFE) Coding system. Journal of Clinical Child Psychology, 24, 193-203, American Psychological Association, American Educational Research Association and National Council on Measurement in Education. Standards for pedagogical and psychological tests.

About Paul Demuth

I am a freelance photographer and wedding photographer, working in London, Sussex and the south east. I have been working as a photographer for over 12 years and prior to that I worked as an image retoucher and photography manager. I work with business, disability organisations and charities offering lifestyle and corporate photography. I also photograph weddings, family celebrations, portraits, interiors and products.
This entry was posted in Uncategorized. Bookmark the permalink.