GOALS OF RELIABILITY EVALUATION IN OBSERVATIONAL STUDIES
Abstract
In the applied behavior analysis literature, reliability
evaluation is done through the measurement of interobserver agreement.
In the ethological literature, on the other hand, several techniques
of reliability evaluation are used, including the replication of
the identification of the same categories of behavior by other researchers.
Reasons for this difference are identified. As a conclusion, it is
suggested that reliability evaluation must be subordinated to the goals
and characteristics of each research project, while keeping general
meaning of reliability as accuracy and replicability.
Downloads
Download data is not yet available.
References
BAER, D. M. (1977). Reviewer's comment: just because it's reliable doesn't mean
that you can use it. Journal of Applied Behavior Analysis, 10, 117-119.
BAER, D. M., WOLF, M. M., & RISLEY, T. R. (1968). Some current dimensions of
applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91-97.
BIJOU, S. W., PETERSON, R. F., & AULT, M. (1968). A method to integrate
descriptive and experimental field studies at the level of data and empirical
concepts. Journal of Applied Behavior Analysis, 1, 175-191.
BIRKIMER, J. C., & BROWN, J. H. (1979). A graphical judgmental aid which
summarizes obtained and chance reliability data and helps assess the
believability of experimental effects. Journal of Applied Behavior Analysis, 12,
523-533(a).
BIRKIMER, J. C, & BROWN, J.H. (1979). Back to basics: percentage agreement
measures are adequate, but there are easier ways. Journal of Applied Behavior
Analysis, 12, 535-543(b).
BLURTON JONES, N. (1972). Characteristics of ethological studies of human
behaviour. Em N. Blurton-Jones. (Ed.). Ethological studies of child behaviour.
Cambridge: Cambridge University Press.
CARO, Т. М-, ROPER, R., YOUNG, M., & DANK, G. R. (1979). Inter-observer
reliability. Behaviour. LXIX, 3-4, 303-315.
FERREIRA, M. С R. (1984). O apego e as reações da criança à separação da mãe:
uma revisão bibliográfica. Cadernos de Pesquisa, 48, 3-19.
FISCH, H., FREY, S., & HIRSBRUNNER, H. (1983). Analyzing nonverbal behavior in
depression, Journal of Abnormal Psychology, 92 (3), 307-318.
HARTMANN, D. P. (1977). Considerations in the choice of inter-observer reliability
estimates.Journal of Applied Behavior Analysis, 10, 103-116.
HAWKINS, R.P.,&D0TS0N,V. A. (1975). Reliability scores that delude: an Alice in
Wonderland trip through the misleading characteristics of inter-observer
agreement scores in interval recording. Em E. Ramp, & G. Semb (Ed.). Behavior
analysis: areas of research and application, Englewood Cliffs, N. Jersey:
Prentice-Hall.
HINDE, R. A. (1966). Animal behaviour. N. York: McGraw-Hill.
HOPKINS, B. L,& HERMANN, J. A. (1977). Evaluating inter-observer reliability of
interval data. Journal of Applied Behavior Analysis, 10, 121 -126.
JOHNSON, S. M.,& BOLSTAD, 0. D. (1973). Methodological issues in naturalistic
observation: some problems and solutions for field research. Em L. A. Hamerlynck, L. С. Handy, & E. J. Mash (Eds.). Behavior change: methodology,
concepts, and practice. Champaign, Illinois: Research Press.
KAZDIN, A. E. (1977). Artifact, bias and complexity of assessment: the ABCs of
reliability. Journal of Applied Behavior Analysis, 10, 141-1 50.
KRATOCHWILL, T. R., & WETZEL, R. J. (1977). Observer agreement, credibility,
and judgment: some considerations in presenting observer agreement data.
Journal of Applied Behavior Analysis, 10, 133-139.
LEACH, G. M. (1977). A comparison of the social behaviour of some normal and
problem children. Em N. Blurton-Jones (Ed.). Ethological Studies of Child
Behaviour. Cambridge: Cambridge University Press.
MARTURANO, E. M. (1978). Um método para a observação e análise do
comportamento da criança em sala de aula. Psicologia, 4 (2), 37-73.
MARTURANO, E. M. (1979). Características do comportamento no jardim da
infância: l-repertório básico. Psicologia, 5 (1), 69-89.
MARTURANO, E. M., BERTOLDO, A. A., & CAMELO, A. L. P. (1982). Estudo
descritivo do intercâmbio verbal em sala de aula através da análise de
contingência - uma contribuição metodológica. Psicologia, 5(3), 19-36.
MICHAEL J. (sem data). Characteristics of a good definition. Apostila mimeografada
para distribuição interna na American University.
PIERON, H. (1966). Dicionário de Psicologia. Tradução de Cullinan, D. Ð’., do
original francês de 1951. Rio de Janeiro: Globo.
RAMP, E., & SEMB, G. (Eds.). (1975). Behavior analysis: areas of research and
application. Englewood Cliffs, N. Jersey: Prentice-Hall.
RICHARDS, M. P. M., & BERNAL, J. F. (1972). An observational study of motherinfant
interaction. Em N. Blurton-Jones (Ed.). Ethological Studies of Child
Behaviour. Cambridge: Cambridge University Press.
SCHERER, K. R., & EKMAN, P. (1982). Handbook of methods in nonverbal behavior
research. Cambridge: Cambridge University Press.
SILLAMY, N. (1 980). Dictionnaire encyclopedique de Psychologie. Paris: Bordas.
SMITH, P. K.,& CONNOLLY, K. (1972). Patterns of play and social interaction in preschool
children. Em N. Blurton-Jones (Ed.). Ethological Studies of Child
Behaviour. Cambridge: Cambridge University Press.
WARREN, H. С (1934). Dictionary of Psychology. Boston: Houghton Mifflin.
WILDMAN, B. G., & ERICKSON, M. T. (1977). Methodological problems in behavioral
observation. Em J. D. Cone, & R. P. Hawkins (Eds.). Behavioral assessment:
New directions in clinical psychology. N. York: Brunner, Mazel.
WOLMAN, Ð’. Ð’. (1973). Dictionary of behavioral science. N. York: Van Nostrand
Reinhold.
YELTON, A. R. (1979). Reliability in the context of the experiment. Journal of
Applied Behavior Analysis, 12, 565-569.
that you can use it. Journal of Applied Behavior Analysis, 10, 117-119.
BAER, D. M., WOLF, M. M., & RISLEY, T. R. (1968). Some current dimensions of
applied behavior analysis. Journal of Applied Behavior Analysis, 1, 91-97.
BIJOU, S. W., PETERSON, R. F., & AULT, M. (1968). A method to integrate
descriptive and experimental field studies at the level of data and empirical
concepts. Journal of Applied Behavior Analysis, 1, 175-191.
BIRKIMER, J. C., & BROWN, J. H. (1979). A graphical judgmental aid which
summarizes obtained and chance reliability data and helps assess the
believability of experimental effects. Journal of Applied Behavior Analysis, 12,
523-533(a).
BIRKIMER, J. C, & BROWN, J.H. (1979). Back to basics: percentage agreement
measures are adequate, but there are easier ways. Journal of Applied Behavior
Analysis, 12, 535-543(b).
BLURTON JONES, N. (1972). Characteristics of ethological studies of human
behaviour. Em N. Blurton-Jones. (Ed.). Ethological studies of child behaviour.
Cambridge: Cambridge University Press.
CARO, Т. М-, ROPER, R., YOUNG, M., & DANK, G. R. (1979). Inter-observer
reliability. Behaviour. LXIX, 3-4, 303-315.
FERREIRA, M. С R. (1984). O apego e as reações da criança à separação da mãe:
uma revisão bibliográfica. Cadernos de Pesquisa, 48, 3-19.
FISCH, H., FREY, S., & HIRSBRUNNER, H. (1983). Analyzing nonverbal behavior in
depression, Journal of Abnormal Psychology, 92 (3), 307-318.
HARTMANN, D. P. (1977). Considerations in the choice of inter-observer reliability
estimates.Journal of Applied Behavior Analysis, 10, 103-116.
HAWKINS, R.P.,&D0TS0N,V. A. (1975). Reliability scores that delude: an Alice in
Wonderland trip through the misleading characteristics of inter-observer
agreement scores in interval recording. Em E. Ramp, & G. Semb (Ed.). Behavior
analysis: areas of research and application, Englewood Cliffs, N. Jersey:
Prentice-Hall.
HINDE, R. A. (1966). Animal behaviour. N. York: McGraw-Hill.
HOPKINS, B. L,& HERMANN, J. A. (1977). Evaluating inter-observer reliability of
interval data. Journal of Applied Behavior Analysis, 10, 121 -126.
JOHNSON, S. M.,& BOLSTAD, 0. D. (1973). Methodological issues in naturalistic
observation: some problems and solutions for field research. Em L. A. Hamerlynck, L. С. Handy, & E. J. Mash (Eds.). Behavior change: methodology,
concepts, and practice. Champaign, Illinois: Research Press.
KAZDIN, A. E. (1977). Artifact, bias and complexity of assessment: the ABCs of
reliability. Journal of Applied Behavior Analysis, 10, 141-1 50.
KRATOCHWILL, T. R., & WETZEL, R. J. (1977). Observer agreement, credibility,
and judgment: some considerations in presenting observer agreement data.
Journal of Applied Behavior Analysis, 10, 133-139.
LEACH, G. M. (1977). A comparison of the social behaviour of some normal and
problem children. Em N. Blurton-Jones (Ed.). Ethological Studies of Child
Behaviour. Cambridge: Cambridge University Press.
MARTURANO, E. M. (1978). Um método para a observação e análise do
comportamento da criança em sala de aula. Psicologia, 4 (2), 37-73.
MARTURANO, E. M. (1979). Características do comportamento no jardim da
infância: l-repertório básico. Psicologia, 5 (1), 69-89.
MARTURANO, E. M., BERTOLDO, A. A., & CAMELO, A. L. P. (1982). Estudo
descritivo do intercâmbio verbal em sala de aula através da análise de
contingência - uma contribuição metodológica. Psicologia, 5(3), 19-36.
MICHAEL J. (sem data). Characteristics of a good definition. Apostila mimeografada
para distribuição interna na American University.
PIERON, H. (1966). Dicionário de Psicologia. Tradução de Cullinan, D. Ð’., do
original francês de 1951. Rio de Janeiro: Globo.
RAMP, E., & SEMB, G. (Eds.). (1975). Behavior analysis: areas of research and
application. Englewood Cliffs, N. Jersey: Prentice-Hall.
RICHARDS, M. P. M., & BERNAL, J. F. (1972). An observational study of motherinfant
interaction. Em N. Blurton-Jones (Ed.). Ethological Studies of Child
Behaviour. Cambridge: Cambridge University Press.
SCHERER, K. R., & EKMAN, P. (1982). Handbook of methods in nonverbal behavior
research. Cambridge: Cambridge University Press.
SILLAMY, N. (1 980). Dictionnaire encyclopedique de Psychologie. Paris: Bordas.
SMITH, P. K.,& CONNOLLY, K. (1972). Patterns of play and social interaction in preschool
children. Em N. Blurton-Jones (Ed.). Ethological Studies of Child
Behaviour. Cambridge: Cambridge University Press.
WARREN, H. С (1934). Dictionary of Psychology. Boston: Houghton Mifflin.
WILDMAN, B. G., & ERICKSON, M. T. (1977). Methodological problems in behavioral
observation. Em J. D. Cone, & R. P. Hawkins (Eds.). Behavioral assessment:
New directions in clinical psychology. N. York: Brunner, Mazel.
WOLMAN, Ð’. Ð’. (1973). Dictionary of behavioral science. N. York: Van Nostrand
Reinhold.
YELTON, A. R. (1979). Reliability in the context of the experiment. Journal of
Applied Behavior Analysis, 12, 565-569.
Downloads
Published
2012-05-15
How to Cite
Guarnieri Batista, C. (2012). GOALS OF RELIABILITY EVALUATION IN OBSERVATIONAL STUDIES. Psicologia: Teoria E Pesquisa, 1(3), 205–214. Retrieved from https://periodicos.unb.br/index.php/revistaptp/article/view/16977
Issue
Section
Artigos
