Nili, Tate, Barros, Johnstone 2020.pdf (532.05 kB)

An approach for selecting and using a method of inter-coder reliability in information management research

Download (532.05 kB)
journal contribution
posted on 07.07.2020 by A Nili, M Tate, A Barros, David Johnstone
© 2020 Elsevier Ltd Qualitative researchers in information management research often need to evaluate inter-coder reliability (ICR) to test the trustworthiness of their content analysis. A suitable method of evaluating ICR enables researchers to rigorously assess the degree of agreement among two or more independent qualitative coders. This allows researchers to identify mistakes in the content analysis before the codes are used in developing and testing a theory or a measurement model and avoid any associated time, effort and financial cost. Different methods have been proposed, but little guidance is available on which approach to evaluating ICR should be used. In this paper, we review and compare leading ICR methods that are suitable for qualitative information management research. We propose an approach for selecting and using an ICR method, supported by an illustrative example. The five steps in our proposed approach include: selecting an ICR method based on its characteristics and requirements of a project; developing a coding scheme; selecting and training independent coders; calculating the ICR coefficient and resolving discrepancies; and reporting the process of evaluating ICR and its results.

History

Preferred citation

(2020). An approach for selecting and using a method of inter-coder reliability in information management research. International Journal of Information Management, 54, 102154-102154. https://doi.org/10.1016/j.ijinfomgt.2020.102154

Journal title

International Journal of Information Management

Volume

54

Publication date

01/10/2020

Pagination

102154-102154

Publisher

Elsevier BV

Publication status

Accepted

ISSN

0268-4012

Article number

102154

Language

en

Exports

Logo branding

Exports