Intercoder agreement/reliability

[ZeinabEl-Dirani]

I know that the issue of having multiple coders to check percentage agreement is debatable, but I am wondering if there is a way to do it in NVivo. Like, two people code separately using same framework and one can compare their coding using nvivo. Is their anyway to do that?

[QDATRAINING_Admin]

Yes, the feature is known as a ‘Coding Comparison Query’ and is a binary score to measure levels of agreement. If you are going to run this test, please first carefully review the blog and video on this page because it may help to avoid some common mistakes people when setting up inter-rater reliability testing which render the test unworkable. This can be a lot of time to waste and even more to run it correctly the next time. The video at the end is quite old (10 years) but this function has not changed since in the software, so we have not re-recorded it.

https://qdatraining.com/conducting-inter-rater-reliability-testing-using-a-coding-comparison-query-in-nvivo-avoiding-the-classic-mistakes-2/

If you have any trouble following these guidlines and steps; you could arrange a one-to-one interactive support call to run through these steps together. If you wish to arrange a support call, you can do so here: https://qdatraining.com/request-nvivo-support-call/  we need the online scheduling system to track and plan resources. Support calls are typically arranged within four working days. We run support calls during normal working hours, but also in the evenings up to 10:00 pm and on Saturdays, up to 6:00 pm. Note* you must be logged into your account on the website to be able to make a support call request

I hope this response is helpful,

I hope this response is helpful, but do let me know if you have any questions or concerns.

[Author]

Posts