Skip to content

Reliability_test #3

@JasonAMK

Description

@JasonAMK

Hello,

Since I'm not sure where I have to ask my question, and if I can ask one in here so feel free to move the message or delete it.
I have some problems making a reliability test and I'm not sure if I'm doing something wrong or if I didn't understand how it is supposed to work. I'm new to DataVyu and Ruby so I think the solution is kind of basic but I'm stuck anyway!

So, to make it simple:

I have two columns, one named "test" the other named "rel_test". The code is the same for the two of them obviously, let's say it is "input"; which can be completed with "x" or "y".

Now, I want to see if the first experimenter did code the same "input" that the second experimenter.

So I use this script:

require 'Datavyu_API.rb'
begin
dump_file = File.expand_path("file_path")
checkReliability("rel_test", "test", "input", 5, dump_file)
end

Basically, I want to compare the cells of each column with the same onset, and see if the code is the same or not, but it really doesn't work. it gives me this output:

Running Script: test_for_inter_reliability.rb on project: name_of_the_project
ERROR in rel_test at Ordinal 1, rel ordinal 1 in argument onset: 6435, 6435
ERROR in rel_test at Ordinal 1, rel ordinal 1 in argument offset: 0, 0
ERROR in rel_tes at Ordinal 1, rel ordinal 2 in argument onset: 6435, 19668
ERROR in rel_tes at Ordinal 1, rel ordinal 2 in argument offset: 0, 0
Total errors for input: 0, Agreement:100.00%
Total errors for onset: 2, Agreement:0.00%
Total errors for offset: 2, Agreement:0.00%
Script has finished running

I really don't understand why it compares the onset of different Ordinal, or even of the same. And why is there an error since it's obviously the same onset?
And why is there 0 errors for input even though I put one deliberately to test?

I'm quite lost there, so if you could tell me where I could ask my question, or if you could give me some insights, it would be much appreciated!

Best,
Jason

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions