Standalone Reliability

class StandaloneReliability

This script is simply the reliability function from PyHab Class (base) but run over two arbitrary verbose data files.

PyHab.avgObsAgree(timewarp, timewarp2)

Computes average observer agreement as agreement in each trial, divided by number of trials.

Parameters:

• timewarp (list) – List of every individual frame’s gaze-on/gaze-off code for coder A
• timewarp2 (list) – As above for coder B

Returns:

average observer agreement or N/A if no valid data

Return type:

float

PyHab.cohensKappa(timewarp, timewarp2)

Computes Cohen’s Kappa

Parameters:

• timewarp (list) – List of every individual frame’s gaze-on/gaze-off code for coder A
• timewarp2 (list) – As above for coder B

Returns:

Kappa

Return type:

float

PyHab.pearsonR(verboseMatrix, verboseMatrix2)

Computes Pearson’s R

Parameters:

• verboseMatrix (dict) – Verbose data, coder A
• verboseMatrix2 (dict) – Verboase data, coder B

Returns:

Pearson’s R

Return type:

float

PyHab.wPA(timewarp, timewarp2)

Calculates weighted percentage agreement, computed as number of agreement frames over total frames.

Parameters:

• timewarp (list) – List of every individual frame’s gaze-on/gaze-off code for coder A
• timewarp2 (list) – As above for coder B

Returns:

Weighted Percentage Agreement

Return type:

float