Table 3: The group-average and individual intra-rater reliability of NIPS before, during and after clinical procedures

	Before		During		After
	ICC (95%CI)	p	ICC (95%CI)	p	ICC (95%CI)	p
Overall intra-rater	0.92 (0.88; 0.94)	<0.01	0.81 (0.73; 0.86)	<0.01	0.99 (0.98; 0.99)	<0.01
Rater 1	0.72 (0.50; 0.86)	<0.01	0.85 (0.72; 0.93)	<0.01	0.94 (0.88; 0.97)	<0.01
Rater 2	0.84 (0.70; 0.92)	<0.01	0.53 (0.22; 0.75)	<0.01	1 (1; 1)	<0.01
Rater 3	0.84 (0.70; 0.92)	<0.01	0.67 (0.42; 0.83)	<0.01	1 (1; 1)	<0.01
Rater 4	0.84 (0.70; 0.92)	<0.01	0.88 (0.77; 0.94)	<0.01	1 (1; 1)	<0.01
Rater 5	0.93 (0.85; 0.96)	<0.01	0.66 (0.40; 0.82)	<0.01	0.97 (0.93; 0.98)	<0.01

ICC: intraclass correlation coefficient; 95%CI: 95% confidence interval
Five nurses assessed 30 videos in first and second assessment for group-average intra-rater reliability using two-way mixed- effects absolute agreement model.
For each rater, individual intra-rater reliability was reported using two-way mixed-effects absolute agreement model.