Table 6 Results from paired-sample t-tests and one-way ANOVA tests for four tool factors. A/B test represents participants who used FindBugs before using VulIntel whereas B/A test represents the opposite
From: Towards the application of recommender systems to secure coding
Paired sample t-Test | One-way ANOVA test based on tool order | |||||||
|---|---|---|---|---|---|---|---|---|
| Â | Â | Â | Â | Â | A/B test | B/A Test | ||
Tool factor | t statistic | DF | p value | 95% confidence interval | F value | Pr(>F) | F value | Pr(>F) |
Helpfulness (Q1) | 10.3333 | 13 | 1.228e-07 | [1.7514, 2.6772] | 0.1200 | 0.735 | 1.0909 | 0.3169 |
Usability (Q2) | 6.5655 | 13 | 1.81e-05 | [1.0064, 1.9936] | 2.7000 | 0.1263 | 0.2500 | 0.6261 |
Secure coding ability (Q3) | 7.3202 | 13 | 5.83e-06 | [1.3091, 2.4052] | 1.1707 | 0.3005 | 0.0000 | 1.0000 |
Adoption (Q4) | 6.1085 | 13 | 3.729e-05 | [1.3389, 2.8040] | 2.0769 | 0.1751 | 0.2500 | 0.6261 |