Empirical Validation on the Usability of Security Reports for Patching TLS Misconfigurations: User- and Case-Studies on Actionable Mitigations

Salvatore Manfredi1,2+, Mariano Ceccato3, Giada Sciarretta1, and Silvio Ranise1,4

1Security & Trust, FBK, Trento, Italy
{smanfredi, giada.sciarretta, ranise}@fbk.eu

2DIBRIS, University of Genoa, Genoa, Italy

3University of Verona, Verona, Italy
mariano.ceccato@univr.it

4Department of Mathematics, University of Trento, Trento, Italy
 

 

Abstract

Several automated tools have been proposed to detect vulnerabilities. These tools are mainly evaluated in terms of their accuracy in detecting vulnerabilities, but the evaluation of their usability is commonly neglected. Usability of automated security tools is particularly crucial when dealing with problems of cryptographic protocols for which even small—apparently insignificant—changes in configuration can result in vulnerabilities that, if exploited, pave the way to attacks with dramatic consequences for the confidentiality and integrity of the exchanged messages. This becomes even more acute when considering such ubiquitous protocols as the one for Transport Layer Security (TLS for short). In this paper, we present the design and the lessons learned of a user study, meant to compare two different approaches when reporting misconfigurations. Results reveal that including contextualized actionable mitigations in security reports significantly impact the accuracy and the time needed to patch TLS vulnerabilities. We used these results to build an open-source tool called TLSAssistant, able to combine state-of-the-art analyzers with a report systems that generates actionable mitigations to assist the user. Finally, we report our experience in using TLSAssistant in two case studies conducted in a corporate environment.

Keywords: Vulnerability Detection, Usability Study, Actionable Mitigations, Security Reports,
TLS Misconfiguration

 

+: Corresponding author: Salvatore Manfredi
Security & Trust, FBK, Via Sommarive, 18, 38123 Trento, Italy

 

Journal of Wireless Mobile Networks, Ubiquitous Computing, and Dependable Applications (JoWUA)
Vol. 13, No. 1, pp. 56-86, March 2022 [
pdf]

 

Received: December 19, 2021; Accepted: February 10, 2022; Published: March 31, 2022

DOI: 10.22667/JOWUA.2022.03.31.056