MoA Lab Data Repository

The MoA Lab Data Repository is a public archive of research datasets released alongside our publications on phishing, web security, and Internet measurement. While the repository is hosted by the MoA Lab at the University of Tennessee, Knoxville, we are also happy to host data for other researchers. The data on this site is restricted to non-commercial, academic use. Contact Doowon Kim doowon@utk.edu with any questions.

Evaluating the Effectiveness and Robustness of Visual Similarity-based Phishing Detection Models
Paper Artifact(s) – USENIX Security 2025

Abstract: Phishing attacks pose a significant threat to Internet users, with cybercriminals elaborately replicating the visual appearance of legitimate websites to deceive victims. Visual similarity-based detection systems have emerged as an effective countermeasure, but their effectiveness and robustness in real-world scenarios have been underexplored. In this paper, we comprehensively scrutinize and evaluate the effectiveness and robustness of popular visual similarity-based anti-phishing models using a large-scale dataset of 451k real-world phishing websites. Our analyses of the effectiveness reveal that while certain visual similarity-based models achieve high accuracy on curated datasets in the experimental settings, they exhibit notably low performance on real-world datasets, highlighting the importance of real-world evaluation. Furthermore, we find that the attackers evade the detectors mainly in three ways: (1) directly attacking the model pipelines, (2) mimicking benign logos, and (3) employing relatively simple strategies such as eliminating logos from screenshots. To statistically assess the resilience and robustness of existing models against adversarial attacks, we categorize the strategies attackers employ into visible and perturbation-based manipulations and apply them to website logos. We then evaluate the models’ robustness using these adversarial samples. Our findings reveal potential vulnerabilities in several models, emphasizing the need for more robust visual similarity techniques capable of withstanding sophisticated evasion attempts. We provide actionable insights for enhancing the security of phishing defense systems, encouraging proactive actions.

DATASET 2 TITLE
Paper Artifact(s) from INSTITUTION — VENUE YEAR

Abstract: REPLACE WITH ABSTRACT.

DATASET 3 TITLE
Paper Artifact(s) from INSTITUTION — VENUE YEAR

Abstract: REPLACE WITH ABSTRACT.