Skip to main content
Scientific publication

Weakly supervised detection and classification of basal cell carcinoma using graph-transformer on whole slide images

In: Nature, Article number: 7555 (2023)
Authored by Filmon Yacob (AI Sweden, AI Competence Center, Sahlgrenska University Hospital) Jan Siarov (Sahlgrenska Academy, University of Gothenburg) Kajsa Villiamsson (Sahlgrenska Academy, University of Gothenburg) Juulia T. Suvilehto (AI Competence Center, Sahlgrenska University Hospital) Lisa Sjöblom (AI Competence Center, Sahlgrenska University Hospital) Magnus Kjellberg (AI Competence Center, Sahlgrenska University Hospital) Noora Neittaanmäki (Sahlgrenska Academy, University of Gothenburg)
Computer vision and pattern recognition

The high incidence rates of basal cell carcinoma (BCC) cause a significant burden at pathology laboratories. The standard diagnostic process is time-consuming and prone to inter-pathologist variability. Despite the application of deep learning approaches in grading of other cancer types, there is limited literature on the application of vision transformers to BCC on whole slide images (WSIs). A total of 1832 WSIs from 479 BCCs, divided into training and validation (1435 WSIs from 369 BCCs) and testing (397 WSIs from 110 BCCs) sets, were weakly annotated into four aggressivity subtypes. We used a combination of a graph neural network and vision transformer to (1) detect the presence of tumor (two classes), (2) classify the tumor into low and high-risk subtypes (three classes), and (3) classify four aggressivity subtypes (five classes). Using an ensemble model comprised of the models from cross-validation, accuracies of 93.5%, 86.4%, and 72% were achieved on two, three, and five class classifications, respectively. These results show high accuracy in both tumor detection and grading of BCCs. The use of automated WSI analysis could increase workflow efficiency.