Main automated image analysis applications in psoriasis include detecting and outlining lesion borders, differentiating psoriatic lesions from other skin conditions, objectively calculating area involvement and severity scores, as well as selecting treatments and predicting their response.
3.1 Image Segmentation of Lesions
In addition to correctly identifying psoriasis on skin photographs, a critical step in performing next-level tasks such as assessing disease severity is the automated detection and delineation of individual lesions. Manual image segmentation is a tedious task for dermatologists, so researchers have focused on developing automated image segmentation algorithms. A major advantage for this feat is that psoriatic lesions are usually easy to distinguish from the surrounding unaffected skin. However, challenges arise from poor image quality, including insufficient illumination, blur, or artifacts such as camera reflections, as well as the polymorphic appearance of lesions [
26]. Previous algorithms often relied on feature engineering (e.g., feature-based Bayesian framework), lacked accuracy, or failed to segment challenging input images correctly (e.g., Markov random field combined with a support vector machine), limitations that have been partially overcome by the use of CNNs [
1,
26]. Dash et al. developed PsLSNet, a 29-layer deep U-net-based CNN (designed for image segmentation, featuring a U-shaped architecture that effectively captures context in images and enables precise localization), which automatically extracts spatial information and was validated on 5241 images from 1026 psoriasis patients, including more challenging images [
26]. Results showed an accuracy of 94.8%, outperforming all previous approaches [
26]. In addition, two deep learning models (DLMs) based on a U-net architecture with a ResNet backbone (which enables training of very deep models with hundreds or thousands of layers) were developed and trained by Amruthalingam et al. to anatomically map and segment hand eczema lesions with high accuracy [
27]. According to the authors, this model could also be applied to psoriasis, as both conditions can present very similarly with red, scaly patches and plaques on the dorsal and palmar aspects of the hands [
27].
At the histopathological level, CNNs are expected to provide future clinical support by automatically analyzing skin biopsy images. As a first step, a U-net-based CNN was applied by Pal et al. to successfully segment psoriasis skin biopsy images into epidermis, dermis, and non-tissue, which is a prerequisite for the development of more sophisticated models that can recognize characteristic pathological features of the disease within each skin layer [
28]. Such forms of image segmentation are not only valuable at the microscopic level, but can also be applied to macroscopic images to evaluate the presence of lesions, as well as disease extent and severity, as outlined in the following sections.
3.2 Diagnosis and Subtype Classification
For proper treatment, psoriasis must first be correctly diagnosed. In clinical routine, diagnosis is usually based on an inspection of the entire skin surface, including scalp and nails, while taking into account the patient’s medical and family history. Significant advances have been made by several research groups in developing image-based AI algorithms trained on large datasets of annotated psoriasis images to extract quantitative image features and automatically detect and classify lesions [
29‐
33].
Aggarwal [
29] was able to improve the performance of a CNN model discriminating five dermatological diseases (acne, atopic dermatitis, impetigo, psoriasis, and rosacea) by augmenting the input data with image transformations such as zooming, shearing, rotating, and horizontal and vertical flipping. Zhao et al. developed a two-stage CNN using 8021 images to discriminate nine different diagnoses based on clinical photographs, which made 9% fewer errors in diagnosing psoriasis compared with 25 dermatologists using a test set of 100 images (accuracy of CNN: 0.96, mean human accuracy: 0.87) [
30]. Using Xiangya-Derm, the largest dermatology data set of the Chinese population with over 150,000 clinical images of 571 different skin diseases, Huang et al. developed a CNN to differentiate six common skin diseases, outperforming the accuracy of 31 dermatologists by 6.6% [
31]. Several other CNNs have been developed to discriminate psoriasis from other dermatological diagnoses, with overall accuracy mostly comparable to or better than dermatologists [
32,
33]. However, there is a lack of research on real-world applicability and open-source training data for currently published algorithms.
Furthermore, image-based AI applications need not be limited to the analysis of macroscopic images. Dermoscopic images offer high-resolution visualization of the skin, revealing subtle details such as vascular or pigment patterns through magnification of epidermal and upper dermal layers, potentially enhancing diagnostic accuracy depending on the clinical task. However, acquiring and interpreting these images requires time, specialized equipment, and expertise. For CNN classification purposes, dermoscopic image data sets tend to be more standardized, improving model generalizability.
In contrast, macroscopic images are more accessible, faster to acquire, and provide a broader clinical overview of lesions, making them preferable for initial screenings. Based on macroscopic assessment, clinicians can determine whether additional dermoscopic examination is necessary. A combined approach, utilizing both macroscopic and dermoscopic images, can be advantageous in providing both context and detail.
For instance, differentiating between psoriasis and seborrheic dermatitis on the scalp can be challenging using macroscopic assessment alone. Dermoscopy can offer additional diagnostic clues, such as the presence of annular and hairpin blood vessels indicative of psoriasis, or unstructured white areas and atypical vessels suggestive of seborrheic dermatitis, aiding in more accurate diagnosis [
34]. Yu et al. trained GoogLeNet, a 22-layer deep CNN pre-trained on the ImagNet dataset, to differentiate scalp psoriasis from seborrheic dermatitis using dermoscopic images [
34]. The algorithm outperformed five dermatologists with varying levels of experience with a 26.7% higher sensitivity and 6.8% higher specificity (sensitivity: CNN 96.1%, dermatologists (mean) 69.4%; specificity: CNN: 88.2%, dermatologists (mean) 81.4%) [
34]. Furthermore, non-qualified physicians were able to achieve diagnostic performance similar to that of dermoscopy-proficient dermatologists through assistance from the model (mean sensitivity 79.1%, mean specificity 81.9%) [
34].
This suggests that physicians without specialized training (e.g., in remote areas) or teledermatological applications could directly benefit from additional AI expertise to optimize patient management with dermatologists referred to when needed. The Telemedicine Working Group of the International Psoriasis Council recently determined that managing psoriasis through teledermatology is feasible in most cases, with exceptions for special affected areas such as the genitals or scalp [
35]. A previous study has demonstrated that both online and in-office dermatologic follow-ups for psoriasis result in comparable improvements in psoriasis severity and Dermatology Life Quality Index scores [
36]. While diagnostic AI holds significant potential to enhance these services, further studies are necessary to assess its implementation and effectiveness.
In terms of subtype classification, a CNN was used by Aijaz et al. to differentiate plaque, guttate, inverse, erythrodermic, and pustular psoriasis with high accuracy (84.2%) [
37]. The training sets used included 80% of 172 images of normal skin and 301 images of psoriasis from the Dermnet dataset, while the remaining 20% were used for validation and testing [
37]. Plaque and guttate psoriasis images were overrepresented in the dataset (plaque:
n = 99, guttate:
n = 96), followed by pustular (
n = 48), erythrodermic (
n = 33), and inverse psoriasis (
n = 25) [
37]. Regarding the classification performance for individual subtypes, the highest accuracy was achieved for inverse psoriasis (100%), followed by a sensitivity of 96.5% for normal skin (28/29), 87.2% for guttate (34/39), 85.2% for erythrodermic (23/27), 73.3% for pustular (22/30), and 70% for plaque psoriasis (28/40) [
37].
A major limitation of these reported results is the lack of external test sets with diverse patient populations in different clinical settings, which would provide more insight into the generalizability of algorithms and their potential for real-world clinical use. In addition to psoriasis subtypes, other differential diagnoses presenting with red, scaly plaques such as atopic dermatitis, tinea corporis, mycosis fungoides, pityriasis rosea, or cutaneous lupus erythematosus must be distinguished from psoriasis by AI. To make an accurate diagnosis, CNNs must be trained using large datasets containing these differential diagnoses to recognize subtle differences in appearance and distribution patterns. As dermatology training sets become larger and include more images of psoriasis subtypes, differential diagnoses, and diverse patient populations, future algorithms are expected to become more comprehensive. In addition to diagnostic applications, AI has great potential to facilitate the assessment of the extent and severity of psoriasis, as detailed in the following section.
3.4 Treatment Selection and Response
Predicting treatment response and personalizing drug selection has great potential to improve the quality of life of psoriasis patients and optimize long-term outcomes. Currently, clinical treatment strategy is based on disease severity, subtype, location, presence of psoriasis arthritis and other co-morbidities, as well as patient preference and satisfaction [
8].
Several AI applications have been developed that attempt to identify potential biomarkers and predict individual short- and long-term response to biologics [
1,
51]. For example, the quantification of systemic inflammatory proteins measured before and four weeks after initiation of systemic treatment with tofacitinib and etanercept was used to develop an ML model that accurately predicted long-term response [
52]. Unsupervised cluster analysis has been used to categorize psoriasis patients into three subgroups based on their lesional and non-lesional skin transcriptome to predict treatment effects of methotrexate and various biologicals using an ML algorithm [
53].
Since AI has the capacity to analyze extensive datasets including patient records, clinical photographs, and molecular characteristics, personalized treatment plans may very well be our near future as new patterns continue to be discovered. ML approaches have already been used to show which patients with psoriatic arthritis would benefit from a higher starting dose of secukinumab [
54]. We anticipate that image-based AI will also play a central role in the development of automated treatment decision algorithms for psoriasis patients. By integrating imaging data with clinical and genetic information, AI models could identify optimal treatment regimens tailored to individual patient characteristics, improving therapeutic efficacy and reducing potential side effects. Features such as the clinical phenotype, lesion distribution, and severity could be extracted from photographs using CNNs to serve as input for such treatment recommendation models. In addition, potentially influential variables for treatment success, such as patient age, gender, ethnicity, comorbidities, co-medication, or previous treatments, as well as molecular profiles, could be considered to optimize treatment choice once further research has been conducted.