Background
Rare diseases present a great challenge for patients and physicians. The long way of suffering most patients must go through before they receive the correct diagnosis and treatment not only leads to enormous mental, physical, and social distress, but also places high economic burdens on our health care system [
1,
2].
The rareness and diversity of orphan diseases corresponds to a lack of knowledge among health care professionals, and both factors impede diagnosis and therapy [
3,
4]. Often, an endless number of medical consultations is necessary, and many years pass by until a patient discovers their diagnosis.
Against this backdrop the current study aims to explore the utility of patients’ pain drawings as a novel diagnostic tool in the differentiation and diagnosis of two rare diseases, Ehlers-Danlos Syndrome (EDS) and Guillain-Barré Syndrome (GBS). This methodological approach is based on the idea that repeating patterns in pain drawings (PDs) could help to accelerate diagnostic proceedings and sensitize physicians for rare diseases. The concept of pain drawing was implemented in 1949 by Palmer [
5] and since then, PDs have been used as a diagnostic tool. Patients are asked to mark painful regions in a simple line drawing of the human body, which may even be more precise compared to the verbal description of pain symptoms, particularly in patients with difficulties in verbal fluency. To date, a few studies have shown that PDs can be used as a screening tool for different purposes. Rennerfelt et al. showed that PDs might be a valuable instrument in diagnosing the causes of exercise-induced leg pain. Based on PDs, two observers correctly identified patients with and without chronic anterior compartment syndrome (CACS), which is the most common cause of exercise-induced leg pain. The test–retest showed a high inter-observer agreement of 84% [
6]. Abott et al. proved that specific Pain Drawing Scores [using the Simple Body Region (SBR) method and the Pain Sites Score (PSS)] in patients with recurrent or chronic low back pain (RCLBP) predict an increased risk of depression, somatization and distress at 1-year follow-up [
7].
For practical reasons regarding availability of patients, we chose EDS and GBS as two different disorders representing rare diseases associated with pain as primary symptom. EDS includes a heterogeneous group of inherited disorders, which are caused by different mutations in genes encoding fibrillar collagen or collagen-modifying enzymes [
8,
9]. The prevalence ranges from 1:150,000 to 1:5,000 depending on the population [
10]. The defective collagen causes fragility of the soft connective tissues and extensive manifestations in skin, ligaments and joints, blood vessels, and internal organs. The clinical spectrum varies from mild skin hyperextensibility, joint hypermobility, and tissue fragility, to severe physical disability and life-threatening vascular complications. In most of the cases, pain is the first clinical symptom. EDS induces mild to severe pain. 90% of the affected patients suffer from chronic pain [
11]. The current Villefranche classification recognizes six subtypes, while more recent studies describe 13 variants [
8]. Since there is no curative treatment for any type of EDS, early diagnosis is of prime importance in order to optimize the symptomatic management of patients and to prevent avoidable complications [
12]. GBS is an acute postinfectious polyradiculoneuropathy with a variable clinical presentation. Every year, 1.1 to 1.8 per 100,000 persons suffer from GBS [
13]. It is caused by autoantibodies that attack peripheral nerve components [
14]. The symptoms range from ascending bilateral limb weakness to decreased reflexes and severe back or extremity pain [
15,
16]. Pain can be seen as an heralding feature and can remain for 2 years [
17]. GBS can lead to respiratory insufficiency making an early diagnosis and the initiation of an appropriate treatment essential.
Discussion
Rare diseases as a group are one of the major, but often overlooked challenges for modern health care systems. In Germany alone, around 4 million patients suffer from rare diseases, and it is estimated that approximately 350 million people are affected worldwide. Approximately 7000 rare diseases have been identified so far [
22,
23]. Rare diseases are difficult to diagnose due to their heterogeneity and their complex symptoms. As a result of their rarity and diversity, most clinicians have neither the time nor the specific knowledge to provide patients with a fast and reliable diagnosis [
4], and even if a rare disease is suspected, misdiagnosis is possible due to the often overlapping symptoms of many rare diseases [
4]. Therefore, the average time from the first symptoms to the correct diagnosis is 6 years, but many patients have to wait far longer, up to decades [
24,
25]. During this time, patients often receive several wrong diagnoses, undergo wrong treatments and suffer not only from their symptoms but also from “frustration” and “self-doubt” [
26]. Diagnostic delays consequently add to the burden of individual affected patients as well as health care systems in general. Therefore, as stated by the European Union Committee of Experts on rare diseases (EUCERD), diagnosis must be one priority area in the field of research on rare disease, and there is a clear need for improving the diagnostic process [
27].
Ehlers–Danlos syndrome (EDS) and Guillain-Barré syndrome (GBS) are two rare diseases associated with pain, but with dissimilar clinical presentation and etiology. EDS is a heritable connective tissue disorder with a number of subtypes, and has an estimated prevalence of 1 in 5000. EDS is characterized by joint hypermobility, skin hyperextensibility and tissue fragility with bruising, and definitive diagnosis is verified by genetic testing, with exception of the hypermobile EDS subtype, for which the genetic basis is unknown [
9]. GBS is an immune system mediated disease affecting peripheral nerves and the nerve roots. It is most often triggered by infections, and typically presents initially with bilateral weakness of the legs and arms. Diagnosis is based on clinical features, electrophysiological studies and cerebrospinal fluid analysis [
15,
16]. The rationale to choose these two diseases was the presence of distinct diagnostic criteria for both diseases, which allowed us to evaluate our tool by comparing its results to a previously verified diagnosis and to demonstrate the feasibility of a rare disease classifier based on the so far underutilized tool of pain drawings.
By collecting PDs from patients with the previously verified diagnosis EDS or GBS, and averaging all PDs from each disease, we obtained a specific disease pattern for EDS and GBS, the pain profile (PP). Using the Ružička similarity coefficient, the binary classifier from Pain2D [
18] was able to classify each PD as EDS or GBS with high accuracy. Within the EDS group, 86% of the PDs (51 out of 59) were identified correctly. PDs from patients with GBS were classified correctly in 96% of the cases (28 out of 29). The very high AUC value of 0.95 of the ROC curve analysis confirms the high accuracy for the distinction between EDS and GBS.
As chronic pain occurs in one of five patients with rare diseases, and is frequently the first symptom that leads to medical consultation [
28], pain assessment has a considerable potential for the diagnosis of rare diseases. Shaballout et al. recently showed that electronic PDs can indeed enhance physicians’ insight into acute pain sensation and improve pain communication [
29], and the excellent results of the binary classifier of Pain2D for EDS.GBS classification highlights the diagnostic potential of the regional information contained in PDs and demonstrates the accessibility of this data type for computer based diagnostic aid tools.
To our knowledge, Pain2D [
18] is the first attempt to develop a diagnostic aid tool utilizing information about pain, although a number of questionnaires, like “painDETECT” [
30], “German pain questionnaire” [
31], “Numeric Pain Rating Scale” [
32,
33], “Visual Analog Scale” [
34,
35], and “McGill Pain Questionnaire” [
36], are available in order to describe, classify and detect different sorts of pain like neuropathic and nociceptive pain and distinguish between acute and chronic pain. A diagnostic interpretation algorithm or their evaluation as a diagnostic tool for (rare) diseases is lacking. However, there are a few studies evaluating the diagnostic potential of PDs, but without the development of specific computer aided diagnostic tools. Rennerfelt et al. used PDs for the diagnosis of chronic anterior compartment syndrome (CACS) in patients with exercise-induced leg pain [
6]. Classification of individual drawings was done by two human observers. They reported a sensitivity of 67% (observer 1) and 75% (observer 2) and specificity of 65% and 54%. Another study investigated PDs as a tool for the diagnosis of single level lumbar disc herniation and reported an accuracy of ~ 68.8% [
37]. Both studies achieved lower values than our EDS.GBS classifier, with an accuracy of 90%, sensitivity of 86%, and specificity of 96%.
Comparison of our results with other computer aided diagnostic tools is difficult due to the differences in approaches, as is pointed out by the authors of a recent scoping review summarizing current developments in the field of rare disease diagnosis support [
38]. They identified 72 studies published between 2009 and 2019, with roughly half of those published after 2016, highlighting the very recent progress made towards this end. In the group of data driven approaches, most studies were based on image data (14 of 29 data driven studies reviewed), which is the category to which our study contributes as well. The authors comment that a comparison between studies with regard to validation and metrics is hampered by the diversity of measures used by different groups (like specificity, sensitivity, ROC and AUC, or proportion of correct diagnosis within the top k recommendations), and the differences in tool designs, diseases classified, study participants, and parameters measured. Furthermore, none of the studies included in the review dealt with pain as the main diagnostic parameter. Our tool might therefore close a gap in the current efforts towards the development of diagnostic support systems for rare diseases.
Of note, the main goal of the present study was not a new diagnostic approach to EDS and GBS, since their differential diagnoses would not normally overlap due to the clear differences in clinical presentation and etiology (although the classifier is able to distinguish effectively between the two diseases). Instead, it represents the first step towards a general rare disease classifier based on pain drawings. The excellent performance of our binary classifier for EDS.GBS classification suggests that PDs are indeed a valid tool to distinguish between rare diseases and shows that Pain2D [
18] has the potential to augment diagnosis of diseases based on pain drawings, with the ultimate goal to cover the majority of pain-associated rare diseases. The procedure used in our study to create a typical pain pattern for each disease by scanning PDs and overlapping the marked areas can easily be applied to a wide range of further pain-associated diseases. Further clinical studies are currently implemented by our research group to investigate whether PDs are useful in the diagnosis of rare neurologic diseases, and we are working on the development of a k-disease classifier that includes more rare diseases. Ultimately, Pain2D [
18] is supposed to grow to include many, if not most rare diseases that present with pain, at which point it potentially could indeed contribute to EDS or GBS diagnosis in a realistic clinical setting as a cheap and reliable method, and complement the clinical, genetic or lab based diagnostic parameters used right now by clinicians [
9,
15,
16].
From a practical perspective in a clinical setting, Pain2D [
18] in its final form is supposed to narrow down the possibilities of diagnosis to accelerate the diagnostic process. Like most computer aided diagnosis support tools, it is not meant to be a one-and-done approach, but to make diagnosis of rare diseases easier by concentrating on a few possible candidates [
38]. The final diagnosis will always have to be done by other clinical methods, but the advantage of the diagnostic aid tool is that it is quick, easy, non-interventional, and can be applied in any setting where PDs can be generated. Being given a short explanation, a wide spectrum of patients was able to create PDs in a very short time without any further guidance. Only a small number of patients had difficulties because of pain in hands or fingers. Therefore, this diagnostic tool is suitable, for example, to be completed during the waiting time in outpatient clinics.
While we plan to include most rare diseases presenting with pain into future iterations of the tool, it will not be able to diagnose everything, since some diseases might have pain profiles that are more randomly distributed over the body, and it is of course unable to diagnose diseases that don’t present with pain. In addition, a limitation inherent to rare diseases is the relatively small sample size due to the small number of patients suffering from rare diseases. Furthermore, like all self-report instruments, the binary classifier has to deal with subjective interpretation of pain perception. The procedure for PD evaluation also has its limitations, since painful regions were marked using only one color. Thus, it is not possible to distinguish different qualities or intensities of pain, nor between e.g. pain of the skin at the joints, vs. joint pain. This is a limitation of the method, that for now, for the two examples used, is however not interfering with correct classification, as shown by the excellent results of the binary classifier (Table
3). A combined approach that includes evaluation of PDs and pain questionnaires in a single tool might in the future be able to increase the sensitivity by providing qualitative information about the pain experienced by patients.
Recently, Grigull et al. developed a questionnaire-based diagnostic support tool for several rare neuromuscular diseases by combining patient-oriented questions and data mining algorithms [
39], a study that is also included in the recent review by Faviez et al. [
38]. It is conceivable that a combination of PD analysis with this advancement in taking medical history will take diagnostic procedures of rare diseases to a new level of improvement.
Methods
Study design and population
The trial was designed as a prospective, observational, non-interventional study in patients with Ehlers-Danlos-Syndrome and Guillain-Barré-Syndrome. The study design and protocol were reviewed and approved by the local ethics committee, registered in the German Clinical Trials Register No. DRKS00014777 (Deutsches Register klinischer Studien, DRKS), and performed in accordance with the Declaration of Helsinki and in compliance with Good Clinical Practice. Written informed consent was obtained from each patient.
Between 2017 and 2018, a total of 60 patients with EDS (4 male, 56 female; aged 39.2 ± 11.4 years) and 32 patients with GBS (11 male, 21 female; aged 50.5 ± 13.7 years) participated in this study. To recruit patients, we contacted support groups for the diseases and attended their meetings. In addition, we used different social media platforms organized by support groups to draw attention to the study.
After informed consent patients received a questionnaire and a PD by mail or via personal contact. To be sure that the patients filled out the questionnaire and the PD properly, we added a brief explanation (see Fig.
1). PDs were scanned and automatically adjusted for shift and rotation based on the position of black bars that were printed on the PDs for this calibration purpose. Using standard image processing techniques, noise and the printed outlines of the body and body parts were removed so that only the areas marked by the patients were left [
18].
Inclusioncriteria
Only patients without any other chronic disease besides the ones investigated in this study were included. Inclusion criteria were as follows: patients with GBS or EDS with a minimum age of 18 years, and written consent obtained after a detailed explanation of the investigation.
Questionnaire and pain drawing (PD)
To evaluate different aspects of pain symptomatology, patients filled in a questionnaire based on the “painDETECT questionnaire” and the “German pain questionnaire”. Besides personal information (age, height, weight and sex), the questionnaire asked for the chronicity of pain (rating scale from less than 1 month to more than 5 years), pain course pattern (persistent pain with slight/severe fluctuations, pain attacks with pain-free episodes/pain in between), frequency of pain attacks (from several times a day to less than once a month), duration of the pain attacks (from a few seconds to more than 3 days), and dependency on time of the day. In addition, a list of eight adjectives describing the sensory, and four adjectives describing the emotional aspect of pain perception was used. Furthermore, seven questions concerning specific characteristics of neuropathic pain were included.
In addition to the questionnaire the patients received a sketch of a human body (PD) with anterior, posterior and lateral views. Additionally, head, mouth, as well as anterior and posterior views of hands and feet were magnified to receive more detailed information of these regions (see Fig.
1). Patients received also an explanation how to fill out the pain drawing.
The patients marked the afflicted areas of pain on the drawings. If the PDs for different reasons (too fine, creasing of questionnaire) lacked electronic readability, the template PD was transferred into a new PD with thicker lines or an uncreased questionnaire. This problem occurred in 10% of the PDs in the EDS group and 16% of the PDs in the GBS group.
We used the software Pain2D, which was previously developed by our group [
18], to generate pain profiles (PPs) by overlapping and averaging all PDs which belong to one disease. The PP is depicted as a color code image, with blue colors indicating that a low number (below 50%) of the PDs had the corresponding pixel marked, and yellow to red colors indicating that more PDs had the corresponding pixel marked (above 50%). Green marks the 50% border. Pixels that were not marked at all are depicted in white.
Data evaluation and statistics
In a leave-one-out cross-validation approach, each PD was classified by the binary classifier of Pain2D [
18] as either EDS or GBS by calculating the Ružička similarity to both profiles. This means that one PD was removed from the data set. The remaining images were used to compute pain profiles for EDS and GBS by averaging all PDs from the corresponding disease. For the PD that was previously removed from the data set, the Ružička similarity coefficients to the EDS and the GBS average image were then computed. An EDS score—and similarly a GBS score—was also computed by dividing the EDS similarity by the sum of the EDS and the GBS similarity. Classification occurred according to the highest probability, with the cut-off set to 0.5. The whole procedure of removing a single PD was repeated for each PD. Using the computed probabilities, we plotted a ROC curve and obtained an AUC value of 0.95. In total, 28 out of 29 GBS PDs and 49 out of 59 EDS PDs were correctly classified. Fisher’s exact test and confidence intervals were calculated (as explained in more detail in the results section and figures; Table
2, Fig.
6).
Software
NS developed a software Pain2D [
18] with the open-source programming language R and RShiny. R was also used for all statistic procedures and data visualization. Pain2D allows to extract pain points from paper PDs, generating and analyzing pain profiles and generating ROC-curves and statistics with the binary classifier.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.