Keywords
Melanoma, cancer awareness measure, symptoms, risk factors, skin cancer
In the UK, the time taken to recognise a melanoma symptom and seek medical attention is the third longest of all cancers. There is no validated measure to assess public awareness of melanoma. We aimed to develop and validate a reliable Melanoma Cancer Awareness Measure (M-CAM).
Items for symptoms and risk factors were sourced from national cancer guidelines and patient information websites and reviewed by an expert panel. Three validation studies were undertaken. To assess internal and test-retest reliability, the general public (n = 32) completed the M-CAM on two occasions (~14 days apart). Construct validity was assessed by comparing expert (n = 35) and the general public (n = 100) responses. Sensitivity to change was established by comparing responses of participants randomly allocated to a control leaflet (n = 32) or a melanoma leaflet (n = 29).
Internal reliability was high (Cronbach’s alpha>0.8) for all scales. Public responses were consistent over time, demonstrating test-retest reliability. Experts achieved higher scores than the general public on prompted [11.26(2.70) vs 9.10(3.25),p < 0.001] and unprompted symptom awareness items [3.06(1.81) vs 1.67(1.68),p < 0.001], and unprompted risk factor items [1.26(1.22) vs 0.81(0.95),p = 0.053]. However, prompted risk factor items scores were not different between the groups [10.69(6.07) vs 10.74(4.62),p = 0.422]. The melanoma leaflet group performed better than the control group in the prompted symptom [12.59(1.84) vs 9.75(3.57), p < 0.001], unprompted symptom [4.55(2.08) vs 1.84(1.44),p < 0.001], prompted risk factor [15.59(3.49) vs 12.06(4.40),p < 0.001] and unprompted risk factor items [2.14(1.73) vs 0.87(1.04),p = 0.007] demonstrating the measure is sensitive to change. A risk factor item related to age did not demonstrate construct validity or sensitivity to change.
The M-CAM is a reliable and valid tool to assess melanoma symptom awareness. Further validation may be needed to assess construct validity of the risk factor subscale. Assessing awareness of melanoma in national surveys could identify gaps in knowledge and support early detection and awareness efforts.
Melanoma is a type of skin cancer. Many people do not seek help quickly from a healthcare professional if they notice a symptom, which can lead to worse outcomes. Currently there is no reliable, tested way of measuring how much the public know about the symptoms and risk factors of melanoma. In this study, we aimed to develop a questionnaire called the Melanoma Cancer Awareness Measure (M-CAM).
This involved three studies to assess whether the M-CAM:
Produces similar results over time;
Can differentiate between groups with different levels of melanoma knowledge;
Can detect increases in awareness after education about melanoma.
To do this, we ran three studies:
32 members of the public completed the M-CAM twice, two weeks apart. Results were compared across the two time points.
35 medical doctors completed the M-CAM once. Results were compared with responses from 100 members of the public.
61 members of the public completed the M-CAM twice. Before completing the M-CAM the second time, they were randomly shown a melanoma information leaflet (29 participants) or an unrelated information leaflet (32 participants). Results were compared across the two groups.
All sections of the M-CAM were consistent, meaning the public gave similar answers at two time points. Doctors were aware of more melanoma symptoms, and could list more risk factors than the public. However, when doctors and the public were given a list of risk factors, there was no significant difference between how many they correctly identified. Participants who were shown the melanoma leaflet showed greater improvements in awareness than those shown the unrelated information leaflet.
The M-CAM is a reliable tool for assessing melanoma awareness, but may need further testing. The measure can be used in national surveys to identify gaps in public knowledge.
Melanoma, cancer awareness measure, symptoms, risk factors, skin cancer
Melanoma is the most serious form of skin cancer, with incidence rising rapidly worldwide.1–3 It is the fifth most common cancer in the UK, with around 17,500 new diagnoses and 2,300 deaths annually.4,5 Populations exposed to high levels of ultraviolet (UV) radiation and those with fair skin and hair are particularly at risk of developing the disease.6 The greatest burden of melanoma falls on New Zealand, Australia, North America and Europe.7 This has, in part, been attributed to populations in these regions being predominantly fair skinned and having a high lifetime exposure to UV radiation though environmental factors and tanning culture.8–10 Symptoms of melanoma include newly forming or changing lesions, which are often irregular in shape and colouring, large in size, rapidly growing, and may be bleeding, itchy, crusty or painful.11 Two-week referral to specialist dermatological care is recommended upon recognition of symptoms in the UK.
Low awareness of melanoma symptoms may increase time taken to seek medical support.12 A UK study of 2371 patients with 15 cancers found that 28.9% of patients with malignant melanoma had a delay (>3 months) between noticing symptoms and first presentation to a doctor, which was the third longest delay of all cancer sites.13 One of the most common barriers to presentation of melanoma symptoms to a doctor is not realising a symptom is serious.14 Increased time prior to first presentation could delay specialist referral, diagnosis, and management, increasing the stage at diagnosis and the likelihood of poorer clinical outcomes.14–17 Later stage melanoma at diagnosis is associated with an increased chance of recurrence and mortality, lower quality of life and increased healthcare costs15,18–22
Higher awareness of risk factors of melanoma and preventive measures may help to reduce incidence and improve clinical outcomes. Campaigns implemented in recent decades have aimed to inform the public of behaviours which increase risk of developing melanoma and implement positive attitudes towards preventing exposure to UV radiation.23–25 Evidence has suggested that raising awareness could significantly reduce morbidity and mortality, and may be attributable to the rise in proportion of thin 0.1 mm melanomas and fall in thicker melanomas at diagnosis.23,26 However, there is a lack of recent data outlining public awareness of symptoms and risk factors associated with melanoma.
The limited research on melanoma awareness may be in part due to the lack of an appropriate validated measure. Such cancer awareness measures (CAMs) have been validated in an established process for other disease sites, including breast, bowel, lung, ovarian and cervical.27–31 These measures capture symptom and risk factor awareness and barriers to seeking medical help. The site-specific CAMs can be used in population and targeted studies to assess awareness of specific cancers, to identify gaps in knowledge, guide focus for interventions and evaluate efficacy of public awareness campaigns.28,31
Using an established process for the development of other site-specific CAMs,32 this series of linked studies aimed to develop and validate a Melanoma Cancer Awareness Measure (M-CAM). Specifically, our objectives were to: 1) test the extent to which the M-CAM shows internal and test-retest reliability; 2) assess whether the M-CAM can distinguish between two distinct groups known to differ in levels of cancer awareness (the ‘known groups’ method); and 3) evaluate whether the M-CAM was sensitive to change.
Patients and members of the public were not involved in the development of the research question or the design of this study.
The development and validation of the M-CAM followed a process used to validate the general32 and site-specific CAMs.27–31
The M-CAM includes unprompted and prompted questions to assess knowledge of both symptoms and risk factors. Participants are asked the unprompted items prior to prompted items to prevent inflating accurate responses to the unprompted items. The CAMs also include questions to assess confidence detecting symptoms and anticipated behaviours around seeking medical attention as a means of capturing anticipated delays in medical help-seeking.
Melanoma symptoms and risk factors were identified from the National Institute for Health and Clinical Excellence (NICE) ‘Suspected cancer: referral and recognition’ guidelines33; the NHS ‘Symptoms- melanoma skin cancer’ website34 and the Cancer Council Australia melanoma guidelines.35 Accuracy of items and determination of the correct responses were reviewed and discussed by the study team, including behavioural scientists, medical students and a dermatologist (SS, SG, ON, LW, MJ, PS). Items were removed, added or re-worded accordingly.
A panel of GPs (n = 8) reviewed the M-CAM items via an online survey, to check for interpretability, accuracy, and overlap between items. Overlapping items were removed where necessary and minor changes were made to item wording. The draft version of the M-CAM comprised 41 items; 15 items on symptom awareness (one unprompted and 14 prompted), one item on anticipated delay in seeking medical attention for potential symptoms, 21 items on risk factor awareness (one unprompted and 20 prompted), one item on age associated with the risk of melanoma, two items on previous skin checks and one item on confidence detecting melanoma symptoms. Unprompted items asked participants to list all symptoms or risk factors of melanoma they were aware of, while prompted items presented a list of symptoms or risk factors and asked respondents to indicate whether they could be symptoms or risk factors of melanoma. The full version of the M-CAM can be found as extended data.36 The M-CAM follows scoring for the other site-specific CAMs.27–30
Symptom awareness. For the unprompted item, one point was given for each symptom accurately identified, verified by referring to the symptoms in the prompted list. Responses were scored by three authors (ON, LW, SG), with any disagreements arbitrated by a fourth author (SS). For prompted items, participants responded with ‘Yes’, ‘No’ or ‘Don’t know’. All ‘yes’ responses were scored as correct (1 point), and all ‘No’ and ‘Don’t know’ responses were scored as incorrect (0 points). A separate score was calculated for unprompted and prompted awareness of symptoms.
Risk factors. The same process for scoring symptom awareness was followed for the risk factors. Any risk factor named in the unprompted recall item that was accurate and present in the closed list of risk factors scored 1 point. For the closed items, participants responded on a 5-point Likert scale (strongly disagree to strongly agree). ‘Strongly agree’ or ‘Agree’ responses were considered accurate (1 point), and ‘Not sure’, ‘Disagree’ and ‘Strongly disagree’ responses were considered incorrect (0 points). A separate score was calculated for unprompted and prompted awareness of risk factors.
Anticipated delay in help-seeking. Participants were asked how long they would anticipate waiting if they had a sign or symptom of melanoma. Response options for anticipated help-seeking ranged from ‘1–3 days’ to ‘more than 3 months’, with additional options of ‘I would not contact my doctor’ and ‘I would contact another health professional’. Items were scored from 1 to 9.
Age and risk. Participants were asked which age group was most likely to develop melanoma or if melanoma was unrelated to age. As risk of melanoma increases with age, responses of ’70 year old’ scored ‘1’, and all other responses were scored ‘0’.
Previous skin checks. Participants were asked if they have had a previous skin check conducted by themselves, a non-clinician or a healthcare professional. ‘Yes’ responses scored ‘1’ and other options scored ‘0’.
Confidence detecting melanoma symptoms. Participants were asked how confident they felt to notice a symptom of melanoma. This item was scored between ‘1’ to ‘4’ (‘not at all confident’- ‘very confident’).
Only symptom awareness, risk factor awareness and age and risk items generated in phase 1 were included in the validation studies. This is because the items related to delays in seeking medical attention and confidence in detecting symptoms had been previously validated in the general CAM32 and did not pertain to awareness or knowledge of melanoma, but rather a behavioural response to symptom identification.28,37 Ethical approval was granted by the University of Leeds Research Ethics Committee (MREC 22–066), and informed consent was obtained from all participants. All surveys were conducted on Jisc Online Surveys, and data were analysed using SPSS version 28.0.
Aim: To assess the internal and test-retest reliability of the M-CAM items.
Participants: A total of 100 adults from the general UK population were recruited via personal and professional social media accounts of the core study team (LW, ON, SS, SG) and our associated UK-based research groups. The link to the online survey was included in all posts. People were eligible if they were UK adults without clinical or academic medical qualifications.
Procedure: After reading the study information and consenting to participate, participants completed an online survey including demographic information and the M-CAM items. To assess test-retest reliability, half of the sample were asked to complete the M-CAM again two weeks after initial completion. A unique participant ID linked baseline and follow-up responses.
Analysis: Cronbach’s alpha was used to assess internal reliability on the baseline data. A paired group t-test assessed test-retest reliability in participants who completed the M-CAM at two timepoints, for the symptom awareness and risk factor subscales. McNemar’s test was used to assess test-retest reliability for the age risk factor item. The M-CAM was considered reliable if there was no significant difference between baseline and follow-up responses.
Aim: To assess the degree to which items measure the construct of melanoma awareness using the ‘known groups’ method.31
Participants: Medical doctors (n = 35), considered experts, were recruited via personal and professional relationships of the core study team. Invitation emails, including a link to the online survey were sent to potential participants.
Procedure: Using a cross-sectional design, experts were asked to complete an online survey, consisting of demographic information and the M-CAM. No personally identifiable information was collected.
Analysis: We compared the expert responses with Study 1 baseline general population participant responses (n = 100). As the dependent variables were not normally distributed, we tested the difference in unprompted and prompted recall for symptom awareness and risk factors using Mann-Whitney U tests. Pearson’s chi-square was used to assess difference in response between experts and the general public on the age and risk factor item. The M-CAM was considered valid if the scores between the experts and general population samples were significantly different in the expected direction.
Aim: To assess whether the M-CAM was sensitive to an expected improvement in knowledge of symptoms and risk factors.
Participants: Data from the UK general population sample used in Study 1 (n = 100) were used in Study 3.
Procedure: After completing the initial survey in Study 1, all participants were randomly allocated (1:1) into two groups using Microsoft Excel. The control group (n = 50) received an information leaflet about influenza that was unrelated to melanoma. The intervention group (n = 50) received an information leaflet that detailed the symptoms and risk factors associated with melanoma. The leaflets were sent via email two weeks after completion of the baseline M-CAM. Participants were instructed to read the leaflets, and then complete the M-CAM for a second time. A unique participant ID linked baseline and follow-up responses.
Analysis: Analysis of covariance (ANCOVA) was used to assess differences between the control and intervention group on unprompted and prompted symptom and risk factor awareness, adjusting for participants’ baseline M-CAM scores. Logistic regression was used for the age as a risk factor item, to determine whether receiving the melanoma leaflet increased participants ability to correctly identify that older age increases risk of melanoma, adjusting for baseline scores on this item.
Participants (n = 100) from the general public completed the M-CAM at time point 1, and 61 (61%) completed the M-CAM two weeks later (32/50 [64%]: control group; 29/50 [58%]: intervention group). Participant data that could not be linked via individual codes was excluded (n = 3). Most respondents at time point 1 were female (76%, n = 76), White (68%, n = 68) and educated to degree level (69%, n = 69) (Table 1). A minority (10%, n = 10) reported a family history of melanoma. Of the 35 experts who responded, 14% (n = 5) had clinical/academic expertise in dermatology or oncology. Most experts (66%, n = 23) had more than 25 years of post-graduate medical experience.
Using responses from all participants at time point one (n = 135), the M-CAM demonstrated good internal reliability for symptoms (α = 0.81) and risk factors (α = 0.88). Internal reliability was also demonstrated for symptoms (α = 0.85) and risk factors (α = 0.85) at time point two (n = 61).
Data from participants who were randomised to the control condition in Study 3, were used to assess test-retest reliability over the two time points. There were no significant differences between time point 1 and 2 scores on unprompted and prompted symptom awareness and risk factor scales, indicating test-retest reliability (Table 2). For the age and risk item, there was no significant difference in participants responses at time point 1 (28/32 incorrect, 4/32 correct) and time point 2 (28/32 incorrect, 4/32 correct) (p = 1.000). This indicates test-retest reliability for the age and risk item.
Baseline responses from the general population sample (time point 1, n = 100) and experts (n = 35) were compared to assess construct validity. Experts recognised significantly more melanoma symptoms in the unprompted item (p < 0.001) and prompted scale (p < 0.001), demonstrating construct validity (Table 3). The unprompted risk factor scores were higher for the expert group compared with the general population group, but the difference did not reach statistical significance (p = 0.053). There was no significant difference between the two groups for the prompted risk factor scale (p = 0.422). For the age risk factor item, 28.6% of experts and 15.0% of the general public answered correctly, which was not significantly different (p = 0.075). Construct validity was therefore partially demonstrated for the M-CAM.
After adjusting for baseline scores, the group that received the melanoma leaflet scored significantly higher than the control group across all symptom and risk factor scales in prompted and unprompted items, demonstrating sensitivity to change ( Table 4). For the age and risk item, 7.8% of participants who received the influenza leaflet correctly identified age as a risk factor, compared with 20.4% of those who received the melanoma leaflet (OR = 5.29, 95% CI 0.99, 28.26, p = 0.052).
In this series of linked validation studies, we demonstrated that the Melanoma Cancer Awareness Measure (M-CAM) is a valid and reliable tool to assess melanoma awareness. Checks for internal reliability, test-retest reliability and sensitivity to change were all met for the key symptom awareness measure and risk factor scales. Further investigation of construct validity may be needed for the risk factor items, as the general population and expert groups both scored equally poorly on this scale. This could be included as part of future national surveys evaluating the prevalence of melanoma awareness at a population-level.
The marginal difference between the general population and expert samples regarding the risk factor subscales was not expected. Similarities between the general population and expert samples were particularly apparent in the prompted risk factor items and could be explained by a number of factors. In the development studies of other site-specific CAMs, experts performed better than the general public in the symptom and risk factor items.27–31 The expert samples in those studies only included specialists in the specific cancer associated with the respective measure. In comparison, most (86%) experts in our sample reported they did not have any clinical or academic expertise in oncology or dermatology. Resident doctors and GPs also report a lack of confidence in recognising signs and symptoms of melanoma.38–42 Greater than expected scores in the general public participants may be due to the high level of education observed. Future work could therefore verify the validity of the M-CAM by repeating the known groups study with dermatologists.
The M-CAM is available for use in national surveys to assess awareness of symptoms and risk factors of melanoma. Results of such surveys could identify specific gaps in knowledge to inform interventions. Use of the M-CAM would advance upon existing research which has typically used unvalidated surveys.43–49 National surveys could also highlight whether there are particular socio-demographic groups who lack awareness, which has been suggested in previous research.50–53 The results of future M-CAM surveys could be used to identify gaps in knowledge that can be targeted in future melanoma prevention programmes.
Strengths of this work include a diverse sample, with participants from a range of age and ethnic groups. However, these studies had limitations. The majority of the general population sample were female (76%) and had degree level education (69%), which may limit the generalisability of the findings. Recruitment through the research team’s social media networks may account for the high education level of participants. Of the experts, the majority did not have expertise in dermatology or oncology which may have affected their knowledge of melanoma symptoms and risk factors. However, most medical schools incorporate ‘skin cancer’ learning outcomes into their syllabuses globally.54–56 Therefore, we would expect clinicians to have more knowledge on melanoma compared to the general public.
The survey was completed by participants unsupervised on an online platform and therefore participants could have searched for the correct answers to the items. While unprompted items were separated onto a different page from prompted items, they were able to return to previous pages and could have altered their free text answers. Attrition between the two time points may have created bias in follow-up. Participants who completed the survey at both points may have had increased interest or knowledge in the topic, although the distribution of age, sex, ethnicity and education levels were broadly similar across the timepoints. We anticipated needing small sample sizes for most studies, however some effect sizes may have been smaller than expected, thereby reducing our statistical power to detect such effects.
In conclusion, after following an established procedure for validating site-specific cancer awareness measures, the M-CAM was shown to be a reliable and valid tool of melanoma awareness. Further verification of the validity of the measure could be undertaken in larger population samples. Such population-based surveys could be used to identify gaps in knowledge and could inform potential interventions and public health campaigns to support the early diagnosis of melanoma.
Written informed consent was obtained electronically from all participants. All procedures, including the informed consent process, were conducted in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2000.
We confirm that a conference abstract has been published for a poster presentation. The manuscript has not been published and is not under consideration in any other journals.
The dataset is available in an open access data repository. Ethical approval was granted to share the dataset open access in the University of Leeds data repository. All participants consented to their data to be stored in this way.
Repository name: Research Data Leeds Repository.57
Data can be accessed at: https://doi.org/10.5518/1865.
Wilson L, Nix O, Janda M, Soyer HP, Smith SG, Green SMC. Development and validation of the Melanoma Cancer Awareness Measure- dataset. University of Leeds. [Dataset]; 2026. https://doi.org/10.5518/1865.
The dataset contains the cleaned dataset in an SPSS file.
Data are available under the Creative Commons Attribution 4.0 International (CC BY 4.0).
Open Science Framework: Extended data for ‘Development and Validation of the Melanoma Cancer Awareness Measure’, https://doi.org/10.17605/OSF.IO/HZJ5U.36
This project contains the following files:
Data are available under the Creative Commons Attribution licence (CC-BY) 4.0.
We would like to express our gratitude to the panel of general practitioners for their contribution towards the development of the M-CAM items. We are also grateful to all survey participants for their valuable time and input.
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Register with NIHR Open Research
Already registered? Sign in
If you are a previous or current NIHR award holder, sign up for information about developments, publishing and publications from NIHR Open Research.
We'll keep you updated on any major new updates to NIHR Open Research
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)