Deriving Vignettes for the Rare Disease AADC Deficiency Using Parent, Caregiver and Clinician Interviews to Evaluate the Impact on Health-Related Quality of Life.

PURPOSE: Aromatic l-amino acid decarboxylase (AADC) deficiency is a rare genetic condition, characterised by movement disorder, and speech and cognitive functioning impairment. To enable economic evaluation of treatments, health-related quality of life or utilities need to be derived. These are currently lacking in the literature. This is challenging, where patient numbers are small, particularly in paediatric populations. This study outlines the 5-stage development of vignettes describing AADC, for use in a subsequent health-state utility elicitation study, with an emphasis on caregiver and clinician engagement.
METHODS: To align with the economic model, 5 vignettes describing 5 AADC deficiency motor milestones were developed, ranging from "bedridden" to "walking with assistance". Stage 1 comprised identification of symptoms/impairments from the literature and AADC deficiency charity websites. Stage 2 comprised group discussion with 3 caregivers. A symptoms matrix was developed, followed by draft vignettes (Stage 3). Eight clinicians reviewed these, alongside the same 3 caregivers via a survey (Stage 4). The vignettes were revised at stage 5.
RESULTS: There was high consensus regarding symptoms at Stages 1 and 2, although the literature highlighted behavioural and autonomic symptoms, which caregivers did not. The symptoms were grouped into neuromuscular, autonomic, cognitive, behavioural and functional impairments. Clinician and caregiver vignette feedback highlighted the idiopathic nature of AADC. Despite this, clinicians suggested only 2 additional symptoms. Similarly, caregivers suggested 4 symptoms and a change to the wording used for the cognitive symptoms. Not all changes were included.
CONCLUSION: The differing focus of caregivers, clinicians and the literature reinforces the importance of patient/caregiver engagement. The vignettes need to comprehensively capture what it is like to live with AADC deficiency, in order for the subsequent utilities to be robust. A focus on evidence triangulation, especially for idiopathic conditions, and how engagement is sought from caregivers are important future avenues of research.

Introduction

Aromatic l-amino acid decarboxylase (AADC) deficiency is a rare genetic condition with only around 140 cases reported worldwide to date.1 AADC deficiency is caused by mutations in the gene encoding the enzyme AADC which is responsible for the formation of the neurotransmitters, serotonin and dopamine. It is characterised by movement disorder, including the loss of voluntary movement, hypotonia and intermittent oculogyric crises (OGC). Speech and cognitive functioning may also be affected. Around 80% of cases are categorised as severe,1 meaning the patient is bedridden for life, fails to achieve developmental milestones and is fully dependent. Mild and moderate cases have also been recorded (representing 5% and 15% of cases, respectively).1,2 Mild to moderate cases respond to drug treatment such as, dopamine agonists and monoamine oxidase B (MOA-B) inhibitors, aimed at reducing symptoms through correcting serotonin and catecholamines deficiencies. For severe cases, this is not the case. However, an emerging one-time gene therapy which supports the production of key neurotransmitters has been shown to be a promising new treatment.3

Alongside demonstrating the clinical efficacy of AADC deficiency therapy, cost-effectiveness (CE) studies are stipulated by certain health technology assessment (HTA) agencies to help inform reimbursement decisions. In the United Kingdom (UK), for instance, the National Institute for Health and Care Excellence (NICE) requires CE studies to include a measure of health-related quality of life (HRQoL) in the form of health utilities. For the UK, health utilities have to be derived, where possible, from preference-based instruments, such as the EQ-5D-3L.4 Utility scores – which typically range from 0 (equivalent to dead) to 1 (perfect health) – represent societal preferences for a given health state. Health states considered worse than death are also possible (utility score <0). However, given the nature and rarity of AADC deficiency it is not possible for patients to complete instruments like the EQ-5D-3L. The robustness of proxy scores derived from parents or caregivers may also be questioned, again owing to the few cases globally. Therefore, other approaches, such as time trade-off (TTO), standard gamble5 (SG) and discrete choice experiments6 (DCE), are required. The first approaches typically present vignettes describing health states to participants who then are either instructed to indicate the hypothetical amount of life they would be willing to trade in return for the remaining time in perfect health (TTO) or the level of risk of treatment failure they would be willing to accept in exchange for a cure (SG); health state utilities are then provided by 1-(number of years traded/10) or 100-(risk of failure/100).

The aim of this study was to develop a number of TTO and SG vignettes for subsequent use in obtaining health state utilities for AADC deficiency. The vignettes were developed using input from a number of sources, including parents of AADC deficiency patients, as well as clinicians.

Methods

Initial considerations were whether to design the vignettes from the child’s or parent’s perspective. Direct utility elicitation using TTO and SG can be challenging for rare diseases involving children. If the child perspective is taken, the subsequent valuation by the adult general population can become difficult, especially if certain symptoms are related to development milestones, such as crawling. If the parent/carer perspective is taken, the health states need to be carefully developed to describe the health state of the child, whilst then eliciting valuations of those health states from the perspective of the parent/carer. In AADC, the condition typically presents within the first year of life, meaning these challenges are inherent in designing a utility elicitation study. The vignettes were being developed in order to be used in a TTO/SG study and a DCE to derive health state utilities for a CE model. The health states in the model reflect motor and developmental milestones and are based on an ongoing clinical trial investigating gene therapy for AADC deficiency (NCT02926066). The decision was therefore taken to develop the vignettes from parent/carer perspective describing the health of (a hypothetical) child. The five health states were: 1. the base health state (“bedridden” or untreated AADC deficiency); 2. “head control”; 3. “ability to sit unaided”; 4. “standing with support”; and 5. “walking with assistance” (the “best” health state). An additional vignette was developed in order to capture parental/caregiver quality of life. It should be noted that the economic model, and therefore the health states, reflect severe AADC deficiency. Although a few cases have been reported in the literature where patients have developed the ability to walk independently following gene therapy for AADC deficiency,2 these have involved the moderate phenotype. Therefore, the “best” health state in the vignettes was anchored at “walking with assistance”.

Development of the vignettes occurred over 5 stages. The vignettes were developed de novo given that no existing vignettes describing AADC deficiency were available in the literature. Caregiver involvement was early on at Stage 2, ahead of the initial vignette development. Early-stage involvement was considered critical to ensure that the project team understood what it is like to live with the condition/have a child live with the condition. This insight then helped to shape the development of the vignettes. Caregivers were involved again at Stage 4, reviewing the descriptions alongside clinical experts. Figure 1 provides an overview of the stages.

Figure 1

Overview of the stages.

Ethical Considerations

No patients were involved in any aspect of the study. Parents and caregivers of patients with AADC deficiency, as well as clinicians involved in the treatment and clinical management of AADC deficiency patients took part. Those parents and caregivers involved in the study (the advisory panel in Stage 2 and survey in Stage 4, described below), as well as the physicians (an advisory panel in Stage 4) were contracted by the study sponsor (PTC Therapeutics) to provide their participation. All participants in Stages 2 and 4 were reimbursed. The stages of the study involving parents and caregivers in the USA (see below) were conducted by the study sponsor and qualify as exempt research (). Consequently, these were not submitted to an Institutional Review Board or Medical Ethics Review Committee for consideration. The entirety of the study was conducted in compliance with the University of York Code of Practice and Principles for Good Ethical Governance ().

Stages in Vignette Development

Stage 1

A pragmatic literature search and review was conducted in PubMed. The key terms used in the search were:

(“aromatic L-amino acid decarboxylase” OR “AADC”) AND “deficiency” AND („symptoms„ OR „signs„) AND (“paediatric” OR “pediatric”).

No limitations were applied in terms of time period or language restrictions. Potential abstracts were downloaded and reviewed to identify full articles. Abstracts were excluded if only reporting: laboratory results or animal studies; other medical conditions; or not reporting the signs and/or symptoms of AADC deficiency. This process was undertaken by a single reviewer (ABS). Stage 1 also included a review of AADC deficiency charity websites (; ) with the aim of gaining richer insight into what it is like to live with the condition and support a child with the condition. In addition to this, a search was undertaken on the Jake database (). This is a global repository of anonymised AADC deficiency patients and includes patient data, DNA and laboratory tests, as well as clinical information.

Stage 2

A structured discussion with caregivers on the challenges and obstacles encountered when caring for a person with AADC deficiency. The structured discussion included a number of themes: the patient journey, patient and family quality of life, patient and caregiver interaction, relationship and communication with the physician/healthcare team, information sources, current treatments/modalities, healthcare insurance, as well as tools, resources and support mechanisms. Three parents/caregivers from in the United States of America provided their insights through a virtual advisory board which lasted a half day.

Stage 3

Development of a symptom matrix summarising the symptoms and severity of them by health state, drawing on the insight gained from Stages 1 and 2. This was followed by drafting the health state vignettes.

Stage 4

Clinician review of the symptom matrix and the vignettes, and caregivers’ feedback (N=3) via a bespoke survey. The clinician review consisted of engagement with 3 internal clinicians (including a UK clinician) with expertise in rare diseases, and with 5 external clinicians with expertise specifically in the management of patients with AADC deficiency. The latter took place at an advisory board meeting: 3 of these clinicians were from France, 1 from Portugal and 1 from Spain.

Stage 5

The vignettes and DCE attributes and levels were revised by the project team based on the feedback received from the clinicians, as well as the parents and caregivers in Stage 4.

Results

Stages 1 and 2

The pragmatic literature review returned 39 potential articles; following a review of the A total of 17 (43.6%) were excluded: 9 (23.1%) laboratory/animal studies; 4 other medical conditions (10.3%); 2 no symptoms reported (5.1%); and 2 other (5.1%). The remaining 20 (51.3%) abstracts were selected for full review (2 English abstracts of Chinese publications were included in addition). The articles have been included as .

There were 81 patients registered on the Jake database: 41 males (51%), 32 females (40%) and 8 (9%) where sex had not been recorded. Year of birth ranged from 1973 to 2012. Region of birth was as follows: 20 patients were born in the European Union (25%, including the UK); 28 in Asia (35%; Japan (2), Malaysia (6), Singapore (2), Taiwan (18)); 2 patients were born in Israel and 1 in Turkey. There were 30 patients where this had not been recorded. The literature search also revealed an article which had previously summarised the clinical findings in the Jake database7 reporting hypotonia in 95% of cases; 86% oculogyric crises and 63% developmental retardation. The symptoms and broader impact of AADC deficiency identified during Stages 1 and 2 are summarised in Table 1. Stage 1 has been split into “AADC charity website” versus “literature” identified symptoms and impacts.

Table 1

Summary of Stages 1 and 2

Domain	Stage 1 Literature	Stage 1 Charity Websites	Stage 2 Carers’ Discussion
Neuromuscular	Hypotonia	Hypotonia, (eg, “low muscle tone”)	Hypotonia (“muscle tone abnormalities”)
	Oculogyric crises	Oculogyric crises	Oculogyric crises
	Dystonia	Dystonia (eg, “muscle spasms”)	Dystonia (eg, twisted body syndrome/seizures)
	Hypokinesia/motor impairment	Inability to sit up/stand/walk	–
Cognition	Developmental delay	Developmental delay	Developmental delay (“lack milestone development”/’no milestones’)
	–	No voice, not able to speak	–
	–	Can make eye contact	–
	–	Can respond with expressions	–
Care	–	Lots of medications	Lots of medications
	–	Time spent in hospital	Time spent in hospital
Autonomic	Ptosis	–	–
	Excess sweating	–	Excess sweating
	Nasal congestion	–	–
	Gastrointestinal problems (reflux, diarrhoea, constipation)	Severe gut dysmotility, reflux, excess saliva, need for feeding tube	Inability to feed oneself, vomiting
	Hypoglycaemia	–	Hypoglycaemia
	Excess saliva	–	Excess saliva (“drooling”)
Behavioural	Irritability	–	–
	Excess crying/dysphoria	–	–
	Sleep disturbance	–	Insomnia
Respiratory	–	–	Difficulty breathing
Other	–	–	Neutropenia (autoimmune)
		–	Impact on siblings, family quality of life, financial

There was high consensus across the 3 sources in terms of the key symptoms and signs, however, there were 4 key differences. First, the literature reviewed did not cover the volume and burden of the medication regimen nor the amount of time patients and their caregivers spend in hospital, compared to the supported websites and caregivers’ discussion. Second, whilst the charity websites identified issues relating to cognitive functioning, namely inability speak and, conversely, capabilities around making eye contact and responding with expressions, the carers discussion and the literature referred more broadly to “developmental delay”. Third, autonomic symptoms were covered in the literature, but were referred to less by carers, particularly the charity websites which mentioned only gastrointestinal problems. Finally, whilst the literature highlighted several behavioural issues, this was not the focus of carers and the charity websites. Here, the focus was more on broader impact, including on family quality of life and finances.

Stage 3

The symptoms of AADC deficiency identified at Stages 1 and 2 were grouped into neuromuscular (N=4), behavioural (N=3) and cognitive (N=1), alongside 3 functional impairments. These are summarised in Table 2.

Table 2

Domains and Symptoms Identified in Stages 1 and 2

Domain	Symptom
Neuromuscular	Hypotonia
	Oculogyric crises
	Motor impairment
	Dystonia
Functional	Feeding and swallowing difficulties
	Autonomous feeding
	Weight gain
Cognitive	Mental impairment (delayed cognitive development)
Behavioural	Irritability
	Screaming (“crying child”)
	Sleep

Table 3 summarises the descriptions used in the draft vignettes, broken down by each of the symptom and functioning domains. As can be seen, certain symptom descriptions do not change/improve through each and every health state (i.e., from the worst to the best health state). Notably, the same description/severity is used for the baseline and head control health states for several symptoms: hypotonia, oculogyric crises, dystonia, feeding and swallowing difficulties, irritability and sleeping. Clinical experts and caregivers were asked to feedback on the accuracy of this at Stage 4.

Table 3

Initial Vignettes

Domain	Baseline Vignette	Head Control	Ability to Sit Unaided	Standing with Support	Walking with Assistance
Hypotonia	They have very poorly developed muscle tone meaning their body, arms and legs are very floppy. This means your child is unable to grasps or hold onto things.	They have very poorly developed muscle tone meaning their body, arms and legs are very floppy. This means your child is unable to grasp or hold onto things.	The muscles in their body, arms and legs are still floppy. Your child is able to reach out and or hold onto things.	The muscles in their body, arms and legs are still a bit floppy. Your child can reach out their hands and or hold onto things.	The muscles in their body, arms and legs are still a bit floppy, but your child can reach out their hands and or hold onto things.
Oculogyric crises	Your child experiences something called an “oculogyric crisis”. This is where their eyes rotate or roll in unusual ways, again this is something that happens involuntarily and is not controlled by your child.	Your child experiences something called an “oculogyric crisis”. This is where their eyes rotate or roll in unusual ways, again this is something that happens involuntarily and is not controlled by your child.	Your child experiences something called an “oculogyric crisis”. This is where their eyes rotate or roll in unusual ways, again this is something that happens involuntarily and is not controlled by your child. This happens occasionally.	Your child experiences something called an “oculogyric crisis”. This is where their eyes rotate or roll in unusual ways, again this is something that happens involuntarily and is not controlled by your child. This happens very occasionally.
Motor impairment	Your child in bedridden and unable to move by themselves. This means that your child is unable to lift and control their head, crawl, sit, or stand.	Your child is bedridden and unable to move by themselves. This means that your child is unable to crawl, sit, or stand. However, your child is able to control their head.	Your child is not bedridden and able to move by themselves voluntarily. Your child can sit without help, although they are not able to crawl or stand. Your child can control their head.	Your child is not bedridden and can move by themselves voluntarily. Your child can sit without help and stand with support from a walking frame or another person.	Your child is not bedridden and is able to move by themselves. Your child can lift and control his or her head and is able to sit without assistance. They can stand without any help, and walk as well, although your child needs support from a walking frame or person to do so.
Dystonia	Your child will also experience painful muscle spasms, and their arms and legs may move involuntarily with sudden jerking or twisting.	Your child will also experience painful muscle spasms, and their arms and legs may move involuntarily with sudden jerking or twisting.	Your child will also occasionally experience painful muscle spasms, and their arms and legs may still move involuntarily with sudden jerking or twisting.	Your child will also very occasionally experience painful muscle spasms, and their arms and legs may sometimes move involuntarily with sudden jerking or twisting.
Feeding and swallowing difficulties	They are unable to feed themselves and may need to be fed through a tube (a “naso-gastric” tube).	They are unable to feed themselves and may need to be fed through a tube (a “naso-gastric” tube).	They are able to feed themselves a little bit, and do not need to be fed through a tube (a “naso-gastric” tube).	They are able to feed themselves.	They are able to feed themselves
Weight gain	Your child is very underweight	Your child is underweight	Your child is slightly underweight.	Your child’s weight will be similar to that of a child their own age.	Their body weight is the same as that of a child their own age
Mental impairment	Your child is able to follow objects with their eyes and recognise and smile at people. They can understand simple words but are not able to speak.	Your child is able to follow objects with their eyes and recognise and smile at people. They can understand simple words but are not able to speak.	Your child is able to follow objects with their eyes and recognise and smile at people. They can understand simple words and babble a little.	They can understand simple words and are able to say a few words.	They can understand sentences and can speak and hold conversation. Your child meets the same development milestones as other children of the same age.
Irritability/screaming child	Your child screams constantly throughout the day and night.They will be irritable and agitated.	Your child screams frequently throughout the day and night.They will be irritable and agitated.	Your child screams occasionally throughout the day and night.They may occasionally become irritable and agitated.	They may very occasionally become irritable and agitated	Their body weight is the same as that of a child their own age, as is their mood, which means that they may occasionally cry, but in appropriate situations.
Sleep	Your child will have problems sleeping, as well as having disturbed sleep.	Your child will have problems sleeping, as well as having disturbed sleep	Your child may have problems sleeping, but will sleep for periods of time.	Your child’s will sleep will hardly be affected.	Their sleep will not be affected.

Note: Italicised text refers to text amended from the previous stage.

Stage 4

Clinician Feedback

Clinician feedback focussed on additional symptoms across each of the health states that were felt to be important to include and on the severity of symptoms described across the health states. The additional symptoms suggested by clinicians were: hypoglycaemia (for some patients, with this flagged as a route to diagnosis) and autonomic symptoms including nasal congestion, drooling and gastrointestinal issues. These had all been identified at Stage 1 and Stage 2 but had been excluded from the draft vignettes due to the number of symptoms to cover. Clinicians fed back that AADC deficiency is idiopathic, varying from case to case and that symptoms do not necessarily improve at the same rate and across each and every health state. This was reflected already in the health state descriptions. Example clinician quotations include:

“Description of patients is very difficult as it may change from one case to another, severity of the disease varies between countries”.

And

“As an example, patient can improve in motor milestones but still may not be able to swallow properly, different symptoms (like oculogyric crises) may or may not improve in correlation with motor milestone, different symptoms may improve at different rates”.

Nevertheless, the literature2 suggested that although milestones may be reached at different rates, improvement in symptoms did occur in a global way. Severity of the symptoms was therefore varied across the 5 vignettes so that symptoms decreased globally in severity moving from the bedridden to the walking health state.

The additional feedback on the vignettes only suggested the inclusion of hypoglycaemia and autonomic symptoms, rather than conflicting suggestions/feedback.

Clinicians also emphasised the impact of oculogyric crises on quality of life, suggesting greater emphasis on this would be justified in the health state descriptions.

Caregiver Feedback

The caregiver feedback similar highlighted the idiopathic nature of AADC, with additional symptoms of mouth dislocation, use of a ventilator and daily vomiting suggested. None of these symptoms had been identified at Stages 1 or 2 nor by the clinicians. A caregiver with a child whom they self-rated as fitting the “walking with assistance” health state also fed back that their child does not meet some developmental milestones, that they are behind peers academically and still have problems sleeping, causing tiredness during the day. This indicated the need to revise the “best” health state vignette to reflect these impairments.

Stage 5

The vignettes were revised to arrive at the final versions for use in a TTO and SG study. The revisions focused on: adding in autonomic symptoms (abdominal problems and nasal congestion) raised by clinicians, mental impairment/developmental milestones raised by caregivers, and rephrasing the oculogyric crisis statements for greater emphasis and clarity. Some suggested revisions were not made. These were those considered to be very idiopathic: e.g., single caregiver statements regarding symptoms such as vomiting. An additional vignette was created to capture the impact of AADC deficiency on parents and caregivers. This vignette described the burden of care, such as round the clock supervision of a child with AADC deficiency, close supervision of medication, sleep disruption, the inability to go out the house very often (or only for short periods of time) and loss of work due to the care process and frequent hospital visits.

Table 4 summarises the changes made to the descriptions summarised in Table 3, based on the feedback received.

Table 4

Final Vignettes

Domain	Baseline Vignette	Head Control	Ability to Sit Unaided	Standing with Support	Walking with Assistance
Hypotonia	They have very poorly developed muscle tone meaning their body, arms and legs are very floppy. This means your child is unable to grasps or hold onto things.	They have very poorly developed muscle tone meaning their body, arms and legs are very floppy. This means your child is unable to grasp or hold onto things.	The muscles in their body, arms and legs are still floppy. Your child is able to reach out and or hold onto things.	The muscles in their body, arms and legs are still a bit floppy. Your child can reach out their hands and or hold onto things.	The muscles in their body, arms and legs are still a bit floppy, but your child can reach out their hands and or hold onto things.The muscle in their body, arms and legs are still a bit limper than normal, but your child can reach out and or hold onto things
Oculogyric crises	Your child experiences something called an “oculogyric crisis”. This is where their eyes rotate or roll in unusual ways, again this is something that happens involuntarily and is not controlled by your child.Your child experiences something called an oculogyric crisis. This is where their eyes rotate or roll in unusual ways, similar to an epileptic seizure. This may last for several hours, several times a day.	Your child experiences something called an “oculogyric crisis”. This is where their eyes rotate or roll in unusual ways, again this is something that happens involuntarily and is not controlled by your child.Your child experiences something called an oculogyric crisis. This is where their eyes rotate or roll in unusual ways, similar to an epileptic seizure. These may last for around an hour, several times a day.	Your child experiences something called an “oculogyric crisis”. This is where their eyes rotate or roll in unusual ways, again this is something that happens involuntarily and is not controlled by your child. This happens occasionally.	Your child experiences something called an “oculogyric crisis”. This is where their eyes rotate or roll in unusual ways, again this is something that happens involuntarily and is not controlled by your child. This happens very occasionally.
Motor impairment	Your child in bedridden and unable to move by themselves. This means that your child is unable to lift and control their head, crawl, sit, or stand.	Your child is bedridden and unable to move by themselves. This means that your child is unable to crawl, sit, or stand. However, your child is able to control their head.	Your child is not bedridden and able to move by themselves voluntarily. Your child can sit without help, although they are not able to crawl or stand. Your child can control their head.	Your child is not bedridden and can move by themselves voluntarily. Your child can sit without help and stand with support from a walking frame or another person.	Your child is not bedridden and is able to move by themselves. Your child can lift and control his or her head and is able to sit without assistance. They can stand without any help, and walk as well, although your child needs support from a walking frame or person to do so.
Dystonia	Your child will also frequently experience painful muscle spasms, and their arms and legs may move involuntarily with sudden jerking or twisting.	Your child will also often experience painful muscle spasms, and their arms and legs may move involuntarily with sudden jerking or twisting.	Your child will also occasionally experience painful muscle spasms, and their arms and legs may still move involuntarily with sudden jerking or twisting.	Your child will also very occasionally experience painful muscle spasms, and their arms and legs may sometimes move involuntarily with sudden jerking or twisting.
Feeding and swallowing difficulties	They are unable to feed themselves and may need to be fed through a tube (a “naso-gastric” tube).	They are unable to feed themselves and may need to be fed through a tube (a “naso-gastric” tube).	They are able to feed themselves a little bit, and do not need to be fed through a tube (a “naso-gastric” tube).	They are able to feed themselves.They are able to feed themselves more or less on their own	They are able to feed themselves
Weight gain (removed in final version)	Your child is very underweight (removed in final version)	Your child is underweight (removed in final version)	Your child is slightly underweight. (removed in final version)	Your child’s weight will be similar to that of a child their own age. (removed in final version)	Their body weight is the same as that of a child their own age
Mental impairment	Your child is able to follow objects with their eyes and recognise and smile at people. They can understand simple words but are not able to speak.Your child is unable to follow objects with their eyes and unable to recognise and interact with people. They can understand simple words but are not able to speak.	Your child is able to follow objects with their eyes and recognise and smile at people. They can understand simple words but are not able to speak.Your child is able to follow objects with their eyes and recognise and smile at people. They can understand simple words but are not able to speak.	Your child is able to follow objects with their eyes and recognise and smile at people. They can understand simple words and babble a little.Your child is able to follow objects with their eyes and recognise and smile at people. They can understand simple words and babble a little.	They can understand simple words and are able to say a few words.Your child is able to follow objects with their eyes and recognise and smile at people. They can understand simple words and are able to say a few words.	They can understand sentences and can speak and hold conversation. Your child meets the same development milestones as other children of the same age.They can understand simple sentences and can speak a little. Your child meets some developmental milestones as other children of the same age.
Irritability/screaming child	Your child screams constantly throughout the day and night.They will be extremely irritable and agitated.	Your child screams frequently throughout the day and night.They will be very irritable and agitated.	Your child screams occasionally throughout the day and night.They may occasionally become irritable and agitated.	Your child may still cryThey may very occasionally become irritable and agitated	Their body weight is the same as that of a child their own age, as is their mood, which means that they may occasionally cry, but in appropriate situations.
Sleep	Your child will have problems sleeping, as well as having disturbed sleep.Your child will have problems sleeping.	Your child will have problems sleeping, as well as having disturbed sleepYour child will have problems sleeping.	Your child may have problems sleeping, but will sleep for periods of time.	Your child’s will sleep will hardly be affected.Your child will sleep more than usual	Their sleep will not be affected.Your child will be more tired than usual
Autonomic	Your child will have severe abdominal problems, such as constipation or diarrhoeaOther symptoms include severely blocked nose (nasal congestion), which may lead to serious chest infections, as well as excessive drooling, excessive sweating and extreme tiredness	Your child will have abdominal problems, such as constipation or diarrhoeaOther symptoms include a blocked nose (nasal congestion), which may lead to chest infections, as well as frequent drooling, frequent sweating and tiredness	Your child will have occasional abdominal problems, such as constipation or diarrhoeaOther symptoms include the occasional blocked nose (nasal congestion) as well as some drooling and sweating	Other symptoms include the occasional blocked nose (nasal congestion) as well as some occasional drooling and sweating

Notes: Italicised text in Table 4, refers to text that was amended or modified following Stage 4.

Discussion

Utilities are an important part of economic modelling. Robustly capturing what it is like to live with a particular disease benefits from patient and/or caregiver engagement. For rare diseases such as AADC deficiency, utility elicitation via direct methods is often more typical due to the lack of published utilities and difficulties with using generic preference-based measures (GPBMS) in clinical trials. Nonetheless, direct utility elicitation can still be challenging due to the small number of patients with the disease, which can make patient engagement more difficult, combined with the fact that patients will often be children. In this study, a 5-stage strategy was used to produce vignettes describing 5 different AADC deficiency health states aligned to the primary outcomes in a clinical trial for subsequent use in economic modelling. The emphasis was on early engagement with caregivers, but vignette development also drew on insight gained from published literature, charity websites and clinical expert review.

Each stakeholder/source (caregiver, charity, clinical experts, the literature) contributed to the final vignettes. The differences in the symptoms and functioning limitations highlighted, with caregivers focussing less on autonomic symptoms and behavioural issues than the literature reviewed, and the literature focusing less on the burden of medication and hospital treatment, demonstrate the importance of drawing upon multiple stakeholders and sources. This may be especially important for rare diseases where there are fewer patients and clinical experts to engage with. To some extent, adopting this approach requires some degree of triangulation of evidence, to avoid focusing on very individualistic things that may only be reported by a single clinician or caregiver, whilst still benefiting from the input of each person engaged with. In this study, we have done this triangulation through providing a clear break down of the findings at each stage, and the impact upon the vignettes. For example, at Stage 5, when revising the vignettes for the final time, single symptoms flagged by caregivers at Stage 4 for the first time, having not been picked up in the literature nor in the charity websites nor clinical expert reviews were not included in the revisions. These were difficult decisions to make. These singularly mentioned symptoms may reflect the idiopathic nature of the disease and treatment response reported by the clinical experts, which posed a particular challenge for vignette development. Nonetheless, overall, the feedback from clinicians was consistent, flagging autonomic symptoms and hypoglycaemia, and the feedback from caregivers highlighted additional symptoms to consider, rather than inaccuracies in the descriptions themselves. This provides reassurance that the health states capture what it is like to live with AADC deficiency, despite the idiopathic nature of it, and supports the assertion of Kojima et al.2 that global improvements can be seen in AADC deficiency.

The finding that charity websites focused on different symptoms to caregivers during the advisory board meeting was interesting and raises the question as to how best elicit feedback on symptoms: asking questions a particular way may encourage a focus on deficit versus a focus on what the patient can still do. Indeed, the inclusion of the ability to understand simple words in the bedridden health state, and to “follow objects with their eyes and recognise and smile at people” in the head control health state are arguably important statements to have included in the descriptions, to highlight capabilities as well as impairments. Similarly, in this study caregiver engagement was provided through structured group discussion at an advisory board, compared with one to one telephone interviews. Both are qualitative methods of gathering caregiver perspectives and, thus, provide richer insight than is possible via, for example a survey on its own. However, we suggest that enabling interactions amongst the caregivers may yield additional insights compared with one-to-one interviews. In the social science literature, the general consensus is that focus groups encourage interaction between participants, who respond to and comment on one another’s contributions, which generates richer data.8

It should be noted that the input into and the review of the vignettes was undertaken by participants (parents/caregivers and clinicians) drawn from only 5 countries (UK, USA, France, Portugal and Spain). This was inevitable given the extremely low prevalence of AADC deficiency globally. However, although the development process lends itself easily to the use of the vignettes in these countries (including a planned study in France), given the variety of healthcare systems around the world, including variations in the quality of care and availability of support, the focus on these countries may have the potential to limit the generalisability of the results and may impact on the use of the vignettes in other countries. On the other hand, this needs to be balanced, in the context of the rarity of the condition, against the fact that the supporting literature used to inform the basis of the vignettes was drawn from sources such as the international consensus guidelines1 and patient database (), and therefore reflect the key symptoms and signs of AADC deficiency globally.

Conclusion

In the next stage of the study, the vignettes will be used in both a TTO and SG study to be conducted in both the UK and France, to elicit utilities for use in an economic model. A further stage of vignette review will be included with French clinicians, to ensure that they are valid for use within the French study. As with any such study, the utilities generated will only be as good as they are robust. Whilst in this study 5 stages of development was undertaken to try and more reliably capture what it is like to live with AADC deficiency, the number of caregivers and clinical experts involved was still small, a problem not uncommon in rare disease utility studies. Given the importance of utilities due to their inclusion in cost utility analyses, with ramifications for funding decisions, further research into the issues identified in this study would be valuable: triangulation of evidence, transparency regarding symptoms excluded and included, and whether to use one to one interviews or group discussions.