Skip to main content

Opportunities to improve the adoption of health-related quality of life evidence as part of the French Health Technology Assessment process

Abstract

Objectives

Patient’s health-related quality of life (HRQoL) is an important outcome measure that is considered by many payers and health technology assessment (HTA) bodies in the evaluation of treatments. We aimed to identify opportunities for HRQoL to be further incorporated into the assessment of the French HTA by comparing three health systems. We put forward recommendations that could bring further innovations to French patients.

Methods

We reviewed methodologies by the French, German and British HTA, and conducted a systematic review of all French (n = 312) and German (n = 175) HTA appraisals from 01 January 2019 to 31 December 2021. We also setup an advisory board of 11 ex-HTA leaders, payers, methodologists, healthcare providers and patient advocates, from France, Britain and Germany, to discuss opportunities to improve acceptance and adoption of HRQoL evidence in France.

Results

Our systematic review of HTA appraisals showed a higher HRQoL data rejection rate in France: in > 75% of cases the HRQoL evidence submitted was not accepted for the assessment (usually for methodological reasons, for example, data being considered exploratory; 16–75% of the appraisals mentioned HRQoL evidence, varying by therapeutic area). Overall, we found the French HTA to be more restrictive in its approach than IQWiG.

Conclusions

Based on these findings we articulate collaborative proposals for industry and the HAS to improve acceptance of HRQoL evidence and create a positive feedback loop between HAS and industry along four dimensions (1) patient perception, (2) testing hierarchy, (3) trial design and (4) data collection.

Peer Review reports

Background

Health technology assessment (HTA) bodies and payers are increasingly focused on patient-relevant end-points and the patient voice to ensure that patients benefit from an improved health-related quality of life (HRQoL) and are able to access these innovations rapidly. Patient-relevant end-points are also essential to capture the patient experience on treatment with generation of evidence to inform the clinical benefit–risk assessment. The value assessment put forward by The Professional Society for Health Economics and Outcomes Research (ISPOR) [1], American Society of Clinical Oncology (ASCO) [2], European Society for Medical Oncology (ESMO) [3] and others increasingly focus on assessing new products as holistically as possible, including the impact products have on patients’ quality of life. HRQoL measures are not new; they have been piloted since the 1990s [4]. These measures are continuously adjusted to enable relevance to patients and can be captured reliably in an efficient way. While some payers/HTA prefer generic scales, others, such as Institute for Quality and Efficiency in Health Care (IQWiG), in Germany, traditionally prefer disease-specific scales [5]. Other HTA yet, such as the National Institute for Care Excellence (NICE) in the United Kingdom, use a wholly different system, by looking at utility values, usually derived from instruments such as EuroQol five-dimensions (EQ-5D) generic questionnaire [6, 7].

Taking the impact on patient quality of life is increasingly important: for example, in oncology, for late-stage or metastatic disease, treatments may last for a long period of time, meaning that patients need to be able to, and learn to, live with the side-effects of the treatment trialed. The impact on quality of life therefore becomes a significant part of the patient’s life for weeks and months, and can therefore no longer be ignored.

In France, the question of how to best assess impact of new therapies on patient HRQoL is very topical and gaining prominence: the Haute Authorité de la Santé (HAS), the French HTA, has recently published a number of reports on this topic. These range from reports on international use of/guidelines on patient-reported outcome and experience measures (PROMs and PREMs) [8, 9] to guidelines on how to collect HRQoL data as part of real-world evidence studies [10], including in the context of the new early access program [11, 12]. The 10-year national strategy for fighting cancer specifically mentions improving quality of life as one of its foundational aims [13] and the High Council on Public Health recently published a report that underlines both the importance of capturing and assessing HRQoL as well as the complexity of integrating this into the HTA assessment [14].

We aimed to identify the evidence needs and potential opportunities in how HRQoL could be further incorporated into the assessment of the HAS by comparing HTA authorities in three health systems and putting forward recommendations that could be considered by French payers that could bring further innovations to French patients.

In scope here are all instruments which enable the measurement of health-related quality of life (including, therefore, a number of patient-reported outcomes). We exclude patient-reported experience measures insofar as they do not measure health-related quality of life but rather patient experience of the treatment, and utility values, again insofar as they do not measure health-related quality of life (this helps to explain why our analysis of NICE appraisals is not as in-depth as that undertaken for HAS and IQWiG, given NICE’s focus on utility values rather than HRQoL as more strictly defined here).

Methodology

Literature review

We conducted a literature analysis of relevant HAS, IQWiG and NICE documents published since 2018 across all therapeutic areas, including their official published methodological guidelines. Moreover, we reviewed recommendations and literature from key discussions around HRQoL evidence in the HAS appraisal process. See Additional file 1: Supplemental Methods for the full list of documents reviewed.

Health technology assessment appraisal analysis

We undertook an analysis of the body within HAS which is responsible for the clinical assessment part of the appraisal, the Transparency Committee (CT; as compared with the economic assessment), and IQWiG appraisals dated 1 January 2019–31 December 2021 for drugs indicated for the treatment of rare diseases, respiratory diseases, oncology, cardiovascular diseases, metabolic, endocrinology and paediatric diseases, as accessible from PrismAccess (Prioritis proprietary database). We noted, for each appraisal whether HRQoL evidence was included in the dossier submitted, what instruments were used, whether the HRQoL evidence was considered sufficiently appropriate to be taken into account in the assessment and the reasons for rejecting this data where this was not the case. Our analysis therefore included all products reviewed by HTA, regardless of whether they were reviewed by both HAS and IQWiG or not (and did not conduct a direct comparative analysis of each product review by both agencies). Due to the wide difference in methodology in how NICE conducts its appraisal, and in the type of evidence requested by NICE (as it compares with HAS and IQWiG), we did not include NICE appraisals in this analysis.

Expert opinion survey and interviews

We conducted a survey of 14 stakeholders, including patient advocates, healthcare providers, former HTA directors and methodologists (five from France, five from the United Kingdom and four from Germany). Topics covered by the survey included the principles that determine the types of HRQoL instruments accepted by HTAs, importance of HRQoL evidence for clinical versus economic appraisal and preferred instruments as well as an open question on how HRQoL evidence is assessed in the three countries. To deep-dive into the topics above, we also conducted the survey with six HTA stakeholders from patient advocacy groups and former HTA directors and three patient advocacy group (PAGs). See Additional file 1: Methods for an anonymized list of experts surveyed and interviews, as well as the questions asked in the survey.

Advisory boards to consolidate opinions

We conducted two advisory boards with the leading experts co-authoring this report, with the aim of (1) understanding the benefit of including HRQoL evidence in HTA appraisals for patients; (2) coming to a consensus regarding the pros and cons of the current landscape in France, Germany and the United Kingdom; and (3) discussing consensus proposals to improve HRQoL evidence adoption France. Leading experts included HTA experts (three from France, one from Germany and one from the United Kingdom), clinicians (one from France), methodologists (three from France) and PAGs (two from France).

Results

The doctrine of the Commission de la Transparence (CT) emphasizes the importance of quality of life (HRQoL) data but does not include much detail

Our analysis of methods used to assess HRQoL data in HTA appraisals across the United Kingdom, France and Germany showed how complex this assessment is (Fig. 1). This is complicated by the fact that no two therapeutic areas measure HRQoL are similar; indeed, even within oncology, substantial differences between cancer types mean that different HRQoL instruments will be used, and a uniform approach is difficult to put forward as a result. These analyses were used as a key input into the development of our proposals, which may help the adoption of HRQoL data. The HAS doctrine states “the quality of life data contributes to the evaluation of the clinical efficacy of a medication”. It also further states that “by completing the efficacy and safety data and dependent on medical context, quality of life can lead to an Amélioration du Service Medical Rendu (ASMR) superior to V in the case where they are: using validated and adapted instruments (preferably disease specific), and a rigorous methodology [12] [objective and minimum clinically important difference (MCID) specified in the protocol, double-blind, control of Type-1 error, appropriate frequency of measurement, appropriate time and study duration and extent of missing data”].

Fig. 1
figure 1

The three countries studied differ substantially in the HRQoL scales preferred and in how this evidence is assessed. Comparison of HAS [12], NICE [23] and IQWiG [15] methods guides, including an overall assessment of the approach, acceptance of open-label data, requirements for end-point hierarchy, acceptance of real-world evidence, preference of generic or disease-specific HRQoL scales, requirements for instrument validations, thresholds for minimum clinically important difference (MCID) and guidelines for missing data

Recent case studies show the positive impact which quality of life (HRQoL) data can have on the HTA appraisals

Recent case studies suggested by our ex-HTA directors advisors (Table 1) show the important impact which HRQoL data can have on HAS appraisals, across therapeutic areas (examples here include polyneuropathy, atopic dermatitis and protoporphyria). This often comes from HRQoL-specific end-points in randomized clinical trials (as in the examples of inotersen and dupilumab), but can also come from real-world evidence trials (as in the case of afamelanotide), though HTA attach different importance to real-world evidence (see Fig. 1 for a summary).

Table 1 Recent case studies show the impact which HRQoL evidence can have on a product’s benefit rating in France and Germany

Overall, these examples demonstrate the importance of including HRQoL data in the value assessment, and how highly HTA value this data when it is collected according to guidance.

A systematic review of recent HAS and IQWiG appraisals shows that the HAS’s methodology leads to a higher rate of rejection of HRQoL data

We logged every HAS opinion from 2019, 2020 and 2021 and assessed the share of dossier which included HRQoL data as well as the HAS consideration of this data (due to the wide difference in methodology in how NICE conducts its appraisal, and in the type of evidence requested by NICE as it compares with HAS and IQWiG, we did not include NICE appraisals in this analysis). We undertook this analysis for six therapeutic areas rare diseases, paediatrics, oncology, metabolism and endocrinology, cardiovascular diseases, and respiratory diseases assessed between 1 Jan 2019 and 31 Dec 2021. The share of dossiers which included HRQoL data varied widely by therapeutic area (TA), from 16% to 75% (Fig. 2A). HRQoL data was more frequently collected and reviewed by HAS in rare and respiratory diseases. Cardiovascular, metabolism and endocrinology as well as paediatric clinical appraisals had far fewer submissions with HRQoL data submitted, potentially due to the non-chronic nature of disease or challenges with caregiver HRQoL data collection. Across disease areas, HRQoL data was submitted and accepted by HAS in < 20% of all appraisals. Specifically, the proportion of assessments that considered HRQoL data was 17% in rare diseases (n = 24), 11% in respiratory (n = 57), 5% in oncology (n = 101), ~3% in cardiovascular (n = 36), ~1% in metabolism and endocrinology (n = 72) and 0% in paediatrics (n = 22).

Fig. 2
figure 2

Analysing recent HTA appraisals shows HAS’s methodology to lead to a higher rate of rejection HRQoL data than IQWiG. A Number submissions to HAS across disease areas which included HRQoL data, and when this was accepted. B Rationale quoted by HAS for rejecting HRQoL data as a percent of submissions including HRQoL data across disease areas. C Number of all submissions to IQWiG across disease areas which included HRQoL data, and when this was accepted. HAS and IQWiG appraisals between 1 January 2019 and 31 December 2021 were analysed across six therapeutic areas (rare disease, respiratory disease, oncology, cardiovascular diseases, *metabolism/endocrinology and paediatrics). Appraisals were collected from PrismAccess. Reasons for rejection are not mutually exclusive; some appraisals mentioned more than one reason for rejecting HRQoL evidence. **These reasons for rejection commonly cause the data to be regarded as “exploratory”, which is the most frequent cause of HRQoL data rejection mentioned in HAS appraisals. IQWiG does not undertake an assessment for rare diseases; this is done by the German federal joint committee (G-BA). NICE’s methodology is different, as it usually undertakes the clinical and economic assessment jointly, hence NICE appraisals are not reviewed here

Looking at the HAS opinions in more detail, the most frequent reasons for rejecting the data were methodological, usually because the analysis was considered exploratory, as it was not included in the statistical testing hierarchy (Fig. 2B). The common reasons for rejection did not vary substantially by therapeutic area: lack of control for alpha risk is the most common cause (closely linked to statistical testing hierarchy). The second most common cause for rejection was the open-label nature of trials; other reasons include gaps in reporting, lack of suitable comparators and not clinically relevant or missing statistical tests.

Indeed, the HAS doctrine states that HRQoL data collecting must be done rigorously, according to the following criteria: “using validated and adapted instruments (preferably disease-specific), and a rigorous methodology (objective and MCID specified in the protocol, double-blind, control of alpha risk, frequency, appropriate time and duration and limited missing data” [12].

To provide an international benchmark, we looked at IQWiG’s appraisal over the same time-period, in the same therapeutic areas (Fig. 2C). The percentage of appraisals that included HRQoL data did not vary substantially compared with dossiers submitted to HAS. The most striking difference observed was in the share of a dossier where the HRQoL data was reviewed and accepted as valuable by IQWiG: up to 48% of dossiers for respiratory diseases, and 36% in oncology (versus 11% and 5% at HAS for the same therapeutic areas). The main reasons for rejecting data were gaps in reporting (60% of rejections in oncology), with relevance of HRQoL scales used as the second most frequent reason (18% in oncology). The main difference between the IQWiG and HAS’s approaches seemed to be IQWiG’s acceptance of data outside of the testing hierarchy, and the fact that IQWiG was more open to data from open-label trials or real-world evidence studies. Both IQWiG and HAS reject data where there are too many reporting gaps; IQWiG specifies a threshold of 70% of data required for the statistical analysis, while HAS does not specify a threshold.

This is illustrated by examples such as apalutamide, cemiplimab and lorlatinib, where HAS considered the statistical analyses exploratory, while IQWiG decided to consider the statistical analyses in the appraisal (Fig. 3). Nonetheless, HAS is generally stricter than IQWiG in its consideration of HRQoL evidence, as shown by its frequent rejection of trials without “suitable comparators” and frequent assessment that data were exploratory. NICE merges the economic and clinical appraisal into a single assessment, while HAS and IQWiG separate the two analyses, leading to different methodologies for assessing HRQoL.

Fig. 3
figure 3

Recent case studies show the difference in how HAS and IQWiG handle HRQoL evidence in dossiers submitted to them. Case studies, selected by our ex-HTA directors, show, for HAS [24,25,26,27,28,29,30,31], NICE [32,33,34,35] and IQWiG [36,37,38,39,40,41,42,43], whether the HRQoL data submitted was considered or not, and the rationale for the discrepancies. Note: NICE did not review all the products that HAS and IQWiG reviewed, this is indicated by “n/a”

Survey results show that HRQoL evidence from a validated instrument is seen as essential, but fit with guidance is the greatest barrier to wider adoption in France

According to our survey, a majority of experts believed that HRQoL data is an essential part of the clinical assessment undertaken by HTA in France, the United Kingdom and Germany (Fig. 4A), though there was some variation between countries and therapeutic areas (for example, German ex-HTA directors were less likely to see HRQoL data as essential, compared with French ones The use of a validated and widely used HRQoL instrument was the main principle which determined HRQoL data acceptability across the three countries surveyed, though in Germany the importance of following HTA guidelines closely was also an important factor (indeed, IQWiG’s methodological guidelines are much more detailed than those issued by, for example, HAS [12, 15]; Fig. 4B). When asked about the main barriers to further adoption of HRQoL data, experts stated that trial quality and fit with the methodological guidance issue was the main barrier in France (thereby echoing the German ex-HTA directors; Fig. 4C).

Fig. 4
figure 4

Survey results show that HRQoL evidence from a validated instrument is seen as essential but fit with guidance is the greatest barrier to wider adoption in France. Data from a survey of 14 ex-HTA directors (5 ex-HAS in France, 5 ex-NICE in the United Kingdom and 4 ex-IQWiG in Germany) between the 21 and 31st of January. See Additional file 1: Methods for the detailed list of questions asked. A Percent of experts who stated that HRQoL data was “essential” or “very important” for each of the therapeutic areas listed; B percent of experts who stated that the following principles determined the acceptability of a HRQoL instrument; C percent of experts who stated the following as the most important barriers to further uptake of HRQoL data in their respective countries

To discuss potential opportunities to improve HRQoL data adoption, we setup an advisory board, who framed four areas that determine HRQoL data acceptability: (1) patient perception, (2) end-point hierarchy, (3) trial design, and (4) data collection.

(1) Importance of patient perception: Delivering patient-centric medicines will require including the patient voice and patient reported data in the value assessment. PAGs clearly stated, both through our interviews and AdBoards, that taking the patient’s quality of life into account in the value assessment is critical to making sure their voice is heard and the patient impact is understood. Indeed, PAGs strongly believe these should be considered in reimbursement decisions. A majority of French ex-HTA directors surveyed believe that HRQoL is essential to the clinical process (100% for immune disease, 80% for gastrointestinal diseases, 75% for oncology, 67% for paediatric diseases, 60% for respiratory diseases and 50% cardiovascular diseases). However, in AdBoard discussions, it became clear that there was a perception that HAS ranks HRQoL secondary to safety and efficacy in its value assessment. Additionally, the minimum meaningful difference is an important threshold to define and reach as part of the value assessment process; indeed, there was a sense from our AdBoards that this can be an abstract number which differs by instrument and can be difficult to assess as part of the clinical appraisal, or even by expert methodologists. Patients may be best placed to contextualize the HRQoL data collected and help input on the minimal meaningful difference observed. In Germany, patient advocacy groups provide insight into the relevance of data to patients going into the clinical appraisal process.

(2) Testing hierarchy: The exploratory nature of most HRQoL data submitted in the clinical appraisal process is currently the most frequent reason for this data to be excluded. Indeed, in our survey, methodology and instrument validation were cited by > 80% of French HTA experts as one of the key principals behind HRQoL data acceptance in the clinical appraisal. One such methodological requirement is to account for Type-1 error (multiplicity of analyses) by including HRQoL end-points in the hierarchy of end-points and in the pre-specified statistical analysis plan. Experts at our AdBoards highlighted that, to demonstrate benefit on efficacy, safety or HRQoL, requires data to meet the same requirements. Input from IQWiG methodological guidelines and German experts in interviews showed that the approach there was different: while both bodies will only review secondary data pre-specified in the statistical analysis plan, they do not mandate inclusion in the testing hierarchy.

(3) Trial design: HRQoL data from open-label modalities in quantitative trials are not currently considered by HAS, likely due to their more subjective nature. The HAS doctrine clearly states that HRQoL data must be from a double-blind trial to be accepted in the appraisal. However, sometimes double-blind trials are not possible due to ethical constraints. Additionally, our survey results showed that 90% of HTA experts agree that randomized clinical trial data is superior to, and more important than RWE data, experts agreed that RWE HRQoL data is a useful addition to existing trial designs and should be considered by HAS (particularly in the case of accelerated/managed entry agreements). In the Germany, according to experts, RWE is accepted for HRQoL data as part of the clinical appraisal process: the IQWiG doctrine also states that “There is a preference for trials which ‘combine proximity to everyday conditions… such as real world trials, practical trials or pragmatic trials’ however there must be a high certainty of results” [15].

(4) Data collection: High-quality data collection is key, but missing data and choosing the right instrument is often a challenge. Without high-quality data, statistical analysis and comparisons in the appraisal process are not meaningful. Across the United Kingdom/France/Germany data collection must be undertaken with well-validated, relevant instruments and as little missing data as possible (Germany usually uses a 30% threshold for missing data/70% threshold for complete data). Selecting the right instrument, which is relevant to the patient, easy to complete, and defines the appropriately validated aggregate score or sub-score to analyses in the pre-fine statistical analysis plan are all key to enabling HAS to evaluate the HRQoL data (the point in time when the data is collected is often a key question). This is particularly salient as many of the instruments are decades old, and not relevant to patients today, or to the targeted therapies increasingly used in clinical trials. During our AdBoards, PAGs explained that the length of some HRQoL questionnaire create real barriers to patients completing these forms and having their preference considered.

Discussion

Based on these four areas of work, our advisory board put forward a list of 10 proposals each to industry and HAS to drive HRQoL data adoption.

We discussed a number of proposals, which are detailed below (Table 2). These proposals are very much intended as collaborative propositions to HAS, as well as actions we believe the industry could and should take on to improve adoption of HRQoL data in France. Our proposals are segmented among both short- and long-term horizons. Though we realize some of our proposals may involve complex long-term discussions, we strongly believe these would highly benefit patients, as well as create a positive feedback loop between HAS and industry. See Additional file 2: Table S1 for more detail on our proposals.

Table 2 Table of 10 proposals to industry and 10 proposals to HAS to improve HRQoL data adoption in France, framed around the four key areas of work: patient perception, testing hierarchy, trial design and data collection

In this study we analysed the methodological guidelines published by HTAs and NICE, as well as the appraisals published across six therapeutic areas in 2019–2021 for HAS and IQWiG. HAS and IQWiG are closer in terms of process, separating the clinical and economic assessments as opposed to NICE; though as we showed there are still important differences in their methodology [12, 15]. While NICE, HAS and IQWiG recommend using validated, disease-specific instruments, our analysis of recent appraisals shows IQWiG to be more likely to review HRQoL data submitted than HAS, across therapeutic areas. The methodological guides published by the HTA outline the differences in standards for data accepted: for HAS’s CT, HRQoL end-points must be included in the testing hierarchy, while IQWiG will at times accept data from end-points outside of the hierarchy. In addition, while IQWiG puts HRQoL data on the same level of importance in its assessment as mortality and morbidity, which therefore opens the door for a broader perspective than pure clinical efficacy [15], the HAS CT doctrine simply states that rigorous demonstration of quality of life benefits may increase the “ASMR” (clinical added value) given to a product, thereby limiting the scope of the assessment to pure clinical efficacy [12].

Little has been published about the state of HRQoL data as part of the HTA assessment in France, though recently recommendations were published from the Ateliers de Giens, which bring HTA, industry and methodologists together in France [16]. Roussel et al. concur that a lot of work has been undertaken recently by HAS to understand the current field (for example, the recent publication on international best practise [8]), and have put forward three recommendations: “(1) Better information for all parties involved in a dossier for technology assessment, (2) Systematization of the collection of PROMs for evaluation of health products, (3) Improved quality of dossiers thanks to the use of relevant and validated tools”, which go in the same directions as our proposals 1.2, 1.5, 1.8, 1.9, 2.1 and 2.2.

There are a number of recent studies debating the possibility of a bias in PROs collected as part of open-label trials (see proposals 1.4, 1.5, 2.4). While most retrospective analyses find no bias in favour of the experimental arm in PRO data collected as part of open-label trials [17,18,19,20], one study from 2019 found evidence of some biases particularly where there were large differences in completion rates between the control and experimental arms [21]. Reviewing PRO data from open-label data would be important where randomized trials are not feasible, but it will be important to minimize this risk (proposal 1.4) and discuss with HAS about specific circumstances where open-label data would be most impactful (proposal 2.4). Further investigations of the method used by IQWiG may also be helpful here, given their experience in accepting open-label data for some time now (Figs. 3 and 4).

We also propose investigating the use of synthetic arms (for example, in specific circumstances where appropriate controls may not be feasible), as recent publications suggest such trial types may be impactful if designed correctly and with appropriate caveats [22].

Our 20 proposals to both industry and HAS are an attempt at creating a positive feedback loop between the two stakeholders and the wider community (healthcare providers and patient advocates in particular). Some industry players are already putting some of the proposals put forward here in place, in particular to seek broader input from patient representatives in clinical trial designs including end-points and to collect HRQoL data more comprehensively as part of their clinical trials (proposals 1.2, 1.8 and 1.9). To go further, we encourage industry to work with PAGs to identify any particular therapeutic areas for which measurements are most important and improve and validate the existing instruments to make them more relevant to patients (proposals 1.2 and 1.7).

We also defined proposals for HAS. As with the industry, HAS is already addressing some of these (for example, proposals 2.1, 2.6 and 2.10) but we would encourage further acceleration to better appreciate of the value of HRQoL data. We recognize that some areas will be easier to address than others for HAS: some proposals are short term (proposals 2.1 to 2.2), while others are more long-term areas of work which will require engagement with the wider community and discussions to mature (2.6 to 2.10).

To implement our proposals, we highlight the importance of the wider community (for example, patient advocacy groups, healthcare providers, Ministry of Health), without whom none of our proposals could be implemented. Nonetheless, enabling broader utilization of HRQoL data could have benefits in the value assessment of medicines. Our work only looked at six therapeutic areas (rare diseases, respiratory diseases, oncology, cardiovascular diseases, metabolic/endocrinology and paediatric diseases) and focused on a narrow set of 3 years’ worth of appraisals published by two HTA in Europe (HAS and IQWiG). We focused our study on the clinical assessment, to the exclusion of the economic appraisal undertaken by both HAS and IQWiG (or the joint assessment undertaken by NICE).

Conclusions

We believe that collaborating on implementing these actions and proposals will enable the quality of life of patients to be more widely considered in the appraisal process, especially in therapeutic areas where efficacy is not the only factor which impacts patient well-being. We also believe that mobilizing the wider group of stakeholders will be critical to implementing our proposals and driving up adoption of HRQoL data. As a next step, both the industry and HAS should seek to encourage discussion and detailing of these proposals in relevant meetings and publications with these stakeholders so that they can be effectively implemented within the French system.

Availability of data and materials

Most of the data used in this study is publicly available on the HAS, IQWiG and NICE websites. Survey data are available from the corresponding author upon reasonable requests.

References

  1. Lakdawalla DN, Doshi JA, Garrison LP, Phelps CE, Basu A, Danzon PM. Defining elements of value in health care – a health economics approach: an ISPOR Special Task Force Report [3]. Value Health. 2018;21:131–9.

    Article  PubMed  Google Scholar 

  2. Schnipper LE, Davidson NE, Wollins DS, Blayney DW, Dicker AP, Ganz PA, et al. Updating the American Society of Clinical Oncology Value Framework: revisions and reflections in response to comments received. J Clin Oncol. 2016;34:2925–34.

    Article  PubMed  Google Scholar 

  3. Walter E. Approaches to Capturing Value in Oncology. Recent Results Cancer Res. 2019. p. 85–108.

  4. EuroQol – a new facility for the measurement of health-related quality of life. Health Policy (New York). 1990;16:199–208.

  5. Patrick DL, Deyo RA. Generic and disease-specific measures in assessing health status and quality of life. Med Care. 1989;27:S217–32.

    Article  PubMed  CAS  Google Scholar 

  6. NICE. Position statement on use of the EQ-5D-5L value set for England (updated October 2019). 2019.

  7. Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20:1727–36.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  8. HAS. Qualité des soins perçue par le patient – indicateurs PROMs et PREMs : panorama d’expériences étrangères et principaux enseignements. 2022.

  9. HAS. Indicateurs de qualité des parcours de soins. 2022.

  10. HAS. Études en vie réelle pour l’évaluation des médicaments et dispositifs médicaux. 2021.

  11. HAS. Autorisation d’accès précoce aux médicaments : doctrine d’évaluation de la HAS. 2021.

  12. HAS. Doctrine de la Commission de la Transparence.

  13. INCa. Stratégie décennale de lutte contre les cancers 2021–2030 ; Feuille de route 2021–2025. 2020.

  14. HCSP. Usages et bon usage de la mesure de la santé perçue et de la qualité de vie en France. 2022.

  15. IQWiG. General Methods v6.0. 2020.

  16. Roussel C, Chassany O, Durand-Zaleski I, Josseran A, Alter L, Auquier P, et al. Place des mesures rapportées par les patients (PROMS/PREMS) dans l’évaluation et la valorisation des technologies de santé en France. Therapies. 2022;77:89–102.

    Article  Google Scholar 

  17. Mouillet G, Efficace F, Thiery-Vuillemin A, Charton E, Van Hemelrijck M, Sparano F, et al. Investigating the impact of open label design on patient-reported outcome results in prostate cancer randomized controlled trials. Cancer Med. 2020;9:7363–74.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Efficace F, Cella D, Aaronson NK, Calvert M, Cottone F, Di Maio M, et al. Impact of blinding on patient-reported outcome differences between treatment arms in cancer randomized controlled trials. J Natl Cancer Inst. 2022;114:471–4.

    Article  PubMed  Google Scholar 

  19. Anota A, Pozet A, Lemasson H, Cotté F-E, Falcoz A, Eberst G, et al. Impact of open-label versus blinded study design on patient-reported outcomes data in randomized clinical trials of immunotherapy in advanced or metastatic cancer patients: a systematic review. Qual Life Res. 2022;31:645–57.

    Article  PubMed  Google Scholar 

  20. Roydhouse JK, Fiero MH, Kluetz PG. Investigating potential bias in patient-reported outcomes in open-label cancer trials. JAMA Oncol. 2019;5:457.

    Article  PubMed  Google Scholar 

  21. Roydhouse JK, King-Kallimanis BL, Howie LJ, Singh H, Kluetz PG. Blinding and patient-reported outcome completion rates in US food and drug administration cancer trial submissions, 2007–2017. JNCI J Natl Cancer Inst. 2019;111:459–64.

    Article  PubMed  Google Scholar 

  22. Cucherat M, Laporte S, Delaitre O, Behier J-M, D’Andon A, Binlich F, et al. From single-arm studies to externally controlled studies Methodological considerations and guidelines. Therapies. 2020;75:21–7.

    Article  Google Scholar 

  23. NICE. Guide to the methods of technology appraisal. 2013.

  24. HAS. VITRAKVI: Avis de la CT. 2021.

  25. HAS. TUKYSA: Avis de la CT. 2021.

  26. HAS. ERLEADA: Avis de la CT. 2020.

  27. HAS. LIBTAYO: Avis de la CT. 2022.

  28. HAS. LORVIQUA: Avis de la CT. 2022.

  29. HAS. NUBEQA: Avis de la CT. 2020.

  30. HAS. PIQRAY: Avis de la CT. 2021.

  31. HAS. TALZENNA: Avis de la CT. 2021.

  32. NICE. Apalutamide with androgen deprivation therapy for treating high-risk hormone-relapsed non-metastatic prostate cancer. 2021.

  33. NICE. Lorlatinib for previously treated ALK-positive advanced non-small-cell lung cancer. 2020.

  34. NICE. Tucatinib with trastuzumab and capecitabine for treating HER2-positive advanced breast cancer after 2 or more anti-HER2 therapies. 2022.

  35. NICE. Larotrectinib for treating NTRK fusion-positive solid tumours. 2020.

  36. IQWiG. Apalutamide (prostate cancer) – benefit assessment according to para 35a Social Code Book V. 2020.

  37. IQWiG. Cemiplimab – benefit assessment according to para 35a Social Code Book V. 2019.

  38. IQWiG. Lorlatinib (NSCLC) – benefit assessment according to para 35a Social Code Book V. 2019.

  39. IQWiG. Darolutamide (prostate cancer) – benefit assessment according to para 35a Social Code Book V. 2020.

  40. QWiG. Alpelisib (breast cancer) – benefit assessment according to para 35a Social Code Book V. 2020.

  41. IQWiG. Talazoparib (breast cancer) – benefit assessment according to para 35a Social Code Book V. 2020.

  42. IQWiG. Tucatinib (breast cancer) – benefit assessment according to para 35a Social Code Book V. 2021.

  43. IQWiG. Larotrectinib (solid tumours) – benefit assessment according to para 35a Social Code Book V. 2020.

  44. HAS. TEGSEDI (inotersen): avis de la CT. 2019.

  45. HAS. DUPIXENT (dupilumab): avis de la CT. 2021.

  46. HAS. SCENESSE: avis de la CT. 2020.

  47. Wensink D, Wagenmakers MAEM, Barman-Aksözen J, Friesema ECH, Wilson JHP, van Rosmalen J, et al. Association of afamelanotide with improved outcomes in patients with erythropoietic protoporphyria in clinical practice. JAMA Dermatol. 2020;156:570.

    Article  PubMed  Google Scholar 

  48. NICE. Inotersen for treating hereditary transthyretin amyloidosis. 2019.

  49. NICE. Dupilumab for treating moderate to severe atopic dermatitis. 2018.

  50. NICE. Afamelanotide for treating erythropoietic protoporphyria. 2018.

  51. IQWiG. Dupilumab (atopic dermatitis) – assessment according to para 35a Social Code Book (SGB) V. 2018.

  52. IQWiG. Inotersen (hereditary transthyretin amyloidosis with polyneuropathy) – assessment according to para 35a (para 1., sentence 10) Social Code Book V. 2019.

  53. IQWiG. Afamelatonide – assessment according to para 35a (para 1., sentence 10) Social Code Book V. 2016.

Download references

Acknowledgements

Caroline Haegeman, PhD, and Jon Williams, PhD, supported some of the analyses undertaken for this publication. Olivier Nataf, Heiner Haug, Dana Vigier, Billie Pettersson, Amina Kacher Damache and Séverine Coquerelle supported the discussions undertaken to develop this publication.

Funding

This work was funded by AstraZeneca.

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed extensively to the authorship of this paper. HL executed the literature research, HTA analyses, interviews and the survey and drafted this manuscript. ML, JG, LK, SP and AT supervised the literature research, HTA analyses, interviews and the survey, and supported drafting of this manuscript. AA NN, BF, MP and OC participated in the advisory board discussions and provided expert input, specifically on the four key areas that determine HRQoL data acceptance and the manuscript’s recommendations, as well as supported drafting of this manuscript.

Corresponding author

Correspondence to Hugo Larose.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

HL, ML, JG, OC, MdP, BF and AA were funded by AstraZeneca for this work. LKN, SP-M and AT are employed by AstraZeneca. NN has no conflicts of interest.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

Please find additional, more detailed methods in our Supplemental methods file.

Additional file 2:

Please find additional detail on our 20 proposals in the additional data.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Larose, H., Lee, M., Grueger, J. et al. Opportunities to improve the adoption of health-related quality of life evidence as part of the French Health Technology Assessment process. Health Res Policy Sys 21, 137 (2023). https://doi.org/10.1186/s12961-023-01081-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-023-01081-8

Keywords