Skip to main content

Navigating the path towards successful implementation of the EU HTA Regulation: key takeaways from the 2023 Spring Convention of the European Access Academy

Abstract

Background

The European Regulation on Health Technology Assessment (EU HTA R), effective since January 2022, aims to harmonize and improve the efficiency of common HTA across Member States (MS), with a phased implementation from January 2025. At “midterms” of the preparation phase for the implementation of the Regulation our aim was to identify and prioritize tangible action points to move forward.

Methods

During the 2023 Spring Convention of the European Access Academy (EAA), participants from different nationalities and stakeholder backgrounds discussed readiness and remaining challenges for the Regulation’s implementation and identified and prioritized action points. For this purpose, participants were assigned to four working groups: (i) Health Policy Challenges, (ii) Stakeholder Readiness, (iii) Approach to Uncertainty and (iv) Challenges regarding Methodology. Top four action points for each working group were identified and subsequently ranked by all participants during the final plenary session.

Results

Overall “readiness” for the Regulation was perceived as neutral. Prioritized action points included the following: Health Policy, i.e. assess adjustability of MS laws and health policy processes; Stakeholders, i.e. capacity building; Uncertainty, i.e. implement HTA guidelines as living documents; Methodology, i.e. clarify the Population, Intervention, Comparator(s), Outcomes (PICO) identification process.

Conclusions

At “midterms” of the preparation phase, the focus for the months to come is on executing the tangible action points identified at EAA’s Spring Convention. All action points centre around three overarching themes: harmonization and standardization, capacity building and collaboration, uncertainty management and robust data. These themes will ultimately determine the success of the EU HTA R in the long run.

Peer Review reports

Background

In December 2021, the European Parliament and the Council of the European Union (EU) adopted the European Regulation on Health Technology Assessment (EU HTA R (EU)2021/2282), which came into effect in January 2022 [1]. The EU HTA Regulation aims at promoting collaboration and harmonizing HTA practices across the EU by reconciling divergent national HTA approaches and establishing standardized methodologies and processes. Ultimately, the joint work requested by the Regulation aims to enhance effective use of resources and foster strong cooperation in HTA across the EU [2,3,4]. While the harmonized procedure covers the clinical aspects of HTA, i.e. relative clinical effectiveness and safety of a new health technology, Member States (MS) will remain responsible for conclusions on the overall added value (i.e. appraisals) and related decisions on pricing and reimbursement [2].

In January 2022, a 3-year transition period, referred to as the “preparation phase”, for the joint EU HTA process was initiated. It involves several critical activities to support the successful implementation of the EU HTA Regulation, including (i) the establishment of the Coordination Group consisting of MS’ representatives with its subgroups on Joint Clinical Assessments (JCAs), Joint Scientific Consultations (JSCs) and Identification of Emerging Health Technologies and Methodology, (ii) the formation of the HTA Stakeholder Network, (iii) the drafting of the Implementation and Delegated Acts, and (iv) the creation of Guidance Documents as outlined in the Implementation Rolling Plan [2, 4,5,6,7,8]. Starting from January 2025, with the preparation phase completed, JCAs will be carried out for all cancer medicines and advanced therapy medicinal products (ATMPs), followed by orphan drugs from January 2028 and, finally, all other centrally approved medicines and a selection of medical devices from 2030 onwards (Article 7.2) [2].

In September 2021, to support the implementation of the Regulation, the European network for Health Technology Assessment (EUnetHTA) 21 joint consortium was instituted, consisting of 13 European HTA agencies and led by the Zorginstituut from the Netherlands [4, 9, 10]. The work agenda of EUnetHTA 21 included several deliverables, including the development of methodological guidance and the conduct of a limited number of JCAs and JSCs [4, 11, 12]. Approximately at the same time, the European Access Academy (EAA) was established as a multi-stakeholder initiative with the primary objective of developing a joint European value framework to facilitate the assessment of innovative health technologies, thereby supporting the vision of the EU HTA Regulation to increase patient access to innovative and life-saving technologies [1, 4, 5]. The EAA held its inaugural convention in May 2022 followed by a second convention in October 2022. These events brought together experts from a range of stakeholder groups to accomplish two respective objectives: first, to develop a research agenda aimed at addressing key challenges in implementing the Regulation and the evolving HTA value framework, and second, to gather insights and develop a call to action for optimal stakeholder involvement [5,6,7, 13].

As the preparation phase towards the joint EU process approached its half-way mark in mid-2023, the focus of the third EAA Convention in April 2023, titled “Midterms & Status of the Preparation Phase of the EU HTA Regulation”, was on evaluating the progress already made and identifying steps and actions needed to support a successful implementation of the EU HTA regulation [13]. We present here the input received from the multi-stakeholder participants of the EAA Spring Convention 2023 Working Session on identifying and prioritizing key action points for the remaining months of the preparation phase.

Methods

Preparation of break-out sessions during the EAA Convention

The 2023 Spring Convention of the EAA was held on 21 April 2023 at Utrecht University (Utrecht, the Netherlands). The Convention included plenary sessions as well as break-out sessions with smaller working groups (WGs), both of which were designed as hybrid meetings to allow on-site and remote participation via Microsoft Teams. Four dedicated WGs with approximately 15–20 participants each were formed in advance, with the following focus topics: Health Policy Challenges (WG 1, Health Policy), Stakeholder Readiness (WG 2, Stakeholders), Approach to Uncertainty (WG 3, Uncertainty), and Challenges regarding Methodology (WG 4, Methodology). These themes were chosen on the basis of outcomes of previous EAA conventions and input from the EAA Faculty [4,5,6,7]. The goal of each break-out session was to identify and prioritize key challenges and corresponding action points relating to the EU HTA Regulation within its respective area. Allocation of participants to the four break-out sessions was based on the following criteria, with the aim to achieve equal distribution regarding each criterion among the working groups: (i) personal and professional background; (ii) national diversity in each group, (iii) stakeholder diversity within each group [patients and patients’ representatives, clinicians’ representatives, regulators, health technology developers (HTDs), HTA bodies, payers, policy makers, and academic representatives] and (iv) participation mode (i.e. on-site versus remote).

In preparation for the break-out sessions, two co-leads and a notetaker were appointed in advance for each group, taking into account national backgrounds, stakeholder group representation and professional expertise in the field to minimize potential bias. In pre-convention meetings between the EAA secretariat and the leadership teams, the proposed structure and approach of the break-out sessions were agreed upon to ensure a consistent approach and reporting across all sessions. Break-out co-leads were responsible for facilitating and structuring the sessions and for encouraging involvement of all attendees. Further, the notetaker was responsible for reporting key findings using a predefined PowerPoint format.

Procedural approach of the break-out sessions

The break-out sessions, scheduled for 120 min, aimed to facilitate meaningful discussions, encourage participant input, and generate actionable outcomes to be discussed at the plenary session. First, introductory ranking questions were posed using an IT-based system, in which participants were asked to rank the 'readiness' towards the Regulation within the area of their break-out session (step 1 of Fig. 1). The number of introductory ranking questions varied depending on the break-out session. The introductory questions were aimed to provide a consolidated overview of different participants’ perspectives on the topic of “readiness” in order to inform the subsequent discussions in the respective WG. Next, each WG developed a comprehensive list of action points addressing the remaining challenges within their area of focus (step 2 of Fig. 1). These action points were then prioritized, resulting in a top-four list. One representative was appointed for each WG to present the prioritized list in the final plenary session.

Fig. 1
figure 1

Three-step flow of the sessions that were held at the EAA Spring Convention 2023. CG, Coordination Group; EC, European Commission; EU, European Union; HTA, Health Technology Assessment; HTD, Health Technology Developer; WG, working group

Plenary session and ranking

Following the break-out sessions, the findings from the four respective WGs were reported back to the EAA plenary session by the representative of each group (step 3 of Fig. 1). Subsequently, the top four action points for each break-out session were formally re-ranked on the basis of their importance by all stakeholders present, both on-site and remote, using an IT-based system. The aggregated descriptive ranking data were visible to the audience in real time, fostering an informed and constructive discussion within the concluding plenary session during which key discussion points were reflected upon to further crystallize the proposed action points and identify any additional concerns.

Data handling and analysis

The introductory questions to assess readiness towards the Regulation within the areas of the break-out sessions were conducted on an ordinal Likert response scale scoring from 1 (no) to 4 (yes). For the analysis, weights were allocated to each response corresponding to the value of the Likert scale and descriptive statistics including mean, median, max, min and upper and lower quartile were applied. The data for assigning the relative ranking scores during the plenary session were extracted from the online tool Slido [14]. Here, a weight was assigned to each item in proportion to its position in the ranking list as determined by each individual respondent, i.e. the highest item received the maximum points (4, as this was the number of pre-defined list items), while the lowest priority item was given a single point. Cumulative points for each option were then divided by the total number of respondents who participated in the ranking poll, thereby producing an average ranked score for each option. All ranking questions were presented via Slido and were shared via QR codes and HTML links on-site and remotely to allow for simultaneous IT-based ranking by all participants.

After the EAA Convention, the identified action points for each break-out session were extracted from the WG notes and were transferred to a table format. Any duplications were removed and several adjustments of wording were made to improve clarity. All responses received were pseudonymized prior to any analysis. Data were stored on a password-protected separate file. Data analysis was conducted by F.B. in consultation with E.J. and H.v.d.H.

Results

Break-out sessions

Attendance

The four break-out sessions at the EAA Spring Convention 2023 were attended by N = 15 (WG 1, Health Policy), N = 14 (WG 2, Stakeholders), N = 18 (WG 3, Uncertainty), and N = 14 (WG 4, Methodology) on-site and remote participants covering N = 14 national backgrounds (Belgium, Bulgaria, Denmark, France, Germany, Great Britain, Italy, Ireland, Malta, the Netherlands, Norway, Portugal, Spain, Switzerland). The distribution of representatives of each stakeholder group among the four break-out sessions is shown in Fig. 2.

Fig. 2
figure 2

Representation of stakeholder groups in each break-out session. HTA, Health Technology Assessment; HTD, Health Technology Developer

Readiness towards the implementation of the EU HTA Regulation

WG 1 (Health Policy) rated both the Readiness of Member States [MS; mean 1.9; interquartile range (IQR) 1.25–2; N = 12] and of the European Commission (EC)/Coordination Group (CG; mean 2.1; IQR 1–3; N = 12) rather low to neutral, although the latter showed higher variance. In WG 2 (Stakeholders), regulators as well as HTDs were perceived to have rather high readiness (mean 2.8; IQR 2–3; N = 14, and mean 2.3; IQR 2–3; N = 14, respectively). Patients and patient representatives were ranked low to neutral (mean 1.9; IQR 1–2.25; N = 14), as well as HTA bodies (mean 1.9; IQR 1–2.25; N = 14). The readiness of clinicians and medical associations (mean 1.9; IQR 2–2; N = 14) and of the EC/CG (mean 2.1; IQR 2–2; N = 14) was also perceived to be low to neutral, with very low variance in the responses obtained. In WG 3 (Uncertainty) and WG 4 (Methodology) the readiness of EU HTA to approach uncertainty (mean 2.2, IQR 1.75–3; N = 18) and the readiness of the methodological framework (mean 2, IQR 1–3; N = 12) were ranked low to neutral, with the latter exhibiting higher variance. Analysis of the ranking of readiness towards the implementation of the EU HTA Regulation is shown in Fig. 3.

Fig. 3
figure 3

Box plots [mean (x); median; max; min; upper and lower quartile] for the ranking of the “readiness” within the areas of the four break-out sessions, relating to Health Policy (N = 12), Stakeholders (N = 14), Uncertainty (N = 18) and Methodology (N = 12), respectively. Rankings were conducted on an ordinal Likert response scale scoring from 1 (no) to 4 (yes). Note that the readiness of the EC/ CG was ranked in two distinct break-out sessions (see Fig. 1 for the questions per break-out session). CG, Coordination Group; EC, European Commission; HTA, Health Technology Assessment; HTD, Health Technology Developer

Action points defined

The action points that were identified by each of the WGs are presented in Table 1. The top four action points as prioritized by each WG referred to:

  • WG 1, Health Policy: (i) immediate implementation, (ii) shared standards and rules to appoint subgroup representatives, (iii) common success and failure criteria for the joint HTA work, (iv) adjustability of MS laws and policy processes and their willingness to change these;

  • WG 2, Stakeholders: (i) raised awareness, (ii) sufficient capacity, (iii) alignment of national policies with EU-level, (iv) efficient communication by Coordination Subgroups;

  • WG 3, Uncertainty: (i) living HTA guidelines, (ii) guidelines for real-world data (RWD), (iii) capacity/capabilities of physicians and HTDs, (iv) sufficient capacity for JSCs;

  • WG 4, Methodology: (i) clarified Population, Intervention, Comparator(s), Outcomes (PICO) process, (ii) fit-for-purpose guidelines, (iii) link between JSCs, PICOs, and JCA preparations, (iv) usage of guidelines for addressing evidence gaps.

Table 1 Action points that were identified and prioritized during the four break-out sessions, relating to Health Policy (N = 15), Stakeholders (N = 14), Uncertainty (N = 18) and Methodology (N = 14)

Plenary session

Ranking of action points

The top four action points as re-ranked in the plenary session are shown in Fig. 4. The top prioritized action point for each WG are:

  • WG 1, Health Policy: assess adjustability of MS laws and health policy processes and their willingness to change these (score 3.1).

    • Participants stressed the importance of assessing the preparedness of MS to embrace future aligned policies. Readiness of MS for the Regulation was considered to depend mostly on the degree to which national decision-making processes and legal frameworks need to be adapted by 2025.

  • WG 2, Stakeholders: ensure sufficient capacity (training and resources) for all stakeholder groups (score 3.0);

    • Participants emphasized that various stakeholder groups face limitations in terms of capacity, including resources, expertise and manpower, which hinder their participation in the collaborative efforts envisioned by the Regulation.

  • WG 3, Uncertainty: implement HTA guidelines as living documents in collaboration with stakeholders (score 3.0);

    • In addition to ensuring that guidelines are fit-for-purpose, it was emphasized that these should be living documents. This will enable the continuous incorporation of emerging best clinical practices and guarantee that the guidelines remain relevant and up to date.

  • WG 4, Methodology: clarify the PICO identification process and its impact on JCAs (score 3.6).

    • Participants highlighted that it is currently unclear whether all PICOs that are requested by MS will be included in the assessment. Should not all PICO schemes be included, it was considered unclear how the divergent needs of MS, including varying subgroups or comparators, would be prioritized, and whether this prioritization process would be conducted in a fair and transparent manner.

Fig. 4
figure 4

Relative importance of key action points within the area of focus for each break-out session, as prioritized by the respondents during the plenary session. Cumulative weighted responses for each list item were divided by the total votes (Health Policy: N = 40; Stakeholders: N = 43; Uncertainty: N = 41; Methodology: N = 41) to express an average of the maximum possible weight, i.e., 4 points. ATMPs, Advanced Therapy Medicinal Products; EU, European Union; GL, Guideline; HTA, Health Technology Assessment; HTD, Health Technology Developer; JCA, Joint Clinical Assessment; JSC, Joint Scientific Consultation; MS, Member States; PICO, Population, Intervention, Comparator(s), Outcomes; PLEG, Post Launch Evidence Generation; RWD, Real-World Data

Discussion

By consolidating the strengths of national HTA processes into a harmonized EU-wide common HTA approach, the Regulation aims to minimize duplication of efforts by HTA agencies and HTDs, enhance predictability, promote the long-term sustainability of EU-wide HTA cooperation and, ultimately, facilitate equal access to innovative health technologies within the EU [3, 15]. For this goal to be achieved successfully, it is crucial to define tangible strategies to tackle the key challenges that remain, bearing in mind the advanced stage of the preparation phase. The data presented in this article underline prioritized action points as identified by participants from the EAA Spring Convention 2023, representing diverse stakeholder groups that are closely associated with the Regulation. Noteworthy findings especially underscore the need to assess adaptability of MS laws and policy processes and willingness to change these, sufficient capacities of stakeholders in terms of training and resources, the adoption of living guidelines co-created by stakeholders, and clarification of the PICO scoping process and its impact on JCAs.

Readiness towards EU HTA

Our findings indicate a prevailing neutrality in readiness for the EU HTA Regulation, with mean scores ranging between 1.9 and 2.3 for almost all introductory questions, except one. Notably, the readiness of Regulators received the highest rating of readiness with a mean score 2.8, given their extensive preparations for the Regulation. Indeed, the European Medicines Agency and EUnetHTA 21 have been engaged in collaborative efforts since 2010, involving the exchange of information and discussions on matters of mutual interest and aiming to align regulatory evaluations and HTA assessments, working towards harmonization in these domains [16,17,18]. It is, however, important to note that Regulators are not included in Preamble §44 of the EU HTA Regulation and would therefore technically be considered collaborators/contributors rather than stakeholders [2, 5, 7]. Nonetheless, fostering strong collaboration between Regulators and HTA bodies is considered a key success factor for the Regulation, as continuous involvement in the regulatory process plays a crucial role in facilitating an efficient and predictable JCA process for all stakeholders concerned [4,5,6, 19,20,21,22,23,24,25]. The JCA timelines, as currently proposed, are indeed based on and closely linked to the regulatory timelines in pursuit of the aforementioned objectives [25].

Identification/prioritization of action points

During the break-out sessions of the EAA Convention, the respective WGs identified several key action points that centred around three overarching themes: (i) harmonization and standardization, (ii) capacity building and collaboration, and (iii) uncertainty management and robust data.

Harmonization and standardization

Promoting convergence of HTA tools, procedures and methodologies stands as a critical objective within the Regulation [23], addressing an urgent need due to the notable disparities that exist among HTA working practices and recommendations across different European jurisdictions, inevitably leading to inequities in patient access [6, 26,27,28]. Previous studies have extensively focused on understanding the variations in HTA practices across Europe to identify opportunities for further alignment [26, 29]. In the context of clinical HTA assessments, cross-country differences mainly stem from disparities in the evidence assessed, interpretation of evidence, methodological approaches of the assessment, uncertainty management, and the extent to which other considerations, such as disease severity, available treatments and unmet need, influence assessments [29,30,31]. These variations naturally arise from the unique political and social values of different jurisdictions, as well as specific needs within each healthcare context [26, 31,32,33]. While efforts have been made to develop methodological and procedural guidelines under EUnetHTA 21 to facilitate the implementation of the EU HTA Regulation, it is not yet clear to what extent these will be adopted by the EC in the Implementing Acts and by the CG in respective guidance documents and, therefore, to what extent these will align with the requirements of individual MS [2, 12]. Consequently, despite the Regulation’s objective to promote convergence of HTA procedures, it will likely be inevitable for some MS to “perform complementary clinical analyses relating, inter alia, to patient groups, comparators or health outcomes other than those included in the joint clinical assessment report, or using a different methodology if that methodology would be required in the overall national HTA process of the Member State concerned” as outlined in Preamble §15 of the Regulation [2].

One of the approaches to address the diverging needs of MS is through the PICO survey, aiming to identify each MS PICO requirements and subsequently consolidate them into the minimum number of PICOs necessary to meet the needs of as many MS as possible [34, 35]. Numerous concerns have emerged regarding the possibility of MS requesting multiple divergent PICO schemes, which is considered one of the major hurdles for successful implementation of the Regulation [4, 7, 36]. Indeed, a multiplicity of PICOs significantly increases the time and resources required for HTDs to collect, analyse and present the requested data when available, as well as the time and resources for HTA agencies to assess the data for each PICO, leading to a substantial workload which may result in increased complexity rather than a simplification of the HTA process [4, 7, 36]. The difficulties of aligning PICO elements have been the subject of extensive research and of discussions at previous EAA Conventions in 2022 [4, 5, 7, 20, 21, 36], which primarily focused on the level of agreement of PICO parameters between jurisdictions and the feasibility of managing multiple PICOs. Our study complements previous research by revealing that the scoping process of PICOs is not only considered challenging in terms of feasibility but is also viewed as unclear, creating hurdles in stakeholders’ readiness for the Regulation. For instance, HTA agencies may encounter challenges in predicting the extent of supplementary clinical analyses required for their national procedures as long as the prioritization process of divergent MS’ needs in terms of PICO parameters remains unclear. Therefore, we advocate the EC/CG to engage in clear and transparent communication regarding the PICO scoping process, thereby enhancing overall clarity for stakeholder groups and fostering their readiness for the Regulation.

Capacity building and collaboration

Participants highlighted the critical issue of capacity shortages among all stakeholder groups. This deficiency may, in turn, be closely related to a lack of awareness of some stakeholders concerning the EU HTA Regulation or even HTA in general, which was also identified as an action point. For example, clinicians and patients are anticipated to play vital roles within the new framework, with patient and clinical experts being given the opportunity to provide input on JCAs and JSCs, whereas patient organizations and medical societies can contribute insights through the Stakeholder Network [37]. However, patient involvement practices within the field of HTA are currently limited across different European jurisdictions due to a number of reasons, including financial/time constraints, lack of capacity, poor training/support, language barriers and a generally low awareness [5, 38,39,40], while similar factors impede the involvement of clinicians and medical organizations in HTA practices [5, 7]. Adding to the complexity, several technical and practical challenges of the involvement of both stakeholder groups were highlighted; for example, the definition and qualification criteria of a “patient expert” are vague, the involvement of clinicians and patients in the PICO process lacks clarity and may potentially lead to conflicts of interest – points of criticism that have also been voiced during the inaugural meeting of the Stakeholder Network as well as in prior studies [5, 7, 41]. On the whole, this hampers the involvement of patients/patient organizations and clinicians/medical societies within the domain of HTA and the Regulation, underscoring the need for not only well-structured training programmes and sufficient capacity, but also methodologies to guide the involvement of both stakeholder groups [7, 37].

Our results indicate that poor stakeholder involvement due to a lack of awareness and/or capacity is not only evident for patients and clinicians, but also for the other stakeholder groups. The pressing need to increase awareness of all stakeholders by improved training and capacity building has previously been highlighted as a critical action point by the Stakeholder Network and during the 2022 Fall Convention of the EAA [7, 41]. In its pursuit to “reach out to all relevant national authorities and stakeholders so that they may not only provide their input, but also become partners in this process” [42], the Commission acknowledges the vital role that stakeholders play in realizing the goals of the Regulation, highlighting the significance of their alignment within the overarching objectives of the EU HTA Regulation. A recent study by Hogervorst et al. (2023) highlighted the significance of institutionalized communication as a key element in enhancing synergy among stakeholders. The study further advocates for the early initiation of multi-stakeholder dialogues, along with the adoption of shared definitions and methods [24]. The Commission has already indicated that efforts are made to organize regional information sessions to inform and raise awareness about HTA among local stakeholder communities [41]. Given the reaffirmation of this action point as a high-priority concern during the present convention, coupled with the advanced stage of the preparation phase, we advocate for escalated efforts aimed at improving communication, raising awareness and elevating training/capacity building.

Uncertainty management and robust data

Uncertainty constitutes a fundamental element in HTA-informed decision-making, and while all HTA agencies share a common concern regarding uncertainty management, the strategies employed to decrease it and the levels of uncertainty that can be accepted vary significantly across jurisdictions. This is one of the key factors contributing to the divergent HTA procedures and outcomes observed in different countries, as previously discussed [29, 31, 43, 44]. Adding to the complexity, the development of innovative and personalized therapies is a fast-moving field that is inherently associated with new uncertainties, therefore heightening the challenges in clinical assessments and requiring new state-of-the-art types of methodologies and approaches to manage these [6, 45]. Hence, this emphasizes the importance of implementing guidelines as dynamic and living documents that would allow for continuous integration of new knowledge and novel methodologies to ensure that guidelines remain suitable not only at present, but also in the future. This action point pertains not only to uncertainty management but also holds a pivotal role in shaping clinical guidelines to ensure their relevance for JCAs and the PICO scoping process.

With regard to the data provided by the HTD, these may be considered insufficient for adequate assessment due to various reasons, inevitably resulting in evidence gaps that necessitate additional information [4, 46]. During the 2022 Spring Convention of the EAA, it already became evident that the recognition and resolution of these evidence gaps play a crucial role in tackling challenges associated with uncertainties in joint HTA [4]. Indeed, the first step is to define possible evidence gaps as early as possible (preferably during a JSC) while simultaneously preparing for post-launch data collection activities; however, participants of the present convention emphasized the importance of outlining a strategy with regard to the availability of this additional evidence. In this context, leveraging RWD to address evidence gaps is viewed as a significant opportunity under the Regulation [41, 46]. However, this also introduces novel complexities due to the quality issues associated with RWD and unequal acceptance of RWD in different jurisdictions [47, 48]. As ATMPs and oncology products, including these for rare cancers, will be first to assess under the EU HTA Regulation, there is an urgent need for new guidelines covering RWD and their integration into joint assessments and management of remaining uncertainties, including situations in which non-randomized controlled trial (RCT) data are acceptable for HTA assessment.

Limitations and outlook

To reduce potential bias in the working group discussions, extensive efforts were made to create balanced WGs with a diverse representation of participants from different stakeholder groups, nationalities, personal/professional backgrounds and participation modes. Nevertheless, there was variation in participation across the break-out sessions, ranging from 14 to 18 participants per WG, while participation in the voting ranged between 12 and 18 participants. As a result, the distribution of participants may not have been entirely equitable among the groups and future research on a broader sample of participants might be warranted to confirm the results shown here. Additionally, while consistent approaches and reporting were sought in the four respective WGs by organizing pre-convention meetings, variations in the flow of the break-out sessions and differences in note-taking practices could have arisen due to varying leadership teams across the groups. Further, the ratings of “readiness” towards the Regulation were provided by distinct groups of participants among the four simultaneous break-out sessions. Therefore, direct comparisons between the sessions may be limited.

In summary, this study has identified and prioritized a number of action points that, according to multi-stakeholder participants of the EAA Convention, are essential for a successful implementation of the EU HTA R. An important upcoming task for the Commission as per the Implementation Rolling Plan [8] is to adopt Implementing and Delegated Acts to establish procedural rules that align with EU laws and ensure uniform conditions for their implementation [2]. Both general and detailed procedural rules for JSCs and JCAs, for example, will be adopted by means of Implementing Acts, a process in which EUnetHTA 21’s deliverables on methodological guidance will be taken into account [2]. As stipulated in the Rolling Plan, these Implementing and Delegated Acts are scheduled to be adopted between Q4 2023 and Q4 2024 [8]. Until then, uncertainties about current guidelines and methodologies of JCAs and JSCs persist, hampering MS’ and other stakeholders’ efforts to fully prepare and make their procedures ready for the joint work envisioned under the Regulation. Consequently, this may discourage MS from taking the lead in upcoming JCAs. Therefore, in addition to the discussed action points, the timely adoption of Implementing and Delegated Acts as well as maintaining transparent communication throughout this process will be crucial for the Regulation to be truly operational in January 2025.

Conclusions

Implementation of an EU-wide HTA approach presents a unique opportunity for minimizing duplication of efforts and resources as well as ensuring the long-term sustainability of EU HTA cooperation, to ultimately achieve the goal of improving patient access to innovative health technologies. At “midterms” of the preparation phase towards the EU HTA Regulation, substantial challenges predominantly revolve around harmonization and standardization, capacity building and collaboration, uncertainty management and robust data provision. Moving forward in the remaining preparation phase, key priorities include tangible strategies to tackle those challenges and the timely adoption of Implementing and Delegated Acts, ultimately to establish an effective and fit-for-purpose process for common HTA starting in January 2025.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author upon reasonable request.

Abbreviations

ATMP:

Advanced therapy medicinal product

CG:

Coordination Group

EAA:

European Access Academy

EC:

European Commission

EU HTA R:

European Regulation on Health Technology Assessment

EU:

European Union

EUnetHTA:

European network for Health Technology Assessment

HTA:

Health Technology Assessment

HTD:

Health Technology Developer

IQR:

Interquartile range

JCA:

Joint Clinical Assessment

JSC:

Joint Scientific Consultation

MS:

Member States

PICO:

Population, Intervention, Comparator(s), Outcomes

RCT:

Randomized controlled trial

RWD:

Real-world data

WG:

Working group

References

  1. European Commission: Health Technology Assessment: Commission welcomes the adoption of new rules to improve access to innovative technologies. https://ec.europa.eu/commission/presscorner/detail/en/IP_21_6771. 2021. Accessed 4 Apr 2023.

  2. The European Parliament and the Council of the European Union: REGULATION (EU) 2021/2282 OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL of 15 December 2021 on health technology assessment and amending Directive 2011/24/EU (2021). https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A32021R2282. 2021. Accessed 4 Apr 2023

  3. European Commission: Regulation on Health Technology Assessment. https://health.ec.europa.eu/health-technology-assessment/regulation-health-technology-assessment_en. 2023. Accessed 14 Apr 2023.

  4. Julian E, Pavlovic M, Sola-Morales O, Gianfrate F, Toumi M, Bucher HC, et al. Shaping a research agenda to ensure a successful European health technology assessment: insights generated during the inaugural convention of the European Access Academy. Health Econ Rev. 2022;12(1):54. https://doi.org/10.1186/s13561-022-00402-x.

    Article  PubMed  PubMed Central  Google Scholar 

  5. van Haesendonck L, Ruof J, Desmet T, van Dyck W, Simoens S, Huys I, et al. The role of stakeholder involvement in the evolving EU HTA process: Insights generated through the European Access Academy’s multi-stakeholder pre-convention questionnaire. J Mark Access Health Policy. 2023;11(1):2217543. https://doi.org/10.1080/20016689.2023.2217543.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Julian E, Gianfrate F, Sola-Morales O, Mol P, Bergmann JF, Salmonson T, et al. How can a joint European health technology assessment provide an ‘additional benefit’ over the current standard of national assessments?: insights generated from a multi-stakeholder survey in hematology/oncology. Health Econ Rev. 2022;12(1):30. https://doi.org/10.1186/s13561-022-00379-7.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Desmet T, Julian E, van Dyck W, Huys I, Simoens S, Giuliani R, et al. An Inclusive Civil Society Dialogue for a successful implementation of the EU HTA regulation: call to action to ensure appropriate involvement of stakeholders and collaborators. J Mark Access Health Policy. 2023;12(1):21–34. https://doi.org/10.3390/jmahp12010004.

    Article  Google Scholar 

  8. European Commission: IMPLEMENTATION ROLLING PLAN. https://health.ec.europa.eu/latest-updates/rolling-plan-implementation-regulation-health-technology-assessment-2022-03-10_en. 2023. Accessed 29 Aug 2023.

  9. EUnetHTA: About EUnetHTA 21. https://www.eunethta.eu/about-eunethta/. 2021. Accessed 15 June 2023.

  10. eTendering: Tender reference number CHAFEA/LUX/2020/OP/0013. Calls for tenders from the European institutions. https://etendering.ted.europa.eu/cft/cft-display.html?cftId=7416 (2021). Accessed 6 Apr 2023.

  11. van Engen A, Samaha D. The Future of EU HTA. White Paper. https://www.iqvia.com/library/white-papers/the-future-of-eu-hta. 2022. Accessed 15 June 2023.

  12. EUnetHTA: Joint HTA Work. https://www.eunethta.eu/jointhtawork/. 2023. Accessed 29 Sep 2023.

  13. Brinkhuis F, Ruof J, van den Ham H, Gianfrate F, Strammiello V, Berntgen M, Pavlovic M, Mol PGM, Wasem J, van Dyck W, Cardone A, Dierks C, Schiel A, Solà-Morales O, Goettsch WG, Julian, E. et al. Evaluating progress towards the implementation of the European HTA Regulation: Insights generated from the European Access Academy’s multi-stakeholder survey [Manuscript submitted for publication]. 2024.

  14. Slido: Understanding ranking poll metrics. https://community.slido.com/community-questions-7/understanding-ranking-poll-metrics-1653. 2022. Accessed 10 Aug 2023

  15. European Commission: Q&A: Adoption of Regulation on Health Technology Assessment. https://ec.europa.eu/commission/presscorner/detail/en/qanda_21_6773. 2021. Accessed 04 Apr 2021

  16. European Medicines Agency: European Medicines Agency and EUnetHTA review progress of their cooperation. https://www.ema.europa.eu/en/news/european-medicines-agency-eunethta-review-progress-their-cooperation (2013). Accessed 29 August 2023

  17. EUnetHTA: EMA. https://www.eunethta.eu/ema/. 2021. Accessed 29 Aug 2023.

  18. European Medicines Agency: Priority topics for European collaboration between regulators and health technology assessment bodies. https://www.ema.europa.eu/en/documents/work-programme/european-collaboration-between-regulators-health-technology-assessment-bodies-joint-work-plan-2021_en.pdf. 2022. Accessed 29 Aug 2023.

  19. Ruof J, Flückiger O, Andre N. Early benefit assessments in oncology in Germany: how can a clinically relevant endpoint not be relevant to patients? Drugs R D. 2015;15(3):221–6. https://doi.org/10.1007/s40268-015-0100-1.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Tafuri G, Pagnini M, Moseley J, Massari M, Petavy F, Behring A, et al. How aligned are the perspectives of EU regulators and HTA bodies? A comparative analysis of regulatory-HTA parallel scientific advice. Br J Clin Pharmacol. 2016;82(4):965–73. https://doi.org/10.1111/bcp.13023.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Jansen E, Hines PA, Berntgen M, Brand A. Strengthening the interface of evidence-based decision making across European regulators and health technology assessment bodies. Value Health. 2022;25(10):1726–35. https://doi.org/10.1016/j.jval.2022.01.026.

    Article  PubMed  Google Scholar 

  22. Wang T, McAuslane N, Liberti L, Leufkens HGM, Hövels AM. Building synergy between regulatory and HTA agencies beyond processes and procedures—can we effectively align the evidentiary requirements? A survey of stakeholder perceptions. Value Health. 2018;21(6):707–14. https://doi.org/10.1016/j.jval.2017.11.003.

    Article  PubMed  Google Scholar 

  23. European Commission: Proposal for a Regulation of the European Parliament and of the Council on health technology assessment and amending Directive 2011/24/EU. Executive summary of the impact assessment. https://op.europa.eu/en/publication-detail/-/publication/3ee30a96-0768-11e8-b8f5-01aa75ed71a1/language-en. 2018. Accessed 29 Aug 2023

  24. Hogervorst MA, Møllebaek M, Vreman RA, Lu TA, Wang J, De Bruin ML, et al. Perspectives on how to build bridges between regulation, health technology assessment and clinical guideline development: a qualitative focus group study with European experts. BMJ Open. 2023;13(8): e072309. https://doi.org/10.1136/bmjopen-2023-072309.

    Article  PubMed  PubMed Central  Google Scholar 

  25. EUnetHTA: JCA timelines. https://www.eunethta.eu/wp-content/uploads/2023/06/EUnetHTA-21-D5.4-Timelines-JCA.pdf. 2023. Accessed 29 Aug 2023.

  26. Vreman RA, Mantel-Teeuwisse AK, Hövels AM, Leufkens HGM, Goettsch WG. Differences in health technology assessment recommendations among European jurisdictions: the role of practice variations. Value Health. 2020;23(1):10–6. https://doi.org/10.1016/j.jval.2019.07.017.

    Article  PubMed  Google Scholar 

  27. EUnetHTA: An analysis of HTA and reimbursement procedures in EUnetHTA partner countries: final report. https://www.eunethta.eu/wp-content/uploads/2018/01/WP7-Activity-1-Report.pdf. 2017. Accessed 17 Aug 2023.

  28. Chassagnol F, Marcelli G, Wagle J, Giuliani G, Traub D, Schaub V, et al. Review of Relative effectiveness assessments (REAs) of pharmaceuticals at the European network for health technology assessment (EUnetHTA): a first step towards a consolidated European perspective on comparative effectiveness & safety? Health Policy. 2020;124(9):943–51. https://doi.org/10.1016/j.healthpol.2020.06.013.

    Article  CAS  PubMed  Google Scholar 

  29. Allen N, Liberti L, Walker SR, Salek S. A comparison of reimbursement recommendations by European HTA agencies: is there opportunity for further alignment? Front Pharmacol. 2017;8:384. https://doi.org/10.3389/fphar.2017.00384.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Kleijnen S, Lipska I, Leonardo Alves T, Meijboom K, Elsada A, Vervölgyi V, et al. Relative effectiveness assessments of oncology medicines for pricing and reimbursement decisions in European countries. Ann Oncol. 2016;27(9):1768–75. https://doi.org/10.1093/annonc/mdw233.

    Article  CAS  PubMed  Google Scholar 

  31. Nicod E. Why do health technology assessment coverage recommendations for the same drugs differ across settings? Applying a mixed methods framework to systematically compare orphan drug decisions in four European countries. Eur J Health Econ. 2017;18(6):715–30. https://doi.org/10.1007/s10198-016-0823-0.

    Article  PubMed  Google Scholar 

  32. Nicod E, Kanavos P. Commonalities and differences in HTA outcomes: a comparative analysis of five countries and implications for coverage decisions. Health Policy. 2012;108(2–3):167–77. https://doi.org/10.1016/j.healthpol.2012.09.012.

    Article  PubMed  Google Scholar 

  33. Allen N, Walker SR, Liberti L, Salek S. Health Technology Assessment (HTA) case studies: factors influencing divergent HTA reimbursement recommendations in Australia, Canada, England, and Scotland. Value Health. 2017;20(3):320–8. https://doi.org/10.1016/j.jval.2016.10.014.

    Article  PubMed  Google Scholar 

  34. EUnetHTA: Practical Guideline D4.2 SCOPING PROCESS. https://www.eunethta.eu/wp-content/uploads/2022/09/EUnetHTA-21-D4.2-practical-guideline-on-scoping-process-v1.0.pdf. 2022. Accessed 2 Sep 2023.

  35. EUnetHTA: PICO CONCEPT PAPER. https://www.eunethta.eu/wp-content/uploads/2022/05/PICO-concept-paper-final-v1.0.pdf. 2020. Accessed 2 Sep 2023.

  36. Remap Consulting: EU Joint HTA: How will EUNetHTA balance contrasting decision drivers across Europe with the desire to produce a single Joint Clinical Assessment to be applicable in all member states?. https://remapconsulting.com/hta/eu-joint-hta-how-will-eunethta-balance-contrasting-decision-drivers-across-europe-with-the-desire-to-produce-a-single-joint-clinical-assessment-to-be-applicable-in-all-member-states/. 2022. Accessed 28 Aug 2023.

  37. European Commission: Call for proposals to support the implementation of the Regulation on health technology assessment – training of patient and clinical experts contributing to joint health technology assessment activities. https://ec.europa.eu/info/funding-tenders/opportunities/portal/screen/opportunities/topic-details/eu4h-2022-pj-04;callCode=null;freeTextSearchKeyword=;matchWholeText=true;typeCodes=0,1,2,8;statusCodes=31094502,31094501;programmePeriod=null;pro=. 2022. Accessed 17 Aug 2023

  38. Dimitrova M, Jakab I, Mitkova Z, Kamusheva M, Tachkov K, Nemeth B, et al. Potential barriers of patient involvement in health technology assessment in Central and Eastern European Countries. Front Public Health. 2022;10: 922708. https://doi.org/10.3389/fpubh.2022.922708.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Hunter A, Facey K, Thomas V, Haerry D, Warner K, Klingmann I, et al. EUPATI guidance for patient involvement in medicines research and development: health technology assessment. Front Med. 2018;5:231. https://doi.org/10.3389/fmed.2018.00231.

    Article  Google Scholar 

  40. European Patients Forum: Patient Involvement in Health Technology Assessment in Europe. https://www.eu-patient.eu/globalassets/projects/hta/hta-epf-final-report2013.pdf. 2013. Accessed 2 Sep 2023.

  41. European Commission: 1st Meeting of the Health Technology Assessment Stakeholder Network. https://health.ec.europa.eu/system/files/2023-07/hta_20230614_sr_en.pdf. 2023. Accessed 29 Aug 2023.

  42. European Commission: Pharmaceutical Strategy for Europe. https://health.ec.europa.eu/system/files/2021-02/pharma-strategy_report_en_0.pdf. 2020. Accessed 29 Aug 2023.

  43. Ghabri S, Cleemput I, Josselin JM. Towards a new framework for addressing structural uncertainty in health technology assessment guidelines. Pharmacoeconomics. 2018;36(2):127–30. https://doi.org/10.1007/s40273-017-0603-4.

    Article  PubMed  Google Scholar 

  44. Vreman RA, Strigkos G, Leufkens HGM, Schünemann HJ, Mantel-Teeuwisse AK, Goettsch WG. Addressing uncertainty in relative effectiveness assessments by HTA organizations. Int J Technol Assess Health Care. 2022;38(1): e17. https://doi.org/10.1017/S026646232100177X.

    Article  PubMed  Google Scholar 

  45. Oye KA, Pearson M, Eichler HG, Mullin T, Hoos A. Managing uncertainty in drug development and use informed regulation. https://irgc.org/wp-content/uploads/2018/09/IRGC-IRR-5.pdf. 2015. Accessed 29 Aug 2023.

  46. Drummond M, Tarricone R, Torbica A. European union regulation of health technology assessment: what is required for it to succeed? Eur J Health Econ. 2022;23(6):913–5. https://doi.org/10.1007/s10198-022-01458-6.

    Article  PubMed  Google Scholar 

  47. Graili P, Guertin JR, Chan KKW, Tadrous M. Integration of real-world evidence from different data sources in health technology assessment. J Pharm Pharm Sci. 2023;26:11460. https://doi.org/10.3389/jpps.2023.11460.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Kang J. Real-world data in health technology assessment: do we know it well enough? In: Bremer A, Strand R, editors. Precision oncology and cancer biomarkers. Human perspectives in health sciences and technology, vol. 5. Cham: Springer; 2022.

    Google Scholar 

Download references

Acknowledgements

We would like to acknowledge all attendees of the EAA Spring Convention 2023 for their active involvement in this research. Further, we thank Abbvie, AstraZeneca, Bayer, Novartis, Roche, Sanofi and Seagen for an unrestricted grant for E.J. and J.R. that partially funded this research.

Funding

J.R. and E.J. received an unrestricted grant from Abbvie, AstraZeneca, Bayer, Novartis, Roche, Sanofi and Seagen that partially funded this research. None of the other authors received any funding for their participation in preparing this manuscript.

Author information

Authors and Affiliations

Authors

Contributions

J.R. and E.J. organized the EAA Spring Convention 2023, conceived and established the study design and methodology. F.G., V.S., M.B., M.P., P.M., W.G. and J.W. led the break-out sessions during the Convention, while W.v.D., A.C., C.D. and A.S. acted as notetakers. F.B. drafted the manuscript and conducted the analyses in consultation with E.J. and H.v.d.H. All authors reviewed and approved the final manuscript for publication.

Corresponding author

Correspondence to Elaine Julian.

Ethics declarations

Declarations

The views expressed in this article are the personal views of the author(s) and should not be interpreted or cited as representing the stance of the regulatory agency/agencies or organization(s) with which the author(s) is/are affiliated.

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

J.R. and E.J. received an unrestricted grant from Abbvie, AstraZeneca, Bayer, Novartis, Roche, Sanofi and Seagen that partially funded this research. The authors have no further financial or non-financial interests to disclose.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Brinkhuis, F., Julian, E., van den Ham, H. et al. Navigating the path towards successful implementation of the EU HTA Regulation: key takeaways from the 2023 Spring Convention of the European Access Academy. Health Res Policy Sys 22, 74 (2024). https://doi.org/10.1186/s12961-024-01154-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12961-024-01154-2

Keywords