Skip to main content

Mapping of health technology assessment in China: a comparative study between 2016 and 2021

Abstract

Background

Health Technology Assessment (HTA) in China has recently expanded from purely academic research to include policy or decision-oriented practice, especially after HTA evidence was used to update the National Reimbursement Drug List for the first time in 2017. This study aims to identify the progress and challenges of HTA development from 2016 to 2021 and inform policies and decisions to promote further HTA development in China.

Methods

We conducted a cross-sectional web-based survey with policy makers, researchers and industry-providers in China in 2016 and 2021 respectively. The ‘Mapping of HTA Instrument’, was utilized to assess the HTA development across eight domains: Institutionalization, Identification, Priority setting, Assessment, Appraisal, Reporting, Dissemination of findings and conclusions, and Implementation in policy and practice. To reduce the influence of confounders and compare the mapping outcomes between the 2016 and 2021 groups, we conducted 1:1 Propensity Score Matching (PSM). Univariate analysis was conducted to compare the differences between the two groups. The overall results were further compared with those of a mapping study that included ten countries.

Results

In total, 212 and 255 respondents completed the survey in 2016 and 2021, respectively. The total score of the HTA development level in China in 2021 was higher than that in 2016 before PSM (89.38 versus 83.96). Following PSM, 183 respondents from the 2016 and 2021 groups were matched. Overall, the mean scores for most indicators in the Institutionalization domain and Dissemination domain in 2021 were higher than those in 2016 (P < 0.05). The Appraisal domain in 2021 was more explicit, transparent and replicable than that in 2016 (t = −3.279, P < 0.05). However, the mean scores of most indicators in the Assessment domain were higher in 2016 than those in 2021 (P < 0.05).

Conclusions

Our study suggest that the level of HTA development in China progressed significantly from 2016 to 2021. However, before engaging in HTA activities, further efforts are required to enhance the assessment process. For instance, it is important to establish a clear goal and scope for HTA; adapt standardized methodologies for evaluating the performance of systematic reviews or meta-analyses; and provide comprehensive descriptions of the safety, clinical effectiveness, cost, and cost-effectiveness of the assessed technologies, thus improving the development of HTA in China.

Background

Health Technology Assessment (HTA) carefully assesses the costs and benefits of intervention to inform reimbursement and coverage decisions regarding how to allocate healthcare resources to different health technologies [1, 2]. HTA has played an increasingly important role on healthcare decision-making in China with the growth of HTA agencies and larger HTA research output since its introduction in the 1990s [3, 4]. However, the further development of HTA in China is confronted with potential challenges. Although it has been occasionally used by policy makers, it exists most often in the academic sector [5,6,7,8,9]. In 2016, Chen et al. conducted a study to understand the current development of HTA in China with the aim of identifying areas for improvement. This study identifies that overall HTA development in China is lower than that in developed countries [9].

From 2016 to 2021, HTA in China has gradually broadened from pure academic research to policy-or decision-oriented practices [6, 10, 11]. A milestone achievement for HTA in China, was the use of HTA evidence to update the National Reimbursement Drug List (NRDL) for the first time in 2017 [3, 12]. This was followed by the inclusion of anti-cancer drugs in the NRDL in 2018 and decision to routinize the use of HTA evidence in review processes in 2019 and 2020 by the National Healthcare Security Administration (NHSA) [11, 13]. In this period, however, some problems have become evident. For example, there is a lack of policy mechanisms for using HTA to support decision-making, insufficient HTA technical staff and expertise, and challenges regarding integrating multi-dimensional value assessment into evidence-informed deliberative processes [3]. In addition, researchers, and policy-maker’s understanding of HTA in China has gradually deepened, and the expectations for HTA development have increased.

Our primary aim is to determine what is the current development level of HTA in China, focusing on the NRDL process. Furthermore, how do the current progress and challenges compare to before 2017? To have a better understanding of the development level and potential challenges of HTA in China, we conducted this study to elicit diverse stakeholder views in China and compared it with the survey we conducted in 2016, thus informing policies and decisions to promote further development of HTA in China.

Methods

Study design and sample

This was a cross-sectional study in which an anonymous web-based survey was conducted using Sojump software from June to November, 2016, and February to April, 2021. The survey targeted policy makers, researchers and representatives of the pharmaceutical and medical device industry involved in HTA. Similar to the prior conducted 2016 survey, convenience sampling and snowball sampling were used to identify potential respondents. The process began by involving known HTA experts, who were then asked to recommend other stakeholders who met the above study criteria for participation. In addition, we searched the attendance lists of major HTA conferences in China and Chinese journals in the HTA field between 2013 and 2020.

Survey development

In the distributed questionnaire, we incorporated the ‘Mapping of HTA Instrument’, Which has been employed to gauge respondents' perspectives on HTA development across seven middle-income countries (Argentina, Brazil, India, Indonesia, Malaysia, Mexico, and Russia) and three high-income countries (Australia, Canada, and the United Kingdom) [14]. The Mapping method adopted in this study was the same as that used in 2016, which is based on multiple HTA guidelines and standards that have been adopted broadly as well as discussions among many international HTA experts [9, 14]. The survey instrument was distinguished by two key elements: (i) the institutionalization of HTA and (ii) HTA process itself. Overall, the instrument comprises eight domains: (1) institutionalization of HTA; (2) identification; (3) priority setting; (4) assessment; (5) appraisal; (6) reporting; (7) dissemination of findings and conclusions; and (8) implementation in policy and practice.

For detailed information on the eight domains, their indicators, and the scoring methods of this instrument, please refer to Additional file 1: Figure S1. Respondents provided answers in either a dichotomous (YES/NO) or Likert scale format (0–3) to represent their views on each domain of HTA development. The maximum score for the eight domains is 146.

The questionnaire comprises two parts: the Mapping of HTA and demographic information. The demographic information section included items regarding the participant’s gender, age, region, years of work experience, educational background, highest degree obtained, and profession.

Data collection

To reach a diverse range of participants, the survey link was shared with the target respondents through various channels, including email invitations, social media platforms such as WeChat (one of the most widely used Chinese social media platforms), and the professional network of the National Health Commission Key Laboratory of Health Technology Assessment [15]. Additionally, we distributed the link to stakeholders who were knowledgeable about HTA in China.

Before the main survey, cognitive pre-tests were conducted to ensure the face validity of the survey instrument and comprehensibility of the survey method. We conducted iterative offline pre-tests (n = 7) and after making the necessary revisions, we conducted additional online pre-tests (n = 29). During the pre-tests, the respondents were provided with test questions and encouraged to share feedback verbally.

Throughout the data collection process, the participants were explicitly informed about the voluntary nature of their involvement in the survey. They were given the freedom to decide whether to participate, and informed consent was obtained from all participants before completing the questionnaire. This ensured that their rights and privacy were respected throughout the research process. To ensure data quality, we cross-verified the dates provided by the participants with the actual survey dates to avoid inconsistencies or errors in the data.

Data analysis

To mitigate the impact of confounding factors that could lead to outcome bias in the nonrandom assignment and enable a potential unbiased comparison, the Propensity Score Matching (PSM) methodology was typically applied [16, 17]. This method summarizes all relevant baseline characteristics into a single composite score, which can be used to determine whether there is sufficient overlap in characteristics between groups [18].

To minimize discrepancies and compare the mapping outcomes between the 2016 and 2021 groups, a 1:1 PSM was employed with a caliper size of 0.05 [16]. The matching algorithm included the following variables: years of work experience, profession, and educational background, which exhibited significant differences between the 2016 and 2021 groups in univariate analysis. Consequently, 183 cases from 2016 and 2021 were generated and used for further analyses. Descriptive analyses were conducted for all study variables.

Continuous variables were presented as means with standard deviations and were compared using Student t-test. Categorical variables were reported as frequencies and proportions and were compared using the chi-square test. Statistical significance was set at a two-sided P-value < 0.05. Statistical analyses were performed using R software (version 4.1.1) and Stata Statistics (version 14.2).

Results

Baseline characteristics

In total, 212 and 255 complete responses were obtained in 2016 and 2021, respectively. Detailed characteristics of the respondents in both groups are presented in Table 1. Prior to PSM, most respondents in 2016 were researchers (72.2%), resided in Eastern China (78.3%), and had educational backgrounds in medicine (51.9%). The most common highest degree obtained was a bachelor’s degree (47.2%). The average age of the respondents was 38.9 years (± 8.7 years), and the average years of work experience was 10.61 years (± 6.5 years).

Table 1 Characteristics of survey respondents before PSM

Among the 255 respondents in the 2021 group, 52.9% were researchers. The majority of participants had an educational background in medicine (57.6%), and the most common highest degree obtained was a bachelor's degree (48.2%). Most respondents resided in Eastern China (86.3%). The average age of the respondents was 37.8 years (± 9.1 years), and the average years of work experience was 7.9 years (± 7.2 years). There were no significant differences regarding gender, age, or region between the two groups (P > 0.05).

The PSM process yielded a matched sample of 183 respondents in both the 2016 and 2021 groups, using a 1:1 nearest neighbor matching algorithm. Following PSM adjustment, no significant differences were observed between the two matched groups regarding the propensity score (generated by the PSM method, as shown in Additional file 2: Figure S2). This indicates that the baseline characteristics were effectively balanced between the two groups.

Total score in each domain before PSM

As indicated in Table 2, the overall score for HTA development in China was higher in 2021 than in 2016 prior to applying PSM. Furthermore, the mean scores across various domains, including institutionalization, priority setting, assessment, appraisal, reporting, dissemination of findings and conclusions, and implementation in policy and practice., suggest notable progress in HTA development over time. However, the identification domain identified in 2021 had a relatively lower overall mean score than that in 2016.

Table 2 Score regarding the presence of the domains in the Mapping of HTA instrument in China before PSM

The detailed score in each domain after PSM

Within the “Institionization” domain, most respondents (63.4% in 2016 and 71.0% in 2021) indicated that China lacked an HTA agency that met the specified survey criteria. These criteria encompass aspects such as reporting to a Minister of Health/human resources or other relevant authorities, generating and/or endorsing HTA reports, and informing decisions regarding the introduction, reimbursement, and disinvestment of health technologies. Additionally, the respondents assessed the presence of essential elements for establishing a formal HTA program in China (see Table 3).

Table 3 Mean score regarding the main indicators in the Mapping of HTA Instrument and single-factor analysis results after PSM

The mean score for ‘interest in HTA expressed by government/policy makers which can be retrieved in official documents’ (item I.1, t = −4.455, P < 0.05), ‘commitment toward HTA from government/policy makers and it is expressed in official documents’ (item I.2, t = −2.134, P < 0.05), ‘support for HTA from various stakeholders’ (item I.5, t = −3.856, P < 0.05), and ‘the availability of human resource development’ (item I.8, t = −3.289, P < 0.05) were significantly higher in 2021 than in 2016.

The ‘Identification’ domain focuses on the implementation of emerging technologies in need of assessment or those identified in the early monitoring system(s). The mean score of the indicator related to the existence of monitoring system(s) for emerging technologies (item II.1) is significantly higher in 2016 (1.98 out of 3) than in 2021(1.51 out of 3), (t = 4.237, P < 0.05). Regarding the performance of other activities involving identification (item II.2), the mean scores is 1.99 out of 3 in 2016 and 1.98 out of 3 in 2021.

Regarding the characteristics of China’s priority setting process, most indicators had a mean score of nearly 2 out of 3, demonstrating that these indicators were largely present. The indicator related to stakeholder involvement (item III.3) consistently received the highest score in both 2016 and 2021. However, respondents noted that the clarity of information on priorities (item III.4, t = 2.144, P < 0.05) and the extent of available literature (item III.5, t = 5.484, P < 0.05) were more explicit in 2016 than in 2021.

The ‘Assessment’ domain comprises 16 indicators categorized into five dimensions, inclusion of goal and scope, description of alternative technologies, aspects of assessment contents, standardized methods incorporation, and generalizability of the HTA scheme. The mean score of indicators concerning healthcare problems, patient population, and practitioners or users (item IV.1) was higher in 2016 than in 2021 (P < 0.05).

Regarding describing the technical characteristics of health technologies under study and their alternatives (item IV.2), the mean score in 2021 was lower than that in 2016 (t = 4.469, P < 0.05). Respondents reported that HTA activities in 2016 focused more on safety, clinical effectiveness, cost, and cost-effectiveness (item IV.3) than those in 2021 (P < 0.05). However, the organizational analysis showed the opposite trend (t = −2.408, P < 0.05).

Across all three indicators in the fourth dimension (Do HTAs incorporate standardized methods, item IV.4), the scores were below 2, indicating that this aspect of the HTA process was considered less developed by respondents. The indicator assessing whether HTA plans in China addressed generalizability and transferability (item IV.5) received the highest mean score among all 16 indicators in both 2016 (2.30 out of 3) and 2021 (2.23 out of 3).

The ‘Appraisal’ domain investigated whether a transparent and deliberative appraisal system, according to the participants, was in place. The respondents in 2021 believed that the appraisal process was more explicit, transparent, and replicable than those in 2016 (item V.1, t = −3.279, P < 0.05).

The ‘Reporting’ domain related to the utilization of the best practice guidelines in conducting and reporting HTA (item VI.1) received a score of 2.28 out of 3 in 2016 and 2.34 out of 3 in 2021, indicating that this aspect of HTA reporting was considered well developed in China over the five-year period.

Respondents reported a mean score of 2.93 out of 4 in 2016 and 2.70 out of 4 in 2021 for the number of HTA reports produced per year (item VI.2a, t = 2.564, P < 0.05), indicating a declining trend from 2016 to 2021. In contrast, the mean score for the number of HTA reports related to the NRDL per year (item VI.2b) was 3.09 out of 4 in both 2016 and 2021.

The ‘Dissemination of findings and conclusions’ domain related to the timeless of HTA report dissemination to decision makers and some dissemination strategies. It is worth noting that all indicators related to dissemination strategies (item VII.2) in 2021 showed significant improvement compared to those for 2016 (P < 0.05).

The ‘Implementation in policy and practice’ domain is relevant to the policy and practice information provision and the HTA impact measurement. The mean scores for each indicator were above 2 out of 3, showing that these indicators were largely present. These findings suggest that HTA implementation in policy and practice is moderately well developed in China.

Overall, the level of HTA development in China was higher than that in middle-income countries (Argentina, Brazil, India, Indonesia, Malaysia, Mexico, and Russia) and lower than that in high-income countries (Australia, Canada, and the United Kingdom) in 2016 and 2021 (see Additional file 3: Table S1). In our previous research conducted in 2016, we found that China scored lower than all ten countries regarding institutionalization level based on the views of survey respondents. However, the current results indicate that China has made significant advancements in institutionalization, although in 2021 the score for China is still lower than that for middle-income countries.

Discussion

In this study, we employed HTA mapping instruments to gather diverse stakeholder perspectives in China during in 2016 and 2021. By comparing the mapping outcomes between these two groups using PSM, we gained valuable insights into the current state of HTA and the progress made in HTA development in China from 2016 to 2021. In addition, this study can also provide practical insights for the ‘selected countries’ [14], identifying the benefits of evaluating their HTA development after three to five years, especially in those countries that have announced healthcare reforms and changes to their HTA processes [19,20,21]. This evaluation can assist various stakeholders, including governments, HTA organizations, industry players, and other relevant actors in assessing HTA development at the country level. Furthermore, the study results provide valuable information to inform HTA strategies and justify investments in HTA.

Overall, the mean scores for most domains in 2021 were higher than those in 2016, indicating an improvement in HTA development. However, it is worth noting that the assessment and implementation domain have lower scores in 2021 than in 2016. Although China scored lower than the three developed countries, its overall HTA development score was comparable to those of the ten countries studied. This recognition signifies the significant achievements that China has made in HTA development since 2016.

Although there has been a significant improvement in China’s level of institutionalization in 2021 compared to 2016, our findings indicate that it still lags behind other countries. While HTA in China has recently expanded from pure academic research to include policy or decision-oriented practices, there is remains a lack of well-established systems for integrating HTA evidence into advisory, pricing, and reimbursement decision-making processes within health administration and payer organizations in China [11, 13, 22, 23]. In addition to China, the process of HTA institutionalization in other low- and middle-income countries remains immature [24, 25]. The insufficient institutionalization of HTA hinders its further development and utilization. It is crucial to prioritize national-level HTA institutionalization to promote the continued advancement. The key aspects of this institutionalization process include the identification and prioritization of HTA issues, adequate funding for HTA activities and human resources, establishment of implementation standards for various health technologies, development of HTA appraisal guidelines, and implementation of robust quality control mechanisms for HTA [6, 11, 19].

The scores for most indicators in the assessment domain were lower in 2021 than in 2016, potentially indicating the declining quality and validity of HTA evidence. Although HTA development in China has made significant strides in utilizing HTA evidence to inform policy decisions and successfully update the NRDL, it is important to acknowledge that most HTA studies in China are sponsored by manufacturers [11, 26]. This raises concerns about potential conflicts of interest and uncertainties regarding the quality of the submitted cost and cost-effectiveness analysis (CEA) evidence. For example, Xie et al. have discovered that industry-sponsored CEAs are significantly more likely to report incremental cost-effectiveness ratios below commonly used thresholds than CEAs lacking such sponsorship [27]. To mitigate the potential influence of the utilization of pharmacoeconomic evidence provided by the industry, it is imperative for concerned institutions to establish and endorse standardized procedures for the disclosure of Financial Conflicts of Interest (FCoI) in pharmacoeconomic evaluations. This should encompass the comprehensive FCoI status disclosure of the input parameters’ sources. When submitting relevant studies, the mandatory inclusion of existing disclosure forms, such as the International Committee of Medical Journal Editors (ICMJE) disclosure form, should be enforced to enhance transparency.

Furthermore, even when relevant evidence is available, the adoption of appropriate methodologies is crucial for generating meaningful results that support decision making. Although global resources and best practices can be leveraged and used, China still faces challenges in adapting methodological approaches to meet national or local needs [11]. This is particularly true when applying standard HTA methodologies to assess the efficacy and cost-effectiveness of traditional Chinese medicine, which may require special considerations [11, 26]. According to the top 10 challenges identified by The International Network of Agencies for Health Technology Assessment (INAHTA), there is a perception from INAHTA member agencies that the quality of evidence is declining, with fewer randomized trials being conducted and more observational and real-world data being used [24].

The development score for an explicit, transparent, and replicable appraisal process improved in 2021 compared to that in 2016. Notably, in 2017, a significant change was implemented in the criteria for determining the inclusion of drugs in the NRDL, whereby both clinical and economic evaluations were stipulated as requirements for inclusion [3, 12]. This shift from qualitative expert consensus to quantitative evidence has led to substantial progress in value-based price negotiations for price and reimbursement decisions [3]. Furthermore, the NHSA has provided guidelines and material requirements to pharmaceutical companies to ensure the provision of comprehensive dossiers supporting the inclusion of their products in the NRDL [28,29,30]. This measure enhances the explicit, transparent, and replicable appraisal processes.

This study had some limitations. First, the generalizability of the findings may be limited due to the convenience sampling approach. It was not possible to identify the statistics of the target population of HTA stakeholders in China. Therefore, the representativeness of our sample could not be fully assessed. Second, the questionnaire was adapted from an international study on the mapping levels of HTA development. There may have been imprecision and misinterpretation when translating the mapping instrument from English to Chinese. Third, within the policy-maker and researcher group, owing to their different levels of education, understanding, and application of HTA, the attached meaning to responses may vary across respondents.

Conclusions

From the perspective of multiple stakeholders, HTA development in China has made significant progress from 2016 to 2021, however, more efforts should be given to the assessment process ensuring a higher quality of HTA evidence before conducting HTA activity. Further qualitative research such as in-depth interviews and focus group discussions with multiple stakeholders, including HTA researchers and policy makers, is required to determine the specific reasons that influence the development level of HTA in China.

Availability of data and materials

The data will be shared on reasonable request to the corresponding author.

Abbreviations

HTA:

Health Technology Assessment

NRDL:

National Reimbursement Drug List

NHSA:

National Healthcare Security Administration

PSM:

Propensity Score Matching

CEA:

Cost-Effectiveness Analysis

FCoI:

Financial Conflicts of Interest

ICMJE:

International Committee of Medical Journal Editors

INAHTA:

The International Network of Agencies for Health Technology Assessment

References

  1. O’Rourke B, Oortwijn W, Schuller T. The new definition of health technology assessment: a milestone in international collaboration. Int J Technol Assess Health Care. 2020;36(3):187–90.

    Article  PubMed  Google Scholar 

  2. Kristensen FB, Husereau D, Huić M, Drummond M, Berger ML, Bond K, et al. Identifying the Need for Good Practices in Health Technology Assessment: summary of the ISPOR HTA Council Working Group Report on Good Practices in HTA. Value Health. 2019;22(1):13–20.

    Article  PubMed  Google Scholar 

  3. Chen Y, He Y, Chi X, Wei Y, Shi L. Development of health technology assessment in China: new challenges. Biosci Trends. 2018;12(2):102–8.

    Article  PubMed  Google Scholar 

  4. Chen Y, Banta D, Tang Z. Health technology assessment development in China. Int J Technol Assess Health Care. 2009;25(Suppl 1):202–9.

    Article  PubMed  Google Scholar 

  5. Liu W, Shi L, Pong RW, Dong H, Mao Y, Tang M, et al. Differences in evaluating health technology assessment knowledge translation by researchers and policy makers in China. Int J Technol Assess Health Care. 2014;30(6):612–20.

    Article  CAS  PubMed  Google Scholar 

  6. Zhen X, Sun X, Dong H. Health technology assessment and its use in drug policies in China. Value Health Reg Issues. 2018;15:138–48.

    Article  PubMed  Google Scholar 

  7. Ming J, He Y, Yang Y, Hu M, Zhao X, Liu J, et al. Health technology assessment of medical devices: current landscape, challenges, and a way forward. Cost Eff Resour Alloc. 2022;20(1):54.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Koh L, Glaetzer C, Chuen Li S, Zhang M. Health Technology assessment, international reference pricing, and budget control tools from China’s perspective: What Are the current developments and future considerations? Value Health Reg Issues. 2016;9:15–21.

    Article  PubMed  Google Scholar 

  9. Chen Y, Chi X, He Y, Wei Y, Oortwijn W, Shi L. Mapping of health technology assessment in China: situation analysis and international comparison. Int J Technol Assess Health Care. 2019;35(5):401–7.

    Article  CAS  PubMed  Google Scholar 

  10. Shi L, Mao Y, Tang M, Liu W, Guo Z, He L, et al. Health technology assessment in China: challenges and opportunities. Global Health J. 2017;1(1):11–20.

    Article  Google Scholar 

  11. Chen Y, Zhao K, Liu G, Chen W. Health technology assessment to inform decision making in China: progress, challenges, and sustainability. BMJ. 2023;381:e068910.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Li H, Liu GG, Wu J, Wu J-H, Dong C-H, Hu S-L. Recent pricing negotiations on innovative medicines pilot in China: experiences, implications, and suggestions. Value Health Reg Issues. 2018;15:133–7.

    Article  PubMed  Google Scholar 

  13. Chen Y, Dong H, Wei Y, Yang Y, Ming J, Yu H. Using health technology assessment to inform insurance reimbursement of high technology medicines in China: an example of cancer immunotherapy. BMJ. 2023;381:e069963.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Oortwijn W, Broos P, Vondeling H, Banta D, Todorova L. Mapping of health technology assessment in selected countries. Int J Technol Assess Health Care. 2013;29(4):424–34.

    Article  PubMed  Google Scholar 

  15. Key Lab of Health Technology Assesment, National Health Commission(Fudan University). The offical website of the National Health Commission Key Laboratory of Health Technology Assessment. 2015. https://chta.fudan.edu.cn/. Accessed 28 June 2023.

  16. Austin PC. An introduction to propensity score methods for reducing the effects of confounding in observational studies. Multivar Behav Res. 2011;46(3):399–424.

    Article  Google Scholar 

  17. Walia M, Irani L, Chaudhuri I, Atmavilas Y, Saggurti N. Effect of sharing health messages on antenatal care behavior among women involved in microfinance-based self-help groups in Bihar India. Glob Health Res Policy. 2020;5:3.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Rubin DB. Estimating causal effects from large data sets using propensity scores. Ann Intern Med. 1997;127(8 Pt 2):757–63.

    Article  CAS  PubMed  Google Scholar 

  19. Leelahavarong P, Doungthipsirikul S, Kumluang S, Poonchai A, Kittiratchakool N, Chinnacom D, et al. Health technology assessment in thailand: institutionalization and contribution to healthcare decision making: review of literature. Int J Technol Assess Health Care. 2019;35(6):467–73.

    Article  PubMed  Google Scholar 

  20. Downey LE, Mehndiratta A, Grover A, Gauba V, Sheikh K, Prinja S, et al. Institutionalising health technology assessment: establishing the Medical Technology Assessment Board in India. BMJ Glob Health. 2017;2(2):e000259.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Kim T, Sharma M, Teerawattananon Y, Oh C, Ong L, Hangoma P, et al. Addressing challenges in health technology assessment institutionalization for furtherance of universal health coverage through south-south knowledge exchange: lessons from Bhutan, Kenya, Thailand, and Zambia. Value Health Reg Issues. 2021;24:187–92.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Drummond MF, Augustovski F, Bhattacharyya D, Campbell J, Chaiyakanapruk N, Chen Y, et al. Challenges of health technology assessment in pluralistic healthcare systems: an ISPOR Council Report. Value Health. 2022;25(8):1257–67.

    Article  PubMed  Google Scholar 

  23. MacQuilkan K, Baker P, Downey L, Ruiz F, Chalkidou K, Prinja S, et al. Strengthening health technology assessment systems in the global south: a comparative analysis of the HTA journeys of China, India and South Africa. Glob Health Action. 2018;11(1):1527556.

    Article  PubMed  PubMed Central  Google Scholar 

  24. O’Rourke B, Werkö SS, Merlin T, Huang LY, Schuller T. The “Top 10” challenges for health technology assessment: INAHTA viewpoint. Int J Technol Assess Health Care. 2020;36(1):1–4.

    Article  PubMed  Google Scholar 

  25. Kuchenbecker R, Polanczyk CA. Institutionalizing health technology assessment in Brazil: challenges ahead. Value Health Reg Issues. 2012;1(2):257–61.

    Article  PubMed  Google Scholar 

  26. Yue X, Li Y, Wu J, Guo JJ. Current development and practice of pharmacoeconomic evaluation guidelines for universal health coverage in China. Value In Health Reg Issues. 2021;24:1–5.

    CAS  Google Scholar 

  27. Xie F, Zhou T. Industry sponsorship bias in cost effectiveness analysis: registry based analysis. BMJ. 2022;22(377):e069573.

    Article  Google Scholar 

  28. The National Healthcare Security Administration of China. Notice on the work plan for the adjustment of National Medical Insurance Drug List. 2019. http://www.nhsa.gov.cn/art/2019/4/17/art_37_1214.html. Accessed 16 June 2023.

  29. National Healthcare Security Administration of China and Ministry of Human Resources and Social Security of China. The National Medical Insurance Drug List through Negotiation in 2019. 2019. http://www.nhsa.gov.cn/art/2019/11/28/art_14_2052.html. Accessed 16 June 2023.

  30. National Healthcare Security Administration. Announcement about the work plan for the adjustment of the national reimbursement drug list 2021 and the application guide for the adjustment of the national reimbursement drug list 2021. 2021. http://www.nhsa.gov.cn/art/2021/6/30/art_109_6616.html. Accessed 17 June 2023.

Download references

Acknowledgements

We appreciate all the participants in this web-based survey for their cooperation. We also thank Prof. Wija Oortwijn for the great work of developing the instrument to map the level of HTA development at country level.

Funding

This study was supported by China Medical Board (CMB) under Grant 19-318, A Demonstration Program on Health Technology Assessment in China.

Author information

Authors and Affiliations

Authors

Contributions

YC, SL and YW contributed to the study conception and design. Material preparation and data collection were performed by SL and YC. YX, YY, JM, HS and YW also participated in data collection. Data analysis were performed by YX and SL. The manuscript was written by SL and YX. YC and YW conceived the perspective and contributed to the writing. YC made the critical revision of this manuscript. All authors commented on previous versions of the manuscript. All authors approved the final manuscript.

Corresponding authors

Correspondence to Yan Wei or Yingyao Chen.

Ethics declarations

Ethics approval and consent to participate

The study protocol was approved by the institutional review board, Public Health School of Fudan University (IRB00002408 & FWA00002399).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Supplementary Information

Additional file 1: Figure S1.

The Mapping of HTA instrument. Note This instrument was developed by Wija Oortwijn et al. This figure contains the detailed eight domains and their indicators as well as the scores (max. total score 146).

Additional file 2: Figure S2.

Common support test. Note After PSM adjustment, there were no significant differences between the two matched groups with regard to the propensity score, that is, baseline characteristics were balanced.

Additional file 3. Table S1.

 Level of HTA development per domain in the selected middle-and high-income countries. Note Data of the seven middle-income and three high-income countries are from the research of Oortwijn et al. [14]. Middle-income countries include Argentina, Brazil, India, Indonesia, Malaysia, Mexico, and Russia, high-income countries include Australia, Canada, and the United Kingdom.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, S., Xia, Y., Yang, Y. et al. Mapping of health technology assessment in China: a comparative study between 2016 and 2021. glob health res policy 9, 4 (2024). https://0-doi-org.brum.beds.ac.uk/10.1186/s41256-023-00339-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s41256-023-00339-6

Keywords