Skip to main content

Evidence-based evaluation for stroke guidelines mentioning traditional and complementary medicine rehabilitation

Abstract

Background

Traditional and complementary medicine (T&CM) is often sought as an significant alternative intervention in stroke prevention and rehabilitation, and is recommended in several guidelines. However, little is known about the quality and consistency of T&CM rehabilitation recommendations for stroke in the guidelines.

Methods

We systematically searched PubMed, Embase, CNKI, WOS, CBM, Duxiu, Wanfang, VIP, GIN, NICE, NGC, SIGN, BGS, NCCN, WHO guidelines, Google Scholar, MedSci, and Medilive from January 1990 to April 2024 for stroke rehabilitation guidelines that include T&CM recommendations. Our search strategy used search terms related to stroke, complementary and alternative therapy, and CPGs. Four independent reviewers used the Appraisal of Guidelines for Research and Evaluation II (AGREE II) instrument to evaluate the quality of the included guidelines. We summarized and analyzed the T&CM post-stroke rehabilitation recommendations.

Results

Nineteen guidelines were included, of which nine were recommended for use according to the AGREE II scores. The highest scores were achieved in the domains of clarity of scope and purpose (90.50% ± 9.99%), while the lowest scores were achieved for applicability (45.56% ± 26.37%). Guidelines commonly recommended acupuncture to improve post-stroke spasticity and dysphagia. However, guidelines recommended against the addition of acupuncture to improve activities of daily living. Additionally, there was still controversy regarding the improvement of upper extremity motor function with acupuncture and specific recommendations for post-stroke cognitive impairment were scarce.

Conclusions

The quality of stroke rehabilitation guidelines is acceptable, though improvements are needed in some domains, particularly applicability. The recommended guidelines show a high degree of agreement in recommending acupuncture to improve dysphagia after stroke, but recommendations in the areas of upper extremity motor dysfunction and cognitive impairment after stroke need to be further addressed. However, the strength of these recommendations is typically conditional and the level of evidence still needs to be further improved.

Peer Review reports

Background

Stroke, as the leading cause of death and long-term disability, has become a significant public health problem [1]. In the past few decades, stroke-related deaths have increased by 43.3%, and disability-adjusted life years (DALYs) due to stroke have increased by 32.4% [2]. The Global Burden of Disease study indicates that indirect costs of stroke, including household productivity loss, account for 50%—60% of the total economic burden in low- and middle- income countries, compared to 30%—40% in high-income countries [2]. According to current statistics, the cost of rehabilitation treatment for stroke patients in China accounted for the highest proportion of total hospitalization expenses from 2018 to 2021, exceeding 30% of all costs and imposing a substantial economic burden on the health system and patients' families [3]. Effective rehabilitation strategies could accelerate the improvement of patients' dysfunction, thereby reducing the length of hospitalization and the cost of treatment.

The incidence of different degrees of sequelae in the survivors of stroke can be as high as 70%–80% [4]. Although modern rehabilitation methods, such as noninvasive brain stimulation and virtual reality, can be effective in improving different functional impairments after stroke [5,6,7], because of the unbalanced development of global rehabilitation services, the rehabilitation facilities and service capabilities of hospitals and communities in many regions are limited and cannot adequately meet the health needs of patients, especially in low-income and middle-income countries [8]. The World Health Organization (WHO) indicates that traditional and complementary medicine (T&CM), such as acupuncture, is a critical component of primary healthcare and has essential applications in the rehabilitation and management of lifestyle-related chronic diseases [9].

Evidence-based, high-quality clinical practice guidelines (CPGs) help guide healthcare professionals in their clinical practice and provide scientific and effective T&CM rehabilitation interventions for stroke patients [10]. Although several organizations from different countries/regions have published CPGs for stroke, the quality, main recommendations, strength, and direction of recommendations of the existing stroke guidelines involving T&CM rehabilitation are still unknown. Ya et al. systematically evaluated the methodological quality of traditional Chinese medicine guidelines for ischemic stroke management. However, their analysis was confined to ischemic stroke subtypes and exclusively included Chinese guidelines, resulting in conclusions that fail to represent the comprehensive global application of T&CM in stroke rehabilitation. Furthermore, the study omitted critical comparative analyses with international guideline frameworks (e.g., WHO) regarding T&CM recommendations [11]. Consequently, the primary aims of this review were to assess the quality of CPGs that meet the inclusion criteria with the Appraisal of Guidelines for Research and Evaluation (AGREE II) instrument, and evidence mapping was adopted to present the recommendations and their consistency on the use of T&CM in Chinese and international CPGs, to provide a key decision-making basis for the subsequent development of high-quality stroke T&CM rehabilitation guidelines and the modernization of traditional medicine.

Methods

We followed the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guidelines [12].

Search strategy

We comprehensively searched PubMed, Excerpta Medica Database (Embase), China National Knowledge Infrastructure, Web of Science, China Biology Medicine, Duxiu, Wanfang, VIP, Guidelines International Network, National Institute for Health and Care Excellence, National Guideline Clearinghouse, Scottish Intercollegiate Guidelines Network, British Geriatrics Society, American Geriatrics Society, National Comprehensive Cancer Network), World Health Organization guidelines, Google Scholar, MedSci, and Medilive from January 1990 to April 2024. Our search strategy used search terms related to (1) stroke, (2) complementary and alternative therapy, and (3) CPGs (Supplement 1), without restrictions on publication language or status.

Inclusion criteria

CPGs were included if they (1) were developed by national academic associations or professional organizations; (2) represented expert consensus or evidence-based CPGs for stroke rehabilitation, diagnosis, treatment, or management; (3) included recommendations related to T&CM rehabilitation; (4) were the newest version; (5) were for adult rehabilitation (≥ 18 years old); and (5) available in Chinese/English language. There was no restriction on the strength of recommendations.

Screening, data extraction, quality assessment, and recommendation synthesis

Two researchers independently conducted a title, abstract, and full-text examination. For disagreements, a third researcher was consulted to reach a consensus. Rayyan and EndNote X9 were used to add annotations to indicate specific disagreements between the two researchers (e.g., differences in understanding of the predefined inclusion criteria) and to document the rationale for the eventual inclusion or exclusion of a particular piece of literature. Two researchers independently performed data extraction. The extracted information included guideline title, year of publication, country, developing organization, target population, and evidence grading system. The information mentioned above was screened, extracted, and managed using Rayyan, EndNote X9, and Microsoft Excel 2016. Guidelines for inclusion after the full-text screening were independently assessed by four researchers using the AGREE II tool [13,14,15]. AGREE II comprises six areas—scope and purpose, stakeholder involvement, rigor of development, clarity of presentation, applicability, and editorial independence—divided into 23 items. Each item is rated from 1 (strongly disagree) to 7 (strongly agree). If the criteria are not fully met, the reviewers may provide a score of 2 to 6, depending on the situation. The scaled domain score was calculated as (Obtained score − Minimum possible score)/(Maximum possible score − Minimum possible score). The overall quality of each guideline was evaluated using a threshold of 60% for the mean score of each domain, with more domains with a mean score > 60% indicating higher quality [16, 17]. And each CPG was classified as “recommended” (total score ≥ 70%), “recommended with modifications” (total score between 50 and 70%) or “not recommended” (total score ≤ 50%). We used SPSS 26.0 calculated the intraclass correlation coefficients (ICCs) to test the consistency of the evaluation results of the four reviewers [18]. We classified the recommendations as: ‘should be used’ when there was a strong recommendation that the intervention/criteria should be applied; ‘may be used’ when the recommendation was not strong or the CPGs authors used the terms ‘may/might be used’ or ‘can/could be used’; ‘should not be used’ when there was a clear recommendation to not use the intervention/criteria; and ‘uncertain recommendation’ when the recommendation was not clear.

Results

Literature search and guideline selection

The systematic search retrieved 6,093 records, and 425 duplicate articles were removed. We screened 29 articles in full against the inclusion criteria and included a total of 19 stroke rehabilitation and management CPGs (Fig. 1) [19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37].

Fig. 1
figure 1

Flowchart of the selection process for clinical practice guidelines

Guideline characteristics

Most of the included CPGs were published within the last 10 years (2011–2022). Most were from China (n = 12), followed by the United States (n = 2), Brazil (n = 2), Australia (n = 2), and Canada (n = 1). Eighteen CPGs used an evidence-grading system when making recommendations (18/20, 90%) (eTable 1 in Supplement 2 summarizes the general characteristics of the 19 CPGs).

Appraisal of CPGs: quality and inter-rater agreement

The bar chart and stacked polar chart show the six domain scores and the sum of the total AGREE II scores of each eligible CPG (Figs. 2 and 3). Overall, the quality of the guidelines was highly variable, and the range of scores was wide. Of the 19 stroke CPGs mentioning T&CM, ten (52.63%) were appraised as “recommended”, two (10.53%) as “recommended with modifications”, and seven (36.84%) as “not recommended”. The mean domain score of the guidelines ranged from 38.63% ± 33.27% to 95.08% ± 5.34%, and most CPGs reached a mean domain score of 60%. The "scope and purpose" domain received the highest mean score (90.50% ± 9.99%) across all the domains among the 19 CPGs, which required a clear description of the overall aim of the guideline, specific health questions, and target population of the guidelines, with five CPGs reaching 100.00% in this domain. It was followed by the "clarity of presentation" domain (88.67% ± 11.45%), where 17 CPGs (89.47%) scored > 80%, indicating reasonable clarity of recommendations and easier identification of key recommendations. The domain with the lowest average score was "applicability" (45.56% ± 26.37%). A total of 13 CPGs (68%) scored less than 60% in this domain, as the studies poorly reported the likely barriers and facilitators to implementation, strategies to improve uptake, and resource implications of applying the guideline. The remaining domains, including "stakeholder involvement" (60.51% ± 26.26%), "rigor of development" (54.08% ± 29.66%), and “editorial independence” (59.76% ± 39.72%), had relatively low mean scores and high variability. Within the domain of "stakeholder involvement," two items (development group members that included experts in multi-disciplinary and targeted explicit users) scored relatively high. However, few CPGs considered patient views and preferences in the recommendation formation process. In the "rigor of development" domain, five items (using systematic methods to search for evidence, a clear description of the criteria for selecting the evidence, and the methodology for formulating the recommendations, external review, and updating the CPGs) scored relatively low. Within the domain of “editorial independence,” the CPG developed by the Chinese Stroke Association scored 0.00% in this domain, suggesting that the guideline ignored the influence of the funder and that of the competing interests of the guideline development group’s members (eTable 2 in Supplement 2 shows the quality assessment using the AGREE-II tool for the 19 guidelines selected). Inter-rater agreement was “good” for two domains and “excellent” for four domains of AGREE II score between the four evaluators (eTable 3 in Supplement 2).

Fig. 2
figure 2

Total AGREE II scores by domain across 19 guideline

Fig. 3
figure 3

Quality of the included guidelines across the six domains of the AGREE II instrument

T&CM rehabilitation recommendations in the recommended CPGs

The recommendations from the endorsed CPGs are summarized in Table 1. The persistent reliance on observational studies and anecdotal evidence in T&CM research, combined with a critical shortage of clinical evidence meeting international standards (e.g., CONSORT for trials, PRISMA for reviews), has created a translational gap in evidence hierarchies. This methodological divide directly contributes to the limited integration of T&CM recommendations into international guidelines. Among the ten recommended guidelines, we found a high degree of concordance regarding the use of acupuncture to improve post-stroke dysphagia, which received a weak recommendation from most guidelines. The guidelines also consistently endorsed tai chi to improve balance, tuina to improve spasticity, and fuming-washing to address shoulder-hand syndrome. One CPG (BAN2022) strongly recommended the use of acupuncture or electroacupuncture to enhance post-stroke spasticity, while two CPGs (CACMS and SCMHKBU) weakly suggested that the use of tuina for the same purpose. Additionally, one CPG (CACMS) strongly recommended the use of Xing Nao Jing Injection to improve neurological deficits in patients during the acute phase of cerebral infarction. Consistent weak recommendations across the CPGs (CACMS, NCCACM, and SCMHKBU) indicate that acupuncture can be used to improve post-stroke dysphagia, suggested needling at GV26, GB20, EX-HN12, EX-HN13, and CV23 for four weeks. The use of tai chi to improve balance (WSO and AHA &ASA) and to address anxiety and depression (VA &DoD) can be considered in the later stages of stroke. Fuming-washing therapy (CACMS and SCMHKBU) and acupuncture at the LI15, TE14, SI9, Jianqian, Ashi-point, TE2, TE4, and SI4 (SCMHKBU) can improve post-stroke shoulder-hand syndrome. One CPG (NCCACM) weakly suggested considering blood-activating injections and Xing Nao Jing injections to improve neurological deficits and impaired consciousness during the acute phase of cerebral infarction. Additionally, two CPGs (NHMRC2022 and AHA &ASA) weakly advised against the addition of acupuncture to improve the activities of daily living (ADL).

Table 1 Recommendations on traditional and complementary medicine rehabilitation for stroke patients

Discussion

Summary of the main results

This review assessed 19 national and international stroke clinical practice guidelines (CPGs) concerning T&CM rehabilitation, which extracted recommendations on post-stroke dysfunction. The AGREE II results showed that the guidelines did not exhibit improvement over the years and received relatively low scores in the domains of applicability and rigor of development. Additionally, they overlooked the vital role of patients in forming recommendations. From the nine recommended CPGs, we concluded that guidelines show a high degree of agreement in recommending acupuncture to improve dysphagia after stroke, but recommendations in the areas of upper extremity motor dysfunction and cognitive impairment after stroke need to be further addressed. However, the strength of these recommendations is typically conditional and the level of evidence still needs to be further improved.

Implications for future research and practice

According to the assessment results of the AGREE II instrument, the methodological quality of the CPGs was the lowest in the domain of applicability, with relatively low scores in the domains of rigor of development. The applicability domain was considered relevant to the implementation of the guidelines. It significantly impacted the quality of the CPGs [38]. Only six guidelines scored ≥ 60% in this domain, which consistently received lower scores in other systematic reviews [39]. Most stroke guidelines fail to systematically analyze potential facilitators and barriers that may influence the implementation of recommendations (e.g., patient adherence, healthcare system constraints, policy, and cultural differences) and do not clarify the required resources and costs (e.g., professional expertise, equipment, funding, time). We propose adopting multidimensional evidence-based support strategies during guideline development to help clinicians and policymakers implement recommendations more effectively. Primarily, identify barriers and facilitators: Conduct stakeholder consultations (structured questionnaires and focus group interviews) and Delphi expert consensus processes (First round: Generating a list of critical issues through open-ended expert input; Second round: Conducting priority scoring on identified issues and selecting the top five barriers through quantitative ranking; Third round: Developing solution proposals followed by anonymous voting to achieve consensus (> 80% agreement threshold)) to systematically map implementation challenges (e.g., resource allocation disparities) and enablers, followed by targeted intervention pathways. As an illustration, WHO Recommendations on Maternal and Newborn Care for a Positive Postnatal Experience identified through stakeholder research that transportation costs posed a barrier for women in low-income regions to complete the recommended number of antenatal visits. Consequently, "mobile community clinics" were incorporated into the guideline’s appendix [40]. Subsequently, quantify resource requirements (human, time, financial, and costs), provide stratified recommendations (e.g., for high-, middle-, and low-income settings), and integrate health economic evidence (cost-effectiveness analyses and budget impact forecasts) to strengthen the feasibility and cost-effectiveness clarity of recommendations. Australia Clinical Guidelines for Stroke Management Strongly recommend that all stroke patients should commence mobilisation (out-of-bed activity) within 48 h of stroke onset unless otherwise Contraindicated, and provide data on emergency department presentation and in-patient admission costs to demonstrate the cost-effectiveness of this recommendation [35]. The domain of rigor of development is a core section of developing high-quality CPGs [38, 41]. Current domestic clinical guidelines in China exhibit the following methodological limitations: incomplete systematic search strategies, ambiguous evidence selection criteria, insufficient application of evidence quality assessment, lack of multidisciplinary consensus mechanisms in recommendation formulation, inadequate safeguards for the independence of external review, and underdeveloped dynamic updating systems. The following quality control strategies should be implemented throughout the guideline development lifecycle to ensure guideline currency and evidentiary reliability. First and foremost, establish transparent and traceable evidence chains by documenting search protocols, inclusion/exclusion rationales, and evidence-to-recommendation linkages [42, 43]. Additionally, adhere rigorously to international standards, including PRISMA guidelines for systematic searches and the GRADE framework for evidence quality grading. Furthermore, maintain guideline currency through version control protocols (e.g., timestamped updates) and continuous evidence surveillance systems (e.g., automated PubMed alerts for new studies). Additionally, only 8/19 CPGs reported patient perspectives and preferences in Item 5 of the evaluation within the stakeholder involvement domain. Patient views and preferences are crucial in forming final recommendations and guiding clinicians in making the best decisions. For example, a discrete choice involving 103 stroke patients showed that male stroke survivors in the subacute phase of stroke recovery strongly preferred light- and moderate-intensity exercise and preferred shorter workout durations. Based on this result, adapting and developing tailored exercise programs such as a simplified version of tai chi for stroke survivors in clinical practice in the future could be effective in improving patient compliance and treatment outcomes [44]. This suggests that patient perspectives and preferences should be fully considered in future guideline development. A mixed-methods approach combining semi-structured interviews and e-surveys should be adopted to achieve in-depth identification of core patient needs, acceptability thresholds, and preferences toward T&CM interventions. Additionally, two to three patient advisors with basic health literacy should be embedded throughout the guideline revision process and empowered to conduct structured feasibility assessments of recommendation drafts through participatory voting mechanisms.

Recommendations regarding acupuncture show different directions and strengths of recommendation in different dysfunctions. Guideline BAN2022 strongly recommended the use of acupuncture to improve post-stroke spasticity. A very new systematic review that involves 88 RCTs with 6,431 patients in total has further confirmed that acupuncture possesses a reliable antispastic effect for stroke patients [45]. Acupuncture to improve dysphagia after stroke is an approach mentioned in most guidelines, but all are weakly recommended. This may be due to the fact that most studies on post-stroke dysphagia focus on short-term effects (≤ 3 months of follow-up), lack of health economics data such as cost-effectiveness ratios, and small sample sizes [46, 47]. A clinical study found that acupuncture did not produce significant results in improving upper extremity (UE) motor function in patients with chronic stroke symptoms, but gains in UE motor function observed in protocol-compliant subjects suggested acupuncture may help patients with chronic stroke symptoms [48]. Therefore, future high-quality and large-scale randomized controlled trials are still needed to provide sufficient evidence to support the efficacy of acupuncture in the treatment of UE motor function after stroke. Both guideline NHMRC2022 and guideline AHA&ASA explicitly did not recommend the use of acupuncture to improve ADL. From the available evidence, acupuncture may have a beneficial effect on improving ADL in recovering stroke patients, but most of the included trials were of insufficient quality and size, and therefore there was insufficient evidence to draw any conclusions about its routine use [49]. In addition, a multicenter study involving 188 patients demonstrated that a conventional physical therapy regimen combined with acupuncture did not add any benefit for further improvement of ADL in patients with subacute stroke [50].

Given that traditional Chinese decoctions require syndrome differentiation and pose challenges in standardizing individualized dosing, which hinders large-scale promotion, so our recommendations focused primarily on Chinese patent medicines. Xing Nao Jing Injection was recommended to improve neurological deficits in patients during the acute phase of cerebral infarction in the CACMS [19], likely due to its protective effects on neural cells against oxidative stress-induced cell damage, along with its better safety and efficacy in clinical applications for stroke [51, 52]. However, with emerging evidence, the updated NCCACM guidelines indicated that the National Adverse Drug Reaction Monitoring Report highlights frequent adverse events/reactions associated with Xingnaojing Injection. The expert consensus panel unanimously endorsed its use under strict contraindication screening and thorough informed consent acquisition from patients (or guardians) regarding potential adverse effects [30]. Although Salvianolate injection and Ginkgolide injection demonstrate relatively high effect sizes in improving post-stroke neurological deficits (with large-sample studies supporting their blood-activating and stasis-resolving effects), the evidence remains low-grade due to substantial bias risks and significant heterogeneity [53, 54]. The combination of antidepressants with Chaihushugan powder/Xiaoyao powder significantly reduces HAMD (Hamilton Depression Rating Scale) scores after 8-week treatment, demonstrating efficacy in ameliorating post-stroke depressive symptoms [55]. CPGs consistently suggested using tai chi to improve balance, enabling clinicians to incorporate tai chi during the recovery and sequelae periods to reduce the risk of falls. The inconsistent recommendations in clinical guidelines regarding acupuncture's efficacy in improving upper limb motor function stem from two critical methodological deficiencies: (1) insufficient high-certainty evidence and (2) non-standardized evidence synthesis practices. This discordance underscores the urgent need for WHO-standardized evidence appraisal frameworks for T&CM and requires integration of neuroimaging-validated efficacy metrics and cross-cultural adaptation protocols. However, evidence for the effectiveness of Chinese herbal medicine decoction and moxibustion on different rehabilitation outcomes in stroke remains scarce, which warrants further research to enrich the evidence base for T&CM in stroke. Another finding of concern was that these recommendations rarely included a combination of T&CM rehabilitation and modern rehabilitation; thus, we need to collect further relevant and high-quality evidence in future studies to lay a foundation for the development of clinical evidence-based practice guidelines for integrating T&CM and Western medicine rehabilitation in treating stroke.

There were few specific recommendations for post-stroke cognitive impairment (PSCI). PSCI was one of the major complications after stroke with a prevalence of 32.2% within three months [56]. PSCI not only negatively affected patients' functional independence and quality of life, but was also associated with an increased risk of recurrent stroke, mortality, and progression to dementia [57, 58]. Although a large number of clinical trials have demonstrated the efficacy of acupuncture and tai chi in the treatment of post-stroke cognitive impairment, Guidelines lack recommendations for PSCI T&CM therapy. This may be because randomized controlled trials (RCTs) of T&CM therapies (e.g., acupuncture, tai chi, etc.) for post-stroke cognitive impairment have a relatively small total literature in the field and are generally characterized by small sample sizes and lack of blinding [59, 60]. Therefore, future studies should adhere to the CONSORT and STRICTA guidelines to conduct international multicenter RCTs with large sample sizes. Adaptive trial designs should be employed to dynamically adjust intervention parameters while incorporating active placebo controls (e.g., sham acupuncture) and blinded outcome assessments to minimize bias. Concurrently, Delphi consensus methods should be applied to establish a core outcome set for PSCI, integrating digital tools and biomarkers to quantify therapeutic efficacy and enable long-term outcome tracking objectively.

The included guidelines used various evidence grading systems to categorize the quality of evidence and strength of recommendations, which may perplex and impede communication among CPG developers [61]. The Grades of Recommendation, Assessment, Development, and Evaluation (GRADE) is the most authoritative evidence grading system [62, 63]. To address heterogeneity challenges in evidence grading systems, we propose establishing cooperation between the GRADE Working Group and the WHO Traditional Medicine Department to construct an evaluation framework covering the three major T&CM specificity dimensions. Simultaneously, a T&CM Evidence Transformation Hub will be implemented, which will provide an online tool to convert different grading systems through API-integrated platforms automatically. Furthermore, we only included English and Chinese guidelines, which may limit the global dissemination of T&CM rehabilitation recommendations after stroke. To resolve linguistic barriers and cultural diversity challenges, we propose establishing a Global Traditional Medicine Guideline Database powered by AI-driven multilingual translation platforms. This system will enable real-time semantic alignment across languages and cross-cultural knowledge retrieval. Concurrently, in collaboration with the WHO Traditional Medicine Department, we will integrate T&CM stroke rehabilitation guidelines into the ICD-11 Traditional Medicine Module’s Implementation Toolkit, embedding adaptive policy templates that automatically adjust to national healthcare priorities based on World Bank income classifications and cultural sensitivity indices.

Limitations

Our study has some limitations: (1) We only included English and Chinese guidelines, which may limit the global dissemination of T&CM rehabilitation recommendations after stroke. (2) To present the recommendations more clearly, we categorized them as "strong," "weak," and "not mentioned" based on the GRADE system criteria, which still did not eliminate the confusion caused by the heterogeneity of the evidence grading systems for decision-makers, clinicians, and some stakeholders in practice. (3) We only used AGREE II to assess the methodological quality of the CPGs without evaluating their reporting quality, which prevented us from further analyzing the correlation between the methodological quality and the reporting quality of the included CPGs.

Conclusions

The methodological quality of clinical practice guidelines for stroke rehabilitation varied significantly, but several consistent recommendations emerged. The recommended guidelines show a high degree of agreement in recommending acupuncture to improve dysphagia after stroke, but the recommendation strength is weak. And the recommendations in the areas of upper extremity motor dysfunction and cognitive impairment after stroke need to be further explored. Additionally, the benefits of acupuncture to improve activities of daily living (ADL) are not supported by scientific evidence, and clinicians should refrain from adding this intervention to ADL rehabilitation. In the future, more high-quality, large-scale randomized controlled trials are needed to increase the level of evidence for the T&CM rehabilitation approach, and guidelines development should focus on improving applicability, evidence retrieval, and appraisal methods, addressing patient preferences and values, and establishing evidence grading systems.

Data availability

Data is provided within the manuscript or supplementary information files.

Abbreviations

T&CM:

Traditional and complementary medicine

AGREE II:

Appraisal of Guidelines for Research and Evaluation II

GRADE:

The Grades of Recommendation, Assessment, Development, and Evaluation

DALYs:

Disability-adjusted life years

WHO:

World Health Organization

CPGs:

Clinical practice guidelines

ADL:

Activities of daily living

PSCI:

Post-stroke cognitive impairment

References

  1. Roth GA, Mensah GA, Johnson CO, Addolorato G, Ammirati E, Baddour LM, et al. Global Burden of Cardiovascular Diseases and Risk Factors, 1990–2019: Update From the GBD 2019 Study. J Am Coll Cardiol. 2020;76(25):2982–3021. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.jacc.2020.11.010.

    Article  PubMed  PubMed Central  Google Scholar 

  2. GBD 2019 Stroke Collaborators. Global, regional, and national burden of stroke and its risk factors, 1990–2019: A systematic analysis for the Global Burden of Disease Study 2019. Lancet Neurol. 2021;20(10):795–820. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/S1474-4422(21)00252-0.

  3. Zhang Y, Qiu FL, Zhong XG, Tian J. Hospitalization expenses analysis for rehabilitation stroke patients (in Chinese). Chinese Medical Record. 2022;23(10):58–61.

    CAS  Google Scholar 

  4. Cao D, Zhang X, Liu M, Yang Q, Gu S, Gao T, et al. Efficacy and safety of manual acupuncture for the treatment of upper limb motor dysfunction after stroke: Protocol for a systematic review and meta-analysis. PLoS ONE. 2021;16(11): e0258921. https://doiorg.publicaciones.saludcastillayleon.es/10.1371/journal.pone.0258921.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Veldema J, Gharabaghi A. Noninvasive brain stimulation for improving gait, balance, and lower limbs motor function in stroke. J Neuroeng Rehabil. 2022;19(1):84. Published 2022 Aug 3. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12984-022-01062-y.

  6. Wang L, Chen JL, Wong AMK, Liang KC, Tseng KC. Game-Based Virtual Reality System for Upper Limb Rehabilitation After Stroke in a Clinical Environment: Systematic Review and Meta-Analysis. Games Health J. 2022;11(5):277–97. https://doiorg.publicaciones.saludcastillayleon.es/10.1089/g4h.2022.0086.

    Article  PubMed  Google Scholar 

  7. Kumar S, Wagner CW, Frayne C, Zhu L, Selim M, Feng W, et al. Noninvasive brain stimulation may improve stroke-related dysphagia: a pilot study. Stroke. 2011Apr;42(4):1035–40. https://doiorg.publicaciones.saludcastillayleon.es/10.1161/STROKEAHA.110.602128.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Bright T, Wallace S, Kuper H. A Systematic Review of Access to Rehabilitation for People with Disabilities in Low- and Middle-Income Countries. Int J Environ Res Public Health. 2018;15(10). https://doiorg.publicaciones.saludcastillayleon.es/10.3390/ijerph15102165.

  9. World Health Organization. Traditional and complementary medicine in primaryhealth care. 2018. Available from: https://www.who.int/publications/i/item/WHO-HIS-SDS-2018.37 . Accessed on 2024 December 1.

  10. Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J. Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. BMJ. 1999;318(7182):527–30. https://doiorg.publicaciones.saludcastillayleon.es/10.1136/bmj.318.7182.527.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Yuwen Y, Shi NN, Han XJ, Gao Y, Xu JL, Liu DS, et al. Appraisal of clinical practice guidelines for ischemic stroke management in Chinese medicine with appraisal of guidelines for research and evaluation instrument: A systematic review. Chin J Integr Med. 2015;21(9):707–15. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s11655-014-1834-2.

    Article  CAS  PubMed  Google Scholar 

  12. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372: n71. https://doiorg.publicaciones.saludcastillayleon.es/10.1136/bmj.n71.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Brouwers MC, Kerkvliet K, Spithoff K. The AGREE Reporting Checklist: a tool to improve reporting of clinical practice guidelines. BMJ. 2016;352: i1152. https://doiorg.publicaciones.saludcastillayleon.es/10.1136/bmj.i1152.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: Advancing guideline development, reporting, and evaluation in health care. CMAJ. 2010;182(18):E839–42. https://doiorg.publicaciones.saludcastillayleon.es/10.1503/cmaj.090449.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Burls A. AGREE Improving the quality of clinical care. Lancet. 2010;376(9747):1128–9. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/S0140-6736(10)61034-3.

    Article  PubMed  Google Scholar 

  16. Harrison CL, Teede H, Khan N, Lim S, Chauhan A, Drakeley S, et al. Weight management across preconception, pregnancy, and postpartum: A systematic review and quality appraisal of international clinical practice guidelines. Obes Rev. 2021;22(10): e13310. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/obr.13310.

    Article  PubMed  Google Scholar 

  17. Armstrong JJ, Rodrigues IB, Wasiuta T, MacDermid JC. Quality assessment of osteoporosis clinical practice guidelines for physical activity and safe movement: an AGREE II appraisal. Arch Osteoporos. 2016;11:6. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s11657-016-0260-9.

    Article  PubMed  Google Scholar 

  18. Dv C. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994. https://doiorg.publicaciones.saludcastillayleon.es/10.1037/1040-3590.6.4.284.

    Article  Google Scholar 

  19. Chinese Association of Integrative Medicine Neurology Professional Committee. Diagnosis and Treatment of Cerebral Infarction with Integrated Chinese and Western Medicine (in Chinese). Med: China. Press. Tradit. Chin; 2011.

    Google Scholar 

  20. Zhang T, Zhao J, Bai YL, et al. Chinese Stroke Association Guidelines for Clinical Management of Cerebrovascular Disorders (Excerpts)—Management of Stroke Rehabilitation (in Chinese). Chin J Stroke. 2019;14(08):823–31.

    Google Scholar 

  21. Gao CY, Wu CH, Zhao JG, et al. Guidelines for Diagnosis and Treatment of Cerebral Infarction with Integrated Traditional Chinese and Western Medicine 2017 (in Chinese). Chin J Integr Tradit Chin West Med. 2018;38(02):136–44.

    Google Scholar 

  22. Zou YH, Ma B. Traditional Chinese Medicine Diagnosis and Treatment Guidelines of Cerebral Hemorrhage (in Chinese). Chin Med Mod Distance Educ. 2011;9(23):110–2.

    Google Scholar 

  23. Neurology Chapter of Chinese Medical Association, Cerebrovascular Disease Group, Neurology Branch, Chinese Medical Association. Chinese Guidelines for Diagnosis and Treatment of Acute Ischemic Stroke 2018 (in Chinese). Chin J Neurol (Chin) 2018;51(9):17.

  24. Zhang T. Chinese Guidelines for Rehabilitation Treatment of Stroke (2011 Complete Edition) (in Chinese). Chin J Rehabil. 2012;18(04):301–318.

  25. Tang Q, Li BL, Li HY, et al. Clinical Practice Guidelines in Modified Tai Chi Therapy for Post-stroke Dyskinesia. Rehabil (in Chinese). Med. 2022;32(03):189–96.

    Google Scholar 

  26. Lin ZC, Xue XH, Jiang YJ, et al. Clinical Practice Guidelines for Stroke of Chinese Medicine Rehabilitation. Rehabil (in Chinese). Med. 2019;29(06):6–9+15.

    Google Scholar 

  27. Zhang W, Lou BD, Li JX, et al. Clinical Practice Guidelines of Chinese Medicine Rehabilitation for Ischemic Stroke (Cerebral Infarction) (in Chinese). Rehabil Med. 2021;31(06):437–47.

    CAS  Google Scholar 

  28. Yang SL, Cai SF, Wu JY, et al. Clinical Practice Guidelines in Integrated Traditional Chinese and Western Medicine Rehabilitation—Cognitive Impairment (in Chinese). Rehabil Med. 2020;30(05):343–8.

    Google Scholar 

  29. Zhong LLD, Kun W, Shi N, Ziea TC, Ng BFL, Gao Y, et al. Evidence-based Chinese Medicine Clinical Practice Guideline for Stroke in Hong Kong. Chin Med. 2020;15(1):116. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13020-020-00397-9.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Ni X, Lin H, Li H, Liao W, Luo X, Wu D, et al. Evidence-based practice guideline on integrative medicine for stroke 2019. J Evid Based Med. 2020;13(2):137–52. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/jebm.12386.

    Article  PubMed  Google Scholar 

  31. Hebert D, Lindsay MP, McIntyre A, Kirton A, Rumney PG, Bagg S, et al. Canadian stroke best practice recommendations: Stroke rehabilitation practice guidelines, update 2015. Int J Stroke. 2016;11(4):459–84. https://doiorg.publicaciones.saludcastillayleon.es/10.1177/1747493016643553.

    Article  PubMed  Google Scholar 

  32. Gittler M, Davis AM. Guidelines for Adult Stroke Rehabilitation and Recovery. JAMA. 2018;319(8):820–1. https://doiorg.publicaciones.saludcastillayleon.es/10.1001/jama.2017.22036.

    Article  PubMed  Google Scholar 

  33. Management of Stroke Rehabilitation Working Group. VA/DOD Clinical practice guideline for the management of stroke rehabilitation. J Rehabil Res Dev. 2010;47(9):1–43.

    Google Scholar 

  34. National Stroke Foundation. Clinical Guidelines for Stroke Rehabilitation and Recovery 2005. 2005. Available from: https://guide.medlive.cn/guideline/5561 . Accessed October 01, 2024. Accessed on 2024 December 1.

  35. Australia: National Stroke Foundation. Clinical Guidelines for Stroke Management-Chapter 5 of 8: Rehabilitation. 2022. Available from: https://informme.org.au/guidelines/living-clinical-guidelines-for-stroke-management . Accessed on 2024 December 1.

  36. Minelli C, Bazan R, Pedatella MTA, et al. Brazilian Academy of Neurology practice guidelines for stroke rehabilitation: part I. Arq Neuropsiquiatr. 2022;80(6):634–52.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Minelli C, Luvizutto GJ, Cacho RO, Neves LO, Cacho RO, Magalhães SCSA, et al. Brazilian practice guidelines for stroke rehabilitation: Part II. Arq Neuropsiquiatr. 2022;80(7):741–58. https://doiorg.publicaciones.saludcastillayleon.es/10.1590/0004-282X-ANP-2021-0354.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Alonso-Coello P, Irfan A, Solà I, Gich I, Delgado-Noguera M, Rigau D, et al. The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. Qual Saf Health Care. 2010;19(6): e58. https://doiorg.publicaciones.saludcastillayleon.es/10.1136/qshc.2010.042077.

    Article  PubMed  Google Scholar 

  39. Zhao S, Cao J, Shi Q, Wang Z, Estill J, Lu S, et al. A quality evaluation of guidelines on five different viruses causing public health emergencies of international concern. Ann Transl Med. 2020;8(7):500. https://doiorg.publicaciones.saludcastillayleon.es/10.21037/atm.2020.03.130.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. World Health Organization. WHO recommendations on maternal and newborn care for a positive postnatal experience. 2022. Available from: https://www.who.int/publications/i/item/9789240045989. Accessed on 2024 December 1.

  41. Hoffmann-Eßer W, Siering U, Neugebauer EA, Brockhaus AC, Lampert U, Eikermann M. Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments. PLoS ONE. 2017;12(3): e0174831. https://doiorg.publicaciones.saludcastillayleon.es/10.1371/journal.pone.0174831.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  42. Turner T, Misso M, Harris C, Green S. Development of evidence-based clinical practice guidelines (CPGs): comparing approaches. Implement Sci. 2008;3:45. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/1748-5908-3-45.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Shekelle PG, Woolf SH, Eccles M, Grimshaw J. Developing clinical guidelines. West J Med. 1999Jun;170(6):348–51.

    CAS  PubMed  PubMed Central  Google Scholar 

  44. Ge L, Wang Q, He Y, Wu D, Zhou Q, Xu N, et al. Acupuncture for cancer pain: an evidence-based clinical practice guideline. Chin Med. 2022;17(1):8. https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s13020-021-00558-4.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Xue C, Jiang C, Zhu Y, Liu X, Zhong D, Li Y, et al. Effectiveness and safety of acupuncture for post-stroke spasticity: A systematic review and meta-analysis. Front Neurol. 2022;13: 942597. https://doiorg.publicaciones.saludcastillayleon.es/10.3389/fneur.2022.942597.

    Article  PubMed  PubMed Central  Google Scholar 

  46. Ye Q, Xie Y, Shi J, Xu Z, Ou A, Xu N. Systematic Review on Acupuncture for Treatment of Dysphagia after Stroke. Evid Based Complement Alternat Med. 2017;2017:6421852. https://doiorg.publicaciones.saludcastillayleon.es/10.1155/2017/6421852.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Seki T, Iwasaki K, Arai H, Sasaki H, Hayashi H, Yamada S, et al. Acupuncture for dysphagia in poststroke patients: a videofluoroscopic study. J Am Geriatr Soc. 2005;53(6):1083–4. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/j.1532-5415.2005.53338_11.x.

    Article  PubMed  Google Scholar 

  48. Wayne PM, Krebs DE, Macklin EA, Schnyer R, Kaptchuk TJ, Parker SW, et al. Acupuncture for upper-extremity rehabilitation in chronic stroke: a randomized sham-controlled study. Arch Phys Med Rehabil. 2005;86(12):2248–55. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.apmr.2005.07.287.

    Article  PubMed  Google Scholar 

  49. Yang A, Wu HM, Tang JL, Xu L, Yang M, Liu GJ. Acupuncture for stroke rehabilitation. Cochrane Database Syst Rev. 2016;2016(8):CD004131. https://doiorg.publicaciones.saludcastillayleon.es/10.1002/14651858.CD004131.pub3.

  50. Zhu Y, Zhang L, Ouyang G, Meng D, Qian K, Ma J, et al. Acupuncture in subacute stroke: no benefits detected. Phys Ther. 2013;93(11):1447–55. https://doiorg.publicaciones.saludcastillayleon.es/10.2522/ptj.20110138.

    Article  PubMed  Google Scholar 

  51. Chen Y, Sun Y, Li W, Wei H, Long T, Li H, et al. Systems pharmacology dissection of the anti-stroke mechanism for the Chinese traditional medicine Xing-Nao-Jing. J Pharmacol Sci. 2018;136(1):16–25. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.jphs.2017.11.005.

    Article  CAS  PubMed  Google Scholar 

  52. Peng W, Yang J, Wang Y, Wang W, Xu J, Wang L, et al. Systematic review and meta-analysis of randomized controlled trials of xingnaojing treatment for stroke. Evid Based Complement Alternat Med. 2014;2014: 210851. https://doiorg.publicaciones.saludcastillayleon.es/10.1155/2014/210851.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Liu S, Wu J, Lin M, Zhang B. Meta-analysis on randomized controlled trials of salvianolate injection in the treatment of acute cerebral infarction. J Pharm Epidemiol (in Chinese). 2017;26(4):248–55.

    Google Scholar 

  54. Tan D, Wu J, Liu S, Zhang D, Cui Y, Zhang X, et al. Injections of ginkgo in the treatment of cerebral infarction: a systematic review and network Meta-analysis. J Tradit Chin Med. 2018;38(1):1–11.

    Article  PubMed  Google Scholar 

  55. Zeng LF, Cao Y, Wang L, Dai YK, Hu L, Wang Q, et al. Role of Medicinal Plants for Liver-Qi Regulation Adjuvant Therapy in Post-stroke Depression: A Systematic Review of Literature. Phytother Res. 2017;31(1):40–52. https://doiorg.publicaciones.saludcastillayleon.es/10.1002/ptr.5740.

    Article  CAS  PubMed  Google Scholar 

  56. Zhang Y, Zhang Z, Yang B, Li Y, Zhang Q, Qu Q, et al. Incidence and risk factors of cognitive impairment 3 months after first-ever stroke: a cross-sectional study of 5 geographic areas of China. J Huazhong Univ Sci Technolog Med Sci. 2012;32(6):906–11. https://doiorg.publicaciones.saludcastillayleon.es/10.1007/s11596-012-1056-9.

    Article  CAS  PubMed  Google Scholar 

  57. Cumming TB, Brodtmann A, Darby D, Bernhardt J. The importance of cognition to quality of life after stroke. J Psychosom Res. 2014;77(5):374–9. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.jpsychores.2014.08.009.

    Article  PubMed  Google Scholar 

  58. Gaynor E, Rohde D, Large M, Mellon L, Hall P, Brewer L, et al. Cognitive Impairment, Vulnerability, and Mortality Post Ischemic Stroke: A Five-Year Follow-Up of the Action on Secondary Prevention Interventions and Rehabilitation in Stroke (ASPIRE-S) Cohort. J Stroke Cerebrovasc Dis. 2018;27(9):2466–73. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.jstrokecerebrovasdis.2018.05.002.

    Article  PubMed  Google Scholar 

  59. Wu W, Song C, Yang Y, Hu Y, Lin H. Acupuncture for cognitive impairment after stroke: A systematic review and meta-analysis. Heliyon. 2024;10(9): e30522. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.heliyon.2024.e30522.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Wang Y, Zhang Q, Li F, Li Q, Jin Y. Effects of tai chi and Qigong on cognition in neurological disorders: A systematic review and meta-analysis. Geriatr Nurs. 2022;46:166–77. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.gerinurse.2022.05.014.

    Article  PubMed  Google Scholar 

  61. Sun Y, Gao Y, Chen J, Sun H, Cai YT, Ge L, et al. Evidence mapping of recommendations on diagnosis and therapeutic strategies for diabetes foot: an international review of 22 guidelines. Metabolism. 2019;100: 153956. https://doiorg.publicaciones.saludcastillayleon.es/10.1016/j.metabol.2019.153956.

    Article  CAS  PubMed  Google Scholar 

  62. Alonso-Coello P, Oxman AD, Moberg J, Brignardello-Petersen R, Akl EA, Davoli M, et al. GRADE Evidence to Decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. 2: Clinical practice guidelines. BMJ. 2016;353:i2089. https://doiorg.publicaciones.saludcastillayleon.es/10.1136/bmj.i2089.

  63. Brozek JL, Akl EA, Alonso-Coello P, Lang D, Jaeschke R, Williams JW, et al. Grading quality of evidence and strength of recommendations in clinical practice guidelines. Part 1 of 3. An overview of the GRADE approach and grading quality of evidence about interventions. Allergy. 2009;64(5):669–677. https://doiorg.publicaciones.saludcastillayleon.es/10.1111/j.1398-9995.2009.01973.x.

Download references

Acknowledgements

None.

Funding

This study was supported by the Three-year Action Plan for the Development of Traditional Chinese medicine in the Shanghai—Highland Construction for International Standardization of Traditional Chinese medicine (No. ZY(2021–2023)-0212).

Author information

Authors and Affiliations

Authors

Contributions

Lei Fang and Long Ge contributed to the concept and design of this study. Lei Fang and Ran-ran Zhu had full access to all the data in the study, and took responsibility for the integrity of the data and the accuracy of data analysis. Ran-ran Zhu, Jin-Xiang Wang, Bei Pan, Hong-hao Lai, and Xiao-ting Xu accessed, verified, and analyzed the data. Lei Fang and Ran-ran Zhu interpreted the data and drafted the manuscript. All authors have full access to all the data in the study and have approved the decision to submit this manuscript for publication.

Corresponding authors

Correspondence to Long Ge or Lei Fang.

Ethics declarations

Ethics approval and consent to participate

This study involved a systematic review of peer-reviewed literature only; it did not require ethics approval or consent to participate.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhu, Rr., Wang, Jx., Pan, B. et al. Evidence-based evaluation for stroke guidelines mentioning traditional and complementary medicine rehabilitation. BMC Complement Med Ther 25, 184 (2025). https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12906-025-04916-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doiorg.publicaciones.saludcastillayleon.es/10.1186/s12906-025-04916-9

Keywords