==== Front J Transl Med J Transl Med Journal of Translational Medicine 1479-5876 BioMed Central London 2649 10.1186/s12967-020-02649-6 Research Can harmonisation of outcomes bridge the translation gap for pre-clinical research? A systematic review of outcomes measured in mouse models of type 2 diabetes http://orcid.org/0000-0001-6958-6466Harman Nicola L. n.harman@liv.ac.uk 1 http://orcid.org/0000-0001-9478-5432Sanz-Moreno Adrián 2 http://orcid.org/0000-0001-6665-8508Papoutsopoulou Stamatia 3 http://orcid.org/0000-0002-2325-8050Lloyd Katie A. 4 http://orcid.org/0000-0002-7583-4099Ameen-Ali Kamar E. 5 http://orcid.org/0000-0001-9187-9839Macleod Malcolm 6 http://orcid.org/0000-0001-9802-6636Williamson Paula R. 1 1 grid.10025.360000 0004 1936 8470Department of Health Data Science, University of Liverpool, Liverpool, L69 3GL UK 2 German Mouse Clinic, Institute of Experimental Genetics, HMGU, Neuherberg, 85764 Germany 3 grid.10025.360000 0004 1936 8470Cellular and Molecular Physiology, Institute of Translational Medicine, University of Liverpool, Liverpool, L69 3GL UK 4 grid.12641.300000000105519715Clinical Translational Research Innovation Centre (CTRIC), Altnagelvin Hospital, University of Ulster, Londonderry, BT47 6SB UK 5 grid.1006.70000 0001 0462 7212Translational and Clinical Research Institute, Faculty of Medical Sciences, Newcastle University, Newcastle, NE4 5PL UK 6 grid.4305.20000 0004 1936 7988Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, UK 9 12 2020 9 12 2020 2020 18 46825 6 2020 29 11 2020 © The Author(s) 2020Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.Background In pre-clinical research, systematic reviews have the potential to mitigate translational challenges by facilitating understanding of how pre-clinical studies can inform future clinical research. Yet their conduct is encumbered by heterogeneity in the outcomes measured and reported, and those outcomes may not always relate to the most clinically important outcomes. We aimed to systematically review outcomes measured and reported in pre-clinical in vivo studies of pharmacological interventions to treat high blood glucose in mouse models of type 2 diabetes. Methods A systematic review of pre-clinical in vivo studies of pharmacological interventions aimed at addressing elevated blood glucose in mouse models of type 2 diabetes was completed. Studies were screened for eligibility and outcomes extracted from the included studies. The outcomes were recorded verbatim and classified into outcome domains using an existing outcome taxonomy. Outcomes were also compared to those identified in a systematic review of registered phase 3/4 clinical trials for glucose lowering interventions in people with type 2 diabetes. Results Review of 280 included studies identified 532 unique outcomes across 19 domains. No single outcome, or domain, was measured in all studies and only 132 (21%) had also been measured in registered phase 3/4 clinical trials. A core outcome set, representing the minimum that should be measured and reported, developed for type 2 diabetes effectiveness clinical trials includes 18 core outcomes, of these 12 (71%) outcomes were measured and reported in one or more of the included pre-clinical studies. Conclusions There is heterogeneity of outcomes reported in pre-clinical research. Harmonisation of outcomes across the research pathway using a core outcome set may facilitate interpretation, evidence synthesis and translational success, and may contribute to the refinement of the use of animals in research. Systematic review registration: The study was prospectively registered on the PROSPERO Database, registration number CRD42018106831 Keywords Type 2 diabetesPre-clinical researchMouse models of type 2 diabetesCore outcome setTranslational researchClinical researchPre-clinical systematic reviewhttp://dx.doi.org/10.13039/100010661Horizon 2020 Framework Programme654248Williamson Paula R. issue-copyright-statement© The Author(s) 2020 ==== Body Background Clinical trials are undertaken to evaluate the effectiveness and safety of treatments in defined populations, and use pre-defined outcome measures. However, there is often marked variability between trials in the outcomes measured and reported which contributes to research waste through the inability to compare findings and synthesise evidence from multiple trials [1]. These issues can be addressed through the use of a core outcome set (COS), defined as “the minimum [set of outcomes] that should be measured and reported in all clinical trials of a specific condition” [2]. Indeed, in the case of rheumatoid arthritis, a core outcome set has increased the consistency of outcome reporting, and use of the COS has increased over time [3]. There are currently 337 COSs spanning 31 disease areas that have been developed for clinical research or practice or both [4]. However, despite the uptake of COSs in clinical trials, little is known about their relationship to the outcomes measured at other stages of the research pathway. In pre-clinical research there is a recognised issue in the ability of animal models to predict effectiveness in humans, with large variability in translational success rates [5–7]. Pre-clinical systematic reviews have been proposed as a way to improve understanding of pre-clinical effectiveness and how this can inform clinical trials [8–10]. Yet, as in clinical trials, the ability to systematically review the literature is impacted by issues of methodological rigour and further compounded by heterogeneity in the outcomes measured and reported [1, 11]. Initiatives to improve the reporting of methodological details, for instance, the Animal Research: Reporting In Vivo Experiments (ARRIVE) guidelines [12], do not consider the choice of study outcome(s), that may impact not only on the ability to systematically compare and contrast the study results but also on the translatability of pre-clinical research to later phase trials. While the STAIR criteria for preclinical stroke research does address this issue, their requirements are rather broad [13]. We sought to explore the issue of outcome heterogeneity in pre-clinical research and the potential application of a COS using type 2 diabetes research as a case study. Type 2 diabetes is a global health concern; it has been estimated that 700 million people aged 20–79 will be affected by diabetes by 2045, the majority of these cases being type 2 diabetes [14–16]. There are a number of established animal models for the study of type 2 diabetes [17, 18] with mouse models offering several advantages, including ease of induction of type 2 diabetes, a relatively short breeding span, and availability of physiological and invasive testing [19]. Mice are widely used in endocrine and metabolic research and, if all research areas are taken into account, represent the most widely used animal model in pre-clinical research [20]. We aimed to systematically review outcomes measured in pre-clinical research for type 2 diabetes using a mouse model, and to compare these to outcomes measured in clinical trials of glucose lowering interventions in type 2 diabetes [21]. Finally we examine the extent of the applicability of an existing COS [22] for type 2 diabetes in pre-clinical research. Methods Search strategy Relevant pre-clinical animal studies were identified with a combined search of MEDLINE, PubMED and SCOPUS using search terms specific to each database (Table 1). Searches were undertaken on the 16th July 2018.Table 1 Search strategies MEDLINE Line Search term 1 Exp models,animal/ 2 Exp animals/ 3 Exp humans/ 4 1 OR 2 5 4 NOT 3 6 Mouse ab.ti.tw 7 5 AND 6 8 Pyrazines/or Glucagon-Like Peptide 1/or Adamantane/or Blood Glucose/or exp Hypoglycemic Agents/or Pyrrolidines/or Dipeptidyl-Peptidase IV Inhibitors/or Dipeptidyl Peptidase 4/or Diabetes Mellitus, Type 2/or DPP-4.mp. or Triazoles/ 9 7 AND 8 Pub Med  1 Exp models,animal/  2 Exp humans/  3 1 NOT 2  4 Mouse ab.ti.tw  5 3 AND 4  6 Pyrazines/or Glucagon-Like Peptide 1/or Adamantane/or Blood Glucose/or exp Hypoglycemic Agents/or Pyrrolidines/or Dipeptidyl-Peptidase IV Inhibitors/or Dipeptidyl Peptidase 4/or Diabetes Mellitus, Type 2/or DPP-4 or Triazoles/  7 5 AND 6 SCOPUS  (((TITLE-ABS-KEY (mouse) AND TITLE-ABS-KEY (glucose))) AND (TITLE-ABS-KEY (diabetes))) AND (INDEXTERMS (nonhuman)) AND (LIMIT-TO (SUBJAREA, “PHAR”)) Returned entries were exported to Endnote, screened for duplicates and then uploaded into the CAMARADES-NC3Rs Preclinical Systematic Review & Meta-analysis Facility (SYRF) (www.syrf.org.uk, accessed 3rd March-2020) for screening. The database held on www.preclinicaltrials.eu was also searched for ongoing registered trials of glucose lowering interventions for diabetes, but none were identified (July 2018). The study protocol, including the search strategy, was prospectively registered on the PROSPERO international prospective register of systematic reviews (https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42018106831). Eligibility criteria Publications reporting a pharmacological intervention aimed at lowering blood glucose in a mouse model for type 2 diabetes were eligible for inclusion. Eligible mouse models included dietary induced, chemically induced, monogenic or polygenic models. To be eligible for inclusion, studies must have been undertaken in the context of type 2 diabetes and not solely in other related metabolic disorders, for example, metabolic syndrome, obesity or insulin resistance. There were no restrictions on the year of publication. Studies were excluded if they met any of the following exclusion criteria: publications reporting the use of mouse models in other related metabolic disorders but not in type 2 diabetes; publications focusing on the prevention of type 2 diabetes only; publications reporting interventions in other animal models; publications reporting in vitro studies only; publications reporting non-pharmacological interventions for type 2 diabetes; publications primarily focused on interventions for complications of type 2 diabetes (e.g. retinopathy, neuropathy, cardiovascular disease, gastroparesis); publications reporting interventions exclusively for type 1 diabetes or gestational diabetes; studies that are solely mechanistic. Publications were also excluded if they used a mouse model inappropriate for the study of type 2 diabetes including, but not limited to, non obese diabetic mice, Akita mice, viral induced diabetes, alloxan induced diabetes, high dose streptozotocin (100–200 mg/kg). Streptozotocin models were included if a low dose was used to induce diabetes and the study specified the use of the model in the context of type 2 diabetes. Assessment of study eligibility Abstracts were reviewed in duplicate by a team of reviewers (NH, AS-M, SP, KL and KAA). Due to the large number of included abstracts, a 25% sample (in 10-year blocks) was taken forward to full text review. At full text review, a 10% duplicate screening batch check was completed for each reviewer before proceeding with single review. Where disagreement or uncertainty about inclusion of a study was noted, the reviewers discussed the study before reaching a decision. No study required third reviewer arbitration. Data extraction Data extraction from included full texts was undertaken by NH. Data on the year of publication, region of work and the mouse model used was extracted along with the outcomes measured. Data on outcomes was extracted from the methods and results sections of papers along with figures, tables and Additional file 1 where available. In cases of composite outcomes, all component outcomes were extracted. Where data on a specific adverse event was collected the outcome was listed twice, once as an adverse event and once as the specific outcome. Outcome classification Each outcome was reviewed and grouped with other outcomes if they measured the same aspect albeit using a different method. Each outcome was categorised according to the COMET taxonomy [23]. This taxonomy comprises 38 domains under five areas (death, physiological/clinical, life impact, resource use and adverse events). Outcome grouping and categorisation was cross checked by AS-M. Comparison with clinical trials Outcomes were then compared to those identified from a previous review of phase 3/4 registered clinical trials [21] and to those included in the core outcome set for type 2 diabetes [22]. Results Characteristics of included studies A systematic review was performed, to identify relevant pre-clinical in vivo studies using a mouse model of type 2 diabetes. A sample of 25% of included abstracts was assessed for eligibility at the full text stage and outcomes extracted from 280 eligible studies (Fig. 1). All studies used a mouse model of type 2 diabetes with the majority (63%) using a genetic model, for example, KK-Ay or Lepr db/dbmice. The characteristics of the included studies are described in Table 2. A full list of the included studies is available in Additional file 1-included studies. Fig. 1 PRISMA flow diagram Table 2 Description of included studies N (%) Year  1980–1989 8 (3)  1990–1999 23 (8)  2000–2009 89 (32)  2010–2018 160 (57) Region of work  Africa 5 (2)  Asia 142 (51)  Europe 76 (27)  North America 55 (20)  South America 2 (1) Mouse model  Chemically induced diabetes 38 (14)  Diet induced diabetes 39 (14)  Genetic model 176 (63)  Mixed models–chemical and diet 12 (4)  Mixed models–chemical and genetic 3 (1)  Mixed models–diet and genetic 12 (4) Outcomes measured in pre-clinical studies A total of 2874 individual outcomes were extracted with a median of 8 outcomes per trial (range 1–46). Each outcome was reviewed and categorised using the COMET taxonomy [23] (Table 3). Outcomes were also tagged if they had also been measured in phase 3/4 clinical trials in Type 2 diabetes identified in a previous systematic review [21].Table 3 Comparison of pre-clinical and clinical trial outcomes by domain Outcome domain Pre-clinical in vivo mouse studies Phase 3/4 clinical trials [20] Total number of unique outcomes within domain (verbatim outcomes) Number of studies reporting one or more outcomes in the domain (%) Total number of unique outcomes within domain (verbatim outcomes) Number of studies reporting one or more outcomes in the domain (%) 1. Mortality/survival 2 (7) 7 (2.5) 2 (3) 3 (2.2) 2. Blood and lymphatic system outcomes 12 (23) 13 (4.6) 14 (19) 9 (6.5) 3. Cardiac outcomes 6 (11) 8 (2.9) 11 (56) 20 (14.5) 4. Congenital, familial and genetic outcomes 0 (0) 0 (0) 0 (0) 0 (0) 5. Endocrine outcomes 32 (324) 164 (58.6) 14 (50) 31 (22.5) 6. Ear and labyrinth outcomes 0 (0) 0 (0) 0 (0) 0 (0) 7. Eye outcomes 0 (0) 0 (0) 2 (2) 2 (1.4) 8. Gastrointestinal outcomes 7 (9) 7 (2.5) 12 (20) 5 (3.6) 9. General outcomes 26 (296) 171 (61.1) 40 (146) 65 (47.1) 10. Hepatobiliary outcomes 23 (123) 70 (25) 12 (25) 12 (8.7) 11. Immune system outcomes 35 (84) 26 (9.3) 32 (73) 28 (20.3) 12. Infection and infestation outcomes 0 (0) 0 (0) 7 (8) 4 (2.9) 13. Injury and poisoning outcomes 0 (0) 0 (0) 0 (0) 0 (0) 14. Metabolism and nutrition outcomes 317 (1816) 279 (99.6) 105 (582) 121 (87.7) 15. Musculoskeletal and connective tissue outcomes 21 (42) 19 (6.8) 2 (2) 2 (1.4) 16. Outcomes relating to neoplasms: benign, malignant and unspecified (including cysts and polyps) 0 (0) 0 (0) 0 (0) 0 (0) 17. Nervous system outcomes 14 (18) 7 (2.5) 16 (16) 6 (4.3) 18. Pregnancy, puerperium and perinatal outcomes 0 (0) 0 (0) 0 (0) 0 (0) 19. Renal and urinary outcomes 19 (45) 30 (10.7) 53 (76) 27 (19.6) 20. Reproductive system and breast outcomes 0 (0) 0 (0) 0 (0) 0 (0) 21. Psychiatric outcomes 2 (3) 3 (1.1) 2 (2) 2 (1.4) 22. Respiratory, thoracic and mediastinal outcomes 2 (5) 4 (1.4) 3 (11) 23 (16.7) 23. Skin and subcutaneous tissue outcomes 0 (0) 0 (0) 1 (1) 1 (0.7) 24. Vascular outcomes 8 (9) 8 (2.9) 56 (134) 52 (37.7) 25. Physical functioning 4 (27) 17 (6.1) 3 (7) 5 (3.6) 26. Social functioning 0 (0) 0 (0) 4 (6) 5 (3.6) 27. Role functioning 0 (0) 0 (0) 3 (6) 3 (2.2) 28. Emotional functioning/wellbeing 0 (0) 0 (0) 23 (28) 8 (5.8) 29. Cognitive functioning 1 (2) 2 (0.7) 16 (22) 2 (1.4) 30. Global quality of life 0 (0) 0 (0) 2 (5) 4 (2.9) 31. Perceived health status 0 (0) 0 (0) 2 (4) 4 (2.9) 32. Delivery of care 1 (1) 1 (0.4) 18 (60) 30 (21.7) 33. Personal circumstances 0 (0) 0 (0) 0 (0) 0 (0) 34. Economic 0 (0) 0 (0) 6 (6) 4 (2.9) 35. Hospital 0 (0) 0 (0) 3 (4) 3 (2.2) 36. Need for intervention 0 (0) 0 (0) 7 (24) 16 (11.6) 37. Societal/carer burden 0 (0) 0 (0) 0 (0) 0 (0) 38. Adverse events/effects 5 (29) 20 (7.1) 4 (46) 33 (23.9) Some outcomes have been coded twice based on the context of measurement. Specifically total protein has been coded as ‘general outcomes’ and, where the reason for measurement was specified, this has been coded as ‘renal and urinary outcomes’ One study measured alkaline phosphatase (ALP), aspartate aminotransferase (AST) and alanine aminotransferase (ALT) specifically in the context of renal function and so these outcomes have been coded in both the ‘hepatobiliary outcomes’ domain and for one study coded in the ‘renal and urinary outcomes’ domain Phosphorylated c-Jun N-terminal kinase (p-JNK) expression has been coded as ‘general outcomes’ and also for one study as ‘endocrine’ where this was measured specifically in relation to pancreatic fibrosis The 2874 outcomes represented 532 unique outcomes across 19 domains. Of the unique outcomes, 205 (39%) represented outcomes relevant to the mechanism of drug action rather than safety or efficacy. No single outcome was measured in all studies. The most frequently represented domain was “metabolism and nutrition” with all but one study (279/280) measuring one or more outcomes within the domain. Within this domain, 90% (253/279) measured blood or plasma glucose or both; and 99% (277/279) either blood/plasma glucose, tissue glucose, glycaemic control, glucose tolerance, hypoglycaemia or urinary glucose. Also within the “metabolism and nutrition” domain just under half of studies (44%) measured one or more lipid or lipoprotein markers of cardiovascular disease risk. Emerging cardiovascular risk markers such as biomarkers of oxidative stress were less frequently measured (9% of studies). 171 of 280 studies (61%) reported “general outcomes” (not attributed to a certain body system), for example, outcomes relating to body weight or composition (166/280, 59%).164 of 280 studies (59%) included an outcome in the “endocrine outcomes” domain and of these 151 (92%) included an outcome relating to insulin, c-peptide or glucagon. Adverse events or effects were less frequently reported with only 7% of trials including one or more outcomes in this domain. Comparison with outcomes measured in later phase clinical trials All domains measured in pre-clinical in vivo studies had also been measured in phase 3/4 clinical trials. The distribution of outcomes across the COMET taxonomy domains was similar between pre-clinical and clinical studies with the exception of “vascular”, “cardiac”, “adverse events” and “delivery of care” outcomes that were more prevalent in phase 3/4 trials; and “endocrine outcomes”, that were more frequently measured pre-clinically. The clinical trials also included outcomes in an additional 11 domains (Table 3). Of these additional domains, “economic”, “hospital”, “role functioning” and “perceived health status” could only relate to human intervention studies. Importantly, of the 532 unique outcomes reported pre-clinically, only 21% had also been measured in type 2 diabetes clinical trials. This may reflect the prevalence of mechanistic outcomes in pre-clinical studies, or greater feasibility for measuring certain outcomes in the pre-clinical setting compared with clinical trials. Comparison with an existing core outcome set Core outcome sets (COS) represent the minimum set of outcomes that should be measured and reported in every clinical trial of a specific area of health [24]. Their purpose is to reduce the heterogeneity in outcomes measured in clinical trials of a particular condition, facilitate evidence synthesis, and promote the measurement of outcomes relevant to all stakeholders. A COS for glucose lowering interventions for type 2 diabetes has been developed [22] and the outcomes measured pre-clinically were compared to this. The core outcome set includes 18 outcomes, and of these 17 could potentially be measured in a mouse model. Twelve (71%) of these core outcomes were represented to some extent in the outcomes measured in pre-clinical studies (Table 4). However, studies typically measured only 1 or 2 outcomes and no single study reported more than seven outcomes in the COS (Fig. 2). Similar patterns were observed in clinical trials, registered prior to the publication of the COS, although a larger proportion of trials measured multiple core outcomes. In pre-clinical studies there were multiple outcomes reported that could be used to measure a core outcome (Table 4). Furthermore within these there were multiple methods of assessment. For example, “glycaemic control” was reported in 40 studies using four different outcomes of which glycated haemoglobin (HbA1c) was the most frequently measured (35/40 studies). There are four, commonly used, methods for the measurement of HbA1c [25], details of the method used were reported in 29/35 papers. Each of the four methods was used at least once with immunoassay used most frequently (n = 18) followed by, ion-exchange high-performance liquid chromatography (HPLC) (n = 4), boronate affinity HPLC (n = 6), and enzymatic assays (n = 1), highlighting the variability in “how” outcomes are measured.Table 4 Comparison of the core outcome set for clinical trials in type 2 diabetes and outcomes in pre-clinical studies Core outcome Domain Outcomes reported in pre-clinical in vivo studies Number of pre-clinical studies reporting the outcome (%) Number of phase 3/4 clinical trials reporting the outcome (%) Overall survival—how long someone lives Death Mortality, survival 7 (2.5) 2 (1.4)a Death from a diabetes related cause such as heart disease Death No study specifically described death from a diabetes related cause 0 (0) 1 (0.7) Glycaemic control—how well someone’s blood glucose is controlled Physiological/clinical Glycated haemoglobin (HbA1c), glycated serum proteins, euglycaemic duration, fructosamine 40 (14.3) 93 (67.4) Body weight—how much someone weighs Physiological/clinical Body weight 165 (58.9) 54 (39.1) Kidney function—how well someone’s kidneys are working Physiological/clinical Blood urea nitrogen (BUN), creatinine, electrolytes, renal fructose, renal sorbitol, total protein, urine volume, kidney functionb 23 (8.2) 25 (18.1) Hyperglycaemia—how often someone has high blood glucose Physiological/clinical Blood glucose 253 (90.4) 64 (46.4) Hypoglycaemia—how often someone has low blood glucose levels Physiological/clinical Hypoglycaemic and hypoglycaemic durationc 3 (1.1) 45 (32.6) Visual deterioration or blindness—if someone’s eyesight gets worse or if they have loss of vision including blindness Physiological/clinical No studies measured this outcome 0 (0) 2 (1.4) Neuropathy—damage to the nerves caused by high glucose. This can lead to tingling and pain or numbness in the feet or legs. It can also affect bowel control; stomach emptying and sexual function Physiological/clinical Hyperalgesia, long term potentiation, pain threshold 5 (1.8) 2 (1.4) Having gangrene or having an amputation of the leg, foot or took Physiological/clinical No studies measured this outcome 0 (0) 0 (0) Nonfatal myocardial infarction—having a heart attack that is not fatal Physiological/clinical No studies measured this outcome 0 (0) 2 (1.4) Heart failure Physiological/clinical Heart weight, appearance of the heart, heart histology 6 (2.1) 11 (7.9) Cerebrovascular disease—including stroke, subarachnoid haemorrhage, transient ischaemic attack and vascular dementia Physiological/clinical No studies measured this outcome 0 (0) 0 (0) Hyperglycaemic emergencies (to include diabetic ketoacidosis and hyperosmolar hyperglycaemic state) Physiological/clinical Ketone bodies, lactate, β-hydroxybutyrate 8 (2.9) 11 (7.9) Global quality of life—someone’s overall quality of life including physical, mental and social wellbeing Life impact Object recognition, anxiety, mental status, food or water intaked 111 (39.6) 7 (5.1) Object recognition 2 (0.7) – Anxiety/mental status 3 (1.1) – Food or water intake 110 (39.3) – Activities of daily living - being able to complete usual everyday tasks and activities including those related to personal care; house hold tasks or community based tasks Life impact Behaviour, locomotor activity, open field assessment, exploratory activity, ambulatory activity, physical activity, external appearance, coat fur, hair colour 18 (6.4) 2 (1.4) How often someone is admitted to hospital because of their diabetes Resource use Not applicable N/A 3 (2.2) Side effects of treatment- any unwanted effects of the treatment Adverse events Organ toxicity, adverse effects, side effects, toxicity 20 (7.1) 34 (26.6) aIn clinical trials no reports of death would often be assumed to mean no deaths even if the number of deaths as “zero” is not explicitly stated bAlanine aminotransferase (ALT), alkaline phosphatase (ALP) and aspartate aminotransferase (AST) were measured in one study in relation to kidney function. However, these are generally used as biomarkers for liver function and so have not been included cBlood glucose may also indicate hypoglycaemia, this has been reported separately dBody weight may also represent quality of life but this has been reported as a separate outcome Fig. 2 Proportion of pre-clinical and clinical studies measuring one or more of the core outcomes Outcomes in the COS that were not reported, or infrequently reported, represented longer term outcomes associated with morbidities (nephropathy, neuropathy, retinopathy, cardiovascular and cerebrovascular disease) resulting from long term insulin resistance [26]. Measuring such complications in otherwise healthy, usually adolescent laboratory mice where the rates of spontaneous development of these complications of diabetes is low would bring some challenges, including the ethical and resource costs of the longer duration of experiments which would be required. Discussion Addressing methodological issues in pre-clinical research will help researchers take one step closer to achieving successful translation of safe and effective treatments [12, 27, 28]. However, the issue of outcome heterogeneity in pre-clinical studies, demonstrated here for type 2 diabetes, has been overlooked, impacting on the ability to synthesise evidence, contributing to research waste and widening the translational gap. Initiatives to harmonise outcomes have focused on later phase effectiveness trials [2, 24] yet there is potential to apply COS across the research pathway. In the case of type 2 diabetes, over 70% of the existing COS was measured, to some extent, in publications using pre-clinical mouse models. Discordance was observed for outcomes relating to long term complications but these too were infrequently measured in clinical trials with “gangrene and amputation of the leg, foot or toe”, and “cerebrovascular disease” not measured at all and “deterioration of vision” and “myocardial infarction” each measured in a single clinical trial [21]. There were also limits of the pre-clinical search strategy which excluded studies that used specific mouse models of a long term diabetes complication. Mice display a different rate of development/aging to humans that cannot easily be converted between species [29, 30]; consequently, disease progression and time to the onset of long term complications may not be feasible to assess unless a specific animal model, pre-disposed to the development of such conditions, is used. Whilst mouse models are the most frequently used pre-clinical animal model, there are limitations in the physiological assessments that can be undertaken. A review of large animal and non-human primate models may identify further overlap of outcomes with those assessed in phase 3/4 clinical trials due to the ability to perform particular physiological assessments in these larger animals. Death is reported in clinical trials, either as a specific outcome or in the collection of serious adverse events, and is routinely recorded in clinical practice but in the pre-clinical setting it is widely accepted that “death as an endpoint to a procedure should be avoided as far as possible and replaced by earlier, humane endpoints” [31]. Instead, alternative surrogate outcomes for death may be more appropriate and alleviate terminal distress in mice whilst also capturing the core outcome [32, 33.] In the present study we have applied surrogate markers of quality of life including “food and water intake”, measured in 39% of studies. Yet in these studies the reason for measurement was not specified and, in the case of some diabetes treatments, may indicate assessment of a side effect of treatment (weight gain) or polydipsia (a symptom of elevated blood glucose). Animal welfare encompasses an animal’s overall quality of life, taking into consideration its physical and psychological health along with the suitability of living conditions that give the animal opportunity to exhibit natural behaviours. Assessment of welfare is a critical component of research involving animals but this may go unreported in study publications. This under-reporting is further compounded by multiple methods of assessment and clarity is needed on how quality of life should be measured [34]. A COS has the potential to reduce the risk of outcome reporting bias, an issue that has been highlighted in both pre-clinical and clinical research [35, 36]. For a COS to contribute to reducing the risk of reporting bias there is an expectation that it is used in its entirety or that clear justification is made for why some outcomes have not been measured. It is important to recognise that it may not be practical, or indeed ethical, to measure the full set of core outcomes in every pre-clinical study and instead data on the core outcomes may be collected by the triangulation of data from multiple pre-clinical studies. Using glycaemic control as an example in the present study it is clear that not only are there different ways to define the outcome but, in the case of HbA1c, multiple methods of measurement. For pre-clinical studies to apply the COS there needs to be clear reporting on which of the outcomes will be measured, including reasons why outcomes are not assessed, together with consensus on “how” each of the core outcome should be measured and further work is warranted in this area. Conclusion The COS developed for type 2 diabetes shows a large overlap with outcomes already measured and reported in pre-clinical research using a mouse model of type 2 diabetes. Application of the COS, using agreed methods, in both pre-clinical research and clinical trials will mean that the same outcomes are measured and reported as a minimum, across the research pathway, facilitating evidence synthesis that has the potential to identify the most promising treatments. Supplementary information Additional file 1. Included Studies Abbreviation COSCore outcome set Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. Supplementary information Supplementary information accompanies this paper at 10.1186/s12967-020-02649-6. Acknowledgements We acknowledge the members of the wider CORBEL 3.2 work package study team: Serena Battaglia, Jacques Demotes-Mainard, Valerie Gailus-Durner, Silvio Garattini, Cecilia AC Prinsen, Michael Raess, Patricia da Silva-Buttkus, Caroline B Terwee. Authors’ contributions PRW and NH conceived and designed the study and wrote the study protocol. KAA, AS-M, KL,SP and MM reviewed the protocol. PRW, NH, MM developed the search strategy. NH, KAA, AS-M, KL, SP, NH screened abstracts and full text reports. NH extracted and categorised outcomes. All authors contributed to the interpretation of the data. NH drafted the manuscript; all authors critically reviewed the manuscript. All authors read and approved the final manuscript. Funding This work has received funding from the European Union’s Horizon 2020 research and innovation programme (CORBEL, under Grant agreement n° 654248). The study funder was not involved in the design of the study; the collection, analysis, and interpretation of data; writing the report; and did not impose any restrictions regarding the publication of the report. Availability of data and materials The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request. A full list of included studies used to identify outcomes is provided in Additional file 1-included studies. Ethics approval and consent to participate Not applicable. Consent for publication Not applicable. Competing interests PRW chairs the COMET Management Group. ==== Refs References 1. Clarke M Williamson PR Core outcome sets and systematic reviews Syst Rev. 2016 5 1 11 10.1186/s13643-016-0188-6 26792080 2. Williamson PR Altman DG Bagley H Barnes KL Blazeby JM Brookes ST The COMET Handbook: version 1.0 Trials. 2017 18 3 280 10.1186/s13063-017-1978-4 28681707 3. Kirkham JJ Clarke M Williamson PR A methodological approach for assessing the uptake of core outcome sets using ClinicalTrials.gov: findings from a review of randomised controlled trials of rheumatoid arthritis BMJ 2017 357 2262 10.1136/bmj.j2262 4. Gargon E Gorst SL Williamson PR Choosing important health outcomes for comparative effectiveness research: 5th annual update to a systematic review of core outcome sets for research PLoS ONE 2019 14 12 e0225980 10.1371/journal.pone.0225980 31830081 5. Leenaars CHC Kouwenaar C Stafleu FR Bleich A Ritskes-Hoitinga M De Vries RBM Animal to human translation: a systematic scoping review of reported concordance rates J Transl Med. 2019 17 1 223 10.1186/s12967-019-1976-2 31307492 6. Hackam DG Redelmeier DA Translation of research evidence from animals to humans JAMA 2006 296 14 1727 1732 10.1001/jama.296.14.1731 7. Sena ES van der Worp HB Bath PMW Howells DW Macleod MR Publication bias in reports of animal stroke studies leads to major overstatement of efficacy PLoS Biol 2010 8 3 e1000344 10.1371/journal.pbio.1000344 20361022 8. Hooijmans CR Ritskes-Hoitinga M Progress in using systematic reviews of animal studies to improve translational research PLOS Med. 2013 10 7 e1001482 10.1371/journal.pmed.1001482 23874162 9. Pound P Ritskes-Hoitinga M Can prospective systematic reviews of animal studies improve clinical translation? J Transl Med. 2020 18 1 15 10.1186/s12967-019-02205-x 31918734 10. Sandercock P Roberts I Systematic reviews of animal experiments Lancet 2002 360 9333 586 10.1016/S0140-6736(02)09812-4 12241927 11. Pound P Ebrahim S Sandercock P Bracken MB Roberts I Where is the evidence that animal research benefits humans? BMJ 2004 328 7438 514 517 10.1136/bmj.328.7438.514 14988196 12. Kilkenny C Browne WJ Cuthill IC Emerson M Altman DG Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research PLoS Biol 2010 8 6 e1000412 10.1371/journal.pbio.1000412 20613859 13. Stroke TA Recommendations for standards regarding preclinical neuroprotective and restorative drug development Stroke 1999 30 12 2752 2758 10.1161/01.STR.30.12.2752 10583007 14. Holman N Young B Gadsby R Current prevalence of Type 1 and Type 2 diabetes in adults and children in the UK Diabetic Med 2015 32 9 1119 1120 10.1111/dme.12791 25962518 15. Unnikrishnan R Pradeepa R Joshi SR Mohan V Type 2 diabetes: demystifying the global epidemic Diabetes 2017 66 6 1432 1442 10.2337/db16-0766 28533294 16. Federation ID. Diabetes Atlas Ninth Edition 2019 2019. https://diabetesatlas.org/en/resources/. Accessed 6 Apr 2020 17. Kleinert M Clemmensen C Hofmann SM Moore MC Renner S Woods SC Animal models of obesity and diabetes mellitus Nat Rev Endocrinol. 2018 14 3 140 162 10.1038/nrendo.2017.161 29348476 18. Neubauer N Kulkarni RN Molecular approaches to study control of glucose homeostasis ILAR J 2006 47 3 199 211 10.1093/ilar.47.3.199 16804195 19. Cefalu WT Animal models of type 2 diabetes: clinical presentation and pathophysiological relevance to the human condition ILAR J 2006 47 3 186 198 10.1093/ilar.47.3.186 16804194 20. Report from the Comission to the European Parliament and the Council. 2019 report on the statistics on the use of animals for scientific purposes in the Member States of the European Union in 2015-2017. COM/2020/16 fina. European Comission 2019. 21. Harman NL James R Wilding J Williamson PR SCORE-IT (Selecting Core Outcomes for Randomised Effectiveness trials In Type 2 diabetes): a systematic review of registered trials Trials. 2017 18 1 597 10.1186/s13063-017-2317-5 29246177 22. Harman NL Wilding JPH Curry D Harris J Logue J Pemberton RJ Selecting Core Outcomes for Randomised Effectiveness trials In Type 2 diabetes (SCORE-IT): a patient and healthcare professional consensus on a core outcome set for type 2 diabetes BMJ Open Diabetes Res Care. 2019 7 1 e000700 10.1136/bmjdrc-2019-000700 23. Dodd S Clarke M Becker L Mavergames C Fish R Williamson PR A taxonomy has been developed for outcomes in medical research to help improve knowledge discovery J Clin Epidemiol 2018 96 84 92 10.1016/j.jclinepi.2017.12.020 29288712 24. Williamson PR Altman DG Blazeby JM Clarke M Devane D Gargon E Developing core outcome sets for clinical trials: issues to consider Trials. 2012 13 132 10.1186/1745-6215-13-132 22867278 25. Little RR Roberts WL A review of variant hemoglobins interfering with hemoglobin A1c measurement J Diabetes Sci Technol. 2009 3 3 446 451 10.1177/193229680900300307 20144281 26. Nathan DM Long-term complications of diabetes mellitus N Engl J Med. 1993 328 23 1676 1685 10.1056/NEJM199306103282306 8487827 27. Ali Z Chandrasekera PC Pippin JJ Animal research for type 2 diabetes mellitus, its limited translation for clinical benefit, and the way forward Alterna Lab Anim. 2018 46 1 13 22 10.1177/026119291804600101 28. Pound P Ritskes-Hoitinga M Is it possible to overcome issues of external validity in preclinical animal research? Why most animal models are bound to fail J Transl Med. 2018 16 1 304 10.1186/s12967-018-1678-1 30404629 29. Dutta S Sengupta P Men and mice: relating their ages Life Sci 2016 152 244 248 10.1016/j.lfs.2015.10.025 26596563 30. Agoston DV How to translate time? The temporal aspect of human and rodent biology Front Neurol. 2017 8 92 10.3389/fneur.2017.00092 28367138 31. Directive’, C., 2010-63-EU, art. 13.3. Directive 2010/63/EU of the European Parliament and of the Council of 22 September 2010 on the protection of animals used for scientific purposes Text with EEA relevance, (2010). 32. Ray MA Johnston NA Verhulst S Trammell RA Toth LA Identification of markers for imminent death in mice used in longevity and aging research J Am Assoc Lab Anim Sci 2010 49 3 282 288 20587157 33. Littin K Acevedo A Browne W Edgar J Mendl M Owen D Towards humane end points: behavioural changes precede clinical signs of disease in a Huntington’s disease model Proc Biol Sci. 2008 275 1645 1865 1874 18460434 34. Adrián Sanz-Moreno PdS-B, Cecilia Prinsen, Caroline Terwee, Michael Raess, Valérie Gailus-Durner, Helmut Fuchs, Martin Hrabe de Angelis. Assessing quality of life, fatigue and wellbeing in mouse models of disease-a systematic review 2018. https://www.crd.york.ac.uk/PROSPERO/display_record.php?RecordID=103507. Accessed 4 Apr 2020. 35. Tsilidis KK Panagiotou OA Sena ES Aretouli E Evangelou E Howells DW Evaluation of excess significance bias in animal studies of neurological diseases PLoS Biol 2013 11 7 e1001609 10.1371/journal.pbio.1001609 23874156 36. Dwan K Altman DG Arnaiz JA Bloom J Chan AW Cronin E Systematic review of the empirical evidence of study publication bias and outcome reporting bias PLoS ONE 2008 3 8 e3081 10.1371/journal.pone.0003081 18769481