They have the ability to simultaneously compare multiple experimental treatments with the standard treatment in order to achieve more reliable results in less time as compared with separate Phase II trials to assess each novel treatment individually. An intermediate outcome measure is used to identify both treatments for which there is an early sign of effectiveness and treatments that appear ineffective thus allowing the study to continue with the promising experimental arms and to stop the investigation of insufficient treatments. Generally, MAMS designs, according to Parmar et al. (2008), are useful when (i) there are multiple promising treatments in phase II/III studies; (ii) there is no strong belief that a treatment will be more beneficial compared to another therapy; (iii) availability of adequate funds; (iv) there is an adequate number of patients to be enrolled and (v) there is an intermediate outcome measure correlated with the primary outcome measure. Parmar et al. (2008) encouraged the use of the MAMS strategy in the field of oncology but highlighted that these designs should only be used when quick outcome assessment is possible.
Alternative names: Adaptive biomarker driven design, Adaptive Analysis, Adaptive Multi-stage designs, Multi-stage
Adaptations: Experimental arms can be dropped for futility from the study
Details
Methodology
- At the interim stage, in the case where the observed effect size in an experimental arm is greater than a predefined critical value, accrual of patients continues within that arm to the second stage of the trial until the pre-specified number of events on the primary outcome (e.g. overall survival) measure is reached, otherwise the accrual of additional patients stops within that arm and the corresponding novel treatment does not enter the second stage of the trial. The aforementioned predefined critical value is calculated for each stage of the study in a way that takes into account whether the null hypothesis can be rejected at the level of the probability of the continuation of the study to the next stage should the null hypothesis be true as Parmar et al. (2008) state.
- The stopping thresholds are based on test statistics, resulting in dropping experimental arms which do not show effectiveness. The allocation to each remaining arm is fixed in MAMS trials, however, it is possible to assign more patients in the control treatment group than to the experimental arms which can yield small gains in efficiency over balanced randomization as Wason and Trippa (2014) highlighted; this strategy has been used in practice with the STAMPEDE trial where the control arm is compared with five experimental treatments with the corresponding randomization ratio 2:1:1:1:1:1. MAMS approach could be designed with either a fixed sample size by fixing the number of patients enrolled at each stage or a fixed number of patients enrolled per arm per stage.
Note 1: The methodology has mainly focused on situations where the primary endpoint is assumed normally distributed or time-to-event. Two papers discuss MAMS designs with the normally distributed endpoint, whilst a time-to-event endpoint is used by Royston et al. (2003). Freely-available software in Stata for calculating sample size was proposed by Barthel et al. (2009) for MAMS trials.
Note 2: A recent article by Wason et al. (2015) proposed a new Bayesian adaptive design for clinical trials with biomarkers and linked treatments in multi-arm phase II trials. It is a novel approach combining the methodology used for BATTLE, I-SPY 2 and FOCUS 4 trial, which results in significant power to identify treatment effects. This novel trial design could be used for simultaneously testing several predictive biomarkers and new experimental treatments in a more cost-effective and rapid way.
Statistical/Practical considerations
Advantages
- Promising treatments are tested concurrently using a smaller number of patients as some treatments arms can be dropped early for futility.
- Reduced costs and time as they assess multiple treatments simultaneously.
- Preferable to continue with the investigation of promising treatments as compared to the conduct of separate single-arm phase II clinical trials.
- The simultaneous assessment of multiple experimental treatments increases the chance of identifying a promising treatment.
- It is unlikely that the trial will stop for futility as multiple experimental treatments are tested and hence, it is not likely that all experimental arms will be ineffective and dropped.
- Can ease the regulatory and administrative burden as compared to building—up separate trials.
- Unpromising experimental arms can be dropped in a quick and reliable way.
Limitations
- High setting-up time due to the complexity caused by logistic issues and collection of experimental drugs from different companies.
- Operational challenges regarding the randomization and the modifications of allocation ratios after the performance of an interim analysis.
Key references
-
Simon R. Clinical trial designs for evaluating the medical utility of prognostic and predictive biomarkers in oncology. Personalized medicine. 2010;7(1):33–47. pmid:20383292 View Article PubMed/NCBI Google Scholar
-
Mandrekar SJ, Sargent DJ. Design of clinical trials for biomarker research in oncology. Clinical investigation. 2011;1(12):1629–36. pmid:22389760 View Article PubMed/NCBI Google Scholar
-
Chow S-C, Chang M. Adaptive design methods in clinical trials—a review. Orphanet journal of rare diseases. 2008;3:11-. pmid:18454853 View Article PubMed/NCBI Google Scholar
-
Berry DA. Bayesian clinical trials. Nature reviews Drug discovery. 2006;5(1):27–36. pmid:16485344 View Article PubMed/NCBI Google Scholar
-
Tajik P, Zwinderman AH, Mol BW, Bossuyt PM. Trial designs for personalizing cancer care: a systematic review and classification. Clinical cancer research: an official journal of the American Association for Cancer Research. 2013;19(17):4578–88. View Article PubMed/NCBI Google Scholar
-
Wason JMS, Trippa L. A comparison of Bayesian adaptive randomization and multi-stage designs for multi-arm clinical trials. Statistics in medicine. 2014;33(13):2206–21. pmid:24421053 View Article PubMed/NCBI Google Scholar
-
Tournoux-Facon C, De Rycke Y, Tubert-Bitter P. Targeting population entering phase III trials: a new stratified adaptive phase II design. Statistics in medicine. 2011;30(8):801–11. pmid:21432875 View Article PubMed/NCBI Google Scholar
-
Sydes MR, Parmar MKB, James ND, Clarke NW, Dearnaley DP, Mason MD, et al. Issues in applying multi-arm multi-stage methodology to a clinical trial in prostate cancer: the MRC STAMPEDE trial. Trials. 2009;10:39-. pmid:19519885 View Article PubMed/NCBI Google Scholar
-
Wason JMS, Jaki T. Optimal design of multi-arm multi-stage trials. Statistics in medicine. 2012;31(30):4269–79. pmid:22826199 View Article PubMed/NCBI Google Scholar
-
Ferraldeschi R, Attard G, de Bono JS. Novel strategies to test biological hypotheses in early drug development for advanced prostate cancer. Clinical chemistry. 2013;59(1):75–84. pmid:23204221 View Article PubMed/NCBI Google Scholar
-
Mandrekar SJ, Sargent DJ. Predictive biomarker validation in practice: lessons from real trials. Clinical Trials. 2010;7(5):567–73. pmid:20392785 View Article PubMed/NCBI Google Scholar
-
Parmar MKB, Barthel FMS, Sydes M, Langley R, Kaplan R, Eisenhauer E, et al. Speeding up the evaluation of new agents in cancer. Journal of the National Cancer Institute. 2008;100(17):1204–14. pmid:18728279 View Article PubMed/NCBI Google Scholar
-
Barthel FMS, Parmar MKB, Royston P. How do multi-stage, multi-arm trials compare to the traditional two-arm parallel group design—a reanalysis of 4 trials. Trials. 2009;10:21-. pmid:19374739 View Article PubMed/NCBI Google Scholar
-
Royston P, Parmar MKB, Qian W. Novel designs for multi-arm clinical trials with survival outcomes with an application in ovarian cancer. Statistics in medicine. 2003;22(14):2239–56. pmid:12854091 View Article PubMed/NCBI Google Scholar
-
Chow S-C, Chang M. Adaptive Design Methods in Clinical Trials, Second Edition Boca Raton, FL: Chapman & Hall/CRC Press Biostatistics Series; 2011.
-
Barthel FMS, Royston P, Parmar MKB. A menu-driven facility for sample-size calculation in novel multiarm, multistage randomized controlled trials with a time-to-event outcome. Stata Journal. 2009;9(4):505–23. View Article PubMed/NCBI Google Scholar
-
Copeland LJ, Bookman M, Trimble E. Clinical trials of newer regimens for treating ovarian cancer: the rationale for Gynecologic Oncology Group Protocol GOG 182-ICON5. Gynecologic oncology. 2003;90(2 Pt 2):S1–7. pmid:12927999 View Article PubMed/NCBI Google Scholar
-
Kaplan R, Maughan T, Crook A, Fisher D, Wilson R, Brown L, et al. Evaluating many treatments and biomarkers in oncology: a new design. Journal of clinical oncology: official journal of the American Society of Clinical Oncology. 2013;31(36):4562–8. View Article PubMed/NCBI Google Scholar
Variations:
Two-stage adaptive seamless design
-
Description: It uses the MAMS approach combining two separate studies into one single study and uses interim monitoring as well as multi-arm design features. It connects the explanatory Phase II stage for treatment selection and confirmatory Phase III stage for the final comparison of the chosen experimental treatments with the standard of care. The Two-stage Adaptive Seamless design aims to improve the power in the Phase II stage in order to continue on the Phase III stage having obtained important promising information. In the definitive analysis, it uses data from patients registered during the Phase II and Phase III stages. A prerequisite of this strategy is the availability of a reliable early endpoint.
-
Alternative Names: Seamless Phase II/III designs, Adaptive Seamless, Phase II/III Adaptive design, Two-stage Adaptive Seamless design, Adaptive Seamless Phase II/III design
-
Methodology Brannath et al. (2009) propose an approach which uses Bayesian decision tools and is based on the two-stage seamless design in order to confirm that the identified biomarker-defined subgroup from a Phase II study is sensitive to the new treatment in a separate explanatory phase (i.e., a study which is conducted at the same time with the two-stage adaptive seamless design) and afterward conduct a Phase III study with this selected subgroup. More precisely, the general procedure of this Phase II/III strategy is presented by Brannath et al. (2009) as follows: When half of individuals are recruited in the study, an interim analysis is performed in order to decide whether to accept or not a biomarker-defined subpopulation identified in a separate exploratory study. At this interim stage, a decision is also made about whether to continue accruing patients from the aforementioned biomarker-defined subset or from the entire study population. If the first case occurs, the treatment effect is assessed only in this biomarker subpopulation and if the second case happens, the treatment effect is tested in the entire population and biomarker-defined subgroup at the same time. In case that there is no identified biomarker-defined subpopulation from the separate exploratory study, the trial continues in the overall population using a classical group sequential design. The major advantage of this type of design is its ability to reduce the costs and also the selection of the target population in a reliable way. Also, appropriate methodology, such as that used by Brannath et al. (2009) where multiple testing is adjusted by a weighted combination of p-value from data of the second stage and the first stage, and Simes’ step-up process is used when combining data form both Phases in order to maintain the Type I error rate. An extension of the above approach by Brannath et al. (2009) is proposed by Jenkins et al. (2011) which can result in the rapid approval of novel treatments to the most appropriate individuals who are likely to benefit from the new drug. During the Phase II trial an interim analysis is conducted using a short-term intermediate outcome measure (i.e., survival endpoint) in order to select the population (either the entire population or the biomarker-positive patients) which will be used in the Phase III study with a long–term endpoint.
Mehta et al. (2014) proposed an alternative seamless approach for subgroup selection in time-to-event-data for situations where there is no a priory assumption that a biomarker is predictive of treatment efficacy; consequently their design tests whether there is treatment effect in both biomarker-negative and biomarker-positive subpopulation separately instead of testing the null hypothesis of no treatment effect in the entire study population and in biomarker-positive subset.
According to Scher et al. (2011), formulas for sample size calculation/allocation are proposed in situations where the study endpoints are continuous, discrete, and contain time-to-event data supposing the availability of a well-established relationship between the study endpoints at different stages, and that the study objectives at different stages are the same. Ang et al. (2010) have stated that even in case that the trial stops early, a Phase III infrastructure should be developed. Such strategies have been proposed by Ellenberg and Eisenberger (1985) and Inoue et al. (2002) for evaluating the possibility to stop early or to continue to the confirmatory phase III repeatedly during the explanatory phase. The aforementioned designs are useful in situations where there is strong belief in the efficacy of the experimental therapy that can lead the study to the confirmatory phase, but confirm of this assumption is needed. Despite the fact that this approach is considered as a more efficient strategy yielding larger power as compared with the conduct of separate trials, it can lead to introduction of bias and inflation of the type I error rate. - Adavantages and limitations:
Advantages | Limitations |
The evaluation of each experimental therapy can be performed without requiring the conduct of separate large-scale Phase II trials. |
A significant concern is that the results obtained from the Phase II analysis, which becomes an interim analysis of the Phase III study should remain in the hands of the data monitoring committee due to confidentiality. |
Flexibility and efficiency of trials can be increased. |
Concerns also arise regarding the efficiency and validity of such a trial design. |
Individuals from both explanatory and confirmatory stages are used in the definitive analysis; hence, the design avoids ‘wasting’ individuals already registered in Phase II setting. |
Sometimes, the endpoints within the different phases are dissimilar, hence, a decision is required on how to combine the data obtained from both stages in order to use them in the definitive analysis. This challenge is further discussed in the paper of Chow et al. (2007). |
Diminishes the potential loss of time between the completion of Phase II stage and the beginning of patient enrollment in Phase III setting. |
According to the Draft Guidance by U.S. Food and Drug Administration (2010), an adaptive seamless phase II/III design is described as a less well-understood design which may introduce bias and inflation of the Type I error rate. |
The same standard of care can be used in both stages of the study. |
Calculation and allocation of the necessary sample size for the two separate studies. |
Can result in the same quality of evidence as in a traditional design but with a smaller number of patients. |
|
Can result in the speedup of drug development and also in a successful Phase III trial. |
|
More efficient due to the improved power and the ability to control the Type I error as compared with the conduct of separate studies. |
|
The required power of both individual studies may be acquired by using a smaller number of patients than that of a single study. |
|
Two separate trials (Phase II and Phase III) are conducted under one single trial protocol, but in reality, researchers analyze them separately using data from each stage, resulting in this way in savings of time and cost. |
- References:
Mandrekar SJ, Sargent DJ. Design of clinical trials for biomarker research in oncology. Clinical investigation. 2011;1(12):1629–36. pmid:22389760 View Article PubMed/NCBI Google Scholar
Bradley E. Incorporating biomarkers into clinical trial designs: points to consider. Nature biotechnology. 2012;30(7):596–9. pmid:22781677 View Article PubMed/NCBI Google Scholar
Chow S-C. Adaptive clinical trial design. Annual review of medicine. 2014;65:405–15. pmid:24422576 View Article PubMed/NCBI Google Scholar
Brannath W, Zuber E, Branson M, Bretz F, Gallo P, Posch M, et al. Confirmatory adaptive designs with Bayesian decision tools for a targeted therapy in oncology. Statistics in medicine. 2009;28(10):1445–63. pmid:19266565 View Article PubMed/NCBI Google Scholar
Chow S-C, Tu Y-H. On Two-stage Seamless Adaptive Design in Clinical Trials. Journal of the Formosan Medical Association = Taiwan yi zhi. 2008;107(12 Suppl):52–60. pmid:19129046 View Article PubMed/NCBI Google Scholar
Chow S-C, Chang M. Adaptive design methods in clinical trials—a review. Orphanet journal of rare diseases. 2008;3:11-. pmid:18454853 View Article PubMed/NCBI Google Scholar
Kairalla JA, Coffey CS, Thomann MA, Muller KE. Adaptive trial designs: a review of barriers and opportunities. Trials. 2012;13:145-. pmid:22917111 View Article PubMed/NCBI Google Scholar
Ananthakrishnan R, Menon S. Design of oncology clinical trials: a review. Critical reviews in oncology/hematology. 2013;88(1):144–53. pmid:23623356 View Article PubMed/NCBI Google Scholar
Dragalin V. An introduction to adaptive designs and adaptation in CNS trials. European neuropsychopharmacology: the journal of the European College of Neuropsychopharmacology. 2011;21(2):153–8. View Article PubMed/NCBI Google Scholar
Coffey CS, Kairalla JA. Adaptive clinical trials: progress and challenges. Drugs in R&D. 2008;9(4):229–42. View Article PubMed/NCBI Google Scholar
Freidlin B, Korn EL. Biomarker-adaptive clinical trial designs. Pharmacogenomics. 2010;11(12):1679–82. pmid:21142910 View Article PubMed/NCBI Google Scholar
Ang M-K, Tan S-B, Lim W-T. Phase II clinical trials in oncology: are we hitting the target? Expert review of anticancer therapy. 2010;10(3):427–38. pmid:20214523 View Article PubMed/NCBI Google Scholar
Berry DA. Adaptive clinical trials in oncology. Nature reviews Clinical oncology. 2012;9(4):199–207. View Article PubMed/NCBI Google Scholar
Scher HI, Nasso SF, Rubin EH, Simon R. Adaptive clinical trial designs for simultaneous testing of matched diagnostics and therapeutics. Clinical cancer research: an official journal of the American Association for Cancer Research. 2011;17(21):6634–40. View Article PubMed/NCBI Google Scholar
Simon R. Biomarker based clinical trial design. Chinese clinical oncology. 2014;3(3):39-. pmid:25841465 View Article PubMed/NCBI Google Scholar
Lai TL, Liao OY-W, Kim DW. Group sequential designs for developing and testing biomarker-guided personalized therapies in comparative effectiveness research. Contemporary clinical trials. 2013;36(2):651–63. pmid:23994669 View Article PubMed/NCBI Google Scholar
Emerson SS, Fleming TR. Adaptive methods: telling "the rest of the story". Journal of biopharmaceutical statistics. 2010;20(6):1150–65. pmid:21058111 View Article PubMed/NCBI Google Scholar
Sydes MR, Parmar MKB, James ND, Clarke NW, Dearnaley DP, Mason MD, et al. Issues in applying multi-arm multi-stage methodology to a clinical trial in prostate cancer: the MRC STAMPEDE trial. Trials. 2009;10:39-. pmid:19519885 View Article PubMed/NCBI Google Scholar
Jennison C, Turnbull BW. Adaptive seamless designs: selection and prospective testing of hypotheses. Journal of biopharmaceutical statistics. 2007;17(6):1135–61. pmid:18027222 View Article PubMed/NCBI Google Scholar
Barker AD, Sigman CC, Kelloff GJ, Hylton NM, Berry DA, Esserman LJ. I-SPY 2: an adaptive breast cancer trial design in the setting of neoadjuvant chemotherapy. Clinical pharmacology and therapeutics. 2009;86(1):97–100. pmid:19440188 View Article PubMed/NCBI Google Scholar
Jenkins M, Stone A, Jennison C. An adaptive seamless phase II/III design for oncology trials with subpopulation selection using correlated survival endpoints. Pharmaceutical statistics. 2011;10(4):347–56. pmid:22328327 View Article PubMed/NCBI Google Scholar
Mehta C, Schäfer H, Daniel H, Irle S. Biomarker driven population enrichment for adaptive oncology trials with time to event endpoints. Statistics in Medicine. 2014;33(26):4515–31. pmid:25130879 View Article PubMed/NCBI Google Scholar
Ellenberg SS, Eisenberger MA. An efficient design for phase III studies of combination chemotherapies. Cancer treatment reports. 1985;69(10):1147–54. pmid:4042093 View Article PubMed/NCBI Google Scholar
Freidlin B, McShane LM, Polley M-YC, Korn EL. Randomized phase II trial designs with biomarkers. Journal of clinical oncology: official journal of the American Society of Clinical Oncology. 2012;30(26):3304–9. View Article PubMed/NCBI Google Scholar
Wang S-J. Utility of adaptive strategy and adaptive design for biomarker-facilitated patient selection in pharmacogenomic or pharmacogenetic clinical development program. Journal of the Formosan Medical Association = Taiwan yi zhi. 2008;107(12 Suppl):19–27. pmid:19129042 View Article PubMed/NCBI Google Scholar
Wang S-J, Hung HMJ, O'Neill R. Adaptive design clinical trials and trial logistics models in CNS drug development. European neuropsychopharmacology: the journal of the European College of Neuropsychopharmacology. 2011;21(2):159–66. View Article PubMed/NCBI Google Scholar
Tudur Smith C, Williamson PR, Beresford MW. Methodology of clinical trials for rare diseases. Best practice & research Clinical rheumatology. 2014;28(2):247–62. View Article PubMed/NCBI Google Scholar
Chow S-C, Lu Q, Tse S-K. Statistical analysis for two-stage adaptive design with different study points. Journal of biopharmaceutical statistics. 2007;17(6):1163–76. View Article PubMed/NCBI Google Scholar
U.S.Food and Drug Administration. Draft Guidance for Industry—Adaptive Design Clinical Trials for Drugs and Biologics.: U.S. Food Drug Admin, Rockville, MD; 2010 [cited 2015 10 Oct]. Available from: http://www.fda.gov/downloads/Drugs/…/Guidances/ucm201790.pdf.
Group Sequential design
-
Description: This strategy aims to find the most beneficial treatment for future patients based on their biomarker profiles, with a guaranteed probability of correct selection. It was proposed for the examination of multiple composite hypotheses not only in the entire study population but also in the biomarker-positive subgroups. The design is based on approved treatments, and aims to improve patient’s health by providing them with the most efficacious (yet unidentified) treatment. Additionally, another crucial objective of this approach is that the development of a novel treatment strategy for the forthcoming patients and the confirmation that the treatment effect of this strategy is in fact more effective than the historical mean effect of the control treatment plus a predetermined threshold.
According to Lai et al. (2013), it is an approach for “jointly developing and testing treatment recommendations for biomarker classes, while using multi-armed bandit ideas to provide sequentially optimizing treatments to patients in the trial”. According to an interim data analysis, sequential decisions about whether to continue the study or not, are taken. It is considered a simple approach where selection of cut-off points is not required before the conduct of the first interim analysis. - Alternative names: No alternative names found for this trial deisgn
- Adavantages and limitations:
Advantages | Limitations |
Researchers do not have to choose the cut-off points which should be used to designate the biomarker classes until the performance of the first interim analysis. |
No information found |
Non-promising treatments can be dropped at an early stage. |
|
- References:
Lai TL, Liao OY-W, Kim DW. Group sequential designs for developing and testing biomarker-guided personalized therapies in comparative effectiveness research. Contemporary clinical trials. 2013;36(2):651–63. pmid:23994669 View Article PubMed/NCBI Google Scholar
Lin J-A, He P. Reinventing clinical trials: a review of innovative biomarker trial designs in cancer therapies. British medical bulletin. 2015;114(1):17–27. pmid:25921239 View Article PubMed/NCBI Google Scholar