The SEQDESIGN Procedure

One-Sided Fixed-Sample Tests in Clinical Trials

A one-sided test has either an upper (greater) or a lower (lesser) alternative. This section describes one-sided tests with upper alternatives only. Corresponding results for one-sided tests with lower alternatives can be derived similarly.

For a one-sided test of upper H 0 colon delta less-than-or-equal-to delta 0 with an upper alternative upper H 1 colon delta greater-than delta 0, an equivalent null hypothesis is upper H 0 colon theta less-than-or-equal-to 0 with an upper alternative upper H 1 colon theta greater-than 0, where theta equals delta minus delta 0. A fixed-sample test rejects upper H 0 if the standardized test statistic upper Z 0 equals ModifyingAbove theta With caret StartRoot upper I 0 EndRoot greater-than-or-equal-to upper C Subscript alpha, where ModifyingAbove theta With caret is the sample estimate of theta and upper C Subscript alpha Baseline equals normal upper Phi Superscript negative 1 Baseline left-parenthesis 1 minus alpha right-parenthesis is the critical value.

The p-value of the test is given by 1 minus normal upper Phi left-parenthesis upper Z 0 right-parenthesis, and the hypothesis upper H 0 is rejected if the p-value is less than alpha. An upper left-parenthesis 1 minus alpha right-parenthesis confidence interval has the lower limit

theta Subscript l Baseline equals ModifyingAbove theta With caret minus StartFraction normal upper Phi Superscript negative 1 Baseline left-parenthesis 1 minus alpha right-parenthesis Over StartRoot upper I 0 EndRoot EndFraction equals StartFraction upper Z 0 minus normal upper Phi Superscript negative 1 Baseline left-parenthesis 1 minus alpha right-parenthesis Over StartRoot upper I 0 EndRoot EndFraction

The hypothesis upper H 0 is rejected if the confidence interval for the parameter theta does not contain zero—that is, if the lower limit theta Subscript l is greater than 0.

With an alternative reference theta equals theta 1, theta 1 greater-than 0, a Type II error probability is defined as

beta equals upper P Subscript theta equals theta 1 Baseline left-parenthesis upper Z 0 less-than upper C Subscript alpha Baseline right-parenthesis

which is equivalent to

beta equals upper P Subscript theta equals theta 1 Baseline left-parenthesis upper Z 0 minus theta 1 StartRoot upper I 0 EndRoot less-than upper C Subscript alpha Baseline minus theta 1 StartRoot upper I 0 EndRoot right-parenthesis equals normal upper Phi left-parenthesis upper C Subscript alpha Baseline minus theta 1 StartRoot upper I 0 EndRoot right-parenthesis

Thus, normal upper Phi Superscript negative 1 Baseline left-parenthesis beta right-parenthesis equals upper C Subscript alpha Baseline minus theta 1 StartRoot upper I 0 EndRoot. Then, with upper C Subscript alpha Baseline equals normal upper Phi Superscript negative 1 Baseline left-parenthesis 1 minus alpha right-parenthesis,

theta 1 StartRoot upper I 0 EndRoot equals normal upper Phi Superscript negative 1 Baseline left-parenthesis 1 minus alpha right-parenthesis plus normal upper Phi Superscript negative 1 Baseline left-parenthesis 1 minus beta right-parenthesis

The drift parameter theta 1 StartRoot upper I 0 EndRoot can be computed for specified alpha and beta and the maximum information is given by

upper I 0 equals left-parenthesis StartFraction normal upper Phi Superscript negative 1 Baseline left-parenthesis 1 minus alpha right-parenthesis plus normal upper Phi Superscript negative 1 Baseline left-parenthesis 1 minus beta right-parenthesis Over theta 1 EndFraction right-parenthesis squared

If the maximum information is available, then the required sample size can be derived. For example, in a one-sample test for the mean with a specific standard deviation sigma, the sample size n required for the test is

n equals sigma squared upper I 0 equals sigma squared left-parenthesis StartFraction normal upper Phi Superscript negative 1 Baseline left-parenthesis 1 minus alpha right-parenthesis plus normal upper Phi Superscript negative 1 Baseline left-parenthesis 1 minus beta right-parenthesis Over theta 1 EndFraction right-parenthesis squared

On the other hand, if the alternative reference theta 1, standard deviation sigma, and sample size n are all specified, then alpha can be derived for a given beta and, similarly, beta can be derived for a given alpha.

With an alternative reference theta equals theta 1, theta 1 greater-than 0, the power 1 minus beta is the probability of correctly rejecting the null hypothesis upper H 0 at theta 1:

1 minus beta equals 1 minus upper P Subscript theta equals theta 1 Baseline left-parenthesis upper Z 0 less-than upper C Subscript alpha Baseline right-parenthesis equals normal upper Phi left-parenthesis theta 1 StartRoot upper I 0 EndRoot minus upper C Subscript alpha Baseline right-parenthesis

Superiority Trials

A superiority trial that tests the response to a new drug is clinically superior to a comparative placebo control or active control therapy. If a positive value indicates a beneficial effect, a test for superiority has

upper H 0 colon theta less-than-or-equal-to 0 upper H 1 colon theta greater-than 0

where upper H 0 is the hypothesis of nonsuperiority and upper H 1 is the alternative hypothesis of superiority.

The superiority test rejects the hypothesis upper H 0 and declares superiority if the standardized statistic upper Z 0 equals ModifyingAbove theta With caret StartRoot upper I 0 EndRoot greater-than-or-equal-to upper C Subscript alpha, where the critical value upper C Subscript alpha Baseline equals normal upper Phi Superscript negative 1 Baseline left-parenthesis 1 minus alpha right-parenthesis.

For example, if theta is the response difference between the treatment and placebo control groups, then a superiority trial can be

upper H 0 colon theta less-than-or-equal-to 0 upper H 1 colon theta equals 6

with a Type I error probability level alpha equals 0.025 and a power 1 minus beta equals 0.90 at theta 1 equals 6.

Noninferiority Trials

A noninferiority trial does not compare the response to a new treatment with the response to a placebo. Instead, it demonstrates the effectiveness of a new treatment compared with that of a nonexisting placebo by showing that the response of a new treatment is not clinically inferior to the response of a standard therapy with an established effect. That is, this type of trial attempts to demonstrate that the new treatment effect is not worse than the standard therapy effect by an acceptable margin. These trials are often performed when there is an existing effective therapy for a serious disease, and therefore a placebo control group cannot be ethically included.

It can be difficult to specify an appropriate noninferiority margin. One practice is to choose with reference to the effect of the active control in historical placebo-controlled trials (Snapinn 2000, p. 20). With this practice, there is some basis to imply that the new treatment is better than the placebo for a positive noninferiority trial.

If a positive value indicates a beneficial effect, a test for noninferiority has a null hypothesis delta less-than-or-equal-to minus delta 0 and an alternative hypothesis delta equals delta 1 greater-than minus delta 0, where delta 0 greater-than 0 is the specified noninferiority margin.

An equivalent test has

upper H 0 colon theta less-than-or-equal-to 0 upper H 1 colon theta equals theta 1 greater-than 0

where the parameter theta equals delta plus delta 0, upper H 0 is the null hypothesis of inferiority, and upper H 1 is the alternative hypothesis of noninferiority,

The noninferiority test rejects the hypothesis upper H 0 and declares noninferiority if the standardized statistic upper Z 0 equals ModifyingAbove theta With caret StartRoot upper I 0 EndRoot equals left-parenthesis ModifyingAbove delta With caret plus delta 0 right-parenthesis StartRoot upper I 0 EndRoot greater-than-or-equal-to upper C Subscript alpha, where the critical value upper C Subscript alpha Baseline equals normal upper Phi Superscript negative 1 Baseline left-parenthesis 1 minus alpha right-parenthesis.

For example, if delta is the response difference between the treatment and active control groups and delta 0 equals 2 is the noninferiority margin, then a noninferiority trial with a power 1 minus beta equals 0.90 at delta 1 equals 1 might be

upper H 0 colon theta less-than-or-equal-to 0 upper H 1 colon theta equals 3

where theta equals delta plus delta 0 equals delta plus 2.

Last updated: December 09, 2022