#set document(title: "13.5 Factors Affecting Power", author: "OpenStax") #set page(width: 8.5in, height: auto, margin: 1in) #import "@preview/cetz:0.5.2" #set text(font: ("STIX Two Text", "Libertinus Serif", "New Computer Modern"), size: 10.5pt, lang: "en") #show math.equation: set text(font: ("STIX Two Math", "New Computer Modern Math")) #set par(justify: true, leading: 0.62em, spacing: 0.9em) #set enum(spacing: 1.1em) // room between list items so tall inline fractions don't collide #set list(spacing: 1.1em) #set table(stroke: 0.5pt + rgb("#c7ccd3")) #let BLUE = rgb("#183B6F") // brand navy — section bars + example/solution labels (white on navy 11.09:1) #let ORANGE = rgb("#A94509") // brand primary-700 — AA-safe deep orange for TEXT (5.93:1 on white; raw brand #F37021 is 2.94:1 and must never carry text) #let RED = rgb("#DC2626") // brand error-600 #let GREEN = rgb("#059669") // brand success-600 (decoration only; small green text uses green-text #007942) #show heading.where(level: 1): it => block(width: 100%, above: 0pt, below: 16pt, fill: gradient.linear(BLUE, rgb("#2C5AA0")), inset: (x: 14pt, y: 12pt), radius: 3pt, text(fill: white, weight: "bold", size: 19pt, it.body)) #show heading.where(level: 2): it => block(width: 100%, above: 18pt, below: 10pt, fill: BLUE, inset: (x: 10pt, y: 6pt), radius: 2pt, text(fill: white, weight: "bold", size: 12pt, it.body)) #show heading.where(level: 3): it => text(fill: ORANGE, weight: "bold", size: 12.5pt, it.body) #show heading.where(level: 4): it => text(fill: BLUE, weight: "bold", size: 10.5pt, it.body) #let examplebox(label, title, body) = block(width: 100%, breakable: true, fill: rgb("#EFF1F5"), stroke: 0.5pt + rgb("#CFDDF0"), radius: 4pt, inset: 10pt, above: 12pt, below: 12pt)[ #block(below: 6pt)[#box(fill: BLUE, inset: (x: 6pt, y: 2pt), radius: 2pt, text(fill: white, weight: "bold", size: 8.5pt, label)) #h(0.4em) #strong[#title]] #body] // rail = decorative left rule (raw brand token); labelcolor = AA-safe label text shade #let notebox(label, rail, labelcolor, tint, body) = block(width: 100%, breakable: true, fill: tint, stroke: (left: 3pt + rail), inset: (left: 10pt, rest: 8pt), radius: (right: 4pt), above: 11pt, below: 11pt)[ #text(fill: labelcolor, weight: "bold", size: 7.5pt, tracking: 0.5pt)[#upper(label)] #linebreak() #body] #let solutionbox(body) = block(above: 4pt, below: 8pt)[ #text(fill: BLUE, weight: "bold", size: 8.5pt)[Solution] #linebreak() #body] #let figph(msg) = block(width: 100%, height: 60pt, fill: rgb("#f6f7f9"), stroke: (paint: rgb("#c7ccd3"), dash: "dashed"), radius: 4pt, inset: 10pt)[ #align(center + horizon, text(fill: rgb("#889"), style: "italic", size: 9pt, msg))] // Standardize inlined figure sizes: measure the natural CeTZ canvas, then scale to a // consistent envelope (aspect-aware; see build_typst.py FIG_* constants). Unlike the // print preamble, dimensions are FLOORED: in an editor a user can trim a figure to a // degenerate 1-D shape (a bare line), and w/h or tw/w would then divide by zero. #let _STD_W = 3.5 #let _WIDE_W = 5.6 #let _MAX_H = 3.4 #let _ASPECT_WIDE = 2.2 #let _UPSCALE_MAX = 1.15 #let stdfig(body) = context { let m = measure(body) let w = calc.max(m.width / 1in, 0.01) let h = calc.max(m.height / 1in, 0.01) let tw = if w / h > _ASPECT_WIDE { _WIDE_W } else { _STD_W } let s = calc.min(tw / w, _MAX_H / h, _UPSCALE_MAX) align(center, box(scale(x: s * 100%, y: s * 100%, reflow: true, body))) } #show figure: set block(breakable: false) #set figure(gap: 8pt) #show figure.caption: set text(size: 8.5pt, fill: rgb("#555")) == 13.5#h(0.6em)Factors Affecting Power #notebox("Note", rgb("#8a94a6"), rgb("#556666"), rgb("#f7f8fa"))[ #emph[Prerequisites] Introduction to Power, Example Calculations, Significance Testing, Type I and Type II Errors, One- and Two-Tailed Tests #linebreak() #linebreak() ] #notebox("Note", rgb("#8a94a6"), rgb("#556666"), rgb("#f7f8fa"))[ #emph[Learning Objectives] + State five factors affecting power + State what the effect of each of the factors is ] Several factors affect the power of a statistical test. Some of the factors are under the control of the experimenter, whereas others are not. The following example will be used to illustrate the various factors. Suppose a math achievement test were known to be normally distributed with a mean of 75 and a standard deviation of σ. A researcher is interested in whether a new method of teaching results in a higher mean. Assume that although the experimenter does not know it, the population mean μ for the new method is larger than 75. The researcher plans to sample N subjects and do a one-tailed test of whether the sample mean is significantly higher than 75. In this section, we consider factors that affect the probability that the researcher will correctly reject the false null hypothesis that the population mean is 75 or lower. In other words, factors that affect power. === Sample Size Figure 1 shows that the larger the sample size, the higher the power. Since sample size is typically under an experimenter's control, increasing sample size is one way to increase power. However, it is sometimes difficult and/or expensive to use a large sample size. #figure(figph[Line graph of power (y-axis 0 to 1.00) against sample size N (x-axis 1 to 70) for H0: μ = 75, real μ = 80, one-tailed α = 0.05. Two rising, concave curves: the blue σ = 10 curve climbs from about 0.13 at N = 1 through 0.91 near N = 36 to 0.99 at N = 70; the red σ = 15 curve stays below it throughout, reaching only about 0.87 at N = 70. Power rises with sample size and falls as the standard deviation grows.], alt: "Line graph of power (y-axis 0 to 1.00) against sample size N (x-axis 1 to 70) for H0: μ = 75, real μ = 80, one-tailed α = 0.05. Two rising, concave curves: the blue σ = 10 curve climbs from about 0.13 at N = 1 through 0.91 near N = 36 to 0.99 at N = 70; the red σ = 15 curve stays below it throughout, reaching only about 0.87 at N = 70. Power rises with sample size and falls as the standard deviation grows.", caption: [Figure 1. The relationship between sample size and power for H#sub[0]: μ = 75, real μ = 80, one-tailed α = 0.05, for σ's of 10 and 15.]) === Standard Deviation Figure 1 also shows that power is higher when the standard deviation is small than when it is large. For all values of N, power is higher for the standard deviation of 10 than for the standard deviation of 15 (except, of course, when N = 0). Experimenters can sometimes control the standard deviation by sampling from a homogeneous population of subjects, by reducing random measurement error, and/or by making sure the experimental procedures are applied very consistently. === Difference between Hypothesized and True Mean Naturally, the larger the effect size, the more likely it is that an experiment would find a significant effect. Figure 2 shows the effect of increasing the difference between the mean specified by the null hypothesis (75) and the population mean μ for standard deviations of 10 and 15. #figure(figph[Line graph of power (y-axis 0 to 1.00) against the true population mean μ (x-axis 76 to 90) for H0: μ = 75, one-tailed α = 0.05. Two S-shaped curves rise together from near 0.08 at μ = 76: the blue σ = 10 curve reaches essentially 1.00 by μ = 88, while the red σ = 15 curve lags, reaching only about 0.93 at μ = 90. The larger the gap between the hypothesized and true mean, the higher the power.], alt: "Line graph of power (y-axis 0 to 1.00) against the true population mean μ (x-axis 76 to 90) for H0: μ = 75, one-tailed α = 0.05. Two S-shaped curves rise together from near 0.08 at μ = 76: the blue σ = 10 curve reaches essentially 1.00 by μ = 88, while the red σ = 15 curve lags, reaching only about 0.93 at μ = 90. The larger the gap between the hypothesized and true mean, the higher the power.", caption: [Figure 2. The relationship between μ and power for H#sub[0]: μ = 75, one-tailed α = 0.05, for σ's of 10 and 15.]) === Significance Level There is a trade-off between the significance level and power: the more stringent (lower) the significance level, the lower the power. Figure 3 shows that power is lower for the 0.01 level than it is for the 0.05 level. Naturally, the stronger the evidence needed to reject the null hypothesis, the lower the chance that the null hypothesis will be rejected. #figure(figph[Line graph of power (y-axis 0 to 1.00) against sample size N (x-axis 1 to 70) for μ = 75, real μ = 80, σ = 10, comparing significance levels. The blue α = 0.05 curve rises from about 0.13 at N = 1 to 0.99 at N = 70; the red α = 0.01 curve starts far lower, about 0.03, and is still below it at 0.97 at N = 70. A more stringent significance level costs power.], alt: "Line graph of power (y-axis 0 to 1.00) against sample size N (x-axis 1 to 70) for μ = 75, real μ = 80, σ = 10, comparing significance levels. The blue α = 0.05 curve rises from about 0.13 at N = 1 to 0.99 at N = 70; the red α = 0.01 curve starts far lower, about 0.03, and is still below it at 0.97 at N = 70. A more stringent significance level costs power.", caption: [Figure 3. The relationship between significance level and power with one-tailed tests: μ = 75, real μ = 80, and σ = 10.]) === One- versus Two-Tailed Tests Power is higher with a one-tailed test than with a two-tailed test as long as the hypothesized direction is correct. A one-tailed test at the 0.05 level has the same power as a two-tailed test at the 0.10 level. A one-tailed test, in effect, raises the significance level.