Skip to main content
\(\newcommand{\dollar}{\$} \DeclareMathOperator{\erf}{erf} \DeclareMathOperator{\arctanh}{arctanh} \newcommand{\lt}{<} \newcommand{\gt}{>} \newcommand{\amp}{&} \)

Section7.3Convergence of Series

Motivating Questions
  • What is an infinite series?

  • What is the \(n\)th partial sum of an infinite series?

  • How do we add up an infinite number of numbers? In other words, what does it mean for an infinite series of real numbers to converge?

  • What does it mean for an infinite series of real numbers to diverge?

  • What are some ways to tell whether a series converges or diverges?

In Section7.2, we encountered infinite geometric series. For example, by writing

\begin{equation*} N = 0.1212121212 \cdots = \frac{12}{100} + \frac{12}{100} \cdot \frac{1}{100} + \frac{12}{100} \cdot \frac{1}{100^2} + \cdots \end{equation*}

as a geometric series, we found a way to write \(N\) as a single fraction: \(N = \frac{4}{33}\text{.}\) In this section, we explore other types of infinite sums. In Example7.20 we see how one such sum is related to the famous number \(e\text{.}\)

Example7.20

Have you ever wondered how your calculator can produce a numeric approximation for complicated numbers like \(e\text{,}\) \(\pi\) or \(\ln(2)\text{?}\) After all, the only operations a calculator can really perform are addition, subtraction, multiplication, and division, the operations that make up polynomials. This example provides the first steps in understanding how this process works. Throughout the example, let \(f(x) = e^x\text{.}\)

  1. Find the tangent line to \(f\) at \(x=0\) and use this linearization to approximate \(e\text{.}\) That is, find a formula \(L(x)\) for the tangent line, and compute \(L(1)\text{,}\) since \(L(1) \approx f(1) = e\text{.}\)

  2. The linearization of \(e^x\) does not provide a good approximation to \(e\) since 1 is not very close to 0. To obtain a better approximation, we alter our approach a bit. Instead of using a straight line to approximate \(e\text{,}\) we put an appropriate bend in our estimating function to make it better fit the graph of \(e^x\) for \(x\) close to 0. With the linearization, we had both \(f(x)\) and \(f'(x)\) share the same value as the linearization at \(x=0\text{.}\) We will now use a quadratic approximation \(P_2(x)\) to \(f(x) = e^x\) centered at \(x=0\) which has the property that \(P_2(0) = f(0)\text{,}\) \(P'_2(0) = f'(0)\text{,}\) and \(P''_2(0) = f''(0)\text{.}\)

    1. Let \(P_2(x) = 1+x+\frac{x^2}{2}\text{.}\) Show that \(P_2(0) = f(0)\text{,}\) \(P'_2(0) = f'(0)\text{,}\) and \(P''_2(0) = f''(0)\text{.}\) Then, use \(P_2(x)\) to approximate \(e\) by observing that \(P_2(1) \approx f(1)\text{.}\)

    2. We can continue approximating \(e\) with polynomials of larger degree whose higher derivatives agree with those of \(f\) at 0. This turns out to make the polynomials fit the graph of \(f\) better for more values of \(x\) around 0. For example, let \(P_3(x) = 1+x+\frac{x^2}{2}+\frac{x^3}{6}\text{.}\) Show that \(P_3(0) = f(0)\text{,}\) \(P'_3(0) = f'(0)\text{,}\) \(P''_3(0) = f''(0)\text{,}\) and \(P'''_3(0) = f'''(0)\text{.}\) Use \(P_3(x)\) to approximate \(e\) in a way similar to how you did so with \(P_2(x)\) above.

Solution
  1. The linearization of \(f\) at \(x=a\) is

    \begin{equation*} f(a) + f'(a)(x-a)\text{,} \end{equation*}

    so the linearization \(P_1(x)\) of \(f(x) = e^x\) at \(x=0\) is

    \begin{equation*} P_1(x) = e^0 + e^0(x-0) = 1+x\text{.} \end{equation*}

    Now

    \begin{equation*} f(x) \approx P_1(x) \end{equation*}

    for \(x\) close to \(0\) and so

    \begin{equation*} e = e^1 \approx P_1(1) = 1+1 = 2\text{.} \end{equation*}
    1. The derivatives of \(P_2\) and \(f\) are

      \begin{align*} P_2(x) \amp = 1+x+\frac{x^2}{2} \amp f(x) \amp = e^x\\ P'_2(x) \amp = 1 + x \amp f'(x) \amp = e^x\\ P''_2(x) \amp = 1 \amp f''(x) \amp = e^x\text{,} \end{align*}

      and so the derivatives of \(P_2\) and \(f\) evaluated at 0 are

      \begin{align*} P_2(0) \amp = 1 \amp f(0) \amp = e^0 = 1\\ P'_2(0) \amp = 1 \amp f'(0) \amp = e^0 = 1\\ P''_2(0) \amp = 1 \amp f''(0) \amp = e^0 = 1\text{.} \end{align*}

      Then

      \begin{equation*} e = e^1 \approx P_2(1) = 1 + 1 + \frac{1}{2} = 2.5\text{.} \end{equation*}
    2. The derivatives of \(P_3\) and \(f\) are

      \begin{align*} P_3(x) \amp = 1+x+\frac{x^2}{2}+\frac{x^3}{6} \amp f(x) \amp = e^x\\ P'_3(x) \amp = 1 + x +\frac{x^2}{2} \amp f'(x) \amp = e^x\\ P''_3(x) \amp = 1+x \amp f''(x) \amp = e^x\\ P'''_3(x) \amp = 1 \amp f'''(x) \amp = e^x\text{,} \end{align*}

      and so the derivatives of \(P_2\) and \(f\) evaluated at 0 are

      \begin{align*} P_3(0) \amp = 1 \amp f(0) \amp = e^0 = 1\\ P'_3(0) \amp = 1 \amp f'(0) \amp = e^0 = 1\\ P''_3(0) \amp = 1 \amp f''(0) \amp = e^0 = 1\\ P'''_3(0) \amp = 1 \amp f'''(0) \amp = e^0 = 1\text{.} \end{align*}

      Then

      \begin{equation*} e = e^1 \approx P_3(1) = 1 + 1 + \frac{1}{2} + \frac{1}{6} = \frac{8}{3} \approx 2.67\text{.} \end{equation*}

SubsectionInfinite Series

Example7.20 shows that an approximation to \(e\) using a linear polynomial is 2, an approximation to \(e\) using a quadratic polynomial is \(2.5\text{,}\) and an approximation using a cubic polynomial is 2.6667. If we continue this process we can obtain approximations from quartic (degree 4) and quintic (degree 5) polynomials, giving us the following approximations to \(e\text{:}\)

linear \(1 + 1\) \(2\)
quadratic \(1 +1 + \frac{1}{2}\) \(2.5\)
cubic \(1 + 1 + \frac{1}{2} + \frac{1}{6}\) \(2.\overline{6}\)
quartic \(1 + 1 + \frac{1}{2} + \frac{1}{6} + \frac{1}{24}\) \(2.708\overline{3}\)
quintic \(1 + 1 + \frac{1}{2} + \frac{1}{6} + \frac{1}{24} + \frac{1}{120}\) \(2.71\overline{6}\)

We see an interesting pattern here. The number \(e\) is being approximated by the sum

\begin{equation} 1+1+\frac{1}{2} + \frac{1}{6} + \frac{1}{24} + \frac{1}{120} + \cdots + \frac{1}{n!}\label{eq-8-3-e-n}\tag{7.11} \end{equation}

for increasing values of \(n\text{.}\)

We can use summation notation as a shorthand6Note that \(0!\) appears in Equation(7.12). By definition, \(0! = 1\text{.}\) for writing the sum in Equation(7.11) to get

\begin{equation} e \approx 1+1+\frac{1}{2} + \frac{1}{6} + \frac{1}{24} + \frac{1}{120} + \cdots + \frac{1}{n!} = \sum_{k=0}^n \frac{1}{k!}\text{.}\label{eq-8-3-e}\tag{7.12} \end{equation}

We can calculate this sum using as large an \(n\) as we want, and the larger \(n\) is the more accurate the approximation (7.12) is. This suggests that we can write the number \(e\) as the infinite sum

\begin{equation} e = \sum_{k=0}^{\infty} \frac{1}{k!}\text{.}\label{eq-8-3-e-infinite}\tag{7.13} \end{equation}

This sum is an example of an infinite series. Note that the series(7.13) is the sum of the terms of the infinite sequence \(\left\{\frac{1}{n!}\right\}\text{.}\) In general, we use the following notation and terminology.

Infinite Series

An infinite series of real numbers is the sum of the entries in an infinite sequence of real numbers. In other words, an infinite series is sum of the form

\begin{equation*} a_1+a_2+ \cdots + a_n + \cdots = \sum_{k=1}^{\infty} a_k\text{,} \end{equation*}

where \(a_1\text{,}\) \(a_2\text{,}\) \(\ldots\text{,}\) are real numbers.

We use summation notation to identify a series. If the series adds the entries of a sequence \(\{a_n\}_{n \geq 1}\text{,}\) we will write the series as

\begin{equation*} \sum_{k \geq 1} a_k \end{equation*}

or

\begin{equation*} \sum_{k=1}^{\infty} a_k\text{.} \end{equation*}

Each of these notations is simply shorthand for the infinite sum \(a_1 + a_2 + \cdots + a_n + \cdots\text{.}\)

Is it even possible to sum an infinite list of numbers? That doing so is possible in some situations shouldn't come as a surprise. The definite integral is the sum of an infinite collections of numbers, and we have already examined the special case of geometric series in the previous section. As we investigate other infinite sums, there are two key questions we seek to answer: (1) is the sum finite? and (2) if yes, what is its value?

Example7.21

Consider the series

\begin{equation*} \sum_{k=1}^{\infty} \frac{1}{k^2}\text{.} \end{equation*}

While it is physically impossible to add an infinite collection of numbers, we can, of course, add any finite collection of them. In what follows, we investigate how understanding how to find the \(n\)th partial sum (that is, the sum of the first \(n\) terms) enables us to make sense of the infinite sum.

  1. Sum the first two numbers in this series. That is, find a numeric value for

    \begin{equation*} \sum_{k=1}^2 \frac{1}{k^2} \end{equation*}
  2. Next, add the first three numbers in the series.

  3. Continue adding terms in this series to complete the list below. Carry each sum to at least 8 decimal places.

    • \(\displaystyle\sum_{k=1}^{1} \frac{1}{k^2}=1\)
    • \(\displaystyle\sum_{k=1}^{2} \frac{1}{k^2}=\)
    • \(\displaystyle\sum_{k=1}^{3} \frac{1}{k^2}=\)
    • \(\displaystyle\sum_{k=1}^{4} \frac{1}{k^2}=\)
    • \(\displaystyle\sum_{k=1}^{5} \frac{1}{k^2}=\phantom{1.46361111}\)
    • \(\displaystyle\sum_{k=1}^{6} \frac{1}{k^2}=\)
    • \(\displaystyle\sum_{k=1}^{7} \frac{1}{k^2}=\)
    • \(\displaystyle\sum_{k=1}^{8} \frac{1}{k^2}=\)
    • \(\displaystyle\sum_{k=1}^{9} \frac{1}{k^2}=\)
    • \(\displaystyle\sum_{k=1}^{10} \frac{1}{k^2} = \phantom{1.549767731}\)
  4. The sums in the table in partc form a sequence whose \(n\)th term is \(S_n = \sum_{k=1}^{n} \frac{1}{k^2}\text{.}\) Based on your calculations in the table, do you think the sequence \(\{S_n\}\) converges or diverges? Explain. How do you think this sequence \(\{S_n\}\) is related to the series \(\sum_{k=1}^{\infty} \frac{1}{k^2}\text{?}\)

Hint
  1. Compute \(\frac{1}{1^2} + \frac{1}{2^2}\text{.}\)

  2. Do likewise but include the third term, \(\frac{1}{3^2}\text{.}\)

  3. Note that you can use your work in each previous stage and just add one more term to get the next desired sum.

  4. Look for a pattern in the numbers you computed in part (c).

Answer
  1. See the table in partc.

  2. See the table in partc.

    • \(\displaystyle\sum_{k=1}^{1} \frac{1}{k^2}=1\)
    • \(\displaystyle\sum_{k=1}^{2} \frac{1}{k^2}=1.25\)
    • \(\displaystyle\sum_{k=1}^{3} \frac{1}{k^2}=1.361111111\)
    • \(\displaystyle\sum_{k=1}^{4} \frac{1}{k^2}=1.423611111\)
    • \(\displaystyle\sum_{k=1}^{5} \frac{1}{k^2}=1.463611111\)
    • \(\displaystyle\sum_{k=1}^{6} \frac{1}{k^2}=1.491388889\)
    • \(\displaystyle\sum_{k=1}^{7} \frac{1}{k^2}=1.511797052\)
    • \(\displaystyle\sum_{k=1}^{8} \frac{1}{k^2}=1.527422052\)
    • \(\displaystyle\sum_{k=1}^{9} \frac{1}{k^2}=1.539767731\)
    • \(\displaystyle\sum_{k=1}^{10} \frac{1}{k^2} =1.549767731 \phantom{1.54976773}\)
  3. It appears \(\{S_n\}\) converges to something a bit larger than 1.5.

Solution
  1. See the table in partc.

  2. See the table in partc.

  3. If we add the first few terms of the sequence \(\left\{\frac{1}{k^2}\right\}\) we obtain the entries (to 10 decimal places) in the following table.

    • \(\displaystyle\sum_{k=1}^{1} \frac{1}{k^2}=1\)
    • \(\displaystyle\sum_{k=1}^{2} \frac{1}{k^2}=1.25\)
    • \(\displaystyle\sum_{k=1}^{3} \frac{1}{k^2}=1.361111111\)
    • \(\displaystyle\sum_{k=1}^{4} \frac{1}{k^2}=1.423611111\)
    • \(\displaystyle\sum_{k=1}^{5} \frac{1}{k^2}=1.463611111\)
    • \(\displaystyle\sum_{k=1}^{6} \frac{1}{k^2}=1.491388889\)
    • \(\displaystyle\sum_{k=1}^{7} \frac{1}{k^2}=1.511797052\)
    • \(\displaystyle\sum_{k=1}^{8} \frac{1}{k^2}=1.527422052\)
    • \(\displaystyle\sum_{k=1}^{9} \frac{1}{k^2}=1.539767731\)
    • \(\displaystyle\sum_{k=1}^{10} \frac{1}{k^2} =1.549767731 \phantom{1.54976773}\)
  4. These sums in the table in part (c) seem to indicate that the sequence \(\{S_n\}\) converges to something a bit larger than 1.5. Since the sequence \(\{S_n\}\) is found by adding up the first \(k\) terms of the series, we should expect that the series \(\sum_{k=1}^{n} \frac{1}{k^2}\) is the limit of the sequence \(\{S_n\}\) as \(n\) goes to infinity.

The example in Example7.21 illustrates how we define the sum of an infinite series. We construct a new sequence of numbers (called the sequence of partial sums) where the \(n\)th term in the sequence consists of the sum of the first \(n\) terms of the series. If this sequence converges, the corresponding infinite series is said to converge, and we say that we can find the sum of the series. More formally, we have the following definition.

Partial Sum

The \(n\)th partial sum of the series \(\sum_{k=1}^{\infty} a_k\) is the finite sum \(S_n = \sum_{k=1}^{n} a_k\text{.}\)

In other words, the \(n\)th partial sum \(S_n\) of a series is the sum of the first \(n\) terms in the series,

\begin{equation*} S_n = a_1 + a_2 + \cdots + a_n\text{.} \end{equation*}

We investigate the behavior of the series by examining the sequence

\begin{equation*} S_1, S_2, \ldots, S_n, \ldots \end{equation*}

of its partial sums. If the sequence of partial sums converges to some finite number, we say that the corresponding series converges. Otherwise, we say the series diverges. From our work in Example7.21, the series

\begin{equation*} \sum_{k=1}^{\infty} \frac{1}{k^2} \end{equation*}

appears to converge to some number near 1.54977. We formalize the concept of convergence and divergence of an infinite series in the following definition.

Convergent Series and Divergent Series

The infinite series

\begin{equation*} \sum_{k=1}^{\infty} a_k \end{equation*}

converges (or is convergent) if the sequence \(\{S_n\}\) of partial sums converges, where

\begin{equation*} S_n = \sum_{k=1}^n a_k\text{.} \end{equation*}

If \(\lim_{n \to \infty} S_n = S\text{,}\) then we call \(S\) the sum of the series \(\sum_{k=1}^{\infty} a_k\text{.}\) That is,

\begin{equation*} \sum_{k=1}^{\infty} a_k = \lim_{n \to \infty} S_n = S\text{.} \end{equation*}

If the sequence of partial sums does not converge, then the series

\begin{equation*} \sum_{k=1}^{\infty} a_k \end{equation*}

diverges (or is divergent).

The early terms in a series do not influence whether or not the series converges or diverges. Rather, the convergence or divergence of a series

\begin{equation*} \sum_{k=1}^{\infty} a_k \end{equation*}

is determined by what happens to the terms \(a_k\) for very large values of \(k\text{.}\) To see why, suppose that \(m\) is some constant larger than 1. Then

\begin{equation*} \sum_{k=1}^{\infty} a_k = (a_1+a_2+ \cdots + a_m) + \sum_{k=m+1}^{\infty} a_k\text{.} \end{equation*}

Since \(a_1+a_2+ \cdots + a_m\) is a finite number, the series \(\sum_{k=1}^{\infty} a_k\) will converge if and only if the series \(\sum_{k=m+1}^{\infty} a_k\) converges. Because the starting index of the series doesn't affect whether the series converges or diverges, we will often just write

\begin{equation*} \sum a_k \end{equation*}

when we are interested in questions of convergence/divergence as opposed to the exact sum of a series.

We summarize this property and a few others in the next remark.
Basic Convergence Properties of Series

If \(\displaystyle \sum_{n=1}^\infty a_n \) and \(\displaystyle \sum_{n=1}^\infty b_n \) converge, and \(k \) is a constant, then:

  1. Changing a finite number of terms in a series does not change whether or not the series converges. However, it can change the number that the series will converge to.
  2. If \(\displaystyle \sum_{n=1}^\infty a_n \) and \(\displaystyle \sum_{n=1}^\infty b_n \) converge, then
    \begin{equation*} \displaystyle \sum_{n=1}^\infty (a_n+b_n)=\left( \displaystyle \sum_{n=1}^\infty a_n \right)+\left( \displaystyle \sum_{n=1}^\infty b_n \right) \text{.} \end{equation*}
    Note: If the original series do not converge, then you must be very careful about this rule. See Exercise5 for an exploration of this.
  3. If \(\displaystyle \sum_{n=1}^\infty a_n \) converges, and \(k\) is a constant, then
    \begin{equation*} \displaystyle \sum_{n=1}^\infty (ka_n)=k\left( \displaystyle \sum_{n=1}^\infty a_n \right) \end{equation*}
  4. If \(\displaystyle \sum_{n=1}^\infty a_n \) does not converge, and \(k \neq 0\) is a constant, then \(\displaystyle \sum_{n=1}^\infty (ka_n)\) also diverges.

In Section7.2 we encountered the special family of infinite geometric series. Recall that a geometric series has the form \(\sum_{k=0}^{\infty} ar^k\text{,}\) where \(a\) and \(r\) are real numbers (and \(r \ne 1\)). We found that the \(n\)th partial sum \(S_n\) of a geometric series is given by the convenient formula

\begin{equation*} S_n = \frac{1-r^{n}}{1-r}\text{,} \end{equation*}

and thus a geometric series converges if \(|r| \lt 1\text{.}\) Geometric series diverge for all other values of \(r\text{.}\)

It is generally a difficult question to determine if a given nongeometric series converges or diverges. There are several tests we can use that we will consider in the following sections.

SubsectionThe Divergence Test

The first question we ask about any infinite series is usually "Does the series converge or diverge?" There is a straightforward way to check that certain series diverge, and we explore this test in the next example.

Example7.22

If the series \(\sum a_k\) converges, then an important result necessarily follows regarding the sequence \(\{a_n\}\text{.}\) This example explores this result.

Assume that the series \(\sum_{k=1}^{\infty} a_k\) converges and has sum equal to \(L\text{.}\)

  1. What is the \(n\)th partial sum \(S_n\) of the series \(\sum_{k=1}^{\infty} a_k\text{?}\)

  2. What is the \((n-1)\)st partial sum \(S_{n-1}\) of the series \(\sum_{k=1}^{\infty} a_k\text{?}\)

  3. What is the difference between the \(n\)th partial sum and the \((n-1)\)st partial sum of the series \(\sum_{k=1}^{\infty} a_k\text{?}\)

  4. Since we are assuming that \(\sum_{k=1}^{\infty} a_k = L\text{,}\) what does that tell us about \(\lim_{n \to \infty} S_n\text{?}\) Why? What does that tell us about \(\lim_{n \to \infty} S_{n-1}\text{?}\) Why?

  5. Combine the results of the previous two parts of this example to determine \(\lim_{n \to \infty} a_n = \lim_{n \to \infty} (S_n - S_{n-1})\text{.}\)

Hint
  1. Recall that the \(n\)th partial sum is the sum of the first \(n\) terms.

  2. Consider the sum with one fewer term.

  3. Subtract your results in (a) and (b).

  4. Remember that the partials sums have to tend to the sum of the series.

  5. Note that \(S_n \to L\) and \(S_{n-1} \to L\text{.}\)

Answer
  1. \(S_n = \sum_{k=1}^n a_k \text{.}\)

  2. \(S_{n-1} = \sum_{k=1}^{n-1} a_k \text{.}\)

  3. \(\sum_{k=1}^{n} a_k - \sum_{k=1}^{n-1} a_k = a_{n} \text{.}\)

  4. \(\lim_{n \to \infty} S_n = L\) and \(\lim_{n \to \infty} S_{n-1} = L\text{.}\)

  5. We have \(\lim_{n \to \infty} a_n = \lim_{n \to \infty} \left(S_n - S_{n-1}\right) = 0 \text{.}\)

Solution
  1. The \(n\)th partial sum of the series \(\sum_{k=1}^{\infty} a_k\) is

    \begin{equation*} S_n = \sum_{k=1}^n a_k\text{.} \end{equation*}
  2. The \((n-1)\)st partial sum of the series \(\sum_{k=1}^{\infty} a_k\) is

    \begin{equation*} S_{n-1} = \sum_{k=1}^{n-1} a_k\text{.} \end{equation*}
  3. The difference between \(S_n\) and \(S_{n-1}\) is

    \begin{equation*} \sum_{k=1}^{n} a_k - \sum_{k=1}^{n-1} a_k = a_{n}\text{.} \end{equation*}
  4. Since \(\sum_{k=1}^{\infty} a_k = \lim_{n \to \infty} S_n\) we must have \(\lim_{n \to \infty} S_n = L\text{.}\) Also,

    \begin{equation*} \lim_{n \to \infty} S_n = \lim_{n \to \infty} S_{n-1}\text{,} \end{equation*}

    so \(\lim_{n \to \infty} S_{n-1} = L\) as well.

  5. We have

    \begin{align*} \lim_{n \to \infty} a_n \amp = \lim_{n \to \infty} \left(S_n - S_{n-1}\right)\\ \amp = \lim_{n \to \infty} S_n - \lim_{n \to \infty} S_{n-1}\\ \amp = L - L\\ \amp = 0\text{.} \end{align*}

The result of Example7.22 is the following important conditional statement:

If the series \(\sum_{k = 1}^{\infty} a_k\) converges, then the sequence \(\{a_k\}\) of \(k\)th terms converges to 0.

It is logically equivalent to say that if the sequence \(\{a_k\}\) does not converge to 0, then the series \(\sum_{k = 1}^{\infty} a_k\) cannot converge. This statement is called the Divergence Test.

The Divergence Test

If the sequence \(\{a_k\}\) does not converge, or if it does converge but \(\lim_{k \to \infty} a_k \neq 0\text{,}\) then the series \(\sum a_k\) diverges. This is also sometimes called the \(n\)th term test.

Example7.23

Determine if the Divergence Test applies to the following series. If the test does not apply, explain why. If the test does apply, what does it tell us about the series?

  1. \(\sum \frac{k}{k+1}\)

  2. \(\sum (-1)^k\)

  3. \(\sum \frac{1}{k}\)

Hint
  1. Consider \(\lim_{k \to \infty} \frac{k}{k+1}\text{.}\)

  2. Think about the partial sums of this series.

  3. Remember that if the terms of a series go to zero, the Divergence Test doesn't make any claims.

Answer
  1. \(\sum \frac{k}{k+1}\) diverges.

  2. \(\sum (-1)^k\) diverges.

  3. The Divergence Test does not apply.

Solution
  1. Since the sequence \(\frac{k}{k+1}\) converges to 1 and not 0 as \(k\) goes to infinity, the Divergence Test applies here and shows that the series \(\sum \frac{k}{k+1}\) diverges.

  2. Since the terms of this series don't even converge to a number, they can't converge to zero, and thus this series diverges.

  3. Since \(\lim_{k \to \infty} \frac{1}{k} = 0\text{,}\) the Divergence Test does not apply to this series.

Note well: be very careful with the Divergence Test. This test only tells us what happens to a series if the terms of the corresponding sequence do not converge to 0. If the sequence of the terms of the series does converge to 0, the Divergence Test does not apply: indeed, as we will soon see, a series whose terms go to zero may either converge or diverge.

SubsectionThe Integral Test

The Divergence Test settles the questions of divergence or convergence of series \(\sum a_k\) in which \(\lim_{k \to \infty} a_k \neq 0\text{.}\) Determining the convergence or divergence of series \(\sum a_k\) in which \(\lim_{k \to \infty} a_k = 0\) turns out to be more complicated. Often, we have to investigate the sequence of partial sums or apply some other technique.

Next, we consider the harmonic series 7This series is called harmonic because each term in the series after the first is the harmonic mean of the term before it and the term after it. The harmonic mean of two numbers \(a\) and \(b\) is \(\frac{2ab}{a+b}\text{.}\) See What's Harmonic about the Harmonic Series, by David E. Kullman (in the College Mathematics Journal, Vol. 32, No. 3 (May, 2001), 201-203) for an interesting discussion of the harmonic mean.

\begin{equation*} \sum_{k=1}^{\infty} \frac{1}{k} = 1 + \frac{1}{2} + \frac{1}{3} + \frac{1}{4} + \cdots\text{.} \end{equation*}

The first 9 partial sums of this series are shown following.

\begin{align*} \sum_{k=1}^{1} \frac{1}{k} \amp= 1 \amp \sum_{k=1}^{4} \frac{1}{k} \amp= 2.083333333 \amp \sum_{k=1}^{7} \frac{1}{k} \amp= 2.592857143\\ \sum_{k=1}^{2} \frac{1}{k} \amp= 1.5 \amp \sum_{k=1}^{5} \frac{1}{k} \amp= 2.283333333 \amp \sum_{k=1}^{8} \frac{1}{k} \amp= 2.717857143\\ \sum_{k=1}^{3} \frac{1}{k} \amp= 1.833333333 \amp \sum_{k=1}^{6} \frac{1}{k} \amp= 2.450000000 \amp \sum_{k=1}^{9} \frac{1}{k} \amp= 2.828968254 \end{align*}

This information alone doesn't seem to be enough to tell us if the series \(\sum_{k=1}^{\infty} \frac{1}{k}\) converges or diverges. The partial sums could eventually level off to some fixed number or continue to grow without bound. Even if we look at larger partial sums, such as \(\sum_{n=1}^{1000} \frac{1}{k} \approx 7.485470861\text{,}\) the result isn't particularly convincing one way or another. The Integral Test is one way to determine whether or not the harmonic series converges, and we explore this test further in the next example.

Example7.24

Consider the harmonic series \(\sum_{k=1}^{\infty} \frac{1}{k}\text{.}\) Recall that the harmonic series will converge provided that its sequence of partial sums converges. The \(n\)th partial sum \(S_n\) of the series \(\sum_{k=1}^{\infty} \frac{1}{k}\) is

\begin{align*} S_n =\mathstrut \amp \sum_{k=1}^{n} \frac{1}{k}\\ =\mathstrut \amp 1 + \frac{1}{2} + \frac{1}{3} + \cdots + \frac{1}{n}\\ =\mathstrut \amp 1(1) + (1)\left(\frac{1}{2}\right) + (1)\left(\frac{1}{3}\right) + \cdots + (1)\left(\frac{1}{n}\right)\text{.} \end{align*}

Through this last expression for \(S_n\text{,}\) we can visualize this partial sum as a sum of areas of rectangles with heights \(\frac{1}{m}\) and bases of length 1, as shown in Figure7.25, which uses the 9th partial sum.

Figure7.25A picture of the 9th partial sum of the harmonic series as a sum of areas of rectangles.

The graph of the continuous function \(f\) defined by \(f(x) = \frac{1}{x}\) is overlaid on this plot.

  1. Explain how this picture represents a particular Riemann sum.

  2. What is the definite integral that corresponds to the Riemann sum you considered in (a)?

  3. Which is larger, the definite integral in (b), or the corresponding partial sum \(S_9\) of the series? Why?

  4. If instead of considering the 9th partial sum, we consider the \(n\)th partial sum, and we let \(n\) go to infinity, we can then compare the series \(\sum_{k=1}^{\infty} \frac{1}{k}\) to the improper integral \(\int_{1}^{\infty} \frac{1}{x} \ dx\text{.}\) Which of these quantities is larger? Why?

  5. Does the improper integral \(\int_{1}^{\infty} \frac{1}{x} \ dx\) converge or diverge? What does that result, together with your work in (d), tell us about the series \(\sum_{k=1}^{\infty} \frac{1}{k}\text{?}\)

Answer
  1. The \(n\)th partial sum of the series \(\sum_{k=1}^{\infty} \frac{1}{k}\) is the left hand Riemann sum of \(f(x)\) on the interval \([1,n]\text{.}\)

  2. \(\sum_{k=1}^{n} \frac{1}{k} \gt \int_{1}^{n} \frac{1}{x} \ dx \text{.}\)

  3. \(\sum_{k=1}^{\infty} \frac{1}{k} \gt \int_{1}^{\infty} \frac{1}{x} \ dx \text{.}\)

  4. \(\int_{1}^{\infty} f(x) \ dx = \lim_{t \to \infty} \int_{1}^{t} \frac{1}{x} \ dx = \infty \) so the series \(\sum_{k=1}^{\infty} \frac{1}{k}\) diverges.

Solution
  1. Notice that the \(n\)th partial sum of the series \(\sum_{k=1}^{\infty} \frac{1}{k}\) is equal to the left hand Riemann sum of \(f(x)\) on the interval \([1,n]\text{.}\)

  2. Since \(f\) is a decreasing function, it follows that

    \begin{equation*} \sum_{k=1}^{n} \frac{1}{k} \gt \int_{1}^{n} \frac{1}{x} \ dx\text{.} \end{equation*}
  3. Since \(f\) is decreasing, the improper integral \(\int_{1}^{\infty} \frac{1}{x} \ dx\) is smaller than the limit of the Riemann sums as \(n\) goes to infinity. So we wind up with a comparison between the series \(\sum_{k=1}^{\infty} \frac{1}{n}\) and the improper integral:

    \begin{equation*} \sum_{k=1}^{\infty} \frac{1}{k} \gt \int_{1}^{\infty} \frac{1}{x} \ dx\text{.} \end{equation*}
  4. We can evaluate the improper integral as follows:

    \begin{align*} \int_{1}^{\infty} f(x) \ dx \amp = \lim_{t \to \infty} \int_{1}^{t} \frac{1}{x} \ dx\\ \amp = \lim_{t \to \infty} \ln(x) |_{1}^{t}\\ \amp = \lim_{t \to \infty} \left(\ln(t) - \ln(1) \right)\\ \amp = \infty\text{.} \end{align*}

    Since the value of the series \(\sum_{k=1}^{\infty} \frac{1}{k}\) exceeds the value of the infinite improper integral, we must conclude that the series \(\sum_{k=1}^{\infty} \frac{1}{k}\) diverges.

The ideas from Example7.24 hold more generally. Suppose that \(f\) is a continuous decreasing function and that \(a_k = f(k)\) for each value of \(k\text{.}\) Consider the corresponding series \(\sum_{k=1}^{\infty} a_k\text{.}\) The partial sum

\begin{equation*} S_n = \sum_{k=1}^{n} a_k \end{equation*}

can always be viewed as a left hand Riemann sum of \(f(x)\text{,}\) using rectangles with bases of width 1 and heights given by the values \(a_k\text{.}\) A representative picture is shown at left in Figure7.26. Since \(f\) is a decreasing function, we have that

\begin{equation*} S_n \gt \int_1^n f(x) \ dx\text{.} \end{equation*}

Taking the limit as \(n\) goes to infinity shows that

\begin{equation*} \sum_{k=1}^{\infty} a_k \gt \int_{1}^{\infty} f(x) \ dx\text{.} \end{equation*}

Therefore, if the improper integral \(\int_{1}^{\infty} f(x) \ dx\) diverges, so does the series \(\sum_{k=1}^{\infty} a_k\text{.}\)

Figure7.26Comparing an improper integral to a series

What's more, if we look at the right hand Riemann sums of \(f\) on \([1,n]\) as shown at right in Figure7.26, we see that

\begin{equation*} \int_{1}^{\infty} f(x) \ dx \gt \sum_{k=2}^{\infty} a_k\text{.} \end{equation*}

So if \(\int_{1}^{\infty} f(x) \ dx\) converges, then so does \(\sum_{k=2}^{\infty} a_k\text{,}\) which also means that the series \(\sum_{k=1}^{\infty} a_k\) also converges. Our preceding discussion has demonstrated the truth of the Integral Test.

The Integral Test

Let \(f\) be a real valued function and assume \(f\) is decreasing and positive for all \(x\) larger than some number \(c\text{.}\) Let \(a_k = f(k)\) for each positive integer \(k\text{.}\)

  1. If the improper integral \(\int_{c}^{\infty} f(x) \, dx\) converges, then the series \(\sum_{k=1}^{\infty} a_k\) converges.

  2. If the improper integral \(\int_{c}^{\infty} f(x) \, dx\) diverges, then the series \(\sum_{k=1}^{\infty} a_k\) diverges.

The Integral Test compares a given infinite series to a natural, corresponding improper integral and says that the infinite series and corresponding improper integral both have the same convergence status. In the next example, we apply the Integral Test to determine the convergence or divergence of a class of important series.

Example7.27

The series \(\sum \frac{1}{k^p}\) are special series called \(p\)-series. We have already seen that the \(p\)-series with \(p=1\) (the harmonic series) diverges. We investigate the behavior of other \(p\)-series in this example.

  1. Evaluate the improper integral \(\int_1^{\infty} \frac{1}{x^2} \ dx\text{.}\) Does the series \(\sum_{k=1}^{\infty} \frac{1}{k^2}\) converge or diverge? Explain.

  2. Evaluate the improper integral \(\int_1^{\infty} \frac{1}{x^p} \ dx\) where \(p \gt 1\text{.}\) For which values of \(p\) can we conclude that the series \(\sum_{k=1}^{\infty} \frac{1}{k^p}\) converges?

  3. Evaluate the improper integral \(\int_1^{\infty} \frac{1}{x^p} \ dx\) where \(p \lt 1\text{.}\) What does this tell us about the corresponding \(p\)-series \(\sum_{k=1}^{\infty} \frac{1}{k^p}\text{?}\)

  4. Summarize your work in this example by completing the following statement.

    The \(p\)-series \(\sum_{k=1}^{\infty} \frac{1}{k^p}\) converges if and only if .

Answer
  1. \(\sum_{k=1}^{\infty} \frac{1}{k^2}\) converges.

  2. \(\sum_{k=1}^{\infty} \frac{1}{k^p}\) converges when \(p \gt 1\text{.}\)

  3. \(\sum_{k=1}^{\infty} \frac{1}{k^p}\) diverges when \(p \lt 1\text{.}\)

  4. The \(p\)-series \(\sum_{k=1}^{\infty} \frac{1}{k^p}\) converges if and only if \(p \gt 1\text{.}\)

Solution
  1. We evaluate the improper integral:

    \begin{align*} \int_{1}^{\infty} \frac{1}{x^2} \ dx \amp = \lim_{t \to \infty} \int_{1}^{t} \frac{1}{x^2} \ dx\\ \amp = \lim_{t \to \infty} \left. -\frac{1}{x} \right|_{1}^{t}\\ \amp = \lim_{t \to \infty} \left(-\frac{1}{t} + \frac{1}{1} \right)\\ \amp = 1\text{.} \end{align*}

    So the improper integral converges. The Integral Test then shows that the series \(\sum_{k=1}^{\infty} \frac{1}{k^2}\) converges.

  2. Assume \(p \gt 1\text{.}\) Then \(p-1 \gt 0\) and so \(x^{-p+1} = \frac{1}{x^{p-1}}\) and

    \begin{equation*} \lim_{x \to \infty} x^{-p+1} = \lim_{x \to \infty} \frac{1}{x^{p-1}} = 0\text{.} \end{equation*}

    Thus,

    \begin{align*} \int_{1}^{\infty} \frac{1}{x^p} \ dx \amp = \lim_{t \to \infty} \int_{1}^{t} \frac{1}{x^p} \ dx\\ \amp = \lim_{t \to \infty} \left. \frac{x^{-p+1}}{-p+1} \right|_{1}^{t}\\ \amp = \frac{1}{1-p} \lim_{t \to \infty} \left(t^{-p+1} - 1 \right)\\ \amp = \frac{1}{p-1}\text{.} \end{align*}

    So the improper integral \(\int_1^{\infty} \frac{1}{x^p} \ dx\) converges when \(p \gt 1\text{.}\) The Integral Test then shows that the series \(\sum_{k=1}^{\infty} \frac{1}{k^p}\) converges when \(p \gt 1\text{.}\)

  3. Assume \(p \lt 1\text{.}\) Then \(1-p \gt 0\) and so

    \begin{equation*} \lim_{x \to \infty} x^{-p+1} = \infty\text{.} \end{equation*}

    Thus,

    \begin{align*} \int_{1}^{\infty} \frac{1}{x^p} \ dx \amp = \lim_{t \to \infty} \int_{1}^{t} \frac{1}{x^p} \ dx\\ \amp = \lim_{t \to \infty} \left. \frac{x^{-p+1}}{-p+1} \right|_{1}^{t}\\ \amp = \frac{1}{1-p} \lim_{t \to \infty} \left(t^{-p+1} - 1 \right)\\ \amp = \infty\text{.} \end{align*}

    So the improper integral \(\int_1^{\infty} \frac{1}{x^p} \ dx\) diverges when \(p \lt 1\text{.}\) The Integral Test then shows that the series \(\sum_{k=1}^{\infty} \frac{1}{k^p}\) also diverges when \(p \lt 1\text{.}\)

  4. We complete the statement as

    The \(p\)-series \(\sum_{k=1}^{\infty} \frac{1}{k^p}\) converges if and only if \(p \gt 1\text{.}\)

\(p \) -Series

Series of the form \(\sum \frac{1}{k^p}\) are called \(p \) -series. The harmonic series \(\sum \frac{1}{k}\) is the special case when \(p =1\text{.}\)

The \(p\)-series \(\sum_{k=1}^{\infty} \frac{1}{k^p}\) converges for \(p \gt 1\text{,}\) and diverges for \(p \leq 1 \text{.}\)

SubsectionSummary

  • An infinite series is a sum of the elements in an infinite sequence. In other words, an infinite series is a sum of the form

    \begin{equation*} a_1 + a_2 + \cdots + a_n + \cdots = \sum_{k=1}^{\infty} a_k \end{equation*}

    where \(a_k\) is a real number for each positive integer \(k\text{.}\)

  • The \(n\)th partial sum \(S_n\) of the series \(\sum_{k=1}^{\infty} a_k\) is the sum of the first \(n\) terms of the series. That is,

    \begin{equation*} S_n = a_1+a_2+ \cdots + a_n = \sum_{k=1}^{n} a_k\text{.} \end{equation*}
  • The sequence \(\{S_n\}\) of partial sums of a series \(\sum_{k=1}^{\infty} a_k\) tells us about the convergence or divergence of the series. In particular

    • The series \(\sum_{k=1}^{\infty} a_k\) converges if the sequence \(\{S_n\}\) of partial sums converges. In this case we say that the series is the limit of the sequence of partial sums and write

      \begin{equation*} \sum_{k=1}^{\infty} a_k =\lim_{n \to \infty} S_n\text{.} \end{equation*}
    • The series \(\sum_{k=1}^{\infty} a_k\) diverges if the sequence \(\{S_n\}\) of partial sums diverges.

SubsectionExercises

The associative and commutative laws of addition allow us to add finite sums in any order we want. That is, if \(\sum_{k=0}^n a_k\) and \(\sum_{k=0}^n b_k\) are finite sums of real numbers, then

\begin{equation*} \sum_{k=0}^{n} a_k + \sum_{k=0}^n b_k = \sum_{k=0}^n (a_k+b_k)\text{.} \end{equation*}

However, we do need to be careful extending rules like this to infinite series.

  1. Let \(a_n = 1 + \frac{1}{2^n}\) and \(b_n = -1\) for each nonnegative integer \(n\text{.}\)

    1. Explain why the series \(\sum_{k=0}^{\infty} a_k\) and \(\sum_{k=0}^{\infty} b_k\) both diverge.

    2. Explain why the series \(\sum_{k=0}^{\infty} (a_k+b_k)\) converges.

    3. Explain why

      \begin{equation*} \sum_{k=0}^{\infty} a_k + \sum_{k=0}^{\infty} b_k \neq \sum_{k=0}^{\infty} (a_k+b_k)\text{.} \end{equation*}

      This shows that it is possible to have to two divergent series \(\sum_{k=0}^{\infty} a_k\) and \(\sum_{k=0}^{\infty} b_k\) but yet have the series \(\sum_{k=0}^{\infty} (a_k+b_k)\) converge.

  2. While part (a) shows that we cannot add series term by term in general, we can under reasonable conditions. The problem in part (a) is that we tried to add divergent series. In this exercise we will show that if \(\sum a_k\) and \(\sum b_k\) are convergent series, then \(\sum (a_k+b_k)\) is a convergent series and

    \begin{equation*} \sum (a_k+b_k) = \sum a_k + \sum b_k\text{.} \end{equation*}
    1. Let \(A_n\) and \(B_n\) be the \(n\)th partial sums of the series \(\sum_{k=1}^{\infty} a_k\) and \(\sum_{k=1}^{\infty} b_k\text{,}\) respectively. Explain why

      \begin{equation*} A_n + B_n = \sum_{k=1}^n (a_k+b_k)\text{.} \end{equation*}
    2. Use the previous result and properties of limits to show that

      \begin{equation*} \sum_{k=1}^{\infty} (a_k+b_k) = \sum_{k=1}^{\infty} a_k + \sum_{k=1}^{\infty} b_k\text{.} \end{equation*}

      (Note that the starting point of the sum is irrelevant in this problem, so it doesn't matter where we begin the sum.)

  3. Use the prior result to find the sum of the series \(\sum_{k=0}^{\infty} \frac{2^k+3^k}{5^k}\text{.}\)