ODE-Project Convolution

Section 3.4 Convolution

Objectives

To understand that if $f$ and $g$ are two piecewise continuous exponentially bounded functions, then we can define the convolution product of $f$ and $g$ to be

$(f * g) (t) = \int_{0}^{t} f (t - τ) g (τ) d τ = \int_{0}^{t} f (τ) g (t - τ) d τ .$
To understand that the convolution product has many properties similar to those of ordinary multiplication.
To understand that if $f$ and $g$ be two piecewise continuous exponentially bounded functions and $L (f) (s) = F (s)$ and $L (g) (s) = G (s)$ for $s \geq a > 0,$ then

$F (s) G (s) = L (f * g) (s)$

for $s > a .$
To understand that it is possible to write a solution for the initial value problem

$\begin{aligned} a y^{″} + b y^{'} + c y & = g (t) \\ y (0) & = y_{0} \\ y^{'} (0) & = y_{1} . \end{aligned}$

using the Convolution Theorem.

When solving an initial value problem using Laplace transforms, we employed the strategy of converting the differential equation to an algebraic equation. Once the the algebraic equation is solved, we can recover the solution to the initial value problem using the inverse Laplace transform. While our strategy is straight forward, finding an inverse Laplace tranform can be a hindrance. Often finding the inverse transform involves decomposing a complicated product into the sum for partial fractions. Fortunately, there is a product rule for inverse Laplace transforms. This product rule will allow us to quickly compute solutions of a harmonic oscillator with different forcing functions.

🔗

Subsection 3.4.1 Convolution

🔗

f

and

g

are two piecewise continuous exponentially bounded functions, then we define the convolution product of

f

and

g

to be

(f * g) (t) = \int_{0}^{t} f (t - τ) g (τ) d τ = \int_{0}^{t} f (τ) g (t - τ) d τ .

🔗

The convolution product has many properties similar to those of ordinary multiplication.

Commutivity: $f * g = g * f .$
Distribution: $f * (g + h) = f * g + f * h .$
Associativity: $f * (g * h) = (f * g) * h .$
$0 * f = f * 0 = 0 .$

🔗

A ll of these properties can be proven using the definition of convolution and the properties of integration.

🔗

There is, however, no multiplicative identity. In other words,

f * 1 \neq f .

For example, suppose that

f (t) = \cos t .

Then

(f * 1) (t) = \int_{0}^{t} \cos (t - τ) \cdot 1 d τ = \sin t .

🔗

Also, it may not be the case that

f * f

is a nonnegative function.

🔗

A key property of the Laplace transform is how convolution products behave.

🔗

Theorem 3.4.1. Convolution Theorem.

🔗

Let

f

and

g

be two piecewise continuous exponentially bounded functions, and suppose that

L (f) (s) = F (s)

and

L (g) (s) = G (s)

for

s \geq a > 0 .

Then

F (s) G (s) = L (f * g) (s)

🔗

for

s > a .

Proof.

\begin{aligned} F (s) & = \int_{0}^{\infty} e^{- s ξ} f (ξ) d ξ \\ G (s) & = \int_{0}^{\infty} e^{- s τ} g (τ) d τ, \end{aligned}

then

\begin{aligned} F (s) G (s) & = \int_{0}^{\infty} e^{- s ξ} f (ξ) d ξ \int_{0}^{\infty} e^{- s τ} g (τ) d τ \\ = \int_{0}^{\infty} g (τ) (\int_{τ}^{\infty} e^{- s t} f (t - τ) d t) d τ, \end{aligned}

where

ξ = t - τ

is the change of variable. Reversing the order of integration, we have

\int_{0}^{\infty} g (τ) (\int_{τ}^{\infty} e^{- s t} f (t - τ) d t) d τ = \int_{0}^{\infty} e^{- s t} (\int_{0}^{t} f (t - τ) g (τ) d τ) d t .

However, this last expression is just the Laplace transform of

f * g .

🔗

Subsection 3.4.2 Applying the Convolution Theorem

🔗

The Convolution Theorem (Theorem 3.4.1) can be very useful for finding the inverse transforms of products, since

F (s) G (s) = L (f * g) (s) .

🔗

For example, suppose that we wish to find the inverse transform of

\frac{1}{s^{2} (s + 1)} = \frac{1}{s^{2}} \cdot \frac{1}{s + 1} .

🔗

Since

L [t] = 1 / s^{2}

and

L [e^{- t}] = 1 / (s + 1),

we know that

\begin{aligned} L^{- 1} [\frac{1}{s^{2} (s + 1)}] & = L^{- 1} [\frac{1}{s^{2}}] * L^{- 1} [\frac{1}{s + 1}] \\ = \int_{0}^{t} (t - u) e^{- u} d u \\ = t + e^{- t} - 1. \end{aligned}

🔗

Of course, we could have used partial fractions to decompose

1 / (s^{2} (s + 1)) .

Example 3.4.2.

Instead of using partial fractions, let us use the Convolution Theorem (Theorem 3.4.1) to calculate the inverse Laplace transform of

H (s) = \frac{a}{s^{2} (s^{2} + a^{2})} = \frac{1}{s^{2}} \cdot \frac{a}{s^{2} + a^{2}} .

The inverse Laplace transform of

1 / s^{2}

t,

and the inverse Laplace transform of

a / (s^{2} + a^{2}) .

\sin a t .

Using the Convolution Theorem, the inverse Laplace transform of

H (s)

h (t) = \int_{0}^{t} (t - τ) \sin a τ d τ = \frac{a t - \sin a t}{a^{2}} .

Example 3.4.3.

Let’s use the Convolution Theorem (Theorem 3.4.1) to calculate

L^{- 1} (\frac{s}{(s^{2} + 4)^{2}})

We can split this into

L^{- 1} (\frac{s}{s^{2} + 4}) * L^{- 1} (\frac{1}{s^{2} + 4}) = \cos (2 t) * \frac{1}{2} \sin (2 t) = \frac{1}{2} \cos (2 t) * \sin (2 t)

This turns into an integral

\frac{1}{2} \int_{0}^{t} \cos (2 τ) \sin (2 t - 2 τ) d τ

To evaluate this, I will use the trigonometry identities

\sin (a - b) = \sin (a) \cos (b) - \sin (b) \cos (a), \cos^{2} (θ) = \frac{1}{2} (1 + \cos (2 θ)),

\sin^{2} (θ) = \frac{1}{2} (1 - \cos (2 θ)), \sin (θ) \cos (θ) = \frac{1}{2} \sin (2 θ) .

We get the integrand is

\cos (2 τ) [\sin (2 t) \cos (2 τ) - \sin (2 τ) \cos (2 t)] =

\frac{1}{2} (1 + \cos (4 τ)) \sin (2 t) - \frac{1}{2} \sin (4 τ) \cos (2 t)

We thus get

\frac{1}{4} \int_{0}^{t} \sin (2 t) + \sin (2 t) \cos (4 τ) - \cos (2 t) \sin (4 τ) d τ

= \frac{1}{4} (t \sin (2 t) + \frac{1}{4} \sin (2 t) \sin (4 t) + \frac{1}{4} \cos (2 t) (\cos (4 t) - 1))

= \frac{t}{4} \sin (2 t) + \frac{1}{16} \sin (2 t) \sin (4 t) + \frac{1}{16} \cos (2 t) \cos (4 t) - \frac{1}{16} \cos (2 t)

🔗

We can also use the Convolution Theorem to solve initial value problems.

Example 3.4.4.

Consider the initial value problem

\begin{aligned} y^{″} + 4 y & = g (t) \\ y (0) & = 3 \\ y^{'} (0) & = - 1. \end{aligned}

Taking the Laplace transform of both sides of the differential equation and applying the initial conditions, we obtain

s^{2} Y (s) - 3 s + 1 + 4 Y (s) = G (s),

where

G (s)

is the Laplace transform of

g (t) .

Solving for

Y (s),

we have

Y (s) = \frac{3 s - 1}{s^{2} + 4} + \frac{G (s)}{s^{2} + 4} = 3 \frac{s}{s^{2} + 4} - \frac{1}{2} \frac{2}{s^{2} + 4} + \frac{1}{2} \frac{2}{s^{2} + 4} G (s) .

The last term corresponds to the forcing term of our differential equation. Taking the inverse Laplace transform of both sides and applying the Convolution Theorem, we get

y = 3 \cos 2 t - \frac{2}{2} \sin 2 t + \frac{1}{2} \int_{0}^{t} \sin 2 (t - τ) g (τ) d τ .

🔗

Notice that we did not specify a particular forcing function in Example 3.4.4. In fact, it is possible to write a solution for the initial value problem

\begin{aligned} a y^{″} + b y^{'} + c y & = g (t) \\ y (0) & = y_{0} \\ y^{'} (0) & = y_{1} \end{aligned}

🔗

using the Convolution Theorem without knowing what the actual forcing function

g (t) .

Taking the Laplace transform of both sides of the differential equation and using the initial conditions, we have

(a s^{2} + b s + c) Y (s) - (a s + b) y_{0} - a y_{1} = G (s)

🔗

Y (s) = Φ (s) + Ψ (s),

🔗

where

\begin{aligned} Φ (s) & = \frac{(a s + b) y_{0} + a y_{1}}{a s^{2} + b s + c} \\ Ψ (s) & = \frac{G (s)}{a s^{2} + b s + c} . \end{aligned}

🔗

Therefore,

y = ϕ (t) + ψ (t),

🔗

where

ϕ (t) = L^{- 1} (Φ (s))

and

ψ (t) = L^{- 1} (Ψ (s)) .

Observe that

ϕ (t)

is the solution to the initial value problem

\begin{aligned} a y^{″} + b y^{'} + c y & = 0 \\ y (0) & = y_{0} \\ y^{'} (0) & = y_{1} . \end{aligned}

🔗

Once we have values for

a,

b,

and

c,

the function

ϕ (t)

is easy to find. To find

ψ (t),

we first write

Ψ (s) = \frac{1}{a s^{2} + b s + c} G (s) = H (s) G (s),

🔗

where

H (s) = 1 / (a s^{2} + b s + c) .

h (t)

is the inverse Laplace transform of

H (s),

then

ψ (t) = L^{- 1} (H (s) G (s)) = \int_{0}^{t} h (t - τ) g (τ) d τ .

🔗

If we consider the case where

G (s) = 1,

then

g (t) = δ (t)

and

ψ (s) = H (s) .

This means that

h (t)

is a solution to the initial value problem

\begin{aligned} a y^{″} + b y^{'} + c y & = δ (t) \\ y (0) & = y_{0} \\ y^{'} (0) & = y_{1} . \end{aligned}

🔗

For this reason,

h (t)

is sometimes called the impulse response of the system.

🔗

Subsection 3.4.3 Important Lessons

🔗

If $f$ and $g$ are two piecewise continuous exponentially bounded functions, then we define the convolution product of $f$ and $g$ to be
$(f * g) (t) = \int_{0}^{t} f (t - τ) g (τ) d τ = \int_{0}^{t} f (τ) g (t - τ) d τ .$
The convolution product has many properties similar to those of ordinary multiplication.
- Commutivity: $f * g = g * f$
- Distribution: $f * (g + h) = f * g + f * h$
- Associativity: $f * (g * h) = (f * g) * h$
- $0 * f = f * 0 = 0$
T here is, however, no multiplicative identity. In other words, $f * 1 \neq f .$ Also, it may not be the case that $f * f$ is a nonnegative function.
Let $f$ and $g$ be two piecewise continuous exponentially bounded functions, and suppose that $L (f) (s) = F (s)$ and $L (g) (s) = G (s)$ for $s \geq a > 0 .$ Then
$F (s) G (s) = L (f * g) (s)$
for $s > a .$
It is possible to write a solution for the initial value problem
$\begin{aligned} a y^{″} + b y^{'} + c y & = g (t) \\ y (0) & = y_{0} \\ y^{'} (0) & = y_{1} . \end{aligned}$
using the Convolution Theorem.

🔗

Reading Questions 3.4.4 Reading Questions

🔗

1.

🔗

Explain how the convolution product of two functions is useful when solving an initial value problem.

🔗

Exercises 3.4.5 Exercises

🔗

Convolution of Two Functions.

🔗

Calculate the convolution product of

f (t)

and

g (t)

in Exercise Group 3.4.5.1–6 using the definition of the convolution of two functions.

🔗

1.

🔗

f (t) = 2

and

g (t) = t

🔗

2.

🔗

f (t) = t

and

g (t) = t

🔗

3.

🔗

f (t) = t

and

g (t) = e^{3 t}

🔗

4.

🔗

f (t) = t

and

g (t) = \sin t

🔗

5.

🔗

f (t) = e^{2 t}

and

g (t) = e^{3 t}

🔗

6.

🔗

f (t) = e^{3 t}

and

g (t) = e^{2 t}

🔗

Convolution and the Inverse Transform.

🔗

Calculate the inverse Laplace transform of

F (s)

in Exercise Group 3.4.5.7–12 using the convolution product.

🔗

7.

🔗

F (s) = \frac{1}{(s - 1) (s - 3)}

🔗

8.

🔗

F (s) = \frac{3}{s (s - 1)}

🔗

9.

🔗

F (s) = \frac{2}{s^{2} (s^{2} + 2)}

🔗

10.

🔗

F (s) = \frac{1}{s^{2} + 4 s - 12}

🔗

11.

🔗

F (s) = \frac{1}{(s - 1) (s - 3)}

🔗

12.

🔗

F (s) = \frac{1}{(s - 1) (s - 3)}

🔗

Solving Initial Value Problems.

🔗

Solve the initial problems in Exercise Group 3.4.5.13–18 using the method described in Subsection 3.4.2. The first problem has a solution to check your answer against.

🔗