Mathematics for the interested outsider

Algebraic Laws of Differentiation

Just like we had the laws of limits we have a collection of rules to help us calculate derivatives. Let’s start with the most basic functions.

As we said while defining the derivative, any linear function has the derivative at each point. We’ll separate this out into two rules:

That is, the derivative of any constant function is the constant function , and the derivative of the identity function is the constant function .

The next two rules should be perfectly straightforward to establish, so we’ll skip their proofs:

That is, the derivative of the sum of two functions is the sum of their derivatives, and the derivative of a constant multiple of a function is the same constant multiple of its derivative. In particular, we can use these rules along with the basic pieces above to recalculate the derivative .

Multiplication is a bit tougher. We might hope to simply split derivatives along products like we do for limits, and even the inventors of the calculus originally thought this would work. But look what happens for . If we split the derivative of this function along its product we get . But we know that this function doesn’t always go up at this constant rate. In fact, for negative values of , the function actually goes down. So this rule doesn’t work.

Let’s go back to the definition of the derivative as the limit of a difference quotient:
Now the trick we’ll use to evaluate this limit is to add and subtract to the numerator here. That is, in effect we’re adding zero and leaving it alone, but the formula will be easier to work with. In particular, we can start splitting it up using the laws of limits.
Of these four limits, the fourth is the limit of a continuous function because doesn’t depend on . The second and third are just the definitions of and . The first limit goes to because, as we showed, all differentiable functions are continuous. And so we have the rule

In general, we can take the derivative of the product of a bunch of functions by taking the derivative of each one and multiplying by the other functions, then adding up all the results. As a special case we get the “power rule”:

If is differentiable at , but doesn’t take the value there, then its reciprocal will also be differentiable. We want to calculate its derivative. We could try evaluating the limit of the difference quotient again, but instead we will proceed as follows. Define the reciprocal to be . Then we have the equation . Taking the derivative of both sides at and using the product rule we find . We can now solve this to find , or:

Combining this with the product rule we find the “quotient rule”:

Now we have all the tools in hand to take the derivative of any “rational” function. That is, a function of the form , where and are polynomials. We can take the derivative of any polynomial by using the power rule, constant multiple rule, and addition rule. Then we can take the derivative of with the quotient rule.

A little anecdote about the quotient rule: often it’s written in the form . My first calculus teacher wrote this formula on the board, then noted that one must remember which order the top comes in or you’ll get the wrong sign. “V-D-U-D”. At this point he fake-tiptoed his way to the door, closed it gently, and in a loud stage whisper said, “Venereal Disease is an Ugly Disease”. To this day I can’t teach the quotient rule, and can barely use it myself, without remembering that line.

I didn’t include the chain rule here partly in order to keep the length of the post down. Besides, composition of functions isn’t sort of not an algebraic operation, in the sense of real-valued functions forming an -algebra.

[…] are given by partial derivatives, and partial derivatives (like all single-variable derivatives) are linear, it’s straightforward to see that the differential operator is linear as well. That is, if […]

[…] generally no product of higher-dimensional vectors, and so there’s no generalization of the product rule. But we can multiply and divide real-valued functions of more than one variable. Finding the […]

About this weblog

This is mainly an expository blath, with occasional high-level excursions, humorous observations, rants, and musings. The main-line exposition should be accessible to the “Generally Interested Lay Audience”, as long as you trace the links back towards the basics. Check the sidebar for specific topics (under “Categories”).

I’m in the process of tweaking some aspects of the site to make it easier to refer back to older topics, so try to make the best of it for now.