Mathematics for the interested outsider

Partial Derivatives

Okay, we want to move towards some analogue of the derivative of a function that applies to functions of more than one variable. For the moment we’ll stick to single real outputs. As a goal, we want “differentiability” to be a refinement of the idea of smoothness started with “continuity“, so an important check is that it’s a stronger condition. That is, a differentiable function should be continuous.

For functions with a single real input we defined the derivative of the function at the point by the limit of the difference quotient

The problem here is that for vector inputs we can’t “divide” by the vector . So we need some other way around this problem.

Our first attempt may be familiar from calculus classes: we’ll just look at one variable at a time. That is, if we have a function of real variables and we keep all of them fixed except the th one, we can try to take the limit

That is, we fix down the values of all the other variables and get a function of the single remaining variable. We then take the single-variable derivative as normal.

The first problem here is that it having these partial derivatives — even having a partial derivative for each variable — doesn’t make a function continuous. Let’s look at the first pathological example of a limit we discussed:

If we consider the point , we can calculate both partial derivatives here. First we fix and find . Thus it’s easy to check that . Similarly, we can fix to find , and thus that . So both partial derivatives exist at , but the function doesn’t even have a limit there, much less one which equals its value.

The problem is the same one we saw in the case of multivariable limits: we can’t take a limit as one input point approaches another along a single path and just blithely expect that it’s going to mean anything. Here we’re just picking out two paths towards the same point and establishing that the function is continuous when we restrict to those paths, which doesn’t establish continuity in general.

There’s a deeper problem with partial derivatives, though. Implicit in the whole set-up is choosing a basis of our space. To write as a function of real variables instead of one -dimensional vector variable means picking a basis. In practice we often have no problem with this. Indeed, many problems come to us in terms of a collection of variables which we bind together to make a single vector variable. But in principle, anything with any geometric meaning should be independent of artificial choices of coordinates. We can’t even talk about partial derivatives without making such a choice, and so they clearly don’t get to the heart of any sensible notion of “differentiability”.

Sorry, Johan. Easiest way around is to patch it at that point by defining . Then the partial derivatives exist, but the limit doesn’t. I did something similar when talking about directional derivatives.

Okay, Johan, here’s one that’s a lot more hacky but should finally settle this: let if either or are , and otherwise. Then both partials exist but the limit doesn’t.

Or go back to the original function and use the definition of the derivative that takes a sample point approaching the given point from either side, which is a common alternative to handle the nonexistence of a function at the point in question

[…] we can say “the” differential), we showed that given an orthonormal basis we have all partial derivatives. We even have all directional derivatives, with pretty much the same proof. We replace with an […]

[…] most common first approach to differential calculus in more than one variable starts by defining partial derivatives and directional derivatives, as we did. But instead of defining the differential, it simply […]

[…] within an open region . In particular, if we pick coordinates on the function has all partial derivatives at each point in . As we move around within the value of the partial derivative changes, […]

About this weblog

This is mainly an expository blath, with occasional high-level excursions, humorous observations, rants, and musings. The main-line exposition should be accessible to the “Generally Interested Lay Audience”, as long as you trace the links back towards the basics. Check the sidebar for specific topics (under “Categories”).

I’m in the process of tweaking some aspects of the site to make it easier to refer back to older topics, so try to make the best of it for now.