Direction of Max Increase

MathJax TeX Test Page
Another important property of the gradient is that it points in the direction of greatest increase. For example, consider $f(x) = x^2 + y^2 + z^2$. Each level surface is a sphere.

If you're an ant on the surface of a unit sphere, and you want to move to a larger sphere, you have an infinite number of options. You can move along the sphere, which means your radius, or $f(x)$ value, would the stay the same. If you move toward the center, the radius decreases. If you move perpendicularly away from the sphere, the radius increases most efficiently. The gradient, the perpendicular direction, goes towards the next highest level curve.

Now, let's show this mathematically
$$|D_vf(p)| = |\nabla f(p) \cdot v|$$
We can use the C-S Inequality now.
$$|D_vf(p)| = |\nabla f(p) \cdot v| \leq ||\nabla f(p)||||v|| = ||\nabla f(p)|| $$
This means that the maximum value of the directional derivative is when the vector points in the direction of the gradient, which is orthogonal to the curve.

You have one unit sphere at the origin. How far away do you center a sphere of radius 2 so that it's orthogonal to the first sphere?

The first thing to note is that if the surfaces are orthogonal, then their normal vectors are orthogonal. Therefore, the gradient of the unit sphere at the origin dot the new gradient is 0. Additionally, to simplify calculations, we can only change x. We now write two equations that we have to solve. First, we find where the normals are perpendicular:
$$\begin{bmatrix}2x \\ 2y \\ 2z\end{bmatrix} \cdot \begin{bmatrix}2(x- x_0)\\2y \\ 2z\end{bmatrix}$$
$$= 4x^2 - 4xx_0 + 4y^2 + 4z^2 = 0$$
$$4(x^2 + y^2 + z^2) = 4xx_0$$
$$1 = xx_0 \to x_0 = \frac{1}{x}$$
Now, we see where the two spheres intersect
$$x^2 + y^2 + z^2 = 1$$
$$(x-x_0)^2 + y^2 + z^2 = 4$$
Now, we subtract the first equation from the second.
$$x^2 - 2xx_0 + x_0^2 - x^2 = 3$$
We now plug in our solution for $x = \frac{1}{x_0}$.
$$x_0^2 - 2\frac{1}{x_0}x_{0} = 3$$
$$x_0 = \pm\sqrt{5}$$
We now know two things: First, the radius of the other sphere is 2 (given). Second, its center's distance from the origin is $\sqrt{5}$.