hi, I'm reading the book Mathematics for 3d game programming and computer graphics, and got a doubt in the mentioned section ( page 362 ). It says the distance between a point P ( center of sphere ) and L ( defined as < N, D > ) can be defined as

Not sure what L*P is supposed to mean. I suppose with N*P you mean the dot product between normal N and point P. Depending on how you define your plane, you should either add or subtract D. In the case of Ax + Bx + Cz = D, you should subtract D. And in the case of Ax + Bx + Cz + D = 0, you should add D. Also note that N needs to be normalized for this. If it's not, you should use the following (N.P +- D) / |N| = r.

It means the dot product between the four-dimensional plane L = (Nx, Ny, Nz, D) and the homogeneous point P = (Px, Py, Pz, 1). The plus sign in the book is correct. If you're familiar with my more recent talks on Grassmann Algebra, then this is more accurately stated as the wedge product between the antivector (Nx, Ny, Nz, D) and the vector (Px, Py, Pz, 1).

It means the dot product between the four-dimensional plane L = (Nx, Ny, Nz, D) and the homogeneous point P = (Px, Py, Pz, 1). The plus sign in the book is correct. If you're familiar with my more recent talks on Grassmann Algebra, then this is more accurately stated as the wedge product between the antivector (Nx, Ny, Nz, D) and the vector (Px, Py, Pz, 1).

Aha yes, I remember the wedge product from a distant geometric algebra course. I'm assuming the OP cited the notation wrongly(should be L^P right?). Thank you for the link, seems very extensive!