Tip Patrol member Billy Wooten sent us a LISP routine he created that unloads an xref by picking on it.

"Although this routine will unload an xref, it won't detach it, so the xref is still referenced. If the object is a block or other object instead of an xref, the routine identifies it as such and instructs the user via the Command line to try again."