"If people can't trust not only the executive branch but also don't trust Congress and don't trust federal judges to make sure that we're abiding by the Constitution with due process and rule of law, then we're going to have some problems here."