TOKYO—Optimism among Japan's major manufacturers toward the next three months sharply deteriorated, the Bank of Japan's tankan survey showed Tuesday, as firms grow more cautious about the impact of a national sales tax increase and skepticism builds over Prime Minister Shinzo Abe's economic policies.

The quarterly survey—a broad gauge of corporate activity from sentiment, to profits, to fresh investment—has drawn more attention than...