Are Special Lines for Elite Members of Airline Frequent Flier Programs Unfair?

One of the perks of being an elite member of the frequent flier program of an airline is to be able to pass through a Transportation Security Administration checkpoint using a special line at select airports around the United States.

Usually, there is a shorter wait at the line reserved for elite members of airline frequent flier programs. However, I can assure you from personal experience that that is not always the case.

Regardless, is the practice of lines especially reserved for elite members of airline frequent flier programs unfair?