Yes, you are losing some of your religious freedom by not being able to discriminate against members of the LGBT community. Churches who used the Bible to justify slavery and racial discrimination lost similar rights after the Civil War and during the Civil Rights Movement. No freedom is absolute, especially when the expression of that freedom results in the repression of another group.