We’ve come a long way in a fairly short time, but even in supposedly enlightened countries like the UK there are people who hate LGBT+ people. Those people do not always keep their bigoted beliefs a secret, wrap them in “reasonable concerns” or keep their hatred in the closet. Many of them are vocal. Some are violent. And not everyone is strong enough to come out and have to deal with that.
Liberty does in fact mean that you get to state your beliefs. Violence is, of course, creation of a third party harm and so not allowed. But voicing beliefs? What version of freedom is there where this is not allowed?