I'm tired of having to choose outfits when going out at night

So today I was supposed to go out with a friend, but just so no one would make comments or stare at me while we were coming back this evening, I decided to wear a t-shirt and baggy pants instead of the dress I wanted to wear. I mean, why do we constantly have to limit ourselves? We talk about freedom and all, but even when we’re just going from one place to another in the evening, we end up thinking about a million different things. This situation seriously ruined my mood. Does this happen to you too, or am I just being too sensitive about this safety issue?