I “let people be” when their religion doesn’t harm them or other people.
And I don’t care if “not all Muslims think of women that way”. Their decisions/opinions make them better people, they don’t make Islam a better religion.
This is, of course, not limited to Islam.
Tell that to the victims of the Therac-25