Not to belabor this point, but I think some people kind of are overestimating the amount of mask-avoidance that's overtly driven by vanity/embarrassment or ideological hostility. 
What distinguishes the people who aren't wearing masks:
-They reject the framing as a public health issue
-They're more likely to believe there's no public health benefits
-They reject the framing as a public health issue
-They're more likely to believe there's no public health benefits
Obviously, holding that latter set of beliefs is still intrinsically tied up with partisanship, but it's a little different from "masks are for weaklings" or "not wearing a mask to own the libs."
Of course, people are bad at explaining the motivations for their own behavior, and this is all self-reported data here. But...
If there's one thing polls are generally great at, it's picking up on when people's answers to questions are meant more as partisan signalling than as reflections of the respondents’ true actions or beliefs ("expressive responding")
That you're NOT seeing most Republicans answering that they're bothered by masks or that they see masks as a sign of weakness would seem to indicate that most don't see holding those positions as the "correct" response for their party.
A few months back, we found that Dems mostly thought Reps opposed stay-at-home orders, while most Reps both supported them and believe that such support was a mainstream GOP position. Obviously issue has moved on a bit, but I think something similar happening here.
Should say also: it's clearly not that the attitudes like "masks are a sign of weakness" or "it bothers me when people wear masks" don't exist at all (they obviously do, and in visible numbers!), or that they don't present an issue. The distinction is they're not majority view.
Data here: huffpost.com/entry/mask-req…
