Think of it as chit-chat in a bar, where someone is telling you what they think about your idea, in a relaxed environment.
The idea has merit, but also limitations.
You might shrug and say OK and laugh.
But think of the paper as just a transcript of what somebody said in a bar. Hopefully that makes it easier to see it as just a comment, just an honest reflection of what's going through someone's head?
"I thought of this / did this, and now someone is saying something against it."
You did well to keep calm! We're all still big fans!