I know what you mean mate. Some "purists" just love to rub people's noses in it, and also want a medal, for riding throughout the year.
Personally, I don't ride when it's pissing down and freezing cold very much, because I don't enjoy it a lot. Since I've no real need for a bike at all, there's no call to ride in such conditions.
When the weather is reasonable, I don't mind riding on any day of the year, at least for shortish trips (to keep the practice in). There can be nice days even in December and January.
Back in the day, I used to travel 250 miles to college on a dodgy 2-stroke with no fairing, no heated grips, fairly primitive clothing right at the start of January, with snow, slush, ice and hail all round. It was an absolute bastard.