Why is it so hard to make for guys? Generally speaking, men are fairly rectangular. Furthermore, they like their clothes to fit loose and boxy, or in other words, SQUARE. Therefore, making a pattern is a piece of cake!
I used a basic men's T-shirt as my pattern reference (a long-sleeved T or sweatshirt would work even better), and some Polarfleece I happened to have in my stash. Cotton sweatshirt fleece would work great, too.