I believe that's due, at least in part, to the fact that their ratio of surface area to volume is higher, so they radiate more heat relative to their overall mass.

They also need a higher metabolic rate to maintain the same core body temperature because of that increased heat loss.

The more you know :D I never knew that.