My outdoor unit frosts up during the winter, is this normal?

Yes, this is perfectly normal. In fact, in hot mode, condensation on the outdoor unit due to the cold generated by the unit during operation, as well as temperatures close to 0 or below, leads to the formation of frost on the outdoor unit's condenser.