You stay out long enough that the cold stops being a decision and becomes a punishment you are administering to yourself.

The window goes dark. Then the door opens and Mione comes out with your coat over her arm and no coat of her own.

MioneYou are going to make yourself ill and then I am going to have to be sensible about it, and I have been sensible all week.

You go in. She does not ask what you were doing out there and you do not tell her.