Beer lovers: once beer is chilled is it necessary to keep it cold? I heard it affected the taste. ?

I bought too much beer for the fridge and want to put it in my pantry closet (room temperature). What do you think?