I am in zone 6, and have brought the gang in only when the temps threaten to go down to 33. This time of year, the lowest temp is at around 5 am, so I bring them in the night of 33 or less.
The exception is that my phal types only stay outside till around 50 at night. I do not have many of them, so it is no big thing to carry in a few pots.
My problem now is that it will soon get too hot to keep them out.