Mounting it vertically will often leave you with much less space inside your robot or at least compromise your design in some way (at least for most conventional designs).

The horizontal should not over pressurise, as whats in the bottle is max pressure and the rest of your system should be rated for that assuming your running FP.

Should probably ask what pressure your running at before giving more specific advice regarding freezing?