I have 2 legs of 120 on the fuse/disconnect for 247 volts earlier today.
How are you verifying this? If you are using a multimeter, you may be seeing stray voltage. Measure with the air conditioner turned on at the thermostat on so the contactor is pulled in. Or use a lightbulb in a pigtail socket to check.