You might want to replace the radiator cap as well. However, if you will buy a new radiator, it comes with a cap.
Perhaps you have water-pump or radiator issues.
I don't see why the overflow hose would leak -- it's not pressurized. The coolant you see may be from draining/filling/overflow. Always completely wash any coolant to protect animals.