Thanks guys. It is T6061 so I will try a forstner bit with oil. I only need to cut about 1/8" deep to give enough depth to hold the nut in place.
Even better that its a shallow hole. the deeper , the more the shavings stick to the sides of the forstner bit and mess up the sides of the hole.